Past Semesters

Prior to 2019/2020, WING ran a series of NLP- and IR-oriented MOOC re-plays from other lecturers worldwide. These courses’ webpages are available on the Links page.

Semester	Topic
AY 2020/2021 Semester II (2020)	Conversational and Recommender Systems
AY 2020/2021 Semester 1 (2010)	Advanced General NLP Topics II
AY 2019/2020, Semester II (1920)	Advanced General NLP Topics I

AY 2020/2021, Semester II (2020)

To see the most current syllabus, click on the top WING Reading Group (CS6101) link.

Our reading group will be conducted as a group seminar, with class participants nominating themselves and presenting the materials and leading the discussion. In Sem II of AY2020/2021, we focused on the topics of

Conversational Systems, Recommender Systems and their intersections.

Date	Description
NUS Week 02 Fri, 22 Jan NUS Calendar (PDF)	Topics on Conversational Systems I Reading List for Surveys and Research Papers Lecturers: Min-Yen Kan, Yisong Miao, Lin Xu, Yuxi Xie Support Staff: whole class [ Lecture Slides ] [ Scribe Notes ] Descriptions: [ 00:00 ] Start - CS6101 / DYC1401 administration, presented by Min-Yen Kan [ 36:00 ] Overview of Dialogue Systems, presented by Yisong Miao [ 45:11 ] Qin et al. (2020) "DCR-Net: A Deep Co-Interactive Relation Network for Joint Dialog Act Recognition and Sentiment Classification". [ PDF ] In AAAI'2020, presented by Min-Yen Kan [ 1:26:45 ] Rishabh Joshi, Vidhisha Balachandran, Shikhar Vashishth, Alan Black, Yulia Tsvetkov. "DialoGraph: Incorporating Interpretable Strategy-Graph Networks into Negotiation Dialogues" [ PDF@OpenReview ], Accepted@ICLR '21, presented by Lin Xu [ 2:08:00 ] Li et al. (2020) "Don’t Say That! Making Inconsistent Dialogue Unlikely with Unlikelihood Training". [ PDF ] In ACL'2020, presented by Yuxi Xie
NUS Week 03 Thur, 28 Jan	Project Consultation Session 1, led by Min-Yen Kan Descriptions: [ 00:00 ] Start [ 3:20 ] Agenda for today [ 35:47 ] Sprint Descriptions [ 1:10:37 ] Breakout Room Start / End of Common Video
NUS Week 04 Fri, 5 Feb	Topics on ConvSys II Same Material as Week 02 Lecturers: Xiong An Lee, Tongyao Zhu, Muhd Assyarul Ariffin Bin Omar, Axel Lau, Abhinav Ramesh Kashyap, Stephen Tan Support Staff: TBD [ Lecture Slides ] [ Scribe Notes ] Descriptions: [ 00:00 ] Start - CS6101 / DYC1401 administration, presented by Min-Yen Kan [ 12:32 ] Zhang et al. (2020) "DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation" [ PDF ], ACL'2020, presented by Muhd Assyarul Ariffin Bin Omar, Axel Lau [ 28:21 ] Wu & Xiong (2020) "Probing Task-Oriented Dialogue Representation from Language Models" [ PDF ], EMNLP'2020, presented by Abhinav Ramesh Kashyap, Stephen Tan [ 1:25:51 ] Lei et al. (2018) "Sequicity: Simplifying Task-oriented Dialogue Systems with Single Sequence-to-Sequence Architectures". [ PDF ] In ACL'2018, presented by Xiong An Lee, Tongyao Zhu
NUS Week 05 Thur, 11 Feb	Project Consultation Session 2, led by Min-Yen Kan Descriptions: [ 00:00 ] Start [ 2:06 ] Agenda for today [ 9:15 ] Breakout Rooms Start / Min discusses with Diversifying Dialogue Gen with Non-Conversational Text group [ 50:40 ] Breakout Room Finish / Description of Consultation Session 3
NUS Week 06 Fri, 19 Feb	Topics on RecSys I Reading List for Surveys and Research Papers Lecturers: Yisong Miao, Takanori Aoki, Gabriel Loye Hean Yong, Aadit Rahul Kamat, Yeo Qi Xun, Chan Guan Hao, Tian Zhen, Lu Xinyuan Support Staff: Stephen Tan Hin Khai, Axel Lau Wei En, Abhinav Ramesh Kashyap, Clarence Ong, Li Xinze, Ruchen Zhen [ Lecture Slides ] [ Scribe Notes ] Descriptions: [ 00:00 ] Start [ 4:31 ] Zheng et al. (2021) "Disentangling User Interest and Popularity Bias for Recommendation with Causal Embedding" [ PDF ], accepted by WWW'2021, presented by presented Yisong Miao and Gabriel Loye [ 50:55 ] Saito (2020) "Unbiased Pairwise Learning from Implicit Feedback" [ PDF ], ICTIR '2020, presented by Takanori Aoki and Aadit Rahul Kamat [ 1:36:17 ] Xu et al. (2021) "Causal Collaborative Filtering" [ PDF ], ArXiv preprint, presented by Qi Xun, Tian Zhen and Xinyuan Lu
NUS Week Recess Thur, 25 Feb	Project Consultation Session 3, led by Min-Yen Kan Descriptions: [ 00:00 ] Start [ 1:10 ] Agenda for today [ 3:25 ] Yeo Qi Xun, Tian Zhen, Yuxi Xie (CS6101 01 Project) Diversifying Dialogue Generation with Non-Conversational Text [ 29:00 ] End
NUS Week 07 Fri, 5 Mar	Topics on RecSys II Same Material as Week 06 Lecturers: Xu Pengtai, Ran Yiding, Clarence Ong, Sashank C. Kumar, Li Xinze, Chan Guan Hao, and Kong Zijin Support Staff: Nham Quoc Hung, Li Zihan, Lee Xiong An, Evan Chong and Shreyas Kuthanoor Prakash [ Lecture Slides ] [ Scribe Notes ] Descriptions: [ 00:00 ] Start [ 5:31 ] Guo et al. (2017) "DeepFM: A Factorization-Machine based Neural Network for CTR Prediction" [ PDF ], IJCAI'2017, presented by Xu Pengtai and Ran Yiding [ 51:55 ] Zheng et al. (2020) "A Novel Hybrid Deep Recommendation System to Differentiate User’s Preference and Item’s Attractiveness", [ Closed Access ], Information Sciences, presented by Clarence Ong and Sashank C. Kumar [ 1:36:00 ] Yuan et al. (2019) "A Simple Convolutional Generative Network for Next Item Recommendation" [ PDF ], WSDM'2019, presented by Li Xinze, Chan Guan Hao, and Kong Zijin
NUS Week 08 Thur, 11 Mar	Project Consultation Session 4, led by Min-Yen Kan Descriptions: [ 00:00 ] START - PART I ** [ 3:35 ] Diversifying Dialogue Generation with Non-Conversational Text by Yeo Qi Xun, Tian Zhen and Xie Yuxi [ 26:55 ] Unbiased Recommender / Search Systems by Causal Inference by Takanori Aoki and Aadit Rahul Kamat [ 43:10 ] DeepFM: Neural Network for Advertisement Recommendation by Muhammad Assyarul Ariffin, Lee Xiong An and Xu Pengtai [ 56:35 ] Inductive Matrix Completion based on Graph Neural Network (IGCM) by Joel Tan Wan Rong, Chan Guan Hao, Wendi Ren, Stephen Tan Hin Khai and Axel Lau Wei En [ 1:11:50 ] Neural Collaborative Filtering by Clarence Ong, Nham Quoc Hung, Gabriel Loye Hean Yong and Sashankh Chengavalli Kumar [ 1:22:05 ] Causal Estimation by Yisong Miao and Chengxin Wang [ 1:31:30 ] START - PART II ** [ 1:59:30 ] Self-Introductions
NUS Week 09 Fri, 19 Mar	Topics on ConvRecSys I Reading List for Surveys and Research Papers Lecturers: Joel Tan Wan Rong, Nham Quoc Hung, Qiao Rui, Wang Chengxin, Liu Hongfu and Victor Li Chuang Scribes / Support Staff: Henry Kasim, Chan Guan Hao, Taha Aksu, Takanori Aoki, Kong Zijin and Liu Yong [ Lecture Slides ] [ Scribe Notes ] Descriptions: [ 00:00 ] Start [ 05:00 ] Introduction to Conversation Recommendation Systems by Victor Li Chuang [ 19:43 ] Xu et al. (2020) "User Memory Reasoning for Conversational Recommendation" [ PDF ], COLING'2020, presented by Wang Chengxin and Nham Quoc, Slides 2-32 [ 1:05:12 ] Chen et al. (2019) "Towards Knowledge-Based Recommender Dialog System" [ PDF ], EMNLP'2019, presented by Liu Hongfu, Qiao Rui, and Joel, Slides 33–47 [ 1:35:54 ] Xu et al. (2021) "Adapting User Preference to Online Feedback in Multi-round Conversational Recommendation" [ PDF ], WSDM'2021, presented by Gangyi Zhang and Kong Zijin, Slides 48-68
NUS Week 10 Thur, 25 Mar	Project Consultation Session 5, led by Min-Yen Kan Descriptions: Short session to introduce the projects. Most work conducted in the respective breakout rooms (not recorded). For DYOM / CS6101-1 group (Breakout room 1 – 15 mins each): · Counterfactual Recommender/Search Systems (@taka, @Aadit Rahul Kama) · IGMC (@Stephen Tan, @Wendi Ren, @Axel Lau, @Joel Tan Wan Rong, @Chan Guan Hao) · Causal Estimation (@Yisong, @WANG CHENGXIN’s) For DYOM / CS6101-1 group (Breakout room 2 – 15 mins each): · KGRecSys (@Evan Chong, @Rabiul Awal) · Neural Collaborative Filtering (@Gabriel Loye, @Clarence Ong, @Nham Quoc Hung, @Sashankh CK) · DeepFM: NN for Ad Recommendation (@Muhd Assyarul Ariffin Bin Omar, @Pengtai, @Lee XA) For CS6101-2 (Breakout Room 3 - 15 mins each): · Multimodal Response Generation with Conditional Wasserstein Auto-Encoder (@Liu Ruofan, @Liu Yong, @Liu Hongfu) · Feedback-guided Preference Adaptation Network (@Sam Broughton, @Henry Kasim) · FiBiNET (@Zihan, @Qiao Rui, @Sng Weicong)
NUS Week 11 Fri, 2 Apr	Topics on ConvRecSys II Same Material as Week 09 Lecturers: Hu Hengchang, Taha Ibrahim Aksu, Sam Broughton, Wendi Ren, Zhang Tianyang Scribes/ Support Staff: Muhd Assyarul, Ran Yiding, Zhu Tongyao, Xu Pengtai, Liu Hongfu [ Lecture Slides ] [ Scribe Notes ] Descriptions: [ 00:00 ] Start [ 03:50 ] Penha and Hauff (2020) "What does BERT know about books, movies and music? Probing BERT for Conversational Recommendation" [ PDF ], RecSys'2020, presented by Hengchang and Taha [ 47:00 ] Zhou et al. (2020) "Improving Conversational Recommender Systems via Knowledge Graph based Semantic Fusion" [ PDF ], KDD'2020, presented by Sam and Wendi [ 1:27:30 ] Zhang et al. (2020) "Conversational Contextual Bandit: Algorithm and Application" [ PDF ], WWW'2020, presented by Tianyang and Weicong [ 2:03:45 ] Kahoot! Run for today's session
NUS Week 12 Thur, 8 Apr	Project Consultation Session 6, led by Min-Yen Kan Descriptions: Short session to introduce the projects. Most work conducted in the respective breakout rooms (not recorded) [ 00:00 ] Start - STePS update [ 5:51 ] KGRecSys: Evan Chong, Rabiul Awal [ 12:01 ] FiBiNET team: Sng Weicong, Qiao Rui, Li Zihan [ 35:15 ] DiagWAE: Multimodal Response Generation with Conditional Wasserstein Auto-encoder, Hongfu Liu, Ruofan Liu, Yong Liu
NUS Week 13 Fri, 16 April	Topics on ConvRecSys III Same Material as Week 09 Lecturers: Liu Ruofan, Liu Yong, Li Zihan, Henry Kasim, Evan Chong, Shreyas Kuthanoor Prakash Scribes/ Support Staff:Sashankh Chengavalli Kumar, Wang Chengxin, Sng Weicong, Samuel Broughton, Wendi Ren, Hu Hengchang, Lu Xinyuan, Zhang Tianyang [ Lecture Slides ] [ Scribe Notes ] Descriptions: [ 00:00 ] Start [ 03:38 ] Chen et al. (2020) "Towards Explainable Conversational Recommendation" [ PDF ], IJCAI'2020, presented by Li Zihan, Henry Kasim, Evan Chong (Slides 1-32) [ 58:24 ] Li. et al. (2021) "Seamlessly Unifying Attributes and Items: Conversational Recommendation for Cold-Start Users" [ PDF ], In ACM Trans. Online Information Systems, presented by Liu Ruofan, Liu Yong, Shreyas Kuthanoor Prakash (Slides 33-56) [ 1:38:30 ] Kahoot! Quiz

Organizers

This version of CS6101 is jointly run by WING@NUS and Lab of Data Science @ USTC, the latter one is led by Dr Xiangnan He.

The current organisation team includes following members (alphabetical order):

Jiawei Chen@USTC, Chongming Gao@USTC, [Xiangnan He@USTC]

AY 2020/2021, Semester I (2010)

Date	Description
NUS Week 02 Fri, 21 Aug	Basic Seq2Seq and Variants, Week 1 Lecturer and Support staff: Tongyao Zhu, Zijin Kong, Tianyang Zhang, Chenglei Si [Lecture Slides] [Scribe Notes] Reading List: Sutskever, Vinyals, & Le. (2014) “Sequence to sequence learning with neural networks.” : https://papers.nips.cc/paper/5346-sequence-to-sequence-learning-with-neural-networks.pdf [ Video Segment @ 29:55] Gehring, et al. (2017) "Convolutional sequence to sequence learning." : https://arxiv.org/abs/1705.03122 [ Video Segment @ 53:12 ] Vaswani, et al. (2017) "Attention is all you need." : https://papers.nips.cc/paper/7181-attention-is-all-you-need.pdf [ Video Segment @ 1:19:35 ]
NUS Week 03 Fri, 28 Aug	Basic Seq2Seq and Variants, Week 2 Lecturer and Support staff: Lu Xinyuan, Abdul Waheed, Taha Aksu, Xiachong Feng, Yu Fan Cai, Liangming Pan, Jia Qing Yap, Laiba Mehnaz, Taru Jain [Lecture Slides] [Scribe Notes] Reading List: Decoding, Beam Search : https://arxiv.org/abs/1409.3215 [Video Segment @ 2:05] Attention Mechanism : https://arxiv.org/abs/1409.0473 https://arxiv.org/abs/1706.03762 [ Video Segment @ 12:59] CopyNet : https://arxiv.org/pdf/1603.06393.pdf [ Video Segment @ 44:15] Sequicity : https://www.aclweb.org/anthology/P18-1133.pdf [ Video Segment @ 1:09:47]
NUS Week 04 Fri, 4 Sep	Natural Language Generation, Week 1 Lecturer and Support staff: Pan Liangming, Mingliang Ang, Wu Jiaying, Ding Xu, Zhang Jipeng, Khush Jammu, Brian Formento, Tongyao Zhu, Li Chuang, Rabiul Awal. [Lecture Slides] [Scribe Notes] Reading List: SeqGAN : https://arxiv.org/abs/1609.05473 [Video Segment @ 4:33] Improving Sequence-to-Sequence Learning via Optimal Transport : https://arxiv.org/abs/1609.05473 [Video Segment @ 44:58] The Curious Case of Neural Text Degeneration : https://arxiv.org/abs/1904.09751 [Video Segment @ 1:04:43] MASS: Masked Sequence to Sequence Pre-training for Language Generation : https://arxiv.org/abs/1905.02450 [Video Segment @ 1:28:05] Plug and Play Language Models : https://arxiv.org/abs/1905.02450 [Video Segment @ 1:50:18]
NUS Week 05 Fri, 11 Sep	Natural Language Generation, Week 2 Lecturers and Support Staff: Liangming Pan, Xinyuan Lu, Shreyas Kuthanoor Prakash, Judith Jeyafreeda, Lin Xu, Hengchang Hu, Alexandre Gravier, Romain Iehl, Ming Liang Ang, Jipeng Zhang. [Lecture Slides] [Scribe Notes] Reading List: Wiseman et al. (2018) "Learning Neural Templates for Text Generation" https://arxiv.org/abs/1808.10122 EMNLP'18 [ Video Segment @ 5:43 ] Koncel-Kedziorski et al. (2019) "Text Generation from Knowledge Graphs with Graph Transformers" https://arxiv.org/abs/1904.02342 NAACL'19 [ Video Segment @ 53:26 ] Zhang, Xu, and Wang (2019) "Pretraining-Based Natural Language Generation for Text Summarization" https://arxiv.org/abs/1902.09243 CONLL'19 [ Video Segment @ 1:29:00 ] Chen et al. (2020) "Distilling Knowledge Learned in BERT for Text Generation" https://arxiv.org/abs/1911.03829 ACL'20 [ Video Segment @ 1:45:46 ]
NUS Week 06 Fri, 18 Sep	Domain Adaptation / Adapting Pretrained Models, Week 1 Lecturers and Support Staff: Abhinav Ramesh Kashyap, Devamanyu Hazarika, Alexandre Gravier, Rabiul Awal, Yisong Miao, Zhang Ruixi, Ding Xu, Lin Xu. [Lecture Slides] [Scribe Notes] Reading List: Ganin et al. (2016) "Domain-Adversarial Training of Neural Networks" https://arxiv.org/abs/1505.07818 JMLR'16 [ Video Segment @ 1:25 ] Keneshloo et al. (2019) "Deep Transfer Reinforcement Learning for Text Summarization" https://arxiv.org/abs/1810.06667 SDM'19 [ Video Segment @ 1:11:20 ] Howard et al. (2018) "Universal Language Model Fine-tuning for Text Classification" https://arxiv.org/abs/1801.06146 ACL'18 [ Video Segment @ 1:46:44 ]
NUS Week Recess Fri, 25 Sep	Domain Adaptation / Adapting Pretrained Models, Week 2 Lecturers and Support Staff: Zhang Ruixi, Laiba Mehraz, Zhang Yifan, Khush Jammu, Brian Formento, Taha Aksu, Abhinav Ramesh Kashyap, Shreyas Kutanoor Prakash, Bhavitvya Malik. [Lecture Slides] [Scribe Notes] Reading List: Devlin et al. (2019) "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding" https://arxiv.org/abs/1810.04805 [ Video Segment @ 0:00:08 ] Sanh et al. (2020) "DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter" https://arxiv.org/abs/1910.01108 [ Video Segment @ 0:09:03 ] Lan et al. (2020) "ALBERT: A Lite BERT for Self-supervised Learning of Language Representations" https://arxiv.org/abs/1909.11942 ICLR'20 [ Video Segment @ 0:09:56 ] Radford et al. (2018) "Improving Language Understanding by Generative Pre-Training" https://openai.com/blog/language-unsupervised/ [ Video Segment @ 0:44:20 ] Radford et al. (2019) "Language Models are Unsupervised Multitask Learners" https://openai.com/blog/better-language-models/ [ Video Segment @ 0:47:43 ] Brown et al. (2020) "Language Models are Few-Shot Learners" https://arxiv.org/abs/2005.14165 [ Video Segment @ 0:50:33 ] Houlsby et al. (2019) "Parameter-Efficient Transfer Learning for NLP" https://arxiv.org/abs/1902.00751 PMLR'19 [ Video Segment @ 1:17:14 ] Yang et al. (2017) "Transfer Learning for Sequence Tagging with Hierarchical Recurrent Network" https://openreview.net/pdf?id=ByxpMd9lx ICLR'17 [ Video Segment @ 1:49:52 ]
NUS Week 07 Fri, 2 Oct	Synthetic Data Generation for Machine Reading Comprehension, Week 1 Lecturers and Support Staff: Shuang Gao, Anab Maulana Barik, Si Chenglei, Li Xinze, Zhao Zirui, Devamanyu Hazarika, Wu Jiaying, Feng Xiachong and Fiona Tan. [Lecture Slides] [Scribe Notes] Reading List: Yadav et al. (2020) "Unsupervised Alignment-based Iterative Evidence Retrieval for Multi-hop Question Answering" https://arxiv.org/abs/2005.01218 [ Video Segment @ 0:03:47 ] Lewis et al. (2019) "Unsupervised Question Answering by Cloze Translation" https://arxiv.org/abs/1906.04980 [ Video Segment @ 0:41:29 ] Li et al. (2020) "Harvesting and Refining Question-Answer Pairs for Unsupervised QA." https://arxiv.org/abs/2005.02925 ICLR'20 [ Video Segment @ 1:13:51 ] Asai et al. (2020) " Logic-Guided Data Augmentation and Regularization for Consistent Question Answering" https://arxiv.org/abs/2004.10157 [ Video Segment @ 1:41:08 ]
NUS Week 08 Fri, 9 Oct	Synthetic Data Generation for Machine Reading Comprehension, Week 2 Lecturers and Support Staff: Alex Foo Da Weng, Taha Aksu, Luong Quoc Trung, Yang Yajing, Xu Yiqing, Hiray Shruti Shivram, Yifan Zhang, Samson Tan, and Liu Jiahao. [Lecture Slides] [Scribe Notes] Reading List: Cao et al. (2020) "Unsupervised Domain Adaptation on Reading Comprehension" https://arxiv.org/abs/1911.06137 [ Video Segment @ 0:07:10 ] Wang et al. (2019) "Adversarial Domain Adaptation for Machine Reading Comprehension" https://arxiv.org/abs/1911.06137 [ Video Segment @ 0:33:46 ] Puri et al. (2020) "Training Question Answering Models From Synthetic Data" https://arxiv.org/abs/1911.06137 [ Video Segment @ 0:57:45 ] Liu et al. (2020) "Asking Questions the Human Way: Scalable Question-Answer Generation from Text Corpus" https://arxiv.org/abs/1911.06137 [ Video Segment @ 1:21:28 ]
NUS Week 09 Fri, 16 Oct	Conversational Recommender Systems, Week 1 Lecturers and Support Staff: Henghchang Hu, Victor Li, Jiaqi Zheng, Jiahao Liu, Hansheng Ren, Zijin Kong, Yajing Yang, Yiqing Xu, Sunil Kumar Yadav, Yiding Ran. [Lecture Slides] [Scribe Notes] Reading List: Introduction to Conversational Recommender Systems [ Video Segment @ 0:06:45 ] Christakopoulou et al.(2018) "Q&R: A Two-Stage Approach toward Interactive Recommendation"http://alexbeutel.com/papers/q-and-r-kdd2018.pdf [ Video Segment @ 0:12:35 ] Zou et al. (2020) "Towards Question-based Recommender Systems"https://arxiv.org/pdf/2005.14255.pdf [ Video Segment @ 0:32:21 ] Lei et al. (2020) "Estimation-Action-Reflection: Towards Deep Interaction Between Conversational and Recommender Systems"https://dl.acm.org/doi/pdf/10.1145/3336191.3371769 [ Video Segment @ 1:00:11 ] Zeng et al. (2020) "Dynamic Online Conversation Recommendation"http://www4.comp.polyu.edu.hk/~jing1li/publication/zeng2020dynamic.pdf [ Video Segment @ 1:38:38 ] Chen, Z. (2020) "Towards Explainable Conversational Recommendation."https://www.ijcai.org/Proceedings/2020/0414.pdf [ Video Segment @ 1:59:31 ]
NUS Week 10 Fri, 23 Oct	Conversational Recommender Systems, Week 2 Lecturers and Support Staff: Sunil Kumar Yadav, Hannan Cao, Cai Yu Fan, Yisong Miao，Xinyuan Lu, Anab Maulana Barik, Jiaqi Zheng, Hansheng Ren, Zitai Chen. [Lecture Slides] [Scribe Notes] Reading List: Zhang et al.(2020) "Conversational Contextual Bandit: Algorithm and Application"https://arxiv.org/pdf/1906.01219.pdf [ Video Segment @ 0:04:20 ] Lei et al.(2020) "Interactive Path Reasoning on Graph for Conversational Recommendation"https://arxiv.org/pdf/2007.00194.pdf [ Video Segment @ 0:50:15 ] Liu et al.(2020) "Towards Conversational Recommendation over Multi-Type Dialogs"https://arxiv.org/pdf/2005.03954.pdf [ Video Segment @ 1:18:10 ] Chen et al.(2019) "Towards Knowledge-Based Recommender Dialog System"https://www.aclweb.org/anthology/D19-1189.pdf [ Video Segment @ 1:49:50 ]
NUS Week 11 Fri, 30 Oct	Fairness in NLP, Week 1 Lecturers and Support Staff: Samson Tan, Hiray Shruti Shivram, Fiona Tan, Bhavitvya Malik, Abdul Waheed, Judith Jeyafreeda, Li Xinze, Alex Foo Da Weng [Lecture Slides] [Scribe Notes] Reading List: Suresh and Guttag (2019) "A Framework for Understanding Unintended Consequences of Machine Learning"http://arxiv.org/pdf/1901.10002.pdf [ Video Segment @ 0:00:35 ] Bolukbasi et al. (2016) "Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings"https://proceedings.neurips.cc/paper/2016/file/a486cd07e4ac3d270571622f4f316ec5-Paper.pdf [ Video Segment @ 0:45:50 ] Maudslay et al. (2019) "It’s All in the Name: Mitigating Gender Bias with Name-Based Counterfactual Data Substitution"https://www.aclweb.org/anthology/D19-1530/ [ Video Segment @ 1:18:28 ] Saunders and Byrne (2020) "Reducing Gender Bias in Neural Machine Translation as a Domain Adaptation Problem"https://www.aclweb.org/anthology/2020.acl-main.690/ [ Video Segment @ 1:50:52 ]
NUS Week 12 Fri, 6 Nov	Fairness in NLP, Week 2 Lecturers and Support Staff: Zitai Chen, Zirui Zhao , Samson Tan, Shuang Gao, Hannan Cao, Laiba Mehnaz [Lecture Slides] [Scribe Notes] Reading List: Liang et al. (2020) "Towards Debiasing Sentence Representations"https://www.aclweb.org/anthology/2020.acl-main.488.pdf [ Video Segment @ 0:06:13 ] Wang et al. (2020) "Double-Hard Debias: Tailoring Word Embeddings for Gender Bias Mitigation"https://arxiv.org/pdf/2005.00965.pdf [ Video Segment @ 0:41:00 ] Blodgett et al. (2020) "Language (Technology) is Power: A Critical Survey of `Bias` in NLP"https://arxiv.org/pdf/2005.14050.pdf [ Video Segment @ 1:14:14 ]
NUS Week 13 Fri, 13 Nov	STEPS Presentation [ 17TH STEPS Program]

AY 2019/2020, Semester II (1920)

Date	Description
NUS Week 13 17 Apr	~~Entity Linking~~ - Canceled
NUS Week 12 10 Apr	Dialogue and Discourse Lecturer and Support staff: Shi Tian, Low Siow Meng, Samson Tan, Dogukan Yigit Polat, Jiaqi Li
NUS Week 11 3 Apr	Neural Machine Translation Lecturer and Support staff: Sashankh Kumar, Ang Shen Ting, Taha Aksu, Abhinav Kashyap, Saravanan Rajamanickam
NUS Week 10 27 Mar	Machine Reading Comprehension Lecturer and Support staff: Samson Tan, Pan Liangming, Taha Aksu, Van Hoang Nguyen [ Lecture Slides Part 1 ] [ Lecture Slides Part 2 ] [ Notes ] References: Mohit Bansal "Interpretability and Robustness for Multi-Hop QA ". MRQA-EMNLP 2019 Workshop. Chen, et al. "QANet: Combining Local Convolution with Global Self-Attention for Reading Comprehension". Sixth International Conference on Learning Representations (2018).
NUS Week 9 20 Mar	Named Entity Recognition/ Information Extraction Lecturer and Support staff: Calvin Tantio, Yap Jia Qing, Abhinav Kashyap, Low Siow Meng, Miao Yisong
NUS Week 8 13 Mar	Text Summarization Lecturer and Support staff: Taha Aksu, Yigit Polat, Calvin Tantio, Shen Ting Ang [ Lecture Slides ] [ Notes ] References: See, et al. "Get To The Point: Summarization with Pointer-Generator Networks". 55th Annual Meeting of the Association for Computational Linguistics. (2017). Chen, et al. "Knowledge-aware Multimodal Dialogue Systems". 56th Annual Meeting of the Association for Computational Linguistics (2018).
NUS Week 7 6 Mar	Semantic Analysis
NUS Week Recess 28 Feb	Recommendation Systems Lecturer and Support staff: Takanori Aoki, Hengchang Hu, Mun Kar Kin, Shelvia Wongso, Sashankh Chengavalli Kumar [ Lecture Slides ] [ Notes ] References: Mnih, A., & Salakhutdinov, R. R. "Probabilistic Matrix Factorization". Neural Information Processing Systems. (2017). He, X., Liao, L., Zhang, H., Nie, L., Hu, X., & Chua, T. S. "Neural Collaborative Filtering". In Proceedings of the 26th international conference on world wide web (pp. 173-182). Wang, X., He, X., Wang, M., Feng, F., & Chua, T. S. "Neural Graph Collaborative Filtering". In Proceedings of the 42nd international ACM SIGIR conference on Research and development in Information Retrieval (pp. 165-174).
NUS Week 6 21 Feb	Multimodal Models Lecturer and Support staff: Guilherme Zagatti, Liangming Pan, Yisong Miao, Ng Kheng Yi, Shi Tian [ Lecture Slides ] [ Notes ] References: Jenkins, Porter, et al. "Unsupervised Representation Learning of Spatial Data via Multimodal Embedding". Int'l Conf. on Information and Knowledge Management. (2019). Liao, Lizi, et al. "Knowledge-aware Multimodal Dialogue Systems". Int'l Conf. on Multimedia (2018). Yang, Xun, et al. "Interpretable fashion matching with rich attributes". SIGIR Conference on Research and Development in Information Retrieval. (2019).
NUS Week 5 14 Feb	Graph Based Models Lecturer and Support staff: Christopher Hendra, Mun Kar Kin, Nguyen Van Hoang, Hu Hengchang, Guilherme Zagatti [ Lecture Slides ] [ Notes ] References: Bronstein, Michael, et al. "Geometric deep learning: going beyond Euclidean data". Neural Information Processing Systems. (2017). [ video ] Thomas N. Kipf and Max Welling "Semi-Supervised Classification with Graph Convolutional Networks". Int'l Conf. on Learning Representations (2017).
NUS Week 4 7 Feb	Transfer Learning, Transformers and BERT Lecturer and Support staff: Abhinav Kashyap, Cara Leong, Samson Tan and Vu Duc Nam [ Lecture Slides ] [ Notes ] References: Vaswani, Ashish, et al. "Attention is all you need". Advances in neural information processing systems. (2017). Devlin, Jacob, et al. "Bert: Pre-training of deep bidirectional transformers for language understanding". arXiv preprint arXiv:1810.04805 (2018).
NUS Week 3 31 Jan	Canceled due to logistic constraints imposed by nCov-1 ~~Embeddings / Pretraining~~

WING.NUS

Past Semesters

Table of Contents:

AY 2020/2021, Semester II (2020)

Organizers

AY 2020/2021, Semester I (2010)

AY 2019/2020, Semester II (1920)