112 - Alignment of Multilingual Contextual Representations, with Steven Cao
We invited Steven Cao to talk about his paper on multilingual alignment of contextual word embeddings. We started by discussing how multilingual transformers work in general, and then focus on Steven’...
13 Touko 202033min
111 - Typologically diverse, multi-lingual, information-seeking questions, with Jon Clark
We invited Jon Clark from Google to talk about TyDi QA, a new question answering dataset, for this episode. The dataset contains information seeking questions in 11 languages that are typologically di...
27 Huhti 202038min
110 - Natural Questions, with Tom Kwiatkowski and Michael Collins
In this episode, Tom Kwiatkowski and Michael Collins talk about Natural Questions, a benchmark for question answering research. We discuss how the dataset was collected to reflect naturally-occurring ...
6 Huhti 202043min
109 - What Does Your Model Know About Language, with Ellie Pavlick
How do we know, in a concrete quantitative sense, what a deep learning model knows about language? In this episode, Ellie Pavlick talks about two broad directions to address this question: structural ...
30 Maalis 202046min
108 - Data-To-Text Generation, with Verena Rieser and Ondřej Dušek
In this episode we invite Verena Rieser and Ondřej Dušek on to talk to us about the complexities of generating natural language when you have some kind of structured meaning representation as input....
23 Maalis 202049min
107 - Multi-Modal Transformers, with Hao Tan and Mohit Bansal
In this episode, we invite Hao Tan and Mohit Bansal to talk about multi-modal training of transformers, focusing in particular on their EMNLP 2019 paper that introduced LXMERT, a vision+language trans...
24 Helmi 202037min
106 - Ethical Considerations In NLP Research, with Emily Bender
In this episode, we talked to Emily Bender about the ethical considerations in developing NLP models and putting them in production. Emily cited specific examples of ethical issues, and talked about t...
17 Helmi 202039min
105 - Question Generation, with Sudha Rao
In this episode we invite Sudha Rao to talk about question generation. We talk about different settings where you might want to generate questions: for human testing scenarios (rare), for data augmen...
10 Helmi 202042min
