Multimodal, Multi-Lingual NLP at Hugging Face with John Bohannon & Douwe Kiela
EPISODE 589
|
AUGUST
29,
2022
Watch
Follow
Share
About this Episode
In this extra special episode of the TWIML AI Podcast, a friend of the show John Bohannon leads a jam-packed conversation with Hugging Face’s recently appointed head of research Douwe Kiela. In our conversation with Douwe, we explore his role at the company, how his perception of Hugging Face has changed since joining, and what research entails at the company. We discuss the emergence of the transformer model and the emergence of BERT-ology, the recent shift to solving more multimodal problems, the importance of this subfield as one of the “Grand Directions'' of Hugging Face’s research agenda, and the importance of BLOOM, the open-access Multilingual Language Model that was the output of the BigScience project. Finally, we get into how Douwe’s background in philosophy shapes his view of current projects, as well as his projections for the future of NLP and multimodal ML.
About the Guests
John Bohannon
Primer
Douwe Kiela
Hugging Face
Resources
- Big Science and Embodied Learning at Hugging Face with Thomas Wolf - #564
- Paper: The Dangers of Underclaiming: Reasons for Caution When Reporting How NLP Systems Fail
- Paper: Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
- Paper: REALM: Retrieval-Augmented Language Model Pre-Training
- Paper: Supervised Learning of Universal Sentence Representations from Natural Language Inference Data
- Evaluate
- AI Rewind 2021: Trends in NLP with John Bohannon - #550
- Taming arXiv with Natural Language Processing with John Bohannon - #136
