AI Rewind 2018: Trends in Natural Language Processing with Sebastian Ruder
EPISODE 216
|
DECEMBER
31,
2018
Watch
Follow
Share
About this Episode
In this episode of our AI Rewind series, we've brought back recent guest Sebastian Ruder, PhD Student at the National University of Ireland and Research Scientist at Aylien, to discuss trends in Natural Language Processing in 2018 and beyond.
In our conversation we cover a bunch of interesting papers spanning topics such as pre-trained language models, common sense inference datasets and large document reasoning and more, and talk through Sebastian's predictions for the new year.
About the Guest
Sebastian Ruder
DeepMind
Resources
- TWIML Talk #195 - Milestones in Neural Natural Language Processing with Sebastian Ruder
- Paper: Phrase-Based & Neural Unsupervised Machine Translation
- Paper: Deep Contextualized Word Representations
- Paper: SWAG: A Large-Scale Adversarial Dataset for Grounded Commonsense Inference
- Paper: Semi-Supervised Sequence Modeling with Cross-View Training
- Paper: QANet: Combining Local Convolution with Global Self-Attention for Reading Comprehension
- Paper: BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
- Google Dataset Search
- Fever.ai
- Aylien
- Deep Learning Indaba
- Fast AI 1.0

