Trends in Natural Language Processing with Nasrin Mostafazadeh

800 800 The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

Today we continue the AI Rewind 2019 joined by friend-of-the-show Nasrin Mostafazadeh, Senior AI Research Scientist at Elemental Cognition.

We caught up with Nasrin a few weeks ago to discuss the latest and greatest developments and trends in Natural Language Processing, including Interpretability, Ethics, and Bias in NLP, how large pre-trained models have transformed NLP research, and top tools and frameworks in the space. Check out the rest of the series at!

We want to hear from you! Send your thoughts on the year that was 2019 below in the comments, or via Twitter at @samcharrington or @twimlai.

To follow along with the 2019 AI Rewind Series, head over to the series page!

About Nasrin

Mentioned in the Interview

  • #174 – Contextual Modeling for Language and Vision with Nasrin Mostafazadeh
  • Attention is not explanation
  • What’s in a Name? Reducing Bias in Bios without Access to Protected Attributes
  • Language Models are Unsupervised Multitask Learners
  • BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
  • From ‘F’ to ‘A’ on the N.Y. Regents Science Exams: An Overview of the Aristo Project
  • Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference
  • Energy and Policy Considerations for Deep Learning in NLP
  • #286 – Environmental Impact of Large-Scale NLP Model Training with Emma Strubell
  • Blog: Attention is not not Explanation
  • Dissecting the Controversy around OpenAI’s New Language Model
  • AllenNLP Interpret: A Framework for Explaining Predictions of NLP Models
  • A Corpus and Cloze Evaluation for Deeper Understanding of Commonsense Stories
  • Tackling the Story Ending Biases in The Story Cloze Test
  • Check it out

    “More On That Later” by Lee Rosevere licensed under CC By 4.0

    Leave a Reply

    Your email address will not be published.