Environmental Impact of Large-Scale NLP Model Training with Emma Strubell

Today we're joined by Emma Strubell, currently a visiting scientist at Facebook AI Research. Emma's focus is on NLP and bringing state of the art NLP systems to practitioners by developing efficient and robust machine learning models. Her paper, Energy and Policy Considerations for Deep Learning in NLP, hones in on one of the biggest topics of the generation: environmental impact. Training neural networks has resulted in an impressive increase in accuracy, however the computational resources required to train these models is staggering - and carbon footprints are only getting bigger. In this episode, we discuss Emma's research methods, how companies are reacting to environmental concerns, and  how we as an industry can be doing better.