Today we kick off our ICML coverage joined by Virginia Smith, an assistant professor in the Machine Learning Department at Carnegie Mellon University.
Subscribe: iTunes / Google Play / Spotify / RSS
In our conversation with Virginia, we explore her work on cross-device federated learning applications, including where the distributed learning aspects of FL are relative to the privacy techniques. We dig into her paper from ICML, Ditto: Fair and Robust Federated Learning Through Personalization, what fairness means in contrast to AI ethics, the particulars of the failure modes, the relationship between models and the things being optimized across devices, and the tradeoffs between fairness and robustness.
We also discuss a second paper, Heterogeneity for the Win: One-Shot Federated Clustering, how the proposed method makes heterogeneity beneficial in data, how the heterogeneity of data is classified, and some applications of FL in an unsupervised setting.
Thanks to our Sponsor!
Thanks to our friends at SigOpt, an Intel Company, for their continued support of the podcast, and their sponsorship of this series!
Experimentation is critical for AI model development, but is messy and tough to get right. This is why most modelers use tools that help them track what they’ve done. But none of these tools also help them discover what to do next. This is where SigOpt can help. SigOpt combines experiment management with seamless and powerful optimization. With SigOpt, modelers design novel experiments, explore modeling problems and optimize models to meet multiple objective metrics in their iterative workflow. Modelers from Two Sigma, OpenAI, Numenta, MILA and many more apply SigOpt to make model development 8x faster and boost team productivity by 30%. And now, SigOpt is available for free forever. Sign up for an account today at sigopt.com/signup or check out our docs to see how easy it is to get running in minutes at sigopt.com/docs.
Connect with Virginia!
- Paper: Ditto: Fair and Robust Federated Learning Through Personalization
- Paper: Heterogeneity for the Win: One-Shot Federated Clustering
- NeurIPS 2020 Tutorial on FL & Analytics
- Paper: Federated Learning: Challenges, Methods, and Future Directions
- Blog: Federated Learning: Challenges, Methods, and Future Directions
- 35 Innovators Under 35: Virginia Smith