Energy Star Ratings for AI Models with Sasha Luccioni
EPISODE 687
|
JUNE
3,
2024
Watch
Follow
Share
About this Episode
Today, we're joined by Sasha Luccioni, AI and Climate lead at Hugging Face, to discuss the environmental impact of AI models. We dig into her recent research into the relative energy consumption of general purpose pre-trained models vs. task-specific, non-generative models for common AI tasks. We discuss the implications of the significant difference in efficiency and power consumption between the two types of models. Finally, we explore the complexities of energy efficiency and performance benchmarking, and talk through Sasha’s recent initiative, Energy Star Ratings for AI Models, a rating system designed to help AI users select and deploy models based on their energy efficiency.
About the Guest
Sasha Luccioni
Hugging Face
Resources
- Energy Star Ratings for AI Models
- Power Hungry Processing: Watts Driving the Cost of AI Deployment?
- Mind your Language (Model): Fact-Checking LLMs and their Role in NLP Research and Practice
- Measuring Data
- AI for Whom? Shedding Critical Light on AI for Social Good
- NeurIPS Code of Ethics 2023
- EleutherAI/lm-evaluation-harness
- Visualizing Climate Impact with GANs with Sasha Luccioni - #413
- AI for Power & Energy with Laurent Boinot - #683
- OLMo: Everything You Need to Train an Open Source LLM with Akshita Bhagia - #674
- Can Language Models Be Too Big? - #467
