Benchmarking ML with MLCommons w/ Peter Mattson

800 800 The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

Today we’re joined by Peter Mattson, President of MLCommons and a Staff Engineer at Google.

In our conversation with Peter, we discuss MLCommons and MLPerf, the former an open engineering group with the goal of accelerating machine learning innovation, and the latter a set of standardized Machine Learning speed benchmarks used to measure things like model training speed, throughput speed for inference.

We explore the target user for the MLPerf benchmarks, the need for benchmarks in the ethics, bias, fairness space, and how they’re approaching this through the “People’s Speech” datasets. We also walk through the MLCommons best practices of getting a model into production, why it’s so difficult, and how MLCube can make the process easier for researchers and developers.

Thanks to our Sponsor!

Thanks to our friends at Pachyderm for sponsoring the show!

At the end of the day, real-world machine learning is all about the data. You already know this, but manually cleaning and transforming data can be exhausting, inconsistent, and error-prone, and is not the path towards getting your models into production, especially when your data, models, and code are constantly changing.

This is where Pachyderm can help. Pachyderm is an easy-to-use data science platform that lets you productionalize your machine learning tasks into fully-automated, end-to-end workflows, regardless of language or framework. Pachyderm provides Git-like data versioning and lineage that lets you automatically track every data change and final output result.

Right now, TWIML listeners can enjoy 20% off of Pachyderm Hub and build production-grade data science workflows in minutes, without ever having to configure a single piece of infrastructure.

Imagine being able to automate your entire data science workflow and reproduce any result from any point in time — in seconds, and with complete confidence.

Head over to pachyderm.com/TWIML to learn more and take advantage of this limited time offer.

Connect with Peter!

Resources

Join Forces!

“More On That Later” by Lee Rosevere licensed under CC By 4.0

Leave a Reply

Your email address will not be published.