Do AI Tokenomics Matter More Than Model Benchmarks? with Christopher Potts
EPISODE 776
|
SEPTEMBER
9,
2026
Watch
Follow
Share
About this Episode
As reasoning models consume more tokens and AI systems become more expensive to run, understanding what those tokens actually buy is becoming increasingly important. In this episode, Stanford professor and Big Spin co-founder Chris Potts joins us to discuss AI tokenomics and his research into “tokenflation”—the possibility that token usage is growing faster than the measurable value those tokens produce.
We explore how to measure the return on AI spending, why benchmarks alone provide an incomplete picture of model progress, and what inference-time scaling means for the economics of increasingly capable models. Chris also explains why expert AI users tend to get better results by challenging and iterating with models, how AI fluency affects outcomes, and why more efficient architectures could change the underlying economics. We also discuss DSPy, interpretability, the limits of today’s transformer architectures, and where Chris sees opportunities for more fundamental innovation in AI.
About the Guest
Christopher Potts
Bigspin; Stanford University
Resources
- Bigspin
- The Decline of Token-Level Purchasing Power
- The Mystery of Opus 4.6’s Sudden Tokenflation
- SWE-chat: Coding Agent Interactions From Real Users in the Wild
- A Paradox of AI Fluency
- Coding Personas: Variations in How People Use AI
- Invisible Failures in Human-AI Interactions
- DSPy
- ColBERT
- Claude Code
- Deep Contextualized Word Representations
- Attention Is All You Need
- Anthropic Education Report: The AI Fluency Index
- PyTorch
- Dynamic Token Merging for Efficient Byte-Level Language Models with Julie Kallini - #724