Guest

dan-fu-photo

Dan Fu

PhD Student
Stanford University
Connect with Dan

I'm a fifth-year Computer Science PhD candidate at Stanford, where I'm co-advised by Chris Ré and Kayvon Fatahalian, affiliated with the Stanford AI LabStanford CRFM, the Stanford Machine Learning GroupDAWN, and the Stanford Computer Graphics Lab. I'm also an academic partner with Together. In my research, I develop ML and systems algorithms to break crucial modeling bottlenecks. Recently, I've been very interested in enabling longer-sequence models, with a line of work starting with H3 and FlashAttention, and continuing on with Hyena. This blog post summarizes our past two years of work on increasing the context length of foundation models.

Podcast Episodes