The Mathematics of Training LLMs — with Quentin Anthony of Eleuther AI

Listen now | Breaking down the viral Transformers Math 101 article and high performance distributed training for Transformers-based architectures (or "How I Learned to Stop Handwaving and Make the GPU go brrrrrr")

Related Keywords

Quentin Anthony ,George Hotz ,Lawrence Livermore ,Microsoft ,Twitter ,Nvidia ,Ohio State University ,Facebook ,Actually Open ,Transformers Math ,Latent Space ,Decibel Partners ,Obviously Eleuther ,Stas Bekman ,Hugging Face ,Hugging Face Bloom ,Flash Attention ,Google Cloud ,Mesh Tensorflow ,Oak Ridge ,Maybei M ,Discordi M ,