The Mathematics of Training LLMs — with Quentin Antho

Listen now | Breaking down the viral Transformers Math 101 article and high performance distributed training for Transformers-based architectures (or "How I Learned to Stop Handwaving and Make the GPU go brrrrrr")

Related Keywords

Quentin Anthony , George Hotz , Lawrence Livermore , Microsoft , Twitter , Nvidia , Ohio State University , Facebook , Actually Open , Transformers Math , Latent Space , Decibel Partners , Obviously Eleuther , Stas Bekman , Hugging Face , Hugging Face Bloom , Flash Attention , Google Cloud , Mesh Tensorflow , Oak Ridge , Maybei M , Discordi M ,