What Is ChatGPT Doing … and Why Does It Work?—

Stephen Wolfram explores the broader picture of what's going on inside ChatGPT and why it produces meaningful text. Discusses models, training neural nets, embeddings, tokens, transformers, language syntax.

Related Keywords

Oliver Selfridge , Marvin Minsky , Roger Germundsson , John Hopfield , Matteo Salvarezza , Etienne Bernard , Eric Mjolsness , Giulio Alessandrini , Jesse Galef , Jack Cowan , Sebastian Bodenstein , Brad Klee , Taliesin Beynon , Jerry Lettvin , Gordon Shaw , Pedro Domingos , Terry Sejnowski , Robert Hecht Nielsen , Gerry Tesauro , Ilya Sutskever , Tomaso Poggio , Greg Brockman , Geoff Hinton , Timothee Verdier , Dario Amodei , Yann Lecun , Wolfram Alpha , Jerome Louradour , , Just Adding One Word , Wolfram Language , Probabilities Come , Neural Net , Computational Equivalence , Physics Project , Network That , Mad Libs , Semantic Laws , Cayden Pierce ,