Introducing gigaGPT: GPT-3 sized models in 565 lines of code

GigaGPT is Cerebras’ implementation of Andrei Karpathy’s nanoGPT – the simplest and most compact code base to train and fine-tune GPT models.

Related Keywords

,Pytorch Apis ,Condor Galaxy ,Cerebras Wafer Scale Clusters ,Cerebras Wafer Scale Engine ,