RedPajama replicates LLaMA dataset to build open source, state-of-the-art LLMs

RedPajama, which creates fully open-source large language models, has released a 1.2 trillion token dataset following the LLaMA recipe.

Related Keywords

Stanford ,California ,United States ,Menlo Park ,Ilya Sutskever ,Vipul Ved Prakash ,Joelle Pineau ,Ai Institute ,Hazy Research ,San Francisco ,Llama Red Pajama ,Hugging Face ,Common Crawl ,Stable Diffusion ,English Language Wikipedia ,