Llamafile 0.8.5 Delivers Greater Performance: Tiny Models 2x Faster On Threadripper
The Mozilla Ocho group has published their newest version of Llamafile, the open-source project that makes it very easy to distribute and run large language models (LLMs) as a single file
Source: phoronix.com