Developer ports compact Llama 2 LLM to DOS in weekend hackathon

Serving tech enthusiasts for over 25 years.TechSpot means tech analysis and advice you can trust Vintage Hallucinations: A lone developer spent a weekend attempting to run the Llama 2 large language model on old, DOS-based machines. Thanks to the readily available open-source code, the project ultimately succeeded. However, adapting Llama 2 to the archaic DOS environment was no easy feat. Yeo Kheng Meng, a programmer previously known for creating a DOS client for ChatGPT, has recently embarked on a new AI-related project focused on the prompt-based computing environment of the past. His latest endeavor is a fully DOS-based large language model (LLM) that performs inference tasks offline. The FreeDOS Project notes that Meng developed the DOS LLM client using Meta's Llama 2 model, released in 2023. The programmer tested the software on systems with both older and newer components, providing a striking side-by-side performance comparison between a Thinkpad T42 (2004) and a Toshiba Sate ... Read full article.