Local Llms - GoKawiil

Cost of AI Model Tokens Falling Sharply as GPU Efficiency Doubles Every Two Years

An analysis argues that the cost of running machine learning models is dropping by orders of magnitude annually, driven by GPU efficiency gains that double roughly every two years—a pace not seen since early Moore's Law. The piece distinguishes proprietary models like GPT-6 Astra from open-weight models such as GLM-5.3-flash, noting that hosted and locally-run versions improve at different rates, with per-token pricing for frontier models not falling as consistently as costs for smaller models.

jyn.dev · 2026-09-23

Guide Details How to Run AI Chatbots Locally on Your Own Computer

A new guide explains how everyday users can download and run large language models like those from Meta and Google directly on their own Windows, macOS, or Linux machines instead of relying on cloud-based apps like ChatGPT. Running LLMs locally offers offline access and greater privacy since no data is sent to outside servers, and it avoids subscription fees, though these free models are generally less powerful and slower than paid cloud versions. The guide notes that macOS is often preferred due to Apple Silicon's unified memory architecture, and that at least 16GB of RAM is recommended for smooth performance.

wired.com · 2026-08-29