GoKawiilCost of AI Model Tokens Falling Sharply as GPU Efficiency Doubles Every Two Years
An analysis argues that the cost of running machine learning models is dropping by orders of magnitude annually, driven by GPU efficiency gains that double roughly every two years—a pace not seen since early Moore's Law. The piece distinguishes proprietary models like GPT-6 Astra from open-weight models such as GLM-5.3-flash, noting that hosted and locally-run versions improve at different rates, with per-token pricing for frontier models not falling as consistently as costs for smaller models.