AI coding may not be helping as much as you think
A significant fraction of the money that people have paid for Generative AI has been for coding assistance. When I point to the positive uses of Generative AI, I invariably point to how GenAI serves as kind of valuable autocomplete for coding. In that context, a new study from METR, an AI benchmarking nonprofit, is shocking. METR ran a randomized control trial in the first half of this year “to see whether AI tool usage at the February–June 2025 frontier (primarily Cursor Pro) sped-up experien