Study finds newer AI models fabricate citations far less often than earlier versions
Researchers led by Stanford's Owen Queen analyzed 50 widely cited problematic behaviors in large language models, including hallucinated citations and overthinking simple math, by re-testing the original prompts on 20 newer models released between mid-2024 and late 2026. They found nearly half of these behaviors had largely faded, with many disappearing roughly 16 months after being first documented in published research. The analysis was posted as a blog post and has not been peer reviewed.