How to verify AI-generated Lean proofs actually prove what they claim
A new post lays out a checklist for assessing claims that a theorem is 'correct because it was checked in Lean,' particularly for AI-generated proofs. It notes that in OpenAI's recent dump of 722 math papers, about 45% included Lean code, three papers were later retracted over a sign error, and the formal verification steps needed to confirm correctness have often not yet been carried out.
GoKawiil's interpretation of the reporting above, not reported fact.
The post suggests that Lean verification is a meaningful signal but not an automatic guarantee of correctness, especially when proofs are AI-generated and could be subject to reward hacking or statement-proof mismatches. This framing could inform how researchers and journalists should scrutinize AI math claims rather than treating 'verified in Lean' as a simple stamp of truth.
- OpenAI's math paper dump included 722 papers, with roughly 45% accompanied by Lean code.
- Three non-Lean-verified papers from the dump were retracted due to a sign error.
- The author argues extra checks are needed before trusting AI-generated Lean proofs, and says these checks haven't been systematically applied yet.
No Starch Press Mathematics in Lean book — If you're intrigued by Lean's role in formally verifying mathematical proofs, this book is a great hands-on introduction to writing and checking proofs in Lean yourself. It bridges the gap between abstract theorem claims and the actual mechanics of formal verification discussed in the article. Perfect for readers who want to understand what 'checked in Lean' really means beyond the headlines.
See No Starch Press Mathematics in Lean book on Amazon → Affiliate link — we may earn a commission on purchases, at no extra cost to you. Product picked by AI based on this article; it is not a tested recommendation.Source: xenaproject.wordpress.com — View All Posts Xenaproject, 2026-11-16
Published there as: ““…and the proof is checked in Lean””
Read the original report → The summary and analysis above are GoKawiil's own, written from reporting by the source above. Facts and quotes belong to the original publisher.