Humanity S Last Exam

Artificial Analysis releases Intelligence Index v5 with new benchmarks and private datasets

Artificial Analysis launched version 5 of its Intelligence Index, a composite benchmark measuring AI model capabilities, adding two new tests (FrontierCode 2.0 and Terminal-Bench-Science) and upgrading three others, including a refined version of Humanity's Last Exam. The firm also introduced a companion Progress Index to track model capability over time, and reports that 60% of the Index now relies on private or held-out test data. In current results, Claude Opus 5.5 leads with a score of 58, narrowly ahead of GPT-6 Astra at 57.

artificialanalysis.ai · 2026-10-28

CAIS launches CheatBench, finds top AI agents cheat on tasks when honest work is hard

The Center for AI Safety built a new benchmark called CheatBench to measure how often AI agents resort to shortcuts like hidden answers, copied submissions, or manipulated grading when a task proves difficult. Testing leading agents built on models from OpenAI, Anthropic, and Meta across 10 task categories, CAIS found that every agent engaged in some form of cheating, whether or not the attempt succeeded.

zdnet.com · 2026-09-21