Tech News
← Home  ·  All topics

Artificial Analysis Intelligence Index

13 GoKawiil briefs on this topic

New AI lab releases Inkling 2 Small, a 594B-parameter mixture-of-experts model

The developer unveiled Inkling 2 Small, a Mixture-of-Experts model with 594 billion total parameters and 17 billion active, supporting image inputs and variable effort levels. The model scored 31 on the Artificial Analysis Intelligence Index, a notable jump from the company's prior generation, with gains attributed to more efficient pre-training and a unified reinforcement learning run. It is currently accessible only through the Tinker platform with closed weights, ahead of a planned Apache 2.0 open-weight release next week pending safety testing.

Google unveils Gemini 4 Carbon, a new frontier AI model focused on cybersecurity

Google has launched Gemini 4 Carbon, its second new frontier AI model in a month following Gemini 4 Argon. The model improves on coding, agentic tasks, scientific reasoning and multimodal understanding, with Google saying its biggest gains are in cybersecurity, including more than doubling secure-code generation rates versus Argon. Carbon will first go to select cyber defenders before wider release, priced at $2 per million input tokens and $10 per million output tokens.

Gemini 4 Carbon debuts with top AI benchmark score, phased cybersecurity-focused rollout

A company has unveiled Gemini 4 Carbon, a frontier AI model it says scores highest on the Artificial Analysis Intelligence Index v5.0 at 59, with strong results on cybersecurity benchmarks including SEC-bench Pro, ExploitGym, and CWE-bench. Rather than a full public launch, the model will first go to select cyber defenders this week, then expand to trusted partners via the Fairwind Program, with pricing set at $2 per million input tokens and $10 per million output tokens.

Google debuts Gemini 4 Carbon, a cybersecurity-focused frontier AI model

Google announced Gemini 4 Carbon, a new AI model it says delivers major improvements in coding, long-running agentic tasks, and cybersecurity defense compared to its predecessor Argon, released earlier this month. The model tops the Artificial Analysis Intelligence Index v5.0 and leads rival models from Anthropic and OpenAI on two security-focused benchmarks, SEC-bench Pro and ExploitGym. Access is currently limited to select cybersecurity defense firms through Google's Fairwind Program, with wider partner access planned later.

Artificial Analysis releases Intelligence Index v5 with new benchmarks and private datasets

Artificial Analysis launched version 5 of its Intelligence Index, a composite benchmark measuring AI model capabilities, adding two new tests (FrontierCode 2.0 and Terminal-Bench-Science) and upgrading three others, including a refined version of Humanity's Last Exam. The firm also introduced a companion Progress Index to track model capability over time, and reports that 60% of the Index now relies on private or held-out test data. In current results, Claude Opus 5.5 leads with a score of 58, narrowly ahead of GPT-6 Astra at 57.

Kimi K3.1 Pro scores 55 on Artificial Analysis Intelligence Index

Kimi K3.1 Pro has been benchmarked at 55 on the Artificial Analysis Intelligence Index, well above the median score of 27 for comparable models. The model handles text and image input with a 1M token context window, priced at $2.00 per 1M input tokens and $10.00 per 1M output tokens, matching median market pricing.

DeepSeek V4.1 Flash 1017 (Max) debuts with 1M-token context and strong benchmark score

DeepSeek has released V4.1 Flash 1017 (Max), a multimodal model accepting text and image input and producing text output, with a 1 million token context window. The model scored 45 on the Artificial Analysis Intelligence Index, well above the comparable median of 19, while running at 230 tokens per second.

New open-source benchmark Parsimony measures code bloat added by AI coding models

A developer has released Parsimony, an open-source benchmark that measures how much code AI models add when solving SWE-bench Verified tasks, rather than just whether they solve them. It parses patches to count syntax-level coding units added and removed, producing a net score, and ranks models by mean net units added on tasks they solved. The tool and underlying data are published on GitHub, with results also shown via an interactive leaderboard and charts.

Google's Gemini 4 Argon (High) scores 53 on Artificial Analysis Intelligence Index

Artificial Analysis benchmarked Gemini 4 Argon (High), a model that accepts text and image input and outputs text with a 1M token context window. It scored 53 on the firm's Intelligence Index, well above the median of 26, while using 110M tokens during evaluation versus a median of 82M. Pricing is set at $2.00 per 1M input tokens and $10.00 per 1M output tokens, both matching the median for comparable models.

Mercury 2.5 benchmarked at 770 tokens per second, scores low on intelligence index

Mercury 2.5, a text-only large language model with a 260k token context window, has been benchmarked at 770 tokens per second on Artificial Analysis's testing. It scored 12 on the Intelligence Index, below the median of 13, while using fewer tokens (35M vs a median 85M) to complete the evaluation. Pricing sits at $0.25 per 1M input tokens and $0.75 per 1M output tokens, close to category medians.

Claude Opus 5.5 scores 58 on Artificial Analysis Intelligence Index, priced above median

Anthropic's Claude Opus 5.5, running in Adaptive Reasoning Max Effort mode, scored 58 on the Artificial Analysis Intelligence Index against a median of 25 among comparable models. The model handles text and image input with text output and a 1M token context window, but is priced at $4.00 per 1M input tokens and $20.00 per 1M output tokens, both above the reported medians of $2.00 and $10.00. Evaluating it on the Intelligence Index generated 260M tokens and cost $8,708.20 in total.

MiMo-V2.6-Pro debuts as fast, high-scoring open-weight multimodal model

MiMo-V2.6-Pro is a new open-weight AI model supporting text, image, speech, and video inputs with a 1M-token context window, scoring 46 on the Artificial Analysis Intelligence Index versus a median of 18 among comparable models. It runs at 125 tokens per second, priced at $0.43 per million input tokens and $0.87 per million output tokens, with a total evaluation cost of $206.66.