GoKawiil
Tech News
Kimi K3.1 Pro has been benchmarked at 55 on the Artificial Analysis Intelligence Index, well above the median score of 27 for comparable models. The model handles text and image input with a 1M token context window, priced at $2.00 per 1M input tokens and $10.00 per 1M output tokens, matching median market pricing.
DeepSeek has released V4.1 Flash 1017 (Max), a multimodal model accepting text and image input and producing text output, with a 1 million token context window. The model scored 45 on the Artificial Analysis Intelligence Index, well above the comparable median of 19, while running at 230 tokens per second.
A developer has released Parsimony, an open-source benchmark that measures how much code AI models add when solving SWE-bench Verified tasks, rather than just whether they solve them. It parses patches to count syntax-level coding units added and removed, producing a net score, and ranks models by mean net units added on tasks they solved. The tool and underlying data are published on GitHub, with results also shown via an interactive leaderboard and charts.
Mistral released Large 4, a trillion-parameter mixture-of-experts model, in a research preview this week, with full weights due at the end of October. Independent benchmarking firm Artificial Analysis scored it 38 on its Intelligence Index, making it the top model from outside the US and China, though several Chinese open models including DeepSeek V4.1 Flash and MiMo-V2.6-Pro scored as high or higher overall. Large 4 scored 50 on Artificial Analysis's Cyber Index, tying GLM-5.3-Flash, and hit 82% on the CyberGym-E2E-AA cybersecurity test, its best individual result.
Google has launched Gemini 4 Argon, a frontier AI model built for deep reasoning in finance, coding, creative writing and cybersecurity tasks. Independent benchmarking firm Artificial Analysis found Argon matches OpenAI's GPT-6 Astra on its Intelligence Index at roughly 60 percent of the cost, with a notably lower hallucination rate of 15 percent. Google says it is already using Argon internally for quantum computing research, codebase migrations, and data center memory optimization, where it freed up 300 TiB of memory.
Artificial Analysis benchmarked Gemini 4 Argon (High), a model that accepts text and image input and outputs text with a 1M token context window. It scored 53 on the firm's Intelligence Index, well above the median of 26, while using 110M tokens during evaluation versus a median of 82M. Pricing is set at $2.00 per 1M input tokens and $10.00 per 1M output tokens, both matching the median for comparable models.
Artificial Analysis maintains an Intelligence Index that plots large language models against their blended API cost per million tokens, using a 3:1 input-to-output ratio and a log-price scale. The tool highlights a 'value frontier' of models that aren't beaten on both price and intelligence by any other option, showing only top variants and hiding low scorers by default, with filters to expand the view.
Mercury 2.5, a text-only large language model with a 260k token context window, has been benchmarked at 770 tokens per second on Artificial Analysis's testing. It scored 12 on the Intelligence Index, below the median of 13, while using fewer tokens (35M vs a median 85M) to complete the evaluation. Pricing sits at $0.25 per 1M input tokens and $0.75 per 1M output tokens, close to category medians.
Anthropic's Claude Opus 5.5, running in Adaptive Reasoning Max Effort mode, scored 58 on the Artificial Analysis Intelligence Index against a median of 25 among comparable models. The model handles text and image input with text output and a 1M token context window, but is priced at $4.00 per 1M input tokens and $20.00 per 1M output tokens, both above the reported medians of $2.00 and $10.00. Evaluating it on the Intelligence Index generated 260M tokens and cost $8,708.20 in total.
Xiaomi has released MiMo-V2.6 Pro and a lighter Flash variant as open-weight omnimodal AI models handling text, images, video and code. The company says Pro tops open-source rankings on the Artificial Analysis Intelligence Index, trailing only closed models like Claude Opus 5 and GPT-5.6 Sol, and it showcased a feature called Vibe World that turns prompts into interactive 3D games, Blender assets or robotic arm controls.
MiMo-V2.6-Pro is a new open-weight AI model supporting text, image, speech, and video inputs with a 1M-token context window, scoring 46 on the Artificial Analysis Intelligence Index versus a median of 18 among comparable models. It runs at 125 tokens per second, priced at $0.43 per million input tokens and $0.87 per million output tokens, with a total evaluation cost of $206.66.
Following the release of GPT Astra, viral demos such as recreating Minecraft, drawing a pelican on a bicycle as SVG, and simulating a bouncing ball in a rotating box swept social feeds. A commentary piece labels these 'demo-benchmarks': tasks that look impressive and are easy to grasp, but are narrow enough that labs can specifically optimize for them before each launch. It cites Thinking Machines' Inkling Small, a much smaller model that nearly matched or beat its larger sibling on tests like Humanity's Last Exam and GPQA Diamond, as evidence that public, static test sets get gamed through training choices.