Skip to content
Tech News
← Back to articles

Cognition's SWE-2 achieves 92.8 on Terminal-Bench 2.1

read original get Keychron K2 Wireless Mechanical Keyboard → more articles
Why This Matters

Cognition's SWE-2 shows that post-training an open base model (Kimi K3, 2.8T params MoE) can put a smaller player within a point of frontier coding models on FrontierCode while claiming far lower costs. It's also the first time Cognition has pushed RL into the multi-trillion-parameter regime, and its efficiency gains — fewer steps, faster first edit, 81% lower cost at medium effort — matter more to developers than raw benchmark bragging. The weak Terminal-Bench 4.0 score is a reminder that long-horizon agentic work remains the frontier labs' moat.

Key Takeaways
Worth a Look

Keychron K2 Wireless Mechanical Keyboard — If you're spending your days steering coding agents through terminal benchmarks, the Keychron K2 gives you a compact 75% mechanical layout with dedicated function row for all those terminal shortcuts. It pairs over Bluetooth or USB-C and works with Mac and Windows layouts, so it slots into whatever machine your agent runs on. Hot-swappable switch options mean you can tune the feel for long sessions of prompt-and-review.

See Keychron K2 Wireless Mechanical Keyboard on Amazon → Affiliate link — we may earn a commission on purchases, at no extra cost to you. Product picked by AI based on this article; it is not a tested recommendation.

2.8T total params, 104B active per token (MoE) - the Kimi K3 base with Cognition’s post-training on top, and the first time Cognition has scaled RL into the multi-trillion-parameter regime. The base had already been RL-heavy for agentic coding; Cognition’s pass added another 5 to 6 points on most benchmarks.

Serving stack: MoE inference on NVFP4 and FP8 kernels with quantization-aware training; FP8 carries K, Q, V, and score computations in the MLA layers. A draft model retrained with SpecForge gives 15% longer accept lengths, and a prefill delayer lifts TPM per GPU and tokens/sec per request by 10 to 20% (TTFT takes the hit).

MoE inference on NVFP4 and FP8 kernels with quantization-aware training; FP8 carries K, Q, V, and score computations in the MLA layers. A draft model retrained with SpecForge gives 15% longer accept lengths, and a prefill delayer lifts TPM per GPU and tokens/sec per request by 10 to 20% (TTFT takes the hit). Effort levels: mean steps per run 53 (medium), 80 (high), 98 (max), against 127 for SWE-1.7. Medium posts a higher FrontierCode score than SWE-1.7 with 58% fewer turns and 81% lower average cost, and lands its first real edit at a median of step 18 (SWE-1.7: 48).

Benchmarks (Cognition self-reported): FrontierCode 1.1 Main 50.0, DeepSWE 1.1 73.0, Terminal-Bench 2.1 92.8, Terminal-Bench 4.0 27.3. The headline: 50.0 on FrontierCode is one point behind Claude Fable 5.1 (50.9) and 3.3 behind GPT-6 Astra (53.3) - at a claimed 64% lower cost than Fable 5.1 and a quarter of Astra’s. Terminal-Bench 2.1 is the highest number in the published table. The soft spot is Terminal-Bench 4.0, where SWE-2’s 27.3 trails Fable 5.1 (55.8) and GPT-6 Astra (57.9) by a wide margin - long-horizon agentic work is where the gap to the frontier still lives.

Proprietary weights, no local run. Cognition has not published SWE-2 weights, so there is nothing to download and no quant ladder to wait for. It is available today in Devin Desktop and CLI, with rollout on Devin Web and Fusion. Cognition publishes no per-token API for SWE-2, so the cost-per-task comparisons (64% cheaper than Fable 5.1 at FrontierCode parity) are the pricing surface, not a $/1M rate card. Every figure here is Cognition’s own number, pending independent replication.