Distillation - GoKawiil

Anthropic Accuses Chinese Firms Including Moonshot AI of Illicitly Copying Claude

Anthropic's threat intelligence chief Jacob Klein says foreign actors, particularly in China, are using illegal methods to extract outputs from its Claude models and train cheaper rival systems, a practice known as distillation. He named Moonshot AI's Kimi K3 model as an example of technology he believes was built this way, describing an organized effort to evade Anthropic's account and access controls at scale.

cnbc.com · 2026-09-03

Baseten explains how inference engineers trade off latency, throughput and cost for LLMs

A technical breakdown describes the 'efficient frontier' concept in LLM inference, distinguishing techniques that shift performance along a fixed tradeoff curve—like sacrificing latency for throughput or intelligence for speed—from techniques that expand the frontier itself, creating more overall efficiency. Examples cited include quantization, distillation, pruning, and reasoning-level adjustments, applied in the context of running large agentic coding models such as GLM-5.3 or Kimi K3 with KV cache reuse.

baseten.co · 2026-09-01