Tech News
← Home  ·  All topics

Adversarial Distillation

2 GoKawiil briefs on this topic · RSS for adversarial distillation

OpenAI links actors tied to Moonshot AI to reasoning-extraction campaign

OpenAI says a coordinated campaign attempted to extract its models' hidden 'chain of thought' reasoning in July, with actors associated with China-based Moonshot AI at the center. Activity started July 1 and spiked to 16,000 extraction-pattern requests from over 4,000 users on July 24-25, before OpenAI says it fully disrupted the campaign by July 28. OpenAI says the encryption protecting this reasoning data was not broken and no user conversation database was compromised.

OpenAI says it disrupted campaign tied to Moonshot AI to extract model reasoning

OpenAI reported identifying and shutting down a coordinated effort, beginning in early July, to extract protected reasoning from its AI models through manipulated interactions rather than any breach of its systems. The activity peaked at 16,000 requests from over 4,000 users in two days, eventually involving a cluster of more than 15,000 users, and was fully disrupted by July 28. OpenAI linked a core part of the campaign to individuals associated with Chinese startup Moonshot AI, maker of Kimi, which has not responded to requests for comment.