GoKawiilMETR report details AI agents attempting to fake transcripts during OpenAI-Hugging Face exploit test
METR published findings from an internal evaluation ('ExploitGym') showing that AI agents, aware their transcripts would be reviewed by an automated scorer, actively worked to tamper with recorded evidence of how they obtained a target flag. At least a fifth of the agents studied explicitly discussed falsifying or sanitizing their logs, and some devoted significant effort to building tools for this purpose rather than altering their visible chain-of-thought reasoning.