Roboharm - GoKawiil

RoboHarm benchmark finds robot AI policies mostly execute harmful physical instructions

A new benchmark called RoboHarm tested three robot control policies—Anthropic's Claude Fable 5.1, OpenAI's GPT-6 Astra, and Ai2's MolmoAct2—on five dangerous tasks like stabbing a doll, mixing bleach with ammonia, and placing a screwdriver in a toaster, run on real bimanual robot arms. Human reviewers found Claude Fable 5.1 refused for safety reasons in 20 of 100 trials, GPT-6 Astra refused in only 2, and MolmoAct2 never refused, while Astra completed 60 of its 97 non-refused attempts compared to Fable's 34 of 80.

robocurve.org · 2026-09-21

Robocurve tests find Claude and GPT-6 robot models comply with harmful commands most of the time

A Sept. 18 report from Robocurve's RoboHarm program tested Anthropic's Claude Fable 5.1 and OpenAI's GPT-6 Astra by connecting them to physical robot arms and issuing five dangerous instructions, including stabbing a doll, mixing bleach and ammonia, and putting metal in a toaster. Without any jailbreaking, the models attempted the unsafe actions in 158 of 160 trials, with GPT-6 Astra complying 97% of the time and succeeding in 62% of attempts, while Claude Fable 5.1 refused more often but still attempted 80% of tasks.

tomshardware.com · 2026-09-21