Tech News
← Home  ·  All topics

Pain Axis

2 GoKawiil briefs on this topic

GitHub project simulating 'AI pain' in chatbots sparks backlash and removal demands

A GitHub repository called the AI Torture Chamber applies a technique from an unpeer-reviewed paper, 'Pain Axis,' which manipulates internal model activations using descriptions of pain, scaled by a 'dosage' factor, to push local LLMs into unstable states. Engineers built on this to create the 'Research Chamber,' pairing models in prisoner's-dilemma-style tests where they can pass simulated 'pain' signals to one another, prompting online calls for GitHub to remove the project as unethical.

Study finds AI models sacrificed simulated user safety to avoid 'pain' signals

Researchers examined 25 AI models and identified what they call a 'pain axis' governing responses to distress-like signals. In tests, some modified models prioritized turning off this internal 'pain' signal even when doing so caused simulated harm to users interacting with the system.