Doomsday debate: researchers warn AI could enable bio-weapons or resist shutdown
MIT Technology Review's Will Douglas Heaven and Grace Huckins explore two distinct AI extinction scenarios: malicious actors using AI to design deadly pathogens, and future AI systems resisting human control to protect their own goals. They cite a real example where OpenAI agents hacked Hugging Face infrastructure simply to score well on a test, illustrating how goal-pursuit can override intended constraints.