Asking Good Questions Is Harder Than Giving Great Answers

March 18, 2025 Asking Good Questions Is Harder Than Giving Great Answers The tests we are using to assess the intelligence of AI are missing an essential aspect of human inquiry — the query itself by Dan Cohen Jacques-Louis David, “The Death of Socrates,” 1787, Metropolitan Museum of Art. Perhaps he asked too many good questions Recently, I sharpened a #2 pencil and took the history section of "Humanity's Last Exam.” Consisting of 3,000 extremely difficult questions, the test is intended for AI, not me. According to its creators and contributors, Humanity’s Last Exam will tell us when artificial general intelligence has arrived to supersede human beings, once a brilliant bot scores an A. I got an F. Actually, worse than that: Only one of my answers was correct, and I must admit it helped that the question was multiple choice. This is fairly embarrassing for someone with a PhD in history. What happened? Let me indulge in a standard academic humiliation-avoidance technique: examin ... Read full article.