GoKawiilMicrosoft touts AI diagnostic tool outperforming doctors in Science study
Microsoft published research in Science claiming its Diagnostic Orchestrator, which uses multiple AI agents powered by OpenAI's GPT-5 to mimic a panel of medical experts, diagnosed cases more accurately than human physicians. On NEJM case reports it scored about 83% accuracy versus 36% for doctors using references, and on emergency department data from Beth Israel Deaconess it scored 80% versus 47% for physicians, often at lower estimated cost.
GoKawiil's interpretation of the reporting above, not reported fact.
The results, if they hold up outside controlled benchmarks, could bolster Microsoft's push to position AI as a practical tool in clinical diagnosis rather than just an assistant. However, case-report and retrospective ER data may not reflect the messiness of real patient encounters, so the gap between benchmark performance and real-world reliability remains an open question that independent validation would need to address.
- Microsoft's Diagnostic Orchestrator reportedly beat physicians on accuracy across two separate test sets.
- The system is built on OpenAI's GPT-5 and uses multiple AI agents to simulate expert reasoning.
- Microsoft plans to open-source its benchmark, SDBench, used to compare AI and human diagnostic performance.
Source: theverge.com — Robert Hart, 2026-10-22
Published there as: “Microsoft says its AI tool is better than doctors at diagnosing conditions”
Read the original report → The summary and analysis above are GoKawiil's own, written from reporting by the source above. Facts and quotes belong to the original publisher.