GoKawiilStudy finds 90% of US work hours untested by leading AI benchmarks
A new analysis mapped the US Department of Labor's O*NET taxonomy of 923 occupations and nearly 18,800 workplace tasks against 29 widely used AI benchmarks, including Mercor's APEX suite. The researchers found that only a small fraction of real-world work tasks, by weighted hours, are represented in these benchmarks, leaving roughly 90% of US working hours without benchmark coverage.