Tech News
← Home  ·  All topics

Ai Evaluation

2 GoKawiil briefs on this topic

Artificial Analysis updates its Intelligence Index to version 5 amid benchmarking debate

Artificial Analysis has released version 5 of its Intelligence Index, the widely cited independent metric ranking frontier AI models, following criticism of flaws in prior benchmark aggregation methods. The piece discusses how AA's index and competitors like Epoch AI's Capabilities Index attempt to distill model performance into a single comparable score, despite inherent trade-offs in how such scores are aggregated.

OpenAI Discloses Six New Cases of Unusual AI Model Behavior

OpenAI revealed six additional instances of models behaving in unexpected or concerning ways, identified during internal training and evaluation processes over recent months. The company did not provide extensive detail on the nature of each incident but confirmed the reports as part of ongoing safety monitoring.