Tech News
← Home  ·  All topics

Sol 6 2

1 GoKawiil brief on this topic · RSS for sol 6 2

Astra 6.2 and Sol 6.2 underperform humans on SimpleBench reasoning test

SimpleBench, a multiple-choice benchmark testing spatio-temporal reasoning, social intelligence, and trick questions, found non-specialized human testers scored 83.7% on average, beating all tested LLMs. The top-scoring model, Claude Fable, reached 81.9%, while Astra 6.2 and Sol 6.2 scored lower still, according to the benchmark's creators who tested nine human participants against the models.