GoKawiilHugging Face policy chief questions readiness of embedded AI evaluators
At TechCrunch Disrupt, Hugging Face chief policy officer Irene Solaiman said AI benchmarking remains an immature science, with unresolved issues around reproducibility and cross-test comparability. She said open-weight models help enable reproducible evaluations, but that standards for who qualifies as an effective evaluator are still lacking.