Large language models can predict the results of social science experiments

Bail, C. A. Can generative AI improve social science? Proc. Natl Acad. Sci. USA 121, e2314021121 (2024).

Grossmann, I. et al. AI and the transformation of social science research. Science 380, 1108–1109 (2023).

Luo, X. et al. Large language models surpass human experts in predicting neuroscience results. Nat. Hum. Behav. 9, 305–315 (2025).

Crockett, M. & Messeri, L. Should large language models replace human participants? Preprint at PsyArXiv https://doi.org/10.31234/osf.io/4zdx9 (2024).

Abdurahman, S. et al. Perils and opportunities in using large language models in psychological research. PNAS Nexus 3, pgae245 (2024).

Argyle, L. P. et al. Out of one, many: using language models to simulate human samples. Polit. Anal. 31, 337–351 (2023).

Bisbee, J., Clinton, J. D., Dorff, C., Kenkel, B. & Larson, J. M. Synthetic replacements for human survey data? The perils of large language models. Polit. Anal. 32, 401–416 (2024).

Atari, M., Xue, M. J., Park, P. S., Blasi, D. & Henrich, J. Which humans? Preprint at PsyArXiv https://doi.org/10.31234/osf.io/5b26t (2023).

Dillion, D., Tandon, N., Gu, Y. & Gray, K. Can AI language models replace human participants? Trends Cogn. Sci. 27, 597–600 (2023).

Filippas, A., Horton, J. J. & Manning, B. S. Large language models as simulated economic agents: what can we learn from homo silicus? In Proc. 25th ACM Conference on Economics and Computation 614–615 (ACM, 2024).

... continue reading