Large language models can be used to estimate the results of social science experiments about as accurately as a group of human forecasters—even for experiments published after the models were trained—although they tended to overestimate effect sizes.
ReferencesBail, C. A. Can generative AI improve social science? Proc. Natl Acad. Sci. USA 121, e2314021121 (2024).Article
PubMed
PubMed Central
Google Scholar
Grossmann, I. et al. AI and the transformation of social science research. Science 380, 1108–1109 (2023).Article
When a standard large language model (LLM) is confronted with a problem, it tries to solve it by matching it to similar…
Large language models could advance experiments in the social sciences, but fundamental questions remain about how they should be…
Bigger has defined AI from day one. New data says task-specific small models beat frontier LLMs on accuracy, cost and speed — and…
Government-controlled media influences the output of large language models via their training data, and models queried in the…
Computer scientist Louis Castricato was in his eighth year studying large language models – the artificial intelligence…
Large language models aren’t trained on real-life conversations. As we encounter their language, it could affect our own
