Skip to content

Can GenAI Improve Academic Performance? Evidence from the Social and Behavioral Sciences

Summary

An author-level panel study (Scopus, 2021–2024) estimating how GenAI adoption affected publication output and quality in the social and behavioural sciences. Adopters are identified from shifts in AI-related linguistic markers in titles and abstracts post-ChatGPT and compared with matched non-adopters via a difference-in-differences design with nearest-neighbour matching.

Contribution

The authors report "sizable increases in research productivity, measured by the number of published papers" and "moderate gains in publication quality, based on journal impact factors," with the strongest effects among early-career researchers, authors in technically complex subfields, and authors from non-English-speaking countries. They interpret this as evidence that GenAI may lower structural barriers in academic publishing.

Method

Difference-in-differences with nearest-neighbour matching on an author-level Scopus panel; GenAI adoption is a behavioural proxy based on linguistic markers in published text.

Relevance to RISE

Direct large-N evidence on the outcome side of GenAI-assisted research that RISE-style pipelines aim to automate: it provides a baseline for what gains look like when humans simply use GenAI tools, against which fully agentic systems like e2er or sakana-ai-scientist can be benchmarked.

Critique / open questions

Adoption is inferred from linguistic markers, which conflates "writing with GenAI" with "doing research with GenAI" and risks detector-style bias. The quality measure (journal impact factor) is crude and lags adoption.

Key quotes

"We find that GenAI adoption is associated with sizable increases in research productivity, measured by the number of published papers. It also leads to moderate gains in publication quality, based on journal impact factors."

"These effects are most pronounced among early-career researchers, authors working in technically complex subfields, and those from non-English-speaking countries."