External pipelines · RISE project catalogue
Project APE
An autonomous system that generates empirical economic policy research papers end-to-end from publicly available data, then scores them via a TrueSkill tournament in which AI-generated papers compete head-to-head against peer-reviewed human benchmarks from AER and AEJ:Policy (judged by Gemini 3.1 Flash Lite). The motivating problem: "Most policies — probably millions of them globally — are never rigorously evaluated."
Where it sits
left: what it builds on · right: what builds on it · pale: exampleContributed by Social Catalyst Lab
How studies reach it
No published study reaches it yet.
Disciplines it reaches
No study reaches it yet.
Solid: published studies. Light: examples.
Computed from the records on this site: what each study, template and specialist names as used, which study extends which, and who contributed what. 0 studies in total.
What it does
*Combines* autonomous research generation with an explicit human-benchmark tournament — most catalog projects do one or the other. The TrueSkill ranking + AER/AEJ:Policy benchmark set is a reusable evaluation harness; everything (papers, code, data, failures) is published transparently. The project explicitly disclaims policy use: "None of the generated papers have been peer-reviewed and should not be used for evidence-based policy making."
- Focus
- end-to-end
- Inputs
- policy-question
- Outputs
- paper, code, data, tournament-ranking
- Architecture
- multi-agent, tool-use, artifact-versioning, debate-consensus
- Maintained by
- Social Catalyst Lab
- Started
- 2026
Description
Data model- Discipline
- Economics
- Method family
- not specified
- Design
- not specified
- Research stage
- HypothesesResearch designData acquisitionData analysisCode generationDraftingReviewReplication
- Contributors
- Social Catalyst Lab
- Usage
- not used in published research yet
- Source
- RISE project catalogue · projects/landscape · @4c17bae
- Record
- pipeline:ape · JSON
Solid tags are declared by the source or mapped from its terms; dashed tags are inferred by a published rule. Hover a tag for its provenance.
Bring it into the standard
A pipeline built outside E2ER can meet the standard by describing its steps as a template, attaching the floor of checks and publishing evaluation records. Its authors keep ownership and credit.