Evaluations · ev-0003
systematic-review@0.1.0: benchmark test
Recall of included studies 0.91; precision 0.62. Most misses were conference papers without abstracts.
Example with invented datatemplatebenchmark
Record
block: systematic-review@0.1.0 test: benchmark material: Search and screening of a published review, compared with its list of included studies model: a named model and version runs: 10 in total, 1 failed, 0 aborted result: Recall of included studies 0.91; precision 0.62. Most misses were conference papers without abstracts. evaluator: Noor Haddad, contributor role "validation" scope: One review in one field; recall in other fields is untested. date: 2027-03-03
The record counts failed and aborted runs, because reporting only successful runs overstates performance.