Evaluations · ev-0002
qualitative-coding@0.2.0: stress test
Agreement with human coders stays above 0.75 up to 6,000 words per transcript.
Example with invented datatemplatestress
Record
block: qualitative-coding@0.2.0 test: stress material: Interview corpus, 240 transcripts, coded by two humans model: a named model and version runs: 36 in total, 7 failed, 2 aborted result: Agreement with human coders stays above 0.75 up to 6,000 words per transcript. breaking: Agreement falls below 0.75 at about 7,000 words. evaluator: Demo contributor, contributor role "validation" scope: Valid for this corpus; other corpora need their own record. date: 2026-12-02
The record counts failed and aborted runs, because reporting only successful runs overstates performance.