screamingface
Leaderboard

DRACO 3-Pass

The DRACO 100-case reproduction judged three times per answer instead of five. Identical dataset, criteria, Judge, and retrieval policy to the canonical board β€” only the judge-pass count differs. The draco-cache-seed archive covers exactly these three passes, so re-running its candidates is served fully from the shared response cache; scores carry their own benchmark revision and are not compared against five-pass results. Answer format: a free-text research report, no fixed format. A judge checks it against each line of a weighted rubric, one line at a time over several passes: a met positive line adds its weight and a met negative line, an error the report makes, subtracts. The score is earned over winnable weight, kept between 0 and 1.

about The leaderboard's top row is the current state of the art. Every submission carries its url4 expression, a complete recipe for the run. Copy it with the Copy button in the Run Locally column to rerun, verify or build on any score here.
Loading…
😱 screamingface GitHub