1,838 physical-commonsense questions: pick the better of two solutions to an everyday goal (the PIQA validation set), imported from inspect_evals by Task replay: the Cases are fetched the way inspect fetches them and sealed by a Case Digest. Two of its three Case Sources are unpinned downloads, so the Case Digest is their only pin. Graded by inspect's choice scorer against the published answer, so no judge tokens are spent. Benchmark score = plain accuracy over the cases run. Answer format: end the reply with a line like 'ANSWER: B', the letter of one option. A period after it still counts, as in 'ANSWER: B.', and so does a wrapper around the letter, as in 'ANSWER: $B$', 'ANSWER: (B)', 'ANSWER: **B**' or 'ANSWER: \boxed{B}', or a bold label, as in '**ANSWER:** B'. Words after the letter, as in 'ANSWER: B because it is red', or a reply with no 'ANSWER:' line, as in 'The answer is B', are read as no answer and score 0, even when the letter is right.