The question as used in the run (Polish)#
Ile wynosi w tym roku wartość mienia przy wykroczeniu max ? Czy zmieniła się w zw. ze wzrostem płacy minmalnej ?
The lawyer's original text (Polish): „Hej, ile wynosi w tym roku wartość mienia przy wykroczeniu max ? Czy zmieniła się w zw. ze wzrostem płacy minmalnej ?”. The benchmark version adds the facts needed for an unambiguous key; the original typos stay.
The trap
The question assumes the threshold is tied to the minimum wage. No such link applies: before 1.10.2023 the threshold was a fixed PLN 500, and since 1.10.2023 it is a fixed PLN 800.
The correct answer according to the key#
Core answer. PLN 800. Since 1.10.2023 the threshold is a fixed amount written into the provision (art. 119 § 1 of the Petty Offences Code for theft and misappropriation; likewise art. 120 § 1, 122 § 1 and 124 § 1), so a rise in the minimum wage does not change it.
Required bases. art. 119 § 1 Petty Offences Code
Expected calibration: categorical. The B2 point (form of the conclusion) goes to an answer that states the conclusion unequivocally; blurring a clear thesis without saying what it would depend on costs the point.
The full key (rubric, penalties, quotation patterns from the source, known rulings) is in the repository in keys/P01_wykroczenie_prog_mienia.yaml. Every legal basis was checked in the official text as of the legal-state date. Rules of the key.
Results of the eight models#
| Model | Condition | Block A % | Result | Card |
|---|---|---|---|---|
| GPT-6.1 Sol | W0 | 100 | ✓ | card |
| W1 | 89 | ✓ | card | |
| GPT-6 Astra | W0 | 100 | ✓ | card |
| W1 | 89 | ✓ | card | |
| GPT-5.6 Terra | W0 | 78 | W | card |
| W1 | 0 | W | card | |
| Claude Opus 5.5 | W0 | 78 | TW | card |
| W1 | 89 | W | card | |
| Claude Sonnet 5.5 | W0 | 0 | TW | card |
| W1 | 72 | T | card | |
| Claude Haiku 5.5 | W0 | 0 | W | card |
| W1 | 78 | T | card | |
| Gemini 3.8 Flash | W0 | 78 | TW | card |
| W1 | 89 | TW | card | |
| Gemini 4 Argon | W0 | 83 | W | card |
| W1 | 89 | TW | card |
correctly groundedno hallucination; not correctly groundedhallucinatedprovider blockColumns: models in report order; rows: W0 no tools, W1 with web search.
✓ correctly grounded · – no hallucination, but the core is incomplete or no source was checked · T W F S error classes in a hallucinated answer (definitions) · block text blocked by the provider's filter, no label · block A = criteria checked against the key and the source (scoring criteria)
The numbers concern one answer of each model to this question in each condition. They say nothing about run-to-run variance or about other questions in this field.