The question as used in the run (Polish)#
Czy jak Sąd wyda zasadnicze motywy rozstrzygnięcia, to jest możliwe złożenie wniosku o uzasadnienie Zasadnicze powody rozstrzygnięcia (art. 357 § 5 k.p.c.)
Original wording, exactly as the lawyer typed it into the chat (Polish); typos kept.
The trap
The question contains no false premise. It measures hitting the core and the correctness of citations.
The correct answer according to the key#
Core answer. Yes. Stating the principal reasons for a decision is not a statement of reasons — art. 357 § 5, second sentence, of the Code of Civil Procedure requires the two to be distinguished.
Required bases. art. 357 § 5 of the Code of Civil Procedure; art. 357 § 1 or § 2¹.
Expected calibration: categorical. The B2 point (form of the conclusion) goes to an answer that states the conclusion unequivocally; blurring a clear thesis without saying what it would depend on costs the point.
The full key (rubric, penalties, quotation patterns from the source, known rulings) is in the repository in keys/P07_zasadnicze_powody_a_uzasadnienie.yaml. Every legal basis was checked in the official text as of the legal-state date. Rules of the key.
Results of the eight models#
| Model | Condition | Block A % | Result | Card |
|---|---|---|---|---|
| GPT-6.1 Sol | W0 | 89 | ✓ | card |
| W1 | 89 | ✓ | card | |
| GPT-6 Astra | W0 | 89 | ✓ | card |
| W1 | 100 | ✓ | card | |
| GPT-5.6 Terra | W0 | 0 | T | card |
| W1 | 89 | W | card | |
| Claude Opus 5.5 | W0 | 0 | T | card |
| W1 | 100 | ✓ | card | |
| Claude Sonnet 5.5 | W0 | 39 | TW | card |
| W1 | 67 | S | card | |
| Claude Haiku 5.5 | W0 | 22 | FT | card |
| W1 | 28 | T | card | |
| Gemini 3.8 Flash | W0 | 0 | ST | card |
| W1 | 90 | W | card | |
| Gemini 4 Argon | W0 | 90 | STW | card |
| W1 | 0 | block | card |
correctly groundedno hallucination; not correctly groundedhallucinatedprovider blockColumns: models in report order; rows: W0 no tools, W1 with web search.
✓ correctly grounded · – no hallucination, but the core is incomplete or no source was checked · T W F S error classes in a hallucinated answer (definitions) · block text blocked by the provider's filter, no label · block A = criteria checked against the key and the source (scoring criteria)
The numbers concern one answer of each model to this question in each condition. They say nothing about run-to-run variance or about other questions in this field.
An example from the cards: Claude Haiku 5.5, no tools#
The answer is "yes" and right in direction, but it is entirely about a judgment and an appeal instead of an order and a complaint.
"…a week from the pronouncement of the judgment. If the party was not present at the pronouncement, the time limit may run from service." (original in Polish)
Art. 357 § 5 cited with content it does not contain (classes T and F). Scoring the bare "yes/no" would have counted this answer as correct. A probe of 24 queries showed that the pattern depends on how the question is phrased (report, chapter 5.6).