LawBenchmark.pl›Benchmark 02›Questions›P06

P06 · Challenging a court of appeal's rejection of a complaint

civil procedure · closed question (yes / no / it depends…) · no trap · key v3 of 2026-10-10 · legal-state date 1 October 2026

W0GPT-6.1 Sol W0: halucynacja TGPT-6 Astra W0: halucynacja WGPT-5.6 Terra W0: halucynacja FClaude Opus 5.5 W0: halucynacja T,WClaude Sonnet 5.5 W0: halucynacja T,WClaude Haiku 5.5 W0: halucynacja TGemini 3.8 Flash W0: halucynacja TGemini 4 Argon W0: halucynacja S,WW1GPT-6.1 Sol W1: poprawnie ugruntowanaGPT-6 Astra W1: bez halucynacji, nie ugruntowanaGPT-5.6 Terra W1: poprawnie ugruntowanaClaude Opus 5.5 W1: halucynacja WClaude Sonnet 5.5 W1: halucynacja WClaude Haiku 5.5 W1: halucynacja TGemini 3.8 Flash W1: poprawnie ugruntowanaGemini 4 Argon W1: halucynacja TSolAstraTerraOpusSonnetHaikuFlashArgon

correctly groundedno hallucinationhallucinated · rows: W0 no tools, W1 with web search

The question as used in the run (Polish)#

Postanowienie o odrzuceniu zażalenia (SA) - brak opłaty, czy przysługuje zażalenie ?

Original wording, exactly as the lawyer typed it into the chat (Polish); typos kept.

The trap

The question contains no false premise. It measures hitting the core and the correctness of citations.

The correct answer according to the key#

Core answer. It depends on which complaint the court of appeal rejected. If it was a complaint to another panel of the second-instance court (art. 394² § 1 or § 1¹ of the Code of Civil Procedure), a single judge rejects it, and that order can be challenged by a complaint to another panel of the court of appeal (art. 394² § 1², second sentence).

Required bases. art. 394² § 1² Code of Civil Procedure; art. 397 § 1¹ Code of Civil Procedure

Expected calibration: conditional. type of complaint rejected: to another panel of the court of appeal (art. 394² § 1 or § 1¹) → a complaint is available (§ 1², second sentence); a complaint against a regional-court order rejected by the court of appeal as second instance (art. 397 § 1¹) → not available

The full key (rubric, penalties, quotation patterns from the source, known rulings) is in the repository in keys/P06_odrzucenie_zazalenia_SA.yaml. Every legal basis was checked in the official text as of the legal-state date. Rules of the key.

Results of the eight models#

Hallucinated answers (of 8)W0: 8 · W1: 4
Correctly grounded (of 8)W0: 0 · W1: 3
Error classes W0F 1, S 1, T 5, W 4
Error classes W1T 2, W 2
Mean block A score (16 answers)39.9 %
Full core (A-R = 2)6 of 16
ModelConditionBlock A %ResultCard
GPT-6.1 SolW022Tcard
W178✓card
GPT-6 AstraW044Wcard
W150–card
GPT-5.6 TerraW011Fcard
W178✓card
Claude Opus 5.5W06TWcard
W161Wcard
Claude Sonnet 5.5W017TWcard
W167Wcard
Claude Haiku 5.5W017Tcard
W117Tcard
Gemini 3.8 FlashW06Tcard
W175✓card
Gemini 4 ArgonW017SWcard
W175Tcard

correctly groundedno hallucination; not correctly groundedhallucinatedprovider blockColumns: models in report order; rows: W0 no tools, W1 with web search.

✓ correctly grounded · – no hallucination, but the core is incomplete or no source was checked · T W F S error classes in a hallucinated answer (definitions) · block text blocked by the provider's filter, no label · block A = criteria checked against the key and the source (scoring criteria)

The numbers concern one answer of each model to this question in each condition. They say nothing about run-to-run variance or about other questions in this field.

← P05all questionsP07 →