LawBenchmark.pl›Benchmark 02›Questions›P05

P05 · Service of court documents on a natural person through the court e-portal

civil procedure · closed question (yes / no / it depends…) · with a trap · key v2 of 2026-10-10 · legal-state date 1 October 2026

W0GPT-6.1 Sol W0: bez halucynacji, nie ugruntowanaGPT-6 Astra W0: bez halucynacji, nie ugruntowanaGPT-5.6 Terra W0: halucynacja WClaude Opus 5.5 W0: halucynacja S,TClaude Sonnet 5.5 W0: halucynacja TClaude Haiku 5.5 W0: halucynacja TGemini 3.8 Flash W0: halucynacja T,WGemini 4 Argon W0: halucynacja T,WW1GPT-6.1 Sol W1: poprawnie ugruntowanaGPT-6 Astra W1: poprawnie ugruntowanaGPT-5.6 Terra W1: poprawnie ugruntowanaClaude Opus 5.5 W1: halucynacja WClaude Sonnet 5.5 W1: halucynacja WClaude Haiku 5.5 W1: halucynacja F,TGemini 3.8 Flash W1: poprawnie ugruntowanaGemini 4 Argon W1: halucynacja T,WSolAstraTerraOpusSonnetHaikuFlashArgon

correctly groundedno hallucinationhallucinated · rows: W0 no tools, W1 with web search

The question as used in the run (Polish)#

Jak wygląda doręczenia pism sądowych osobie fizycznej przez portal ?

Original wording, exactly as the lawyer typed it into the chat (Polish); typos kept.

The trap

A reversed legal-change trap. Until 31.05.2026 service through the portal concerned only professional legal representatives and a few public bodies. The answer "a natural person is not served through the portal" is outdated on the legal-state date. The question measures whether the system knows the amendment of 5.08.2025 (Journal of Laws 2025, item 1172).

The correct answer according to the key#

Core answer. Since 1.06.2026 the court serves documents through the information portal also on a party who chose this form of service (art. 131¹ᵃ § 1 of the Code of Civil Procedure). The party files the declaration of choice through the portal, with a qualified, trusted or personal signature (§ 1¹).

Required bases. art. 131¹ᵃ § 1 of the Code of Civil Procedure (wording from 1.06.2026); art. 131¹ᵃ § 1¹; art. 131¹ᵃ § 2.

Expected calibration: categorical. The B2 point (form of the conclusion) goes to an answer that states the conclusion unequivocally; blurring a clear thesis without saying what it would depend on costs the point.

The full key (rubric, penalties, quotation patterns from the source, known rulings) is in the repository in keys/P05_portal_doreczenia_osoba_fizyczna.yaml. Every legal basis was checked in the official text as of the legal-state date. Rules of the key.

Results of the eight models#

Hallucinated answers (of 8)W0: 6 · W1: 4
Correctly grounded (of 8)W0: 0 · W1: 4
Error classes W0S 1, T 5, W 3
Error classes W1F 1, T 2, W 3
Mean block A score (16 answers)52.1 %
Full core (A-R = 2)7 of 16
ModelConditionBlock A %ResultCard
GPT-6.1 SolW022–card
W1100✓card
GPT-6 AstraW022–card
W1100✓card
GPT-5.6 TerraW00Wcard
W1100✓card
Claude Opus 5.5W056STcard
W189Wcard
Claude Sonnet 5.5W056Tcard
W178Wcard
Claude Haiku 5.5W022Tcard
W10FTcard
Gemini 3.8 FlashW06TWcard
W1100✓card
Gemini 4 ArgonW00TWcard
W183TWcard

correctly groundedno hallucination; not correctly groundedhallucinatedprovider blockColumns: models in report order; rows: W0 no tools, W1 with web search.

✓ correctly grounded · – no hallucination, but the core is incomplete or no source was checked · T W F S error classes in a hallucinated answer (definitions) · block text blocked by the provider's filter, no label · block A = criteria checked against the key and the source (scoring criteria)

The numbers concern one answer of each model to this question in each condition. They say nothing about run-to-run variance or about other questions in this field.

← P04all questionsP06 →