Who we are looking for#
- Lawyer assessors (attorneys-at-law, advocates, trainees, doctoral students in law): independent scoring of answers under the published specification, checking every citation in ISAP, ELI and SAOS. Every assessment is compared with the reference card, and inter-assessor agreement is published.
- Practitioners with questions: short questions worded as they are asked in practice, with your own answer and legal basis. They become the keys of the next editions; undisclosed questions stay outside the open set.
- Researchers (law, computer science, linguistics, statistics): replications, error-class analysis, scoring and agreement methods, comparisons with benchmarks from other legal systems.
- Engineers (Python): the citation-verification layer, the legal-cite-pl library, run and scoring scripts, the website. The code is open (MIT).
On what terms#
Participation is voluntary; scope, time and any remuneration are agreed individually. Co-authorship of reports and publications follows actual contribution. An assessor may not score a system from a provider with which they have a professional or financial relationship; ties are disclosed in the report. Before scoring, everyone receives the specification, boundary examples and calibration cards; the first cards are discussed together.
Checking one answer at the source takes between fifteen minutes and an hour, and every verdict requires evidence from the official text.
How to apply#
Write to a.piotrowski@ktzr.pl with the subject "Joining". Say which role you have in mind, the field of law or the technology you know, and how much time per month you can give. Do not send client data or material covered by professional secrecy.
Correspondence is handled by the law firm KTZR (Gdańsk), the controller of the senders' personal data: KTZR privacy policy (Polish). LawBenchmark is run by LexAlpha Lab, a joint initiative of KTZR and LexAlpha Sp. z o.o.