From 9f6c0f62b06d67f1987f23e2d1a6d6f1097a2cce Mon Sep 17 00:00:00 2001 From: overthelex Date: Mon, 13 Jul 2026 21:59:25 +0300 Subject: [PATCH 1/2] docs: add CONTRIBUTIONS.md (author list + CRediT split) Author list per the email record (Terry J. C. Zhang and Zhijing Jin, 2026-06-18) and Terry's public Slack confirmation ("both co-first authors"): Terry* / Arian* / Volodymyr* co-first, equal contribution. CRediT role split is Vladimir's proposal, marked pending co-author sign-off (no acknowledgement on record yet). echr-verdict-free size corrected to 23,317 to match the dataset and prior records. Co-Authored-By: Claude Opus 4.8 (1M context) --- CONTRIBUTIONS.md | 55 ++++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 55 insertions(+) create mode 100644 CONTRIBUTIONS.md diff --git a/CONTRIBUTIONS.md b/CONTRIBUTIONS.md new file mode 100644 index 0000000..b3d04b0 --- /dev/null +++ b/CONTRIBUTIONS.md @@ -0,0 +1,55 @@ +# Author Contributions — LiveHumanRightsBench + +This file records the authorship and contribution agreement for the +LiveHumanRightsBench paper (working title; ICLR target, end-of-August 2026), +as agreed by email between the co-first authors and confirmed by the PI. + +## Author list + +As posted by Terry J. C. Zhang (email, 2026-06-18) and confirmed by +Zhijing Jin ("fully supportive of the author list", email, 2026-06-18): + +1. **Terry J. C. Zhang\*** (University of Toronto / ETH Zurich) +2. **Arian Khorasani\*** (Mila — Quebec AI Institute) +3. **Volodymyr Ovcharov\*** (LEX AI / legal.org.ua) + +\* co-first authors, equal contribution — each may list their name first +on their own CV. + +Middle authors (order to be finalized): Jerick Shi, Keenan, +Yu Fan / Jingwei Ni (ETH Zurich), Elliott Ash (ETH Zurich, to be +confirmed), Oxford advisors (TBC), Daniel, Ilias Chalkidis. +Senior/last: Zhijing Jin (PI, University of Toronto). + +## CRediT roles + +The author list above is confirmed (Terry J. C. Zhang and Zhijing Jin, +email, 2026-06-18; Terry publicly on Slack, "both co-first authors on +this paper"). The CRediT role split below was proposed by V. Ovcharov +(email, 2026-06-20) and is **pending co-author sign-off**: + +| CRediT role | Contributor(s) | +|---|---| +| **Conceptualization** | Terry J. C. Zhang, Volodymyr Ovcharov, Zhijing Jin | +| **Data Curation** | **Volodymyr Ovcharov** — ECtHR/HUDOC corpora ingestion (23,317-pair `echr-verdict-free`, 2,619-pair `echr-ukr-verdict-free`), verdict-leakage removal pipeline (truncation + LLM verification + conclusion scrub), the `echr-livehrb-static-2k` and `echr-livehrb-temporal-2k` evaluation sets, leakage audits (v1.1, 2026-07-03) | +| **Methodology** | **Volodymyr Ovcharov** — live (self-refreshing) benchmark design, contamination control (verdict-free construction, per-model pre/post-cutoff partitions), temporal axes (year bins 2017–2026; Ukraine pre/post 2022-02-24); **Terry J. C. Zhang** — perturbation-stability framework (summarization / framing / reconsideration) | +| **Software** | **Volodymyr Ovcharov** (data & live-refresh pipeline, experiment runners), **Arian Khorasani** (perturbation experiments on top of the pipeline) | +| **Investigation / Experiments & Evaluation** | **Arian Khorasani** and **Volodymyr Ovcharov** (shared) | +| **Resources / Funding (compute & API)** | Terry J. C. Zhang (OpenRouter, Bedrock credits), Volodymyr Ovcharov (Bedrock, DeepSeek API, data infrastructure) | +| **Writing — original draft** | co-first authors (Terry J. C. Zhang lead on framing/baselines sections; Volodymyr Ovcharov lead on data/benchmark-construction sections) | +| **Writing — review & editing** | all authors | +| **Supervision** | Zhijing Jin | + +## Data & code pointers + +- Datasets (HF, public, cc-by-4.0): `overthelex/echr-verdict-free`, + `overthelex/echr-ukr-verdict-free`, `overthelex/echr-livehrb-static-2k`, + `overthelex/echr-livehrb-temporal-2k` — all v1.1 + (conclusion-scrub leakage fix, 2026-07-03; see dataset READMEs). +- Pipeline & experiment code: this repository. + +## Change log + +- 2026-07-03 — initial version, per the email record of 2026-06-18/20. + Any changes to the author list or role split should be reflected here + by pull request so the record stays reviewable. From 2118a015174912a7c718591a1337f2016dc86c62 Mon Sep 17 00:00:00 2001 From: overthelex Date: Tue, 14 Jul 2026 16:05:48 +0300 Subject: [PATCH 2/2] docs(CONTRIBUTIONS): correct echr-verdict-free size to 23,204 The published v1.1 dataset has 23,204 pairs (matches the Jul 3 email); 23,317 was the pre-leakage-audit count. Reverts an earlier wrong edit. Co-Authored-By: Claude Opus 4.8 (1M context) --- CONTRIBUTIONS.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/CONTRIBUTIONS.md b/CONTRIBUTIONS.md index b3d04b0..3ede6ef 100644 --- a/CONTRIBUTIONS.md +++ b/CONTRIBUTIONS.md @@ -31,7 +31,7 @@ this paper"). The CRediT role split below was proposed by V. Ovcharov | CRediT role | Contributor(s) | |---|---| | **Conceptualization** | Terry J. C. Zhang, Volodymyr Ovcharov, Zhijing Jin | -| **Data Curation** | **Volodymyr Ovcharov** — ECtHR/HUDOC corpora ingestion (23,317-pair `echr-verdict-free`, 2,619-pair `echr-ukr-verdict-free`), verdict-leakage removal pipeline (truncation + LLM verification + conclusion scrub), the `echr-livehrb-static-2k` and `echr-livehrb-temporal-2k` evaluation sets, leakage audits (v1.1, 2026-07-03) | +| **Data Curation** | **Volodymyr Ovcharov** — ECtHR/HUDOC corpora ingestion (23,204-pair `echr-verdict-free`, 2,619-pair `echr-ukr-verdict-free`), verdict-leakage removal pipeline (truncation + LLM verification + conclusion scrub), the `echr-livehrb-static-2k` and `echr-livehrb-temporal-2k` evaluation sets, leakage audits (v1.1, 2026-07-03) | | **Methodology** | **Volodymyr Ovcharov** — live (self-refreshing) benchmark design, contamination control (verdict-free construction, per-model pre/post-cutoff partitions), temporal axes (year bins 2017–2026; Ukraine pre/post 2022-02-24); **Terry J. C. Zhang** — perturbation-stability framework (summarization / framing / reconsideration) | | **Software** | **Volodymyr Ovcharov** (data & live-refresh pipeline, experiment runners), **Arian Khorasani** (perturbation experiments on top of the pipeline) | | **Investigation / Experiments & Evaluation** | **Arian Khorasani** and **Volodymyr Ovcharov** (shared) |