Expanded long-text compression benchmark

100 LongBench questions across five datasets, 97 distinct source inputs, three repeats per condition.
Answer generation: Terra medium. Validation: source-aware Terra low with Sol low escalation.
Official QA F1/ROUGE-L and every saved answer remain inspectable.

The initial report view measures accepted model compressions against matching original controls.
Protected fallbacks and intentional skips have separate views; all-input results remain visible.
Scope membership uses preparation decisions, never answer quality. Read analysis-policy.json in raw/.

report.html: portable interactive report, quality coverage, source audits, strikeouts and cost controls.
report.json: full source texts, prompts, observed answers and judgments, costs and all decision groups.
analysis.json, source-audits.json, integrity-guards.json: calculations and deeper evidence.
semantic-review.json: complete combined validation; individual raw/ shard folders retain all citations and calls.
raw/: frozen inputs, runs, logs, validator calibration, source audits and exact code snapshots.
A CSV export bug interrupted one answer and one review. The two jobs were explicitly replaced; all original artifacts are preserved. Their interrupted usage is unavailable.
Costs are dated API-equivalent scenarios, not subscription charges; review overhead is separate.

Rebuild the report offline, from this directory, after installing reproduce/requirements-remote-benchmark.txt:
python reproduce/scripts/expanded_longtext_benchmark.py build --work raw --out rebuilt
This makes no compression, answer-generation or judge calls.
For fresh answer replication, use reproduce/scripts/codex_benchmark.py run with a frozen raw/shards/<dataset>/manifest.json and a new output directory. Subscription-authenticated Codex CLI is required.
The raw/frozen-code folder preserves the exact generation/scoring/validation implementations used.
checksums.json covers every packaged member other than itself; archive-validation.json records the verified archive hash. No credential is exported.
