Skip to content

ops: add a machine-readable current-run source of truth#11

Merged
AuraIis merged 7 commits into
mainfrom
ops/current-run-truth
Jul 10, 2026
Merged

ops: add a machine-readable current-run source of truth#11
AuraIis merged 7 commits into
mainfrom
ops/current-run-truth

Conversation

@AuraIis

@AuraIis AuraIis commented Jul 10, 2026

Copy link
Copy Markdown
Owner

Why

The server had been executing a stale, divergent NEWGPT/v2data tree while repository status/config files described other states. A run manifest must bind code, checkpoint, tokenizer, environment and data together.

Measured values recorded

  • 65% DE / 15% EN / 12% Code / 8% Math+Science
  • base corpus20b_codeheavy/step_60000: 3.93B tokens seen, val 1.843, gate 0.14
  • tokenizer measured hash prefix a24fbea439bc8b78
  • runtime torch 2.7.0+cu128 and required TRITON_OVERRIDE_ARCH=sm89
  • reported base environment torch 2.12/cu130
  • measured 7.46B German tokens and the three component sizes
  • explicit rejection of the 25-byte corpus20b/de_curated.bin stub
  • successful bit-identical 1-GPU resume check
  • documented sparse-attention/flash state-dict parity and semantic difference
  • running FineWeb2-HQ-DE retention measurement

Deliberate blockers

Unknown server-only values remain YAML null and are listed under launch_blockers: exact launch commit, full tokenizer SHA-256, German component hashes, reference manifest and FineWeb2 dedup report.

Tests enforce the mix, clean-checkout policy, stub ban, pending provenance and Blackwell override. STATUS.md remains the historical capability snapshot and now points planned runs to this manifest.

@AuraIis
AuraIis merged commit e01acb6 into main Jul 10, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant