Record: SP8192 + SLOT scored-position + cross-batch EMA warmup: val_bpb=0.94569#1929

Open

davie2009kh wants to merge 2 commits intoopenai:mainfrom

davie2009kh:submission/slot-scored-position-ema

Commits on Apr 24, 2026

Record attempt: SP8192 + 3-Epoch Parallel Pre-Quant TTT + Huber WD Muon (SDPA-friendly) — val_bpb 1.07037 (3-seed mean)
davie2009kh
committed

Commits on Apr 29, 2026

SP8192 + SLOT scored-position + cross-batch EMA warmup: val_bpb=0.94569
davie2009kh
committed