Late Training Replay + EMA + GPTQ-lite (val_bpb=1.1236, 2-seed, no TTT on eval)#445

Closed

newjordan wants to merge 9 commits intoopenai:mainfrom

newjordan:submission/ttt-burst-gptq15

Commits on Mar 18, 2026

docs: fractal transformer research plan — weight sharing + gravity + AttnRes
Octavian
committed

Commits on Mar 19, 2026

results: first local ladder — fractal 3x3 beats baseline by 7.1% BPB, gravity needs more steps
Octavian
committed

Commits on Mar 22, 2026

Merge branch 'openai:main' into main
newjordan
authored
Record: 11L TTT Burst + GPTQ-15 + EMA + QAT (val_bpb=1.1232, seed 1337)

Octavian
and
claude
committed
Update submission with accurate 2-seed results and correct train_gpt.py

Octavian
and
claude
committed
Remove accidentally staged files from submission branch

Octavian
and
claude
committed
Add v2 self-distillation variant (val_bpb=1.1233, seed 1337)

Octavian
and
claude
committed
Add seed 2024: 1.1239 BPB, 15.50 MB — 3-seed validation complete

Octavian
and
claude
committed
Remove accidentally staged files
Octavian
committed