Record: Trinity SLOT v3 + Pre-Quant TTT — val_bpb 0.65802 (3-seed mean)#1722

Closed

deborahnelson8788726 wants to merge 17 commits into

openai:mainfrom

deborahnelson8788726:trinity-v3-clean

Commits on Apr 2, 2026

Record: Trinity Ternary GPT — val_bpb 0.9650 (ternary roundtrip)

authored and
SSD DDD
committed
Fix critical bugs in ternary export/import and DDP eval

authored and
SSD DDD
committed
v3: Late QAT + smaller model (11L 512d MLP3x) for stability

authored and
SSD DDD
committed
v3 final: val_bpb=1.8310 (int8 roundtrip) on 8xH100 SXM

authored and
SSD DDD
committed
v4: Trinity Hybrid — val_bpb 1.1357 (training, top-5 level)

authored and
SSD DDD
committed
v4-fix: int6 GPTQ all weights, MLP 3.5x — roundtrip val_bpb 1.1381

authored and
SSD DDD
committed
v4final: MLP 3.5x → roundtrip val_bpb 1.1279 (sliding window)!

authored and
SSD DDD
committed

Commits on Apr 3, 2026

PR cleanup: single submission folder, honest results, full compliance

authored and
SSD DDD
committed

Commits on Apr 4, 2026

FINAL: val_bpb 1.1251 — artifact 15.90MB — within 16MB limit!

authored and
SSD DDD
committed

Commits on Apr 5, 2026

v5: MLP 3.0x + optimized Score-First TTT

authored and
SSD DDD
committed
Fix best result: val_bpb 1.1251 (8xH100, MLP 3.25x)

authored and
SSD DDD
committed
3-seed results on 8xH100 SXM: mean val_bpb 1.1304

authored and
SSD DDD
committed
FINAL: 3-seed 8xH100 results — mean val_bpb 1.1304 (#5-6)

authored and
SSD DDD
committed

Commits on Apr 6, 2026

🏆 Trinity SLOT v2: val_bpb 0.6680 — NEW RECORD on 8xH100 SXM

authored and
SSD DDD
committed
🏆 Trinity SLOT v2: 3-seed mean val_bpb 0.66757 — NEW RECORD

authored and
SSD DDD
committed
Trinity v3: Pre-quant TTT + SLOT cascade — 3-seed mean 0.65802

authored and
SSD DDD
committed

Commits on Apr 18, 2026

Update README to match v3 submission (TTT + SLOT, 0.65802, 3-seed)

authored and
SSD DDD
committed