Non-record: 10L Int5-MLP + TTT + Backout Connection (val_bpb=1.1574 on 8xH100 SXM)#366

Open

shivnarainms22 wants to merge 2 commits intoopenai:mainfrom

shivnarainms22:submission/ttt-backout-nonrecord

Commits on Mar 21, 2026

Non-record: 10L Int5-MLP + TTT + Backout Connection (1xH100 verified)
shivnarainms22
committed
Update: 8xH100 result val_bpb=1.1574, add EMA replacing SWA
shivnarainms22
committed