Skip to content

Record: 12L + Catalytic Residuals + BigramHash(10240) + SWA + Late QAT (val_bpb=1.1466, mean 3 seeds)#450

Open
zachgoldfine44 wants to merge 1 commit into
openai:mainfrom
zachgoldfine44:submission/12L-catalytic-bigbigram-swa
Open

Record: 12L + Catalytic Residuals + BigramHash(10240) + SWA + Late QAT (val_bpb=1.1466, mean 3 seeds)#450
zachgoldfine44 wants to merge 1 commit into
openai:mainfrom
zachgoldfine44:submission/12L-catalytic-bigbigram-swa

Commits

Commits on Mar 22, 2026