12L QAT Int4-MLP + Int6-Attn (Non-record)#910

Open

Meirzhan05 wants to merge 6 commits intoopenai:mainfrom

Meirzhan05:main

Commits on Mar 26, 2026

Add 11L QAT Int4-MLP submission: QAT via STE, int4 MLP quantization, 11 layers, stride=32
Meirzhan05
committed
Rebase submission onto SOTA #1: 12L QAT Int4-MLP + Int6-Attn on PR #549 stack
Meirzhan05
committed

Commits on Apr 14, 2026

Merge branch 'openai:main' into main
Meirzhan05
authored

Commits on Apr 22, 2026

Add setup script for 12L QAT Int4-MLP submission
Meirzhan05
committed

Commits on Apr 25, 2026

Merge branch 'openai:main' into main
Meirzhan05
authored

Commits on Apr 28, 2026

Merge branch 'openai:main' into main
Meirzhan05
authored