minimal gpt-oss implementation in pytorch.

Important

this repo is only for learning purposes.

components:

• RMSNorm (pre-norm)
• Grouped Query Attention with attention sinks and sliding window
• RoPE with YaRN
• Mixture-of-Experts (MoE) with gated router
• SwiGLU and KV-cache

reference: these banger repos by Vizuara and Hamza Elshafie