Skip to content

feat(megatron): Add support for Gated Delta Net (GDN) & Kimi Delta Attention (KDA) - #676

Merged
wenxie-amd merged 51 commits into
mainfrom
clairlee/kda-optimized-training-patch
Jul 29, 2026
Merged

feat(megatron): Add support for Gated Delta Net (GDN) & Kimi Delta Attention (KDA)#676
wenxie-amd merged 51 commits into
mainfrom
clairlee/kda-optimized-training-patch

Merge branch 'main' into clairlee/kda-optimized-training-patch

afc9595
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar