Skip to content

Separate q,k,v projection in sliding attention layers - #3376

Merged
patrickji2014 merged 3 commits into
mainfrom
patrickji.qkv_weight_unmerge
Aug 13, 2026
Merged

Separate q,k,v projection in sliding attention layers#3376
patrickji2014 merged 3 commits into
mainfrom
patrickji.qkv_weight_unmerge

Commits

Commits on Aug 11, 2026

Commits on Aug 12, 2026