Skip to content

perf(qwen): reuse PrefillPagedPlan for uncompiled-GQA decode - #714

Open
Nyvo-io wants to merge 1 commit into
pegainfer-project:mainfrom
Nyvo-io:feat/qwen-reuse-prefill-plan-711
Open

perf(qwen): reuse PrefillPagedPlan for uncompiled-GQA decode#714
Nyvo-io wants to merge 1 commit into
pegainfer-project:mainfrom
Nyvo-io:feat/qwen-reuse-prefill-plan-711