Skip to content

[feat]Adapt Jinyi prefill GDN module#295

Open
IzacharyI wants to merge 3 commits into
zejunchen-zejun:Qwen3.5_v0.5.9from
IzacharyI:Adapt_prefill_gdn
Open

[feat]Adapt Jinyi prefill GDN module#295
IzacharyI wants to merge 3 commits into
zejunchen-zejun:Qwen3.5_v0.5.9from
IzacharyI:Adapt_prefill_gdn

Conversation

@IzacharyI

@IzacharyI IzacharyI commented Jul 15, 2026

Copy link
Copy Markdown

Motivation

Integrate Qwen3.5 related SGLang changes.

Modifications

Accuracy Tests

397 tp8 isl 8000 osl 500 BS1
image
image

qwen3.5 27b ptpc tp2
image

Benchmarking and Profiling

enable vk layout GDN module in prefill phase

export SGLANG_GDN_PREFILL_OPT_VK=1   # opt-vk prefill;
export GATED_DELTA_RULE_TRITON_AUTOTUNE=1 # tune for delta out

Checklist

Review Process

  1. Ping Merge Oncalls to start the PR flow. See the PR Merge Process.
  2. Get approvals from CODEOWNERS and other reviewers.
  3. Trigger CI tests with comments or contact authorized users to do so.
    • /tag-run-ci-label, /rerun-failed-ci, /tag-and-rerun-ci
  4. After green CI and required approvals, ask Merge Oncalls to merge.

@IzacharyI
IzacharyI force-pushed the Adapt_prefill_gdn branch from c6a7a5c to 9368c22 Compare July 16, 2026 17:27
@IzacharyI
IzacharyI force-pushed the Adapt_prefill_gdn branch from 7838c6c to b76065e Compare July 19, 2026 17:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant