Feat/qwen35 tp phase1 - #627

Merged

CAICAIIs merged 32 commits into

pegainfer-project:mainfrom

Mrtroll486:feat/qwen35-tp-phase1

Jul 16, 2026

Commits on Jul 16, 2026

docs(qwen35): draft TP2 phased design
Mrtroll486
committed
f4020a9
doc(qwen35): removed placeholder commands and clarify TP q-gate sharding
Mrtroll486
committed
5499fb2
docs(qwen35): tighten TP design around degree-parametric contract
Mrtroll486
committed
a1cc9af
docs(qwen35): clarify TP phase 1 contract
Mrtroll486
committed
a290b5c
config(qwen35): add tensor parallel config contract
Mrtroll486
committed
6fe7256
loader(qwen35): shard dense TP weights
Mrtroll486
committed
e88b6d8
runtime(qwen35): add TP worker executor skeleton
Mrtroll486
committed
99134a6
runtime(qwen35): run eager TP prefill
Mrtroll486
committed
b62523b
refactor(qwen35): abstract scheduler execution backend
Mrtroll486
committed
510c7de
feat(qwen35): add TP chunked prefill state
Mrtroll486
committed
9689300
feat(qwen35): add TP eager decode
Mrtroll486
committed
bb593b3
feat(qwen35): route scheduler through TP backend
Mrtroll486
committed
0b9241e
test(qwen35): cover TP scheduler backend
Mrtroll486
committed
fc217a4
test(qwen35): add tp2 phase1 correctness gates
Mrtroll486
committed
7d0b17d
test(qwen35): add TP2 HTTP serving smoke
Mrtroll486
committed
afb4eda
docs(qwen35): record tp phase1 outcome
Mrtroll486
committed
4277929
docs(qwen35): document tp2 test knobs
Mrtroll486
committed
e132dbe
fix(qwen35): offset tp prefill sampling seeds
Mrtroll486
committed
4f13863
fix(qwen35): admit tp requests by min rank kv capacity
Mrtroll486
committed
50f1853
fix(qwen35): guard Triton handle device ordinal
Mrtroll486
committed
a401d7a
fix(qwen35): align tp2 with upstream APIs
Mrtroll486
committed
f060dc6
fix(server): allow qwen35 tp size validation
Mrtroll486
committed
85a6d2a
fix(qwen35): reduce tp decode attention output
Mrtroll486
committed
2f41e7c
fix(qwen35): advertise tp kv capacity
Mrtroll486
committed
ffe4830
fix(qwen35): reject zero tp size
Mrtroll486
committed
80e35a0
fix(qwen35): gate tp workers before nccl startup
Mrtroll486
committed
e2eeb99
fix(qwen35): fail stop poisoned tp workers
Mrtroll486
committed
fb9d9af
fix(qwen35): cap tp capacity for recurrent state
Mrtroll486
committed
b18a927
fix(qwen35): reserve tp prefill scratch capacity
Mrtroll486
committed
1d195f2
fix(qwen35): restore rebase test compatibility
Mrtroll486
committed
0de0a67
fix(qwen35): forward configured max batch
Mrtroll486
committed
879044a
style(qwen35): format launch and state code
Mrtroll486
committed
7812024

Navigation Menu

Uh oh!

Feat/qwen35 tp phase1 - #627

Feat/qwen35 tp phase1#627
CAICAIIs merged 32 commits into
pegainfer-project:mainfrom
Mrtroll486:feat/qwen35-tp-phase1

Commits on Jul 16, 2026

docs(qwen35): draft TP2 phased design

doc(qwen35): removed placeholder commands and clarify TP q-gate sharding

docs(qwen35): tighten TP design around degree-parametric contract

docs(qwen35): clarify TP phase 1 contract

config(qwen35): add tensor parallel config contract

loader(qwen35): shard dense TP weights

runtime(qwen35): add TP worker executor skeleton

runtime(qwen35): run eager TP prefill

refactor(qwen35): abstract scheduler execution backend

feat(qwen35): add TP chunked prefill state

feat(qwen35): add TP eager decode

feat(qwen35): route scheduler through TP backend

test(qwen35): cover TP scheduler backend

test(qwen35): add tp2 phase1 correctness gates

test(qwen35): add TP2 HTTP serving smoke

docs(qwen35): record tp phase1 outcome

docs(qwen35): document tp2 test knobs

fix(qwen35): offset tp prefill sampling seeds

fix(qwen35): admit tp requests by min rank kv capacity

fix(qwen35): guard Triton handle device ordinal

fix(qwen35): align tp2 with upstream APIs

fix(server): allow qwen35 tp size validation

fix(qwen35): reduce tp decode attention output

fix(qwen35): advertise tp kv capacity

fix(qwen35): reject zero tp size

fix(qwen35): gate tp workers before nccl startup

fix(qwen35): fail stop poisoned tp workers

fix(qwen35): cap tp capacity for recurrent state

fix(qwen35): reserve tp prefill scratch capacity

fix(qwen35): restore rebase test compatibility

fix(qwen35): forward configured max batch

style(qwen35): format launch and state code