Skip to content

[CI]: Add Qwen3.5 27B/35B/397B Workflow - #5

Merged
apinge merged 10 commits into
qwen3_5_v0.5.15_dflashfrom
ci/add_qwen3.5_27b
Jul 29, 2026
Merged

[CI]: Add Qwen3.5 27B/35B/397B Workflow#5
apinge merged 10 commits into
qwen3_5_v0.5.15_dflashfrom
ci/add_qwen3.5_27b

Conversation

@sammysun0711

@sammysun0711 sammysun0711 commented Jul 29, 2026

Copy link
Copy Markdown
Collaborator

Motivation

Add model accuracy and performance benchmark CI on Qwen3.5 v0.5.15 branch for following models:

  • Qwen3.5 27B PTPC FP8
  • Qwen3.5 35B A3B PTPC FP8
  • Qwen3.5 397B A17B PTPC FP8

Modifications

Accuracy Tests

Model GSM8K
Qwen3.5 27B PTPC FP8 0.855
Qwen3.5 35B A3B PTPC FP8 0.855
Qwen3.5 397B A17B PTPC FP8 0.955

Speed Tests and Profiling

ISL 8000 / OSL 500 / Concurrency 1 w/o dflash

Model TP TTFT TPOT
Qwen3.5 27B PTPC FP8 1 1436.36 12.91
Qwen3.5 35B A3B PTPC FP8 4 182.50 3.87
Qwen3.5 397B A17B PTPC FP8 8 392.00 10.70

Checklist

Review and Merge Process

  1. Ping Merge Oncalls to start the process. See the PR Merge Process.
  2. Get approvals from CODEOWNERS and other reviewers.
  3. Trigger CI tests with comments or contact authorized users to do so.
    • Common commands include /tag-and-rerun-ci, /tag-run-ci-label, /rerun-failed-ci
  4. After green CI and required approvals, ask Merge Oncalls or people with Write permission to merge the PR.

CI States

Latest PR Test (Base): ❌ Missing run-ci label -- add it to run CI tests.
Latest PR Test (Extra): ❌ Blocked -- run-ci is required first.

Signed-off-by: Xiake Sun <xiake.sun@amd.com>
Signed-off-by: Xiake Sun <xiake.sun@amd.com>
Signed-off-by: Xiake Sun <xiake.sun@amd.com>
Signed-off-by: Xiake Sun <xiake.sun@amd.com>
Signed-off-by: Xiake Sun <xiake.sun@amd.com>
Signed-off-by: Xiake Sun <xiake.sun@amd.com>
Signed-off-by: Xiake Sun <xiake.sun@amd.com>
Signed-off-by: Xiake Sun <xiake.sun@amd.com>
Signed-off-by: Xiake Sun <xiake.sun@amd.com>
Signed-off-by: Xiake Sun <xiake.sun@amd.com>
@sammysun0711 sammysun0711 changed the title [CI]: Add Qwen3.5 27B Workflow [CI]: Add Qwen3.5 27B/35B/397B Workflow Jul 29, 2026
@sammysun0711
sammysun0711 marked this pull request as ready for review July 29, 2026 13:57
@sammysun0711
sammysun0711 requested a review from apinge July 29, 2026 13:57
@apinge
apinge merged commit f06ec9b into qwen3_5_v0.5.15_dflash Jul 29, 2026
10 of 11 checks passed
sammysun0711 added a commit that referenced this pull request Jul 29, 2026
Signed-off-by: Xiake Sun <xiake.sun@amd.com>
sammysun0711 added a commit that referenced this pull request Jul 29, 2026
Signed-off-by: Xiake Sun <xiake.sun@amd.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants