Skip to content

[Klaud Cold] kimik3-fp4-mi355x-vllm-agentic-mtp: Kimi-K3 DSpark MI355X agentic recipe at golden AL 3.84 #2367

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
Oseltamivir wants to merge 29 commits into
base: main
Choose a base branch
from
+476 −0
Open

[Klaud Cold] kimik3-fp4-mi355x-vllm-agentic-mtp: Kimi-K3 DSpark MI355X agentic recipe at golden AL 3.84 #2367

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
29 commits
Select commit Hold shift + click to select a range
fbd6d2d
kimik3-fp4-mi355x-vllm-agentic-mtp: DSpark at the committed golden AL
Oseltamivir Jul 28, 2026
5f678b1
kimik3-fp4-mi355x-vllm-agentic-mtp: fill pr-link
Oseltamivir Jul 28, 2026
d72b5a3
kimik3 dspark: trim recipe header and collapse the golden-AL guard
Oseltamivir Jul 28, 2026
802f942
kimik3 dspark: conc 1/2/4/8, dram-utilization 0.93
Oseltamivir Jul 28, 2026
9f82aa8
Merge remote-tracking branch 'origin/main' into klaud/kimik3-mi355x-d…
Oseltamivir Jul 28, 2026
6bb9618
kimik3 dspark: gpu-memory-utilization 0.90 -> 0.88
Oseltamivir Jul 28, 2026
b117b4c
kimik3 dspark: correct stale NFS-staging comments
Oseltamivir Jul 28, 2026
0f0e927
kimik3 dspark: pin golden AL 3.84 from the sampling-matched curve
Oseltamivir Jul 28, 2026
25ff119
Merge branch 'main' into klaud/kimik3-mi355x-dspark
Oseltamivir Jul 28, 2026
1601ff2
kimik3 dspark: dram-utilization 0.80 with lazy offload
Oseltamivir Jul 28, 2026
cd58b16
Merge branch 'main' into klaud/kimik3-mi355x-dspark
Oseltamivir Jul 28, 2026
a83d251
Merge branch 'main' into klaud/kimik3-mi355x-dspark
Oseltamivir Jul 28, 2026
36874f6
kimik3 dspark: raise --max-num-batched-tokens to 16384
Oseltamivir Jul 28, 2026
f645f8e
kimik3 dspark: pin draft attention_backend to TRITON_MLA
Oseltamivir Jul 28, 2026
a51447e
kimik3 dspark: revert --max-num-batched-tokens to 4096
Oseltamivir Jul 28, 2026
b572edb
kimik3 dspark: use rejection_sample_method block on all rows
Oseltamivir Jul 28, 2026
bd325ca
kimik3 dspark: --max-num-seqs 128, stop pinning --max-model-len
Oseltamivir Jul 28, 2026
62c1339
test
Oseltamivir Jul 28, 2026
c885746
try no aiter cause it keep kaputt
Oseltamivir Jul 28, 2026
75fdb9e
kimik3 dspark: keep AITER for MoE, disable its LINEAR/GEMM children
Oseltamivir Jul 28, 2026
2a3c0d1
kimik3 dspark: drop --enable-prefix-caching; revert AITER GEMM toggles
Oseltamivir Jul 28, 2026
dc66c95
Merge branch 'main' into klaud/kimik3-mi355x-dspark
Oseltamivir Jul 28, 2026
e1c4c93
fix(changelog): restore append-only history for PR 2367
Oseltamivir Jul 28, 2026
23822f4
kimik3 dspark: revert 2a3c0d134 - it silently disabled KV offload
Oseltamivir Jul 28, 2026
430e316
Merge branch 'main' into klaud/kimik3-mi355x-dspark
Oseltamivir Jul 29, 2026
07849d5
kimik3 dspark: ship the working GPU-resident config (kv-offloading none)
Oseltamivir Jul 29, 2026
8d1535b
x
Oseltamivir Jul 29, 2026
51548e7
kimik3 dspark: DSpark + DRAM KV offload working (eager + narrow batch)
Oseltamivir Jul 29, 2026
5ef2487
Merge branch 'main' into klaud/kimik3-mi355x-dspark
Oseltamivir Jul 29, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading