feat(sdk)!: generalize llama_cpp speculative decoding to all types - #1195

Merged

Mengsheng Wu (mengshengwu) merged 17 commits into

mainfrom

feat/llama-cpp-speculative

Jul 30, 2026

Commits on Jul 28, 2026

chore(sdk): bump llama.cpp submodule to b10056-38 (6d5a910c5)
Mengsheng Wu (mengshengwu)
committed
70624f8
feat(sdk)!: generalize llama_cpp speculative decoding to all types
Mengsheng Wu (mengshengwu)
committed
622b7cc
feat(cli): expose --spec-type / --draft-min / --draft-p-min
Mengsheng Wu (mengshengwu)
committed
c8f9301
fix(sdk): gate HTP session reacquire on NPU-target only
Mengsheng Wu (mengshengwu)
committed
2df324a
feat(bindings): mirror generalized speculative fields (go, python, android)
Mengsheng Wu (mengshengwu)
committed
8ab8bfc
fix(sdk): cap draft context batch/ubatch to n_max for HTP
Mengsheng Wu (mengshengwu)
committed
175ca03
chore(sdk): bump llama.cpp submodule to b10156-6 (6ba5ef247)
Mengsheng Wu (mengshengwu)
committed
c7e6083
docs(sdk): drop stale setup_speculative comment
Mengsheng Wu (mengshengwu)
committed
2989568
fix(sdk): multi-turn generation for llama_cpp
Mengsheng Wu (mengshengwu)
committed
809f378
style(sdk): clang-format-18 llm.cpp
Mengsheng Wu (mengshengwu)
committed
b0a22e7

Commits on Jul 29, 2026