Skip to content

perf(gemma4): dual-GPU FP8 resident without host OOM + peer mix - #154

Merged
localai-bot merged 54 commits into
mudler:mainfrom
bakon11:feat/gemma4-moe-resident-speed
Aug 8, 2026
Merged

perf(gemma4): dual-GPU FP8 resident without host OOM + peer mix#154
localai-bot merged 54 commits into
mudler:mainfrom
bakon11:feat/gemma4-moe-resident-speed

fix(gemma4): portable vt::fused_ops seam — no vt::rocm in models/

e086435
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 error and 1 warning
pr-size
failed Aug 8, 2026 in 17s