feat(ENG-EXPERT-STREAM-DEVICE): W0f — the dense weights were resident twice, and `--device cuda` now decodes a 369.97 GiB checkpoint on a 119.631 GiB GB10 (#1299) - #1427

Merged

localai-bot merged 6 commits into

mainfrom

row/ENG-EXPERT-STREAM-DEVICE-W0F-ON-MAIN

Aug 20, 2026

Commits on Aug 19, 2026

feat(ENG-EXPERT-STREAM-DEVICE): W0f — the dense weights were resident twice, and `--device cuda` now decodes a 369.97 GiB checkpoint on a 119.631 GiB GB10 (#1299)
mudler
committed
9c30dfe

Commits on Aug 20, 2026