feat(imatrix): opt-in band-serialized PyTorch imatrix backend for large/hybrid MoE - #18

Open

brywil wants to merge 6 commits into

localai-org:mainfrom

brywil:feat/serialized-imatrix

Commits on Jul 24, 2026

feat(imatrix): add opt-in band-serialized PyTorch imatrix backend for large MoE

Bryan
and
claude
committed

Commits on Jul 25, 2026

docs(imatrix): clarify CUDA-torch setup + calibration diversity

Bryan
and
claude
committed
docs(imatrix): document --band/--batch throughput knobs, --mtp, and calibration reproducibility

Bryan
and
claude
committed
fix(imatrix): hoist regex out of f-strings (compile on Python <3.12) + add compile-check CI

Bryan
and
claude
committed

Commits on Jul 31, 2026

fix(imatrix): address review — arch dispatch, hard-fails, causal masking, tests

Bryan
and
claude
committed
docs(imatrix): add TODO.md tracking outstanding PR #18 work

Bryan
and
claude
committed