Add native MLX backend and backend benchmarks - #57

Closed

i386 wants to merge 12 commits into

mainfrom

Commits on Mar 27, 2026

Add plugin outbound handle support
i386
committed
54f3235

Commits on Mar 29, 2026

Add native MLX backend and benchmarks
i386
committed
2c912c0
Improve MLX prompt caching and profiling
i386
committed
8ec3b6f
Add MLX chat prefix cache smoke
i386
committed
a9f3252
Use forked mlx-rs cache trim for MLX prefix reuse
i386
committed
dbbc380
Split benchmark matrix into main and cache phases
i386
committed
aab8c88
Retry backend startup in benchmark harness
i386
committed
ea2d4e7
Use native qwen2 from mlx-rs integration branch
i386
committed
d036513
Split qwen2 onto its own MLX engine path
i386
committed
fe95b0b
Use native qwen2 prefill and decode path
i386
committed
bf764fa
Improve native qwen2 cache reuse and benchmarking
i386
committed
b855022
Repin mlx-rs for contiguous Qwen2 KV views
i386
committed
fbd5d09