feat(cache): multi-slot LRU MRU partial block cache#1149

Draft

blightbow wants to merge 19 commits into

jundot:mainfrom

blightbow:feat/mru-partial-block-cache

Commits on May 13, 2026

feat(cache): add per-model cache hit-rate observability
ivaniguarans
committed
fix(cache): configure disk-max mock in cache observability tests
ivaniguarans
committed
feat(cache): MRU partial cache for repeat prompts

blightbow
and
claude
committed
fix(cache): close MRU partial review findings (C1-C3, H2-H3)

blightbow
and
claude
committed
docs(cache): pin MRU memory accounting invariant

blightbow
and
claude
committed
docs(cache): note pre-load admission's KV headroom in MRU docs

blightbow
and
claude
committed
chore(cache): bit-rot proof MRU docs and collapse test factories

blightbow
and
claude
committed
refactor(cache): factor _can_reconstruct, fix gate docstrings

blightbow
and
claude
committed
feat(cache): multi-slot LRU MRU partial cache

blightbow
and
claude
committed
fix(admin): clear_ssd_cache also wipes MRU partials

blightbow
and
claude
committed
feat(cache): observability counters for MRU partial cache

blightbow
and
claude
committed
refactor(cache): simplify MRU stack — dedupe test helpers, _evict_miss, Alpine getters

blightbow
and
claude
committed

Commits on May 14, 2026

fix(cache): surface MRU fields in get_stats_dict

blightbow
and
claude
committed

Commits on May 15, 2026