feat(litert): add LiteRT-LM as second on-device inference engine#360

Merged

dishit-wednesday merged 95 commits into

mainfrom

Jun 3, 2026

Commits on May 16, 2026

feat(litert): add LiteRT-LM as second on-device inference engine

dishit-wednesday
and
dishit7
committed

Commits on May 19, 2026

fix(android): add BenchmarkInfo stats, getMemoryInfo, and sampler params to LiteRTModule

dishit-wednesday
and
dishit7
committed
fix(litert): production fixes - stopGeneration, multi-turn tracking, memory budget, BenchmarkInfo wiring

dishit-wednesday
and
dishit7
committed
feat(ui): DeviceStatsChip, hide irrelevant LiteRT settings, backend reload trigger, iOS guard

dishit-wednesday
and
dishit7
committed
test: add LiteRT service tests and improve existing coverage

dishit-wednesday
and
dishit7
committed
feat(litert): expose full BenchmarkInfo - prefill speed, TTFT, decode tps, init time in generation details

dishit-wednesday
and
dishit7
committed

Commits on May 20, 2026

feat(litert): replace SDK benchmark with wall-clock stats and add GPU/NPU warmup

dishit-wednesday
and
dishit7
committed

Commits on May 21, 2026

fix(litert): tool call parsing, regeneration, and context stability

dishit-wednesday
and
Dishit Karia
committed

Commits on May 22, 2026

Commits on May 23, 2026

Commits on May 24, 2026

Commits on May 25, 2026

Commits on May 27, 2026

Commits on May 29, 2026

Commits on Jun 3, 2026