feat: unify renderer + teacher endpoints onto vLLM 0.20 /inference/v1/generate#2408

Merged

hallerite merged 15 commits into

mainfrom

feat/unify-inference-generate

May 11, 2026

Commits on May 10, 2026

Merge branch 'main' into feat/unify-inference-generate
hallerite
committed
chore: bump verifiers to aa428f3 (main, v0.1.14 + post-release fixes)
hallerite
committed
fix(serving_tokens): mirror serving_chat_with_tokens patterns
hallerite
committed
Merge remote-tracking branch 'origin/main' into feat/unify-inference-generate
hallerite
committed
test(teacher_logprobs): assert AsyncOpenAI doesn't double-prefix the absolute URL
hallerite
committed
fix(teacher_logprobs): bypass openai SDK parse for non-openai BaseModel
hallerite
committed
fix(teacher_logprobs): preserve auth headers via cast_to=httpx.Response

hallerite
and
claude
committed
refactor(routed_experts): extract _RoutedExpertsCaptureBase

hallerite
and
claude
committed

Commits on May 11, 2026