-
Notifications
You must be signed in to change notification settings - Fork 269
Issues
is:issue state:open
is:issue state:open
Issue creation is restricted in this repository
Search results
Add hybrid mode of concurrency detector that uses both token and requests
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#1990 In llm-d/llm-d-router;FOSSA Licence issues
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.Define profile-aware tracing for scheduler stages
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#1982 In llm-d/llm-d-router;Session-granularity prefix-cache affinity producer (tokenizer-free, stock-engine)
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#1980 In llm-d/llm-d-router;[EPIC] Session-centric prefix-cache affinity and KV-lifecycle orchestration
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#1979 In llm-d/llm-d-router;Precise prefix cache indexer observability metrics
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#1964 In llm-d/llm-d-router;- Status: Open.#1954 In llm-d/llm-d-router;
- Status: Open.#1952 In llm-d/llm-d-router;
- Status: Open.#1950 In llm-d/llm-d-router;
[rfc] Active-Active EPP deployments
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#1946 In llm-d/llm-d-router;- Status: Open.#1943 In llm-d/llm-d-router;
[vllm-omni] single stage diffusion model support
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#1935 In llm-d/llm-d-router;