Search results

RayClusterFleet pod leak when use different model.aibrix.ai/name

Status: Open.

#1423 In vllm-project/aibrix;

· ltm920716 opened on Aug 8, 2025

Optimize pod autoscaler controller to production grade

area/autoscaling

kind/enhancementNew feature or requestNew feature or request

priority/important-soonMust be staffed and worked on either currently, or very soon, ideally in time for the next release.Must be staffed and worked on either currently, or very soon, ideally in time for the next release.

Status: Open.

#1422 In vllm-project/aibrix;

· Jeffwan opened on Aug 7, 2025

· 

v0.5.0

Support Mooncake P/D conductor algorithm in AIBrix router

area/gateway

priority/important-soonMust be staffed and worked on either currently, or very soon, ideally in time for the next release.Must be staffed and worked on either currently, or very soon, ideally in time for the next release.

Status: Open.

#1421 In vllm-project/aibrix;

· Jeffwan opened on Aug 7, 2025

· 

v0.5.0

Optimize prefix-cache aware policy and minimize the performance overhead

area/gateway

Status: Open.

#1420 In vllm-project/aibrix;

· Jeffwan opened on Aug 7, 2025

· 

v0.5.0

Support AFN disaggregation in StormService

area/distributed

priority/important-soonMust be staffed and worked on either currently, or very soon, ideally in time for the next release.Must be staffed and worked on either currently, or very soon, ideally in time for the next release.

Status: Open.

#1419 In vllm-project/aibrix;

· Jeffwan opened on Aug 7, 2025

· 

v0.5.0

Support predictive autoscaling for LLM inference

area/autoscaling

Status: Open.

#1418 In vllm-project/aibrix;

· Jeffwan opened on Aug 7, 2025

PD Router should be able to select P/D pair from same roleset instance

area/disaggregated

area/gateway

kind/featureCategorizes issue or PR as related to a new feature.Categorizes issue or PR as related to a new feature.

priority/critical-urgentHighest priority. Must be actively worked on as someone's top priority right now.Highest priority. Must be actively worked on as someone's top priority right now.

Status: Open.

#1417 In vllm-project/aibrix;

· Jeffwan opened on Aug 7, 2025

· 

v0.5.0

[RFC]: AIBrix Documentation and samples improvement

area/installation

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

kind/documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#1416 In vllm-project/aibrix;

· Jeffwan opened on Aug 7, 2025

· 

v0.5.0

[RFC]: Production-Grade Helm Chart for AIBrix

area/installation

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#1413 In vllm-project/aibrix;

· Jeffwan opened on Aug 7, 2025

· 

v0.5.0

Nixl can not leverage existing RDMA results in slow TPOT

area/distributed

area/performance

Status: Open.

#1407 In vllm-project/aibrix;

· Jeffwan opened on Aug 5, 2025

· 

v0.4.1

gateway protocol error

area/gateway

kind/bugSomething isn't workingSomething isn't working

Status: Open.

#1405 In vllm-project/aibrix;

· ltm920716 opened on Aug 5, 2025

can not use upper case for model-name

Status: Open.

#1404 In vllm-project/aibrix;

· ltm920716 opened on Aug 5, 2025