Skip to content

[Docs] Add balance preset README (part of #2378)#2563

Merged
AayushSaini101 merged 4 commits into
vllm-project:mainfrom
benhurstephen:docs/balance-preset-readme
Jul 20, 2026
Merged

[Docs] Add balance preset README (part of #2378)#2563
AayushSaini101 merged 4 commits into
vllm-project:mainfrom
benhurstephen:docs/balance-preset-readme

Conversation

@benhurstephen

@benhurstephen benhurstephen commented Jul 15, 2026

Copy link
Copy Markdown
Contributor

closes #2378

Purpose

  • What does this PR change?
    • Adds deploy/recipes/balance/README.md documenting the maintained balance routing preset (route order, model assumptions, run/eval commands, customization points).
    • Adds an "Out-of-the-Box Presets" section to deploy/recipes/README.md linking to the new balance README.
  • Why is this change needed?
  • Which module(s) does this affect? Docs

Test Plan

  • Verified README content against deploy/recipes/balance.yaml and deploy/recipes/balance.probes.yaml.
  • Ran make agent-lint CHANGED_FILES="deploy/recipes/balance/README.md,deploy/recipes/README.md" (markdown lint passed).
  • Manual review of route order table, model aliases, and validation command paths.

Test Result

  • Markdown lint and changed-files lint passed locally.
  • Go contract test not run in this environment (no local go install); docs-only change with no config/YAML edits.
  • No follow-up risks for this PR; does not change runtime behavior.

Semantic Router PR Checklist
  • PR title uses module-aligned prefixes such as [Docs]
  • If the PR spans multiple modules, the title includes all relevant prefixes
  • Commits in this PR are signed off with git commit -s
  • The Purpose, Test Plan, and Test Result sections reflect the actual scope, commands, and blockers for this change

Document the maintained balance routing preset with route order,
model assumptions, run/eval commands, and customization points.

Signed-off-by: Benhur Stephen <bekumar@redhat.com>
@netlify

netlify Bot commented Jul 15, 2026

Copy link
Copy Markdown

Deploy Preview for vllm-semantic-router ready!

Name Link
🔨 Latest commit 96f7282
🔍 Latest deploy log https://app.netlify.com/projects/vllm-semantic-router/deploys/6a5da230b860f6000727642a
😎 Deploy Preview https://deploy-preview-2563--vllm-semantic-router.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.
🤖 Make changes Run an agent on this branch

To edit notification comments on pull requests, go to your Netlify project configuration.

@github-actions

Copy link
Copy Markdown
Contributor

👥 vLLM Semantic Team Notification

The following members have been identified for the changed files in this PR and have been automatically assigned when their GitHub accounts are assignable in this repository:

📁 deploy

Owners: @FAUST-BENCHOU, @shraderdm, @drivebyer, @ramkrishs, @WUKUNTAI-0211, @AayushSaini101, @siloteemu
Files changed:

  • deploy/recipes/README.md
  • deploy/recipes/balance/README.md

vLLM

🎉 Thanks for your contributions!

This comment was automatically generated based on the OWNER files in the repository.

@benhurstephen

benhurstephen commented Jul 15, 2026

Copy link
Copy Markdown
Contributor Author

Opened PR #2563 for the balance README docs slice (part of #2378)

@AayushSaini101 AayushSaini101 left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM thanks

@AayushSaini101
AayushSaini101 merged commit 2d3946c into vllm-project:main Jul 20, 2026
24 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

recipes: tune out-of-box presets for balance, cost, accuracy, speed, privacy, and grounding

7 participants