Skip to content

docs: clarify cost-aware model routing - #255

Merged
mrnicholasbcarter-code merged 1 commit into
mainfrom
codex/readme-cost-aware-routing
Aug 2, 2026
Merged

docs: clarify cost-aware model routing#255
mrnicholasbcarter-code merged 1 commit into
mainfrom
codex/readme-cost-aware-routing

Conversation

@mrnicholasbcarter-code

Copy link
Copy Markdown
Owner

Summary

  • Position Verdict around preserving frontier-model capacity
  • Explain routing across Claude Code Max, Codex Pro, 9router, OmniRoute, free, low-cost, and frontier models
  • Add beginner-friendly product explanation and cost-aware routing principle
  • Correct README claims, package names, Python version, security scope, and installer trust wording

Validation

  • git diff --check
  • Relative README links resolve
  • Adversarial review completed

Closes #254

🤖 Generated with Claude Code

@github-actions

github-actions Bot commented Aug 2, 2026

Copy link
Copy Markdown

📊 Benchmark Results

coding

Metric Fixed Verdict Delta
Success Rate 100.0% 99.0% -1.0%
Cost/req $0.014578 $0.006708 54.0%
p95 Latency 145ms 140ms -5ms

reasoning

Metric Fixed Verdict Delta
Success Rate 100.0% 99.5% -0.5%
Cost/req $0.007351 $0.004673 36.4%
p95 Latency 146ms 144ms -2ms

chat

Metric Fixed Verdict Delta
Success Rate 100.0% 100.0% 0.0%
Cost/req $0.000102 $0.001378 -1251.0%
p95 Latency 74ms 141ms 67ms

@mrnicholasbcarter-code
mrnicholasbcarter-code merged commit 5028d12 into main Aug 2, 2026
18 checks passed

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 5898b2dc3c

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread README.md
**Use the right AI model for every task—not the most expensive one.**

Never send prod code to a cheap model. Never burn $20/hr on formatting.
Verdict stretches your Claude Code Max, Codex Pro, 9router, and OmniRoute setup further by routing each task to the least expensive capable model, while reserving frontier models for work that truly needs them. Configure once, use more of what you already have, and keep your best-model usage under control.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Qualify the least-cost routing promise

When users route through either documented public surface (verdict route or POST /v1/route), IntelligenceService.route() selects via select_best_model() (verdict/intelligence.py:232), whose ordering prioritizes quality, capability tier, and provider priority without considering cost (verdict/router.py:25-35). With eligible models at different prices, the selected model therefore need not be the least expensive, so this headline promise can lead users to expect cost savings that the normal routing path does not provide; qualify it as dispatcher-specific or connect the dispatcher to these routes. The declared route-flow invariant also places dispatch after ranking.

AGENTS.md reference: AGENTS.md:L40-L40

Useful? React with 👍 / 👎.

Comment thread README.md
[![License](https://img.shields.io/badge/license-MIT-green.svg)](LICENSE)
[![Python 3.10+](https://img.shields.io/badge/python-3.10%2B-blue.svg)](pyproject.toml)
[![MIT license](https://img.shields.io/badge/license-MIT-green.svg)](LICENSE)
[![Status: active development](https://img.shields.io/badge/status-active%20development-orange.svg)](#project-status)

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Point the status badge at an existing section

When a reader clicks the new active-development badge, #project-status has no matching heading or explicit anchor anywhere in this README, so the link does not navigate to any status information. Add the intended Project Status section or target an existing location.

Useful? React with 👍 / 👎.

Comment thread README.md
| | Typical router | **Verdict** |
|---|---|---|
| Model selection | Heuristic tiers, static allowlists | Orchestrator picks from the **OmniRoute catalog** — thousands of advertised models, liveness probe-verified in bounded samples |
| Model selection | Heuristic tiers, static allowlists | Orchestrator proposes candidates; Verdict admits only policy- and evidence-qualified options |】【。-vesm. ???

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Remove the stray fourth table cell

The Model selection row has an accidental fourth cell containing 】【。-vesm. ???, while the table defines only three columns. GitHub-style renderers may discard the surplus cell, but other Markdown consumers or raw-source readers can expose the corrupted text, so remove it to keep the README portable and intelligible.

Useful? React with 👍 / 👎.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[README-001] Product-led README, demo media, and evidence-backed adoption path

1 participant