Skip to content

docs(stella-parity): stop the calibration row claiming a wiring two paths do not have (#1595) - #1924

Merged
macanderson merged 2 commits into
mainfrom
fix/1595-pipeline-calibration
Aug 7, 2026
Merged

docs(stella-parity): stop the calibration row claiming a wiring two paths do not have (#1595)#1924
macanderson merged 2 commits into
mainfrom
fix/1595-pipeline-calibration

Conversation

@macanderson

@macanderson macanderson commented Aug 6, 2026

Copy link
Copy Markdown
Owner

docs(stella-parity): stop the calibration row claiming a wiring two paths do not have

The calibration.drift capability declared its CLI mechanism as
"seed_calibration from the store plus with_calibration on every driver
path
". That is false. Five paths seed it — interactive, raw one-shot, goal,
the Command Deck and deck sub-sessions — and two do not:

  • run_pipeline_one_shot, which is the default stella run path
  • fleet workers (fleet_cmd.rs)

So the engines the staged pipeline drives run with an un-seeded estimator
while the matrix says otherwise (#1595).

A capability matrix exists so a divergence is declared rather than assumed
(AGENTS.md invariant 8's discipline, applied across surfaces instead of across
providers). A row that is confidently wrong is worse than a row marked
unwitnessed: it is the thing a reviewer checks instead of checking the code.
This corrects the mechanism to name which paths seed and which do not, and
sharpens missing to say that the absent CLI-side witness is exactly what
would have caught the two gaps — the row was unwitnessed and wrong at the same
time, and those two facts are the same fact.

UNWITNESSED_BASELINE is unchanged at 3: the posture is still
ShippedUnwitnessed, because it still is. Promoting it to Shipped is what
#1595 closes, and doing that before the two paths are wired would re-tell the
same lie in a stronger tense.

What this deliberately does not do

Thread the calibration map into the pipeline. That is #1595's option 1, it is
the right answer, and it is a larger change than this — so it stays open with
the design recorded on the issue rather than half-landed here. #1595's option 2
(declare the exemption as deliberate) is NOT taken: there is no principled
reason the pipeline's engines should estimate worse than the deck's, so
documenting it as intentional would be filing a bug as a feature.

The investigation #1595 asks for up front — "establish whether the pipeline's
engine construction can consume a CalibrationMap at all" — is answered:
it can, and the shape is constrained. CalibrationMap derives Debug, Default
but not Clone, while PipelineConfig derives Clone, so the map cannot
be an owned config field; and its own doc comment states the intended
ownership — "the caller owns the map across turns and hands the engine a
shared reference, mirroring how BudgetGuard outlives individual turns". The
correct home is therefore a borrowed field on Pipeline with a with_calibration
builder mirroring the existing with_gate, consumed at the four
Engine::with_sleeper sites. Full write-up on the issue.

cargo test -p stella-parity — 8 passed. Clippy -D warnings and
fmt --check clean.

Refs #1595, #1557

Summary by Sourcery

Documentation:

  • Update the calibration.drift capability documentation to list the specific CLI paths that seed calibration and explicitly call out the default staged-pipeline and fleet worker paths as not wired to calibration, along with the test gap this exposes.

@sourcery-ai sourcery-ai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry @macanderson, you have reached your weekly rate limit of 500000 diff characters.

Please try again later or upgrade to continue using Sourcery

@vercel

vercel Bot commented Aug 6, 2026

Copy link
Copy Markdown
Contributor

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
stella-cli-docs Ready Ready Preview Aug 7, 2026 12:12am

@sourcery-ai

sourcery-ai Bot commented Aug 6, 2026

Copy link
Copy Markdown
Contributor
Reviewer's guide (collapsed on small PRs)

Reviewer's Guide

Updates the stella-parity capabilities documentation for calibration drift to accurately describe which CLI paths seed the CalibrationMap and clarifies why the capability remains marked as ShippedUnwitnessed, without changing any behavior or wiring.

File-Level Changes

Change Details Files
Clarify calibration.drift CLI mechanism and its coverage across driver paths in the capability matrix.
  • Update the CLI mechanism text to enumerate the specific paths that seed calibration (interactive, raw one-shot, goal, deck, and sub-sessions).
  • Explicitly document that the default stella run staged-pipeline path and fleet workers do not seed calibration, referencing issue The default stella run path and fleet workers assemble engines without token-drift calibration #1595.
  • Expand the missing description to state that the absent CLI-side test would have detected these unseeded paths, explaining how the row can be both unwitnessed and incorrect.
crates/stella-parity/src/lib.rs

Possibly linked issues


Tips and commands

Interacting with Sourcery

  • Trigger a new review: Comment @sourcery-ai review on the pull request.
  • Continue discussions: Reply directly to Sourcery's review comments.
  • Generate a GitHub issue from a review comment: Ask Sourcery to create an
    issue from a review comment by replying to it. You can also reply to a
    review comment with @sourcery-ai issue to create an issue from it.
  • Generate a pull request title: Write @sourcery-ai anywhere in the pull
    request title to generate a title at any time. You can also comment
    @sourcery-ai title on the pull request to (re-)generate the title at any time.
  • Generate a pull request summary: Write @sourcery-ai summary anywhere in
    the pull request body to generate a PR summary at any time exactly where you
    want it. You can also comment @sourcery-ai summary on the pull request to
    (re-)generate the summary at any time.
  • Generate reviewer's guide: Comment @sourcery-ai guide on the pull
    request to (re-)generate the reviewer's guide at any time.
  • Resolve all Sourcery comments: Comment @sourcery-ai resolve on the
    pull request to resolve all Sourcery comments. Useful if you've already
    addressed all the comments and don't want to see them anymore.
  • Dismiss all Sourcery reviews: Comment @sourcery-ai dismiss on the pull
    request to dismiss all existing Sourcery reviews. Especially useful if you
    want to start fresh with a new review - don't forget to comment
    @sourcery-ai review to trigger a new review!

Customizing Your Experience

Access your dashboard to:

  • Enable or disable review features such as the Sourcery-generated pull request
    summary, the reviewer's guide, and others.
  • Change the review language.
  • Add, remove or edit custom review instructions.
  • Adjust other review settings.

Getting Help

…aths do not have

The `calibration.drift` capability declared its CLI mechanism as
"seed_calibration from the store plus with_calibration on **every driver
path**". That is false. Five paths seed it — interactive, raw one-shot, goal,
the Command Deck and deck sub-sessions — and two do not:

- `run_pipeline_one_shot`, which is the **default `stella run` path**
- fleet workers (`fleet_cmd.rs`)

So the engines the staged pipeline drives run with an un-seeded estimator
while the matrix says otherwise (#1595).

A capability matrix exists so a divergence is *declared rather than assumed*
(AGENTS.md invariant 8's discipline, applied across surfaces instead of across
providers). A row that is confidently wrong is worse than a row marked
unwitnessed: it is the thing a reviewer checks *instead of* checking the code.
This corrects the mechanism to name which paths seed and which do not, and
sharpens `missing` to say that the absent CLI-side witness is exactly what
would have caught the two gaps — the row was unwitnessed and wrong at the same
time, and those two facts are the same fact.

`UNWITNESSED_BASELINE` is unchanged at 3: the posture is still
`ShippedUnwitnessed`, because it still is. Promoting it to `Shipped` is what
#1595 closes, and doing that before the two paths are wired would re-tell the
same lie in a stronger tense.

## What this deliberately does not do

Thread the calibration map into the pipeline. That is #1595's option 1, it is
the right answer, and it is a larger change than this — so it stays open with
the design recorded on the issue rather than half-landed here. #1595's option 2
(declare the exemption as deliberate) is NOT taken: there is no principled
reason the pipeline's engines should estimate worse than the deck's, so
documenting it as intentional would be filing a bug as a feature.

The investigation #1595 asks for up front — "establish whether the pipeline's
engine construction can consume a `CalibrationMap` at all" — is answered:
it can, and the shape is constrained. `CalibrationMap` derives `Debug, Default`
but **not `Clone`**, while `PipelineConfig` derives `Clone`, so the map cannot
be an owned config field; and its own doc comment states the intended
ownership — "the caller owns the map across turns and hands the engine a
shared reference, mirroring how `BudgetGuard` outlives individual turns". The
correct home is therefore a borrowed field on `Pipeline` with a `with_calibration`
builder mirroring the existing `with_gate`, consumed at the four
`Engine::with_sleeper` sites. Full write-up on the issue.

`cargo test -p stella-parity` — 8 passed. Clippy `-D warnings` and
`fmt --check` clean.

Refs #1595, #1557
@macanderson
macanderson force-pushed the fix/1595-pipeline-calibration branch from f648fd8 to c6fe959 Compare August 6, 2026 22:31
@macanderson
macanderson merged commit 3615232 into main Aug 7, 2026
15 checks passed
@macanderson
macanderson deleted the fix/1595-pipeline-calibration branch August 7, 2026 00:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant