Skip to content

docs(ci): reduce sequence-diagram audit churn (anti-reword + canonical terms)#922

Merged
tracyboehrer merged 7 commits into
mainfrom
copilot/reduce-diagram-audit-churn
Jul 16, 2026
Merged

docs(ci): reduce sequence-diagram audit churn (anti-reword + canonical terms)#922
tracyboehrer merged 7 commits into
mainfrom
copilot/reduce-diagram-audit-churn

Conversation

@tracyboehrer

@tracyboehrer tracyboehrer commented Jul 16, 2026

Copy link
Copy Markdown
Member

Why

The weekly verify-sequence-diagrams audit keeps re-flagging Mermaid diagrams that are already correct. Because the diagrams were originally authored by an AI pass, a second AI audit pass finds different-but-equally-valid ways to model the same code and "corrects" them — churn, not fixes (see the interpretation-only edits in #921: ClassType, Assembly split into SIA/EIA, swapped-but-valid converter examples, A2ASSE labels).

Change

Doc/CI-only edit to .github/prompts/verify-sequence-diagrams.prompt.md:

  • What NOT to change (avoid audit churn) — forbids rewording accurate labels, re-modeling participant granularity, swapping still-valid examples, and adding deliberately-omitted detail unless the code contradicts the diagram. Gated by: "Can I point to a line the diagram states is true but isn't?"
  • Canonical terminology — pins DeliveryMode.Stream SSE and forbids reintroducing the A2A label, so generation and audit passes agree on wording.

Effect

  • Real drift is still flagged (e.g. removed UserSignInFailureHandler, renamed calls, moved paths).
  • Interpretation churn is suppressed, so the audit stops re-opening the same non-issues weekly.

…agram audit prompt

The weekly verify-sequence-diagrams audit re-flagged diagrams that were
already correct, because a second AI pass models the same code with
different-but-equally-valid wording/granularity (e.g. Class vs Type,
Assembly vs SIA/EIA participants, swapped valid examples, A2A vs SSE labels).

Add a 'What NOT to change' section forbidding rewording, re-modeling at a
different granularity, swapping still-valid examples, and adding
deliberately-omitted detail unless the code actually contradicts the diagram.
Add a canonical-terminology section pinning 'DeliveryMode.Stream SSE' and
forbidding the 'A2A' label so generation and audit passes agree.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 56262116-a37d-4365-bb56-f489b6cd5e2e
Copilot AI review requested due to automatic review settings July 16, 2026 14:08
@tracyboehrer
tracyboehrer requested review from a team, ceciliaavila and sw-joelmut as code owners July 16, 2026 14:08
@github-actions github-actions Bot added the Build: Automation Tags changes to Build Automation area label Jul 16, 2026

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates the CI prompt used by the weekly verify-sequence-diagrams audit to reduce “interpretation-only” churn by explicitly prohibiting rewording/re-modeling of already-correct Mermaid diagrams, and by pinning canonical terminology so future audit passes converge on consistent labels.

Changes:

  • Adds a “What NOT to change (avoid audit churn)” section that gates edits on code-contradiction evidence rather than alternative-but-valid phrasing/modeling.
  • Adds a “Canonical terminology” section intended to standardize the SSE streaming wording and avoid reintroducing “A2A” labeling.

Comment thread .github/prompts/verify-sequence-diagrams.prompt.md Outdated
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
@tracyboehrer
tracyboehrer enabled auto-merge July 16, 2026 14:16
@tracyboehrer
tracyboehrer merged commit 1ed3967 into main Jul 16, 2026
12 checks passed
@tracyboehrer
tracyboehrer deleted the copilot/reduce-diagram-audit-churn branch July 16, 2026 21:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Build: Automation Tags changes to Build Automation area

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants