fix(e2e): accept canonical controller check URLs#7599
Conversation
Signed-off-by: Apurv Kumaria <akumaria@nvidia.com>
📝 WalkthroughWalkthroughThe PR updates controller gate validation for canonical and child-run check URLs and expands E2E coverage for lost PATCH responses, including foreign check URLs. ChangesController URL recovery
Estimated code review effort: 3 (Moderate) | ~20 minutes Possibly related issues
Possibly related PRs
Suggested labels: Suggested reviewers: 🚥 Pre-merge checks | ✅ 5✅ Passed checks (5 passed)
✨ Finishing Touches📝 Generate docstrings
🧪 Generate unit tests (beta)
Comment |
Code Coverage OverviewLanguages: TypeScript TypeScript / code-coverage/pluginThe overall coverage in commit d4f53a1 in the TypeScript / code-coverage/cliThe overall coverage in commit d4f53a1 in the Show a code coverage summary of the most impacted files.
Updated |
Signed-off-by: Apurv Kumaria <akumaria@nvidia.com>
PR Review Advisor — No blocking findings reportedAdvisor assessment: No blocking advisor findings reported Model lanes
Nemotron output stays in workflow artifacts and does not change the assessment above. E2E guidanceAdvisory only. E2E / PR Gate selects and runs jobs independently. Recommended E2E: This automated review informs maintainers. Warnings and suggestions do not require a response. A maintainer decides whether to merge. |
ericksoa
left a comment
There was a problem hiding this comment.
Reviewed exact head d4f53a1. The production change retains exact check/app/PR/head/base/status/title/summary binding and additionally accepts only GitHub’s exact canonical URL for that same check ID. Accepting the circular E2E gate failure: the trusted pre-fix controller rejects precisely the canonical URL this PR corrects, while ordinary CI, security checks, and both advisors are green.
<!-- markdownlint-disable MD041 --> ## Summary Add the canonical `docs/changelog/2026-07-25.mdx` release entry with the exact `## v0.0.96` heading. The entry reconciles all 90 first-parent commits since v0.0.95 with all 92 merged PRs in the live `v0.0.96` label ledger and groups the user-visible changes by operator journey. ## Changes - Add the parser-safe dated MDX changelog entry for v0.0.96 with root-absolute links to the focused user guides. - Source summary: - [#7194](#7194) -> `docs/changelog/2026-07-25.mdx`: Document persistent baseline network policy exclusions and their inspection, rebuild, and snapshot behavior. - [#7188](#7188), [#7427](#7427), and [#7546](#7546) -> `docs/changelog/2026-07-25.mdx`: Document DNS-backed HTTPS inference routing, keyless loopback endpoints, and provider-marker isolation. - [#7238](#7238) -> `docs/changelog/2026-07-25.mdx`: Document blueprint sandbox and provider identifier validation before state writes or OpenShell calls, with bounded terminal-safe rejection previews. - [#7319](#7319), [#7274](#7274), [#7528](#7528), [#7353](#7353), and [#7560](#7560) -> `docs/changelog/2026-07-25.mdx`: Document the managed default gateway service, onboarding readiness, and container-runtime identity safeguards. - [#7349](#7349), [#7498](#7498), [#7406](#7406), [#7196](#7196), [#7559](#7559), [#7421](#7421), [#7510](#7510), [#7295](#7295), and [#7565](#7565) -> `docs/changelog/2026-07-25.mdx`: Document gateway-scoped status, lifecycle diagnostics, managed MCP recovery, delete-edge safeguards, and fail-closed CLI prompt and command output. - [#7591](#7591) -> `docs/changelog/2026-07-25.mdx`: Document opt-in authenticated MCP tool-name discovery, its bounded and names-only contract, probe interaction, and rebuild requirement. - [#7305](#7305), [#7480](#7480), [#7471](#7471), [#7365](#7365), and [#7541](#7541) -> `docs/changelog/2026-07-25.mdx`: Document installer version checks, version-tag reporting, license guidance, WSL Ollama selection, and DGX Station vLLM detection. - [#7482](#7482), [#7466](#7466), [#7208](#7208), [#7434](#7434), and [#7586](#7586) -> `docs/changelog/2026-07-25.mdx`: Document Ollama resource details, reasoning precedence, Hermes onboarding behavior, and preserved managed Hermes BuildKit failures. - [#6830](#6830), [#7492](#7492), [#7563](#7563), and [#7582](#7582) -> `docs/changelog/2026-07-25.mdx`: Document the authoritative OpenClaw production lock, fixed managed-image dependencies, immutable Hermes base adoption, and Hermes image-size reduction. - [#7505](#7505), [#7530](#7530), [#7547](#7547), [#7508](#7508), [#7548](#7548), [#7549](#7549), [#7537](#7537), [#7534](#7534), [#7515](#7515), [#7511](#7511), [#7551](#7551), [#7562](#7562), [#7575](#7575), [#7496](#7496), [#7594](#7594), [#7595](#7595), and [#7599](#7599) -> `docs/changelog/2026-07-25.mdx`: Summarize release validation, transient and bounded dispatch reconciliation, exact pre-tag qualification, identity revalidation, npm-audit retry, sharding, image reuse, timeout, telemetry, and workflow-hardening changes. - Reconciled without separate changelog prose: - [#7539](#7539), [#7526](#7526), [#7507](#7507), [#7506](#7506), [#7519](#7519), [#7516](#7516), [#7396](#7396), [#7254](#7254), [#7583](#7583), [#7596](#7596), and [#7598](#7598): Test-harness or fixture-only changes. - [#7403](#7403), [#7161](#7161), [#6877](#6877), [#7531](#7531), [#7525](#7525), [#7522](#7522), [#7536](#7536), [#7552](#7552), [#7566](#7566), [#7553](#7553), [#7561](#7561), [#7577](#7577), [#7569](#7569), [#7585](#7585), [#7584](#7584), [#7592](#7592), [#7580](#7580), [#7571](#7571), [#7517](#7517), [#7589](#7589), [#7402](#7402), [#7558](#7558), [#7544](#7544), and [#7601](#7601): Dependency, internal recovery, validation, contributor-workflow, E2E optimization, telemetry, or CI trust changes with no separate user-facing release claim. - [#7556](#7556), [#7573](#7573), [#7576](#7576), and [#7578](#7578): Experimental repository-maintainer conflict automation with no canonical user documentation surface. ## Type of Change - [ ] Code change (feature, bug fix, or refactor) - [ ] Code change with doc updates - [x] Doc only (prose changes, no code sample modifications) - [ ] Doc only (includes code sample changes) ## Quality Gates - [ ] Tests added or updated for changed behavior - [x] Existing tests cover changed behavior — justification: `test/changelog-docs.test.ts` validates dated changelog structure, version headings, and published links. - [ ] Tests not applicable — justification: - [x] Docs updated for user-facing behavior changes - [ ] Docs not applicable — justification: - [ ] Sensitive paths changed (security, policy, credentials, preflight, onboarding, inference, runner, sandbox, or messaging) - [ ] Sensitive-path review completed or maintainer-approved waiver recorded — reviewer/approval link/justification: - [ ] Non-success, skipped, or missing CI check accepted by maintainer — check name, approval link, and follow-up issue: ## Documentation Writer Review - [x] Documentation writer subagent reviewed the completed changes - Result: `docs-updated` - Evidence: Reviewed `docs/changelog/2026-07-25.mdx` at exact head `0f5dedb47` against 90 first-parent release commits and 92 merged PRs labeled `v0.0.96`. Verified parser-safe MDX SPDX, the exact version heading, literal CLI names, writing style, skip terms, all 20 root-absolute published links, and the accepted #7591 opt-in authenticated discovery bounds. #7544, #7599, and #7601 remain internal or CI-only release-ledger entries. Changelog tests passed 6/6, the docs build passed with 0 errors and two pre-existing Fern warnings, and `npm run check:diff` plus the final diff check passed. - Agent: Codex Desktop documentation-writer subagent <!-- docs-review-head-sha: 0f5dedb --> <!-- docs-review-agents-blob-sha: be20a09 --> ## DGX Station Hardware Evidence - [ ] Tested on DGX Station - Tested commit: - Station profile/scenario: - Result: - Supporting evidence: ## Verification - [x] PR description includes a `Signed-off-by:` line and every commit appears as `Verified` in GitHub - [x] Normal `pre-commit`, `commit-msg`, and `pre-push` hooks passed, or `npm run check:diff` passed when hooks were skipped or unavailable - [x] Targeted behavior tests pass for the current change set, or tests are marked not applicable above — `npx vitest run test/changelog-docs.test.ts`: 6/6 passed. - [ ] Applicable broad gate passed — `npm test` for broad runtime/test-harness changes; `npm run check` for repo-wide validation/coverage changes — command/result: Not applicable to this prose-only changelog entry. - [x] Quality Gates section completed with required justifications or waivers - [x] No secrets, API keys, or credentials committed - [ ] `npm run docs` builds without warnings (doc changes only) — the build passed with 0 errors and 2 existing Fern warnings; the published-route check passed. - [x] Doc pages follow the [style guide](https://github.com/NVIDIA/NemoClaw/blob/main/docs/CONTRIBUTING.md) (doc changes only) - [ ] New doc pages include SPDX header and frontmatter (new pages only) — native changelog files use the required parser-safe MDX SPDX comment and no frontmatter. --- Signed-off-by: Carlos Villela <cvillela@nvidia.com> <!-- This is an auto-generated comment: release notes by coderabbit.ai --> ## Summary by CodeRabbit * **New Features** * Persistent network policy exclusions with consistent restore/exclusion reporting across rebuilds/snapshots. * Opt-in MCP tool discovery via `mcp status --tools` with bounded, redacted authenticated traffic. * Improved HTTPS inference switching for custom endpoints and refreshed onboarding/model menu details. * Refined OpenShell gateway defaults for port `8080`, including more reliable readiness checks. * **Bug Fixes** * Prevent incorrect provider/model restoration after compatible-provider update failures. * Preserve managed MCP state after exec loss and tighten gateway/doctor status scoping. * **Tests** * Stronger, fail-closed release validation with hardened evidence/artifact handoff and bounded timeouts/retries. <!-- end of auto-generated comment: release notes by coderabbit.ai --> --------- Signed-off-by: Prekshi Vyas <prekshiv@nvidia.com> Co-authored-by: Prekshi Vyas <prekshiv@nvidia.com>
#7579) (#7581) ## Summary The bundled `claude-code` network-policy preset allowlisted the npm shim `/tmp/npm-global/bin/claude`, but OpenShell enforces on the kernel-trusted `/proc/<pid>/exe`. For the global npm install documented by the bundled Claude Code skill, that resolves to `/tmp/npm-global/lib/node_modules/@anthropic-ai/claude-code/bin/claude.exe`. The preset did not list that path, so it denied requests to `api.anthropic.com`, including the initial login request. This PR adds the resolved launcher path without changing the preset's hosts, methods, paths, or schema. The later request to allow `platform.claude.com` is a separate endpoint-expansion decision and is outside this PR. ## Related Issue Fixes #7579 ## Changes - Add `/tmp/npm-global/lib/node_modules/@anthropic-ai/claude-code/bin/claude.exe` to the `claude-code` preset's binary allowlist. - Extend the effective-policy contract to compose the real preset and require the resolved launcher path. ## Regression Evidence - Root cause: the preset named the npm shim, while OpenShell authorizes the resolved `/proc/<pid>/exe` path. - Detection gap: the effective-policy contract checked the preset's host, method, and wildcard scope but did not check the resolved npm launcher. - Prevention: the contract now requires the exact resolved path while retaining the existing endpoint and method assertions. ## Type of Change - [x] Code change (feature, bug fix, or refactor) - [ ] Code change with doc updates - [ ] Doc only (prose changes, no code sample modifications) - [ ] Doc only (includes code sample changes) ## Quality Gates - [x] Tests added or updated for changed behavior - [ ] Existing tests cover changed behavior — justification: - [ ] Tests not applicable — justification: - [ ] Docs updated for user-facing behavior changes - [x] Docs not applicable — justification: The change restores the existing documented preset flow and does not change user steps, policy schema, endpoints, methods, or supported scope. - [x] Sensitive paths changed (security, policy, credentials, preflight, onboarding, inference, runner, sandbox, or messaging) - [x] Sensitive-path review completed or maintainer-approved waiver recorded — reviewer/approval link/justification: A nine-category maintainer review at `fc690c629` found no remaining security issue. The change adds one exact binary path and does not broaden endpoint, method, path, credential, dependency, or runtime scope. - [ ] Non-success, skipped, or missing CI check accepted by maintainer — check name, approval link, and follow-up issue: ## Documentation Writer Review - [x] Documentation writer subagent reviewed the completed changes - Result: `no-docs-needed` - Evidence: Reviewed the exact base-to-head policy and contract-test diff. The change adds only the resolved npm-installed Claude Code launcher to the existing binary allowlist; existing network-policy and security documentation already describes the preset’s user-facing behavior. No endpoint, schema, configuration, command, default, or workflow changed. `platform.claude.com` is not added. Exact-head validation passed: `validate:configs` 48/48, focused effective-policy/schema/blueprint tests 121/121, CLI and plugin builds, CLI and plugin typechecks, and `npm run check:diff`. - Agent: Codex Desktop <!-- docs-review-head-sha: a405c1d --> <!-- docs-review-agents-blob-sha: be20a09 --> ## DGX Station Hardware Evidence - [ ] Tested on DGX Station - Tested commit: Not applicable - Station profile/scenario: Not applicable - Result: `scripts/prepare-dgx-station-host.sh` is unchanged. - Supporting evidence: Not applicable ## Verification - [x] PR description includes a `Signed-off-by:` line and every commit appears as `Verified` in GitHub - [x] Normal `pre-commit`, `commit-msg`, and `pre-push` hooks passed, or `npm run check:diff` passed when hooks were skipped or unavailable - [x] Targeted behavior tests pass for the current change set, or tests are marked not applicable above — At `a405c1d95`, `npm run validate:configs` passed all 48 shipped configurations. The focused effective-policy, schema, and blueprint suite passed 3 files / 121 tests. CLI and plugin builds and typechecks passed, and `npm run check:diff` passed the normal pre-commit, commitlint, and pre-push checks. - [x] Applicable broad gate passed — Exact-head CI passed at `a405c1d95`; trusted E2E run [30240660013](https://github.com/NVIDIA/NemoClaw/actions/runs/30240660013) passed zero-presets, inference-routing, and live-probes with complete evidence. - [x] Quality Gates section completed with required justifications or waivers - [x] No secrets, API keys, or credentials committed - [ ] `npm run docs` builds without warnings (doc changes only) - [ ] Doc pages follow the style guide (doc changes only) - [ ] New doc pages include SPDX header and frontmatter (new pages only) ### E2E Gate History - The old `7f60e4f1b` gate failed before product tests ran because the controller rejected GitHub's canonical check URL and could not cancel the unauthorized child run. PR #7599 fixed that controller defect. - The signed main merge at `fc690c629` incorporates PR #7599 and creates a new PR SHA and base SHA for fresh controller evidence. The terminal old SHA was not retried. - At `3a742b8`, the hosted runner could not reach Docker Hub or the custom inference endpoint, so live-probes recorded one skipped test and the controller correctly rejected incomplete evidence. - The signed empty retry commit at `a405c1d95` created a new exact head without changing the semantic diff. Trusted E2E then passed all selected jobs; live-probes recorded one passed test and zero skipped tests. --- Signed-off-by: Jason Ma <jama@nvidia.com> 🤖 Generated with [Claude Code](https://claude.com/claude-code) <!-- This is an auto-generated comment: release notes by coderabbit.ai --> ## Summary by CodeRabbit * **Bug Fixes** * Fixed Claude Code network access when launched through its npm-installed executable path. * Prevented valid Claude Code requests from being blocked by policy enforcement. * **Tests** * Added coverage confirming the npm-installed Claude Code launcher is explicitly allowed. * Continued validating restricted binary and endpoint access. <!-- end of auto-generated comment: release notes by coderabbit.ai --> --------- Signed-off-by: Prekshi Vyas <prekshiv@nvidia.com> Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com> Co-authored-by: Prekshi Vyas <prekshiv@nvidia.com>
Summary
GitHub may canonicalize a PR gate check details URL to the check own /runs/ URL even when the exact child-bound summary is persisted. The controller introduced by #7594 rejected that valid response, revoked authorization, and prevented the selected #7590 Hermes lanes from starting. This change accepts only the exact child URL or the exact canonical check URL while preserving every authorization identity check.
Related Issue
Part of #7140. Follow-up to #7593 and #7594; aligns the parent controller with the canonicalization behavior already protected by #7515.
Changes
Type of Change
Quality Gates
Documentation Writer Review
no-docs-neededd4f53a19618b4d810494e2094c6aff6b9f6602ccchanges only the E2E controller’s canonical check-URL validation and focused tests.test/e2e/README.mdalready documents direct-read recovery, exact persisted child binding, and GitHub canonicalization to/runs/<check-id>. Changed test text is behavior-oriented and introduces no issue references. No docs build was needed because no documentation source changed.DGX Station Hardware Evidence
Verification
Failure evidence: controller run 30221481816 and child run 30221620499. The parent published the exact child-bound summary but GitHub returned the canonical check URL, so the old strict URL comparison revoked the otherwise valid authorization.
Self-hosting evidence: #7599 controller run 30224207359 checked out trusted base
2f66902b, rejected the canonical URL for check 89851619986, and could not cancel child run 30224558462 after GitHub returned HTTP 500. The orphan child then failed closed because trusted controller authorization had not been published. A same-revision retry is not supported after dispatch; the exact fix requires the repository's approved controller-bootstrap governance path.Signed-off-by: Apurv Kumaria akumaria@nvidia.com
Summary by CodeRabbit