Skip to content

feat(runtime): add passport compatibility reports - #200

Merged
mrnicholasbcarter-code merged 1 commit into
mainfrom
codex/122-runtime-passport-gate
Jul 31, 2026
Merged

feat(runtime): add passport compatibility reports#200
mrnicholasbcarter-code merged 1 commit into
mainfrom
codex/122-runtime-passport-gate

Conversation

@mrnicholasbcarter-code

Copy link
Copy Markdown
Owner

Summary

  • add deterministic compatibility reports for runtime capability passports
  • preserve declared, observed, and negotiated evidence states with fail-closed classification
  • expose safe subject identity, remediation guidance, and stable report digests

Issue

Closes #122 (runtime compatibility matrix/remediation slice)

Validation

  • python -m pytest -q tests/test_runtime_compatibility.py tests/test_runtime_passports.py tests/test_policy_transitions.py
  • ruff check verdict/runtime_compatibility.py tests/test_runtime_compatibility.py verdict/__init__.py
  • ruff format --check verdict/runtime_compatibility.py tests/test_runtime_compatibility.py verdict/__init__.py
  • mypy verdict --strict

Live runtime discovery and protocol execution remain intentionally out of scope for this local evidence/reporting slice.

Add deterministic compatibility matrices for runtime capability passports with fail-closed status classification, provenance visibility, remediation guidance, and secret-safe identity output.

Co-Authored-By: ruflo-bot <ruflo-bot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown

📊 Benchmark Results

coding

Metric Fixed Verdict Delta
Success Rate 100.0% 99.0% -1.0%
Cost/req $0.014817 $0.006869 53.6%
p95 Latency 148ms 144ms -5ms

reasoning

Metric Fixed Verdict Delta
Success Rate 100.0% 98.0% -2.0%
Cost/req $0.007968 $0.004497 43.6%
p95 Latency 149ms 142ms -7ms

chat

Metric Fixed Verdict Delta
Success Rate 100.0% 98.5% -1.5%
Cost/req $0.000100 $0.001390 -1290.0%
p95 Latency 75ms 138ms 64ms

@mrnicholasbcarter-code
mrnicholasbcarter-code merged commit 36e2546 into main Jul 31, 2026
19 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

P1: Qualify tools, agents, skills, and protocol peers with runtime-negotiated passports

1 participant