Skip to content

Add auditable model-log invalidation#61

Open
mlava wants to merge 1 commit into
NateBJones-Projects:mainfrom
mlava:codex/issue-40-model-invalidation
Open

Add auditable model-log invalidation#61
mlava wants to merge 1 commit into
NateBJones-Projects:mainfrom
mlava:codex/issue-40-model-invalidation

Conversation

@mlava

@mlava mlava commented Jul 17, 2026

Copy link
Copy Markdown
Contributor

Closes #40

Summary

  • add models --invalidate --run <run_id> [--task <key>] --reason <text> with atomic, permission-preserving JSONL updates
  • retain invalidated evidence and its reason/timestamp while excluding it consistently from CLI, explore, scoreboard/API, and SQLite aggregates
  • expose per-model invalidated counts, including visible unranked invalidated-only buckets
  • detect rewritten/truncated model logs in incremental SQLite sync while avoiding prefix hashing when file metadata is unchanged

Verification

  • python3 -m unittest discover -s tests (230 tests passed)
  • Ringer verification harness passed
  • independent Opus review: APPROVE

The final review correction was also exercised through the OpenRouter Hy3 free route.

seanpmgallagher added a commit to seanpmgallagher/ringer that referenced this pull request Jul 23, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

models --invalidate: correcting the model log shouldn't mean hand-editing runs.jsonl

1 participant