Skip to content

design: clean-room parity slice 1 — subtraction + honest landing stats#213

Merged
HomenShum merged 2 commits into
mainfrom
design/clean-room-parity
Jul 18, 2026
Merged

design: clean-room parity slice 1 — subtraction + honest landing stats#213
HomenShum merged 2 commits into
mainfrom
design/clean-room-parity

Conversation

@HomenShum

Copy link
Copy Markdown
Owner

First slice of docs/design/ROOM_PARITY_GAP.md. No ghost em-dash stats, no zero-bragging proof strip (prod-verified), quiet versionedSync badge, two governance-grounded REJECT amendments. Steady-state room capture attached in-repo. 🤖 Generated with Claude Code

…g, quiet engine badge

- Landing live proof strip: render NOTHING until metrics arrive (persistent
  em-dashes on prod read as broken), and nothing when counts are zero — a
  social-proof strip with nothing to prove should not render. Verified against
  prod convex: metrics:landingMetrics returns zeros today.
- Sheet engine badge de-shouted: "VERSIONEDSPREADSHEETSYNC" all-caps kicker ->
  quiet mono "versionedSync" (scoped CSS, no global .kicker change).
- ROOM_PARITY_GAP amended with two REJECTs discovered during grounding: the
  empty->filled variance arc is the demo's hero moment (seed empties cells so
  the agent reconciles LIVE; state-captures.spec.ts:148 pins the affordance),
  and all-green variance chips violate the sign-aware color ruling.

Steady-state room proof (returning user, tour done):
.qa/evidence/20260717-postmerge/before-after/after-room-steadystate.png

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@vercel

vercel Bot commented Jul 18, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
noderoom Ready Ready Preview, Comment Jul 18, 2026 5:41am

Request Review

@github-actions

github-actions Bot commented Jul 18, 2026

Copy link
Copy Markdown

Scaffold Handoff — For Your Coding Agent

Your coding agent (Codex, Claude Code, etc.) should apply the accepted
scaffold proposals below. Do NOT touch any immutable files.

Immutability Check

Mode: advisory

✅ No immutable files were modified in this branch.

Changed Files

  • docs/design/ROOM_PARITY_GAP.md
  • docs/eval/OFFICIAL_BENCHMARK_READINESS.md
  • docs/eval/OFFICIAL_BENCHMARK_TASK_COVERAGE.md
  • docs/eval/OPENROUTER_CONVEX_BENCHMARK.md
  • docs/eval/agent-improvement-loop.md
  • docs/eval/agent-improvement-loop.svg
  • docs/eval/agent-improvement-loop/20260718T054028Z.json
  • docs/eval/agent-improvement-loop/latest.json
  • docs/eval/agent-workspace-sandbox-smoke.json
  • docs/eval/algorithm-artifact-smoke.json
  • docs/eval/bankertoolbench-official-contract.json
  • docs/eval/docker-sandbox-probe.json
  • docs/eval/eval-runs.jsonl
  • docs/eval/halo-convex-context-telemetry.json
  • docs/eval/halo-self-improvement-smoke.json
  • docs/eval/halo-variant-selection.json
  • docs/eval/official-benchmark-readiness.json
  • docs/eval/official-benchmark-task-coverage.json
  • docs/eval/openrouter-convex-benchmark.json
  • docs/eval/professional-catalog-proofs.json
  • docs/eval/professional-proof-ledger.json
  • docs/eval/spreadsheetbench-chart-visual-probe.json
  • docs/eval/traces/credit/20260718T054037574Z-866a0e6d_dirty.ad9b07a1a0e0f3c9/cascade-healthy.json
  • docs/eval/traces/credit/20260718T054037574Z-866a0e6d_dirty.ad9b07a1a0e0f3c9/delta-incomplete.json
  • docs/eval/traces/credit/20260718T054037574Z-866a0e6d_dirty.ad9b07a1a0e0f3c9/mapping-correct.json
  • docs/eval/traces/credit/20260718T054037574Z-866a0e6d_dirty.ad9b07a1a0e0f3c9/mapping-misbind.json
  • docs/eval/traces/credit/20260718T054037574Z-866a0e6d_dirty.ad9b07a1a0e0f3c9/summit-stressed.json
  • docs/eval/traces/ladder/20260718T054037168Z-866a0e6d_dirty.a69db6ff0203e942/ladder_L1_read_scripted.json
  • docs/eval/traces/ladder/20260718T054037168Z-866a0e6d_dirty.a69db6ff0203e942/ladder_L2_edit_scripted.json
  • docs/eval/traces/ladder/20260718T054037168Z-866a0e6d_dirty.a69db6ff0203e942/ladder_L3_conflict_scripted.json
  • docs/eval/traces/ladder/20260718T054037168Z-866a0e6d_dirty.a69db6ff0203e942/ladder_L4_blocked_scripted.json
  • docs/eval/traces/ladder/20260718T054037168Z-866a0e6d_dirty.a69db6ff0203e942/ladder_L5_large_range_scripted.json
  • docs/eval/traces/ladder/20260718T054037168Z-866a0e6d_dirty.a69db6ff0203e942/ladder_L6_long_horizon_scripted.json
  • docs/eval/traces/ladder/20260718T054037168Z-866a0e6d_dirty.a69db6ff0203e942/ladder_L7_resume_scripted.json
  • src/app/styles.css
  • src/ui/Landing.tsx
  • src/ui/panels/Artifact.tsx

Needs Adversarial Review — Do NOT Apply Yet

These proposals passed the reject check but have not been approved by
an adversarial reviewer. A human or frozen LLM judge must approve them first.

  • scaf-001 (AGENTS.md): Add explicit instruction for step spreadsheetbench-runner-fixture: Step spreadsheetbench-runner-fixture failed — scaffold may need explicit instruction or evidence assertion.
  • scaf-002 (AGENTS.md): Add explicit instruction for step convex-boundaries: Step convex-boundaries failed — scaffold may need explicit instruction or evidence assertion.

Safety Boundary

Agent may improve the scaffold.
Agent may NOT weaken the proof gate.

Immutable files (never modify):

  • scripts/proofloop.mjs
  • scripts/agent-improvement-loop.ts
  • tests/harnessChangeEval.test.ts
  • .github/workflows/
  • src/eval/evalTrustPolicy.ts
  • src/eval/architectureBudget.ts
  • evals/evalStore.ts

Scaffold files (safe to modify):

  • AGENTS.md
  • CLAUDE.md
  • proofloop/scenarios/*.yaml
  • proofloop/rubrics/*.yaml
  • proofloop/subagents/*.md
  • proofloop/adapters/*.js
  • .proofloop/memory.jsonl
  • src/nodeagent/models/prompts/systemPrompt.ts

The zero-suppression check dereferenced metrics.roomsLive.value without the
optional chaining the original code had; a partial payload (as the
roomFullNoFlash test mocks) crashed the landing and took the join-error alert
down with it. Caught by CI verify on #213.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@HomenShum
HomenShum merged commit 5bb3828 into main Jul 18, 2026
10 of 11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant