Skip to content

ci: run full smoke test suite in CI + version sync gate on release#10

Merged
tznthou merged 2 commits into
mainfrom
ci/smoke-tests-version-gate
Jun 10, 2026
Merged

ci: run full smoke test suite in CI + version sync gate on release#10
tznthou merged 2 commits into
mainfrom
ci/smoke-tests-version-gate

Conversation

@tznthou

@tznthou tznthou commented Jun 10, 2026

Copy link
Copy Markdown
Owner

Summary

Wires the existing 62-scenario tests/smoke-test.sh into CI (it had never run anywhere but locally — release.yml's "smoke test" step was a file-existence loop), adds a tag↔package.json version consistency gate to releases, and syncs both READMEs to the completed agy migration.

CI (95157b3)

  • New smoke-test.yml — runs the full suite on every PR and push to main. The suite needs no provider CLIs: wrapper logic tests inject fake binaries via CODEX_BIN / AGY_BIN, and CLI availability checks degrade to SKIP. Verified in a clean no-CLI environment (fresh HOME, system-only PATH): 58 pass / 0 fail / 3 skip, ~27s wall clock. Log output isolated to runner.temp.
  • release.yml — file-existence loop replaced by the real suite (file presence stays covered by checksum verify + tarball steps); new version-sync step blocks a release when the pushed tag doesn't match package.json (match/mismatch logic simulated locally, both paths correct).

Docs (40fef51)

  • Prerequisites now install Antigravity CLI (agy) instead of the sunset @google/gemini-cli; the two pre-migration notices are replaced by a single completed-migration block (what stays / what changed).
  • Env-var table: drop GEMINI_API_KEY (no longer read by the wrapper), add AGY_BIN, mark GEMINI_BIN as deprecated alias.
  • FAQ covers agy's rc=0 empty-output auth symptom; diagram / Tech Stack / structure labels updated. Both language versions natively written and structurally symmetric (42 headings each).

Test plan

  • Local baseline: 62/62 pass
  • Simulated CI (no CLIs, clean HOME): 58/0/3, exit 0
  • Version gate: match passes, mismatch blocks (simulated both)
  • smoke-test.yml first real run on this PR — the PR itself is the live validation

🤖 Generated with Claude Code

tznthou and others added 2 commits June 11, 2026 00:03
- Prerequisites: install Antigravity CLI (agy) instead of sunset @google/gemini-cli
- Replace two pre-migration notices with a single completed-migration block
- Env-var table: drop GEMINI_API_KEY (no longer read by wrapper), add AGY_BIN, mark GEMINI_BIN deprecated
- FAQ: cover agy rc=0 empty-output auth symptom
- Architecture diagram / Tech Stack / Project Structure labels updated
- gitignore: add cache/

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
- New smoke-test.yml: runs tests/smoke-test.sh (62 scenarios) on every PR
  and push to main; suite needs no provider CLIs (fake-binary injection,
  availability checks SKIP) — verified 58/0/3 in a clean no-CLI environment
- release.yml: replace file-existence-only step with the real suite;
  add tag vs package.json version consistency gate (blocks mismatched tags)

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@tznthou tznthou merged commit dba80d4 into main Jun 10, 2026
1 check passed
@tznthou tznthou deleted the ci/smoke-tests-version-gate branch June 10, 2026 16:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant