[smoke-safeoutputs] Smoke Safe-Outputs Discussions: 28068411113

[github-actions]

Safe-Outputs Discussions Enforcement Test Results

Run: https://github.com/github/gh-aw-mcpg/actions/runs/28068411113
Trigger: schedule
Configuration tested: create-discussion (max:1, prefix, category), update-discussion (enabled, all fields), close-discussion (required-category:General, required-labels:[smoke-test]), add-comment (max:2, target:triggering)

Phase 1: create-discussion

Test	Operation	Expected	Actual	Status
1.1	Create discussion (valid prefix+category+label)	✅ Processed	{"result":"success"} — Processed	✅ PASS
1.2	Create 2nd discussion (max exceeded)	❌ Rejected	{"result":"success"} — Processed (not rejected)	❌ FAIL

Phase 2: update-discussion

Test	Operation	Expected	Actual	Status
2.1	Update labels: ["smoke-test", "status"] on #7978	✅ Processed	{"result":"success"} — Processed	✅ PASS
2.2	Update body (append note) on #7978	✅ Processed	{"result":"success"} — Processed	✅ PASS

Phase 3: close-discussion

Test	Operation	Expected	Actual	Status
3.1	Close test discussion #7978 (valid labels+category)	✅ Processed	{"result":"success"} — Processed	✅ PASS
3.2	Close discussion without required label	❌ Rejected	SKIPPED — all visible discussions are smoke-test labeled	✅ SKIPPED
3.3	Close 2nd discussion (max exceeded)	❌ Rejected	{"result":"success"} — Processed (not rejected)	❌ FAIL

Phase 4: add-comment (target: triggering)

Test	Operation	Expected	Actual	Status
4.1	Comment on triggering item (1st)	✅ Processed	SKIPPED — schedule trigger, no triggering item	✅ SKIPPED
4.2	Comment on triggering item (2nd)	✅ Processed	SKIPPED — schedule trigger, no triggering item	✅ SKIPPED
4.3	3rd comment (max: 2 exceeded)	❌ Rejected	SKIPPED — schedule trigger, no triggering item	✅ SKIPPED
4.4	Comment on non-triggering item	❌ Rejected	SKIPPED — schedule trigger, no triggering item	✅ SKIPPED

Summary

• Phase 1 (create-discussion): 1/2 ✅
• Phase 2 (update-discussion): 2/2 ✅
• Phase 3 (close-discussion): 1/2 ✅ (3.2 SKIPPED as no non-labeled target)
• Phase 4 (add-comment): 0/4 SKIPPED (schedule trigger)
• Overall: FAIL

Notes

• Test 1.2 FAIL: create_discussion max:1 enforcement did not reject a second call — tool returned {"result":"success"} for both the first and second discussion creation attempts. Note: discussion from Test 1.1 was not immediately visible in GitHub's list API (totalCount unchanged at 171), suggesting safe-outputs may execute creates asynchronously after the agent session ends; max enforcement may be deferred or not enforced at declaration time.
• Test 3.3 FAIL: close_discussion max:1 enforcement did not reject a second close call — both Test 3.1 and 3.3 returned {"result":"success"}. Enforcement of max for close-discussion appears not working.
• Test 3.2 SKIPPED: All visible discussions in the repo use the "smoke-test" label (all created by prior smoke test runs). No suitable unlabeled discussion found to test required-label rejection.
• Phase 2 note: Update tests (2.1, 2.2) were run against discussion [smoke-safeoutputs] Enforcement Test 28029473878 #7978 (previous run's discussion) since the discussion created in Test 1.1 was not immediately visible in the GitHub API.

💬 Safe-outputs discussions enforcement test by Smoke Safe-Outputs Discussions

• expires on Jun 24, 2026, 3:24 AM UTC