Smoke Test: Claude - 28119469685

[github-actions]

Smoke Test: Claude Engine

Overall Status: FAIL (Tavily test failed)

Run URL: https://github.com/github/gh-aw/actions/runs/28119469685
Timestamp: 2026-06-24 18:13 UTC
PR used for review tests: #41241

Core Tests

#	Test	Result
1	GitHub MCP (last 2 merged PRs: #41245, #41240)	✅
2	GH CLI (gh pr list)	✅
3	Make Build	✅
4	Playwright (title contains 'GitHub')	✅
5	Tavily Web Search	❌
6	File Writing	✅
7	Bash Tool	✅
8	Discussion get (#335)	✅
9	Agentic Workflows status	✅
10	Slack message	✅
11	Code Scanning Alert	✅
12	Check Run	✅

PR Review Tests (#41241)

#	Test	Result
13	Update PR	✅
14	PR Review Comments	✅
15	Submit PR Review	✅
16	Resolve Review Thread	✅
17	Add Reviewer	✅
18	Push to PR Branch	✅
19	Close PR	⚠️ skipped (no safe test PR)

Failure Details

• Test 5 (Tavily): MCP server connects (HTTP 200) but the tools list is empty (tavily.json = []). Calls to tavily_search, search, tavily-search, extract all return Error [-32602]: unknown tool. Tavily tool list unavailable in this environment.

Warning

Firewall blocked 6 domains

The following domains were blocked by the firewall during workflow execution:

• accounts.google.com
• android.clients.google.com
• clients2.google.com
• contentautofill.googleapis.com
• safebrowsingohttpgateway.googleapis.com
• www.google.com

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "accounts.google.com"
    - "android.clients.google.com"
    - "clients2.google.com"
    - "contentautofill.googleapis.com"
    - "safebrowsingohttpgateway.googleapis.com"
    - "www.google.com"

See Network Configuration for more information.

💥 [THE END] — Illustrated by Smoke Claude · 75.8 AIC · ⌖ 38.2 AIC · ⊞ 8.7K · ◷

• expires on Jun 24, 2026, 12:17 PM UTC-08:00

[github-actions]

This issue was automatically closed because it expired on 2026-06-24T20:17:38.836Z.

Closed by Workflow