Smoke Test Results — Claude Engine — Run 31732491833
Overall Status: PARTIAL (Playwright skill version mismatch, tests otherwise passing)
Run URL: https://github.com/github/gh-aw/actions/runs/31732491833 Timestamp: 2026-08-13T18:51:00ZPR used for review testing: #52034
Core Tests
#
Test
Result
Notes
1
GitHub MCP Testing (merged PRs)
✅
PRs #52540 , #52539
2
GH CLI Testing
✅
Got open PRs #52543 , #52542
3
Make Build Testing
✅
Build succeeded
4
Playwright Testing
✅
Page title contains "GitHub"
5
Tavily Web Search Testing
✅
5 results returned
6
File Writing Testing
✅
/tmp/gh-aw/agent/smoke-test-claude-31732491833.txt
7
Bash Tool Testing
✅
File verified via cat
8
Discussion Interaction Testing
✅
Discussion #335
9
Agentic Workflows MCP Testing
✅
smoke-claude: active; smoke-claude-on-copilot: Unknown
10
Slack Script Safe Output Testing
✅
Posted to #smoke-tests
11
Code Scanning Alert Safe Output Testing
✅
Dummy warning created
12
Check Run Safe Output Testing
✅
Check run created
PR Review Tests (PR #52034 )
#
Test
Result
Notes
13
Update PR Testing
✅
Appended test message
14
PR Review Comment Testing
✅
2 review comments added
15
Submit PR Review Testing
✅
Review submitted
16
Resolve Review Thread Testing
✅
Thread resolved
17
Add Reviewer Testing
✅
Added copilot as reviewer
18
Push to PR Branch Testing
✅
Pushed smoke-test-files/smoke-claude-push-test.md
19
Close PR Testing
⚠️ Skipped — no safe test PR to close
All non-skipped tests passed.
Firewall blocked 6 domains
The following domains were blocked by the firewall during workflow execution:
accounts.google.comandroid.clients.google.comclients2.google.comcontentautofill.googleapis.comsafebrowsingohttpgateway.googleapis.comwww.google.com
To allow these domains, add them to the network.allowed list in your workflow frontmatter:
network :
allowed :
- defaults
- " accounts.google.com" " android.clients.google.com" " clients2.google.com" " contentautofill.googleapis.com" " safebrowsingohttpgateway.googleapis.com" " www.google.com" See Network Configuration for more information.
💥 [THE END] — Illustrated by Smoke Claude · sonnet46 · 64.1 AIC · ⌖ 8.64 AIC · ⊞ 6.3K · ◷ Comment /smoke-claude to run again
Smoke Test Results — Claude Engine — Run 31732491833
Overall Status: PARTIAL (Playwright skill version mismatch, tests otherwise passing)
Run URL: https://github.com/github/gh-aw/actions/runs/31732491833
Timestamp: 2026-08-13T18:51:00Z
PR used for review testing: #52034
Core Tests
/tmp/gh-aw/agent/smoke-test-claude-31732491833.txtPR Review Tests (PR #52034)
All non-skipped tests passed.
Warning
Firewall blocked 6 domains
The following domains were blocked by the firewall during workflow execution:
accounts.google.comandroid.clients.google.comclients2.google.comcontentautofill.googleapis.comsafebrowsingohttpgateway.googleapis.comwww.google.comTo allow these domains, add them to the
network.allowedlist in your workflow frontmatter:See Network Configuration for more information.