-
Notifications
You must be signed in to change notification settings - Fork 340
Smoke Test: Claude - 24110244779 #25203
Copy link
Copy link
Closed as not planned
Labels
Description
Summary
All non-skipped smoke tests passed for Claude engine run §24110244779 on 2026-04-08.
PR used for review tests: #25002
Overall Status: PARTIAL (2 tests skipped — no blocking failures)
Core Tests (#1–12)
| # | Test | Status |
|---|---|---|
| 1 | GitHub MCP Testing (last 2 merged PRs: #25176, #25171) | ✅ |
| 2 | MCP Scripts GH CLI Testing (PRs #25178, #25135) | ✅ |
| 3 | Serena MCP Testing (8 Config symbols found) |
✅ |
| 4 | Make Build Testing | ✅ |
| 5 | Playwright Testing (title: "GitHub · Change is constant…") | ✅ |
| 6 | Web Search Testing (WebSearch used — Tavily MCP not available) | ✅ |
| 7 | File Writing Testing (/tmp/gh-aw/agent/smoke-test-claude-24110244779.txt) |
✅ |
| 8 | Bash Tool Testing (cat verified file contents) | ✅ |
| 9 | Discussion Interaction Testing (comment on #25197) | ✅ |
| 10 | Agentic Workflows MCP Testing (smoke-claude: active, every 12h) | ✅ |
| 11 | Slack Safe Output Testing (#smoke-tests) |
✅ |
| 12 | Code Scanning Alert Safe Output Testing (dummy warning on README.md:1) | ✅ |
PR Review Tests (#13–19) — PR #25002
| # | Test | Status |
|---|---|---|
| 13 | Update PR Body (appended test message) | ✅ |
| 14 | PR Review Comment Testing (2 inline comments on action.yml and smoke-copilot.md) |
✅ |
| 15 | Submit PR Review (COMMENT event) | ✅ |
| 16 | Resolve Review Thread | |
| 17 | Add Reviewer (copilot) |
✅ |
| 18 | Push to PR Branch (smoke-test-files/smoke-claude-push-test.md) |
✅ |
| 19 | Close PR Testing |
Notes
- Test 6: No Tavily MCP tool available; used
WebSearchbuilt-in instead — results confirmed. - Test 16:
resolve_pull_request_review_threadrequires aPRRT_kwDO...GraphQL node ID. The REST API andpull_request_readtool return comment IDs, not thread node IDs. The tool was not invoked. - Test 19: Skipped by design — no bot/test PR identified as safe to close.
Run URL: https://github.com/github/gh-aw/actions/runs/24110244779
Timestamp: 2026-04-08T00:05 UTC
Note
🔒 Integrity filter blocked 3 items
The following items were blocked because they don't meet the GitHub integrity level.
- #25186
list_pull_requests: has lower integrity than agent requires. The agent cannot read data with integrity below "approved". - #25185
list_pull_requests: has lower integrity than agent requires. The agent cannot read data with integrity below "approved". - #25180
list_pull_requests: has lower integrity than agent requires. The agent cannot read data with integrity below "approved".
To allow these resources, lower min-integrity in your GitHub frontmatter:
tools:
github:
min-integrity: approved # merged | approved | unapproved | none💥 [THE END] — Illustrated by Smoke Claude · ● 318.2K · ◷
- expires on Apr 8, 2026, 2:07 AM UTC
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
Type
Fields
Give feedbackNo fields configured for issues without a type.