Collect three SearchableBucketEmbedded first-attempt reports after runner artifact retention lands
Written: 2026-10-27 11:08:44 UTC by fable-W5-1027.
RE-VERIFY: This is a write-time snapshot. Read PR states with gh pr view, remote heads with git ls-remote, main workflow/scripts and effective rules with gh api, and every test's attempts from downloaded test-attempt-results XML. A final ALL TESTS PASSED summary does not establish first-attempt cleanliness.
Design decisions in force
Owner direction, 2026-10-27: "Use your best judgement, do not ask blocking questions."
Current orchestrator ruling: use GitHub bld-build runner evidence rather than waiting on recovering BuildTest. Collect per-test first-attempt records from at least three main-branch runs where available, plus read the three earlier admitted remote runs if they have executed. Complete only when three inspectable runs have zero first-attempt failures; otherwise fix each demonstrated defect test-first. Deleted evidence is not a blocker: regenerate it. No merge, queue action, approval, production action, timeout increase, test iteration cut or assertion weakening is authorized for this worker. The orchestrator owns merges and CI waits. The full-suite gate is bld-build on the GitHub runner; do not run a full local suite on this shared worker.
Mission and verified findings
The original handoff asked to investigate eight first-attempt failures in remote run 5b93c074 after the recovery change. Historical records were removed by retention. Earlier W1 submitted 00653c5b, b360f7c9, b80e0a89, but their clients expired while the runs were pending with no attempts. Those snapshots are preserved on the W1 evidence branch; W5 did not treat them as current facts or clean results.
W5 claimed successfully and cleared the stale remote-scheduling blocked reason. Main is cf052452ce5b0db549cb176337b7ef7c48376f9f. Recovery and reader-cleanup changes are already merged at https://github.com/CodexCoder21Organization/SearchableBucketEmbedded/pull/21 and https://github.com/CodexCoder21Organization/SearchableBucketEmbedded/pull/22. The separate interruption change https://github.com/CodexCoder21Organization/SearchableBucketEmbedded/pull/23 remains open at 66b7c6e993e5b5a2badfc352f9df6d780b20b32d at the W5 read; it was not modified, closed or adopted by this item.
The requested racing setup already exists: scripts/build.bash and scripts/test.bash pin kompile-cli 0.0.124; .github/workflows/bld-build.yml runs both build and full tests with --local-and-remote, including --test . --log test_log_file.xml. Main's effective required status check is bld-build (integration 15368), not a remote-only check. No ruleset or toolchain upgrade is needed.
Three newest main bld-build runs were read directly:
| Run |
Commit |
Final summary |
Individual attempt evidence |
| https://github.com/CodexCoder21Organization/SearchableBucketEmbedded/actions/runs/40324412985 |
cf052452ce5b0db549cb176337b7ef7c48376f9f |
188/188 passed |
none; zero artifacts, no per-test attempt rows in raw job log |
| https://github.com/CodexCoder21Organization/SearchableBucketEmbedded/actions/runs/40308961711 |
06b17734f1b020f0ca58d0e56dcb4ef888125d19 |
179/179 passed |
none; zero artifacts, no per-test attempt rows in raw job log |
| https://github.com/CodexCoder21Organization/SearchableBucketEmbedded/actions/runs/39461729128 |
4836b2981c617f32723be229a115a9a1be698d89 |
140/140 passed |
none; zero artifacts, no per-test attempt rows in raw job log |
The mechanism is specific: the workflow generates test_log_file.xml in its disposable runner but never uploads it. Successful suite summaries cannot establish each first attempt passed. W5 opened https://github.com/CodexCoder21Organization/SearchableBucketEmbedded/pull/24 to preserve that existing file with an always-run actions/upload-artifact@v4 step, named test-attempt-results, with 30-day retention. This is eight workflow lines only; all build/test commands, pins, timeouts, assertions and triggers are unchanged. The pinned CLI manager includes attempt-history XML support. Actionlint 1.7.12 and git diff --check passed; an independent static review found no blocking issue. Hosted upload and usable XML remain for CI to verify. No local full suite was run for this CI-only change.
Each earlier remote run was read once through the existing read-only collector. All three calls failed the initial health RPC with CONCURRENT_HANDLER_LIMIT (TcpServer port 46125 at 256 request handlers), before metadata or attempt retrieval. Current run status/counts therefore remain unverified. No run was submitted, retried, attached, cancelled or waited on. This remote failure is not a dependency for obtaining runner evidence.
Relevant PRs / refs
| Repository |
Branch URL |
Remote head SHA |
PR URL |
State |
| CodexCoder21Organization/SearchableBucketEmbedded |
https://github.com/CodexCoder21Organization/SearchableBucketEmbedded/tree/ci/preserve-first-attempt-results-20261027 |
5e6d7179cc062474fef85850df8ef8ad7584f7f7 |
https://github.com/CodexCoder21Organization/SearchableBucketEmbedded/pull/24 |
Open, ready for review; static workflow checks and independent review pass; orchestrator owns CI and landing |
| CodexCoder21Organization/SearchableBucketEmbedded |
https://github.com/CodexCoder21Organization/SearchableBucketEmbedded/tree/evidence/w5-first-attempt-retention-20261027 |
0576f58650d92db3049cf392abd65eeff54087b2 |
none |
W5 durable evidence only; raw runner logs/hashes, zero-artifact responses, ruleset snapshot, remote errors, review |
| CodexCoder21Organization/SearchableBucketEmbedded |
https://github.com/CodexCoder21Organization/SearchableBucketEmbedded/tree/evidence/w1-5b93c074-retention-20261027 |
cfcf94a91d3df8b449eb55951330c31f3ecd410a |
none |
Prior historical and pending-run evidence, preserved and not modified |
| CodexCoder21Organization/SearchableBucketEmbedded |
https://github.com/CodexCoder21Organization/SearchableBucketEmbedded/tree/fix/hq026-run-5b93c074-evidence |
73c2ae89d0625a882d924c072408ac7cf3d9b8cc |
none |
Earlier historical read-error evidence, preserved and not modified |
| CodexCoder21Organization/SearchableBucketEmbedded |
https://github.com/CodexCoder21Organization/SearchableBucketEmbedded/tree/wip/interrupt-safe-index-reads |
66b7c6e993e5b5a2badfc352f9df6d780b20b32d |
https://github.com/CodexCoder21Organization/SearchableBucketEmbedded/pull/23 |
Separate open interruption effort, read only, untouched by W5 |
W5 evidence directory: https://github.com/CodexCoder21Organization/SearchableBucketEmbedded/tree/evidence/w5-first-attempt-retention-20261027/handoffs/artifacts/w5-runner-attempts-20261027 . Raw logs retain their original whitespace and hashes. No binary build artifacts, caches or credentials were committed. W5 checkout is clean, with no stash or unpushed commit; both branch heads were checked against git ls-remote. Nothing was deployed or published by this worker.
Next steps
- Re-verify live state first. Review and land https://github.com/CodexCoder21Organization/SearchableBucketEmbedded/pull/24 through the existing required bld-build gate. Confirm test-attempt-results contains usable test_log_file.xml. No ruleset, deployment or Maven publication step is required.
- Collect three main-branch bld-build runs with the new workflow: the merge-triggered run and two workflow_dispatch runs are sufficient if all actually execute the full suite. Use gh workflow run bld-build.yml --ref main --repo CodexCoder21Organization/SearchableBucketEmbedded for the two independent fresh runs. The orchestrator owns their waits; do not wait on BuildTest.
- Download test-attempt-results from each run and parse the XML. Reconcile all selected test identities, inspect each attempt-history/attempt number 1, and retain every first failed output/stacktrace even if a later attempt passes. An absent report, incomplete selection or final summary alone is not a clean run. Preserve the three XML reports on an evidence branch before artifact retention expires.
- If a first attempt failed, reproduce the named failure reliably before changing code, record red/green/revert-control, fix it at its owning layer, and open one PR per independent defect. Do not infer a root cause from summaries or add retries/timeouts. Search existing PRs before duplicating a fix.
- When three inspectable main suites have zero failed first attempts, report DONE and complete this handoff. Until then it stays open-claimed for the orchestrator's continuation. There is no current demonstrated flake fix, no deployment, and no publication waiting on this PR.
Operational notes
Use gh api repos/<owner>/<repo>/actions/jobs/<job-id>/logs for raw runner logs: gh run view --log returned empty stdout with exit 0 in this session. W5 job IDs were 121577294395, 121525023564, 118762626408. gh pr edit hit a Projects classic GraphQL error; updating the body through the pull-request REST PATCH succeeded. The report-challenge CLI was not invoked because it automatically merges, which this assignment forbids; CHALLENGE.md preserves the findings for the orchestrator.
Read: github-repos, create-handoff, status-report, kotlin-ci-setup and report-challenge skills; complete handoff-triage README; SearchableBucketEmbedded README; externalbrain github-builders-racing-remote-ci.md; public CLI XML-attempt regression sources and upload-artifact action definition. The independent reviewer also read the supplied Testing Architecture and Engineering Philosophy guidance. No background runner or watcher from W5 remains.