During UrlResolver flaky-test verification on 2026-07-13, ./scripts/test.bash --test

Reported (UTC): 2026-07-13 19:39

During UrlResolver flaky-test verification on 2026-07-13, ./scripts/test.bash --test stressTestFreshJoinWithdrawalDeliveryUnderConcurrentReannounce successfully compiled the changed resolver to /tmp/qtbuild9955142350690634519/resolver-0.0.632.jar, but while the same kompile process was still selecting/compiling the test its generated classpath entries under /home/leslie/.aibuildcaches/_code_fix-two-flakes_workspace_UrlResolver disappeared. The process then looped thousands of times with exact diagnostics 'Classpath entry points to a non-existent location: .../buildscriptCache/.../value', 'Classpath entry points to a non-existent location: .../buildscriptCache/builtinJars/.../build-kotlin-jvm-builtin-rules.jar', and '/tmp/.../cmd.kt:1:31: error: unresolved reference: foundation' for foundation.url.resolver.buildMaven(), producing over 400,000 tokens until interrupted. Impact: the official test wrapper never reached the test despite a valid compiled artifact, and repeated invocations are unsafe when concurrent jobs share and delete ~/.aibuildcaches (this task itself is required to purge that global path after edits). Workaround: verify the already-built resolver artifact with the exact compiled test class through a direct non-reflective runner. Durable fix: isolate aibuild cache roots per workspace/process or make cache invalidation atomic/versioned, and make the selector fail fast instead of infinitely recompiling when a referenced cache entry vanishes.

Production verification — 2026-07-17

Status: STILL EXISTS. A live ProductionHealth URL connection succeeded but emitted repeated NothingToCompleteException failures while forwarding gossip; the last HardwareControlFabric daemon log also contains Netty ByteBuf leak reports in libp2p negotiation paths.

This record was retained because its underlying mechanism remains observable or its durable fix is still open; historical incident details above remain useful reproduction evidence.