Record unresolved unattended provider failure

An empty provider response and summary timeout can complete a still-unhealthy finding as needs_attention and suppress later automatic investigation. Retain this qualification gap so passing restart reconciliation proofs are not mistaken for dependable unattended recovery.

Contract-Neutral: Qualification evidence records an unresolved provider failure without changing runtime or subsystem contracts.
This commit is contained in:
rcourtman
2026-10-16 15:23:24 +01:00
parent 6a7f516c41
commit 60c26b5097
+17 -2
View File
@@ -10068,7 +10068,7 @@
},
{
"id": "patrol-assistant-customer-outcome-qualification",
"summary": "The executable redesign plan, product contract, honest baseline and exact qualification receipts are in docs/qualification/PATROL_ASSISTANT_CUSTOMER_JOURNEY.md. Model-owned investigation and the named healthy, unhealthy, dependency, missing-access, storage-capacity, approved and rejected local matrix landed through core PR1960 and enterprise PR23. The shared incident-history continuation landed through PR1973 as 783571bb35c42c4813415d4981673f65c069ee0f, preserving canonical provenance, risk, bounded history, operator notes and the linked Assistant journey. Final worker hooks, affected race suites, all eight hosted Playwright shards, frontend, API and remaining CI tests pass. All 28 reported checks pass after one controlled benchmark repeat. Its first failure and loaded-worker comparison remain recorded, as do the earlier API timeouts. Final source-bound local browser proof covers /alerts at 1440, 900, 768, 767 and 390 widths. Five funded history turns cost US$0.36895475 estimated, with three Astra passes and two Gemini failures. The restored local Gemini route remains unqualified for its unsupported action-absence claims. Passing Astra history explanations do not qualify Gemini or transfer the earlier lab matrix between models. Production-wide readiness requires independent volunteered customer environments and known-condition outcome review beyond this maintainer homelab. Adoption and reported resolutions do not establish population useful-diagnosis, false-alarm, missed-problem or latency rates, which remain unknown. Storage-capacity proof does not qualify backup restore, unattended autonomy or every compatibility filter. Preserve the subscription-provider refusal without retry or bypass. Keep this gap and candidate open while these evidence limits remain.",
"summary": "The executable redesign plan, product contract, honest baseline and exact qualification receipts are in docs/qualification/PATROL_ASSISTANT_CUSTOMER_JOURNEY.md. Model-owned investigation and the named healthy, unhealthy, dependency, missing-access, storage-capacity, approved and rejected local matrix landed through core PR1960 and enterprise PR23. The shared incident-history continuation landed through PR1973 as 783571bb35c42c4813415d4981673f65c069ee0f, preserving canonical provenance, risk, bounded history, operator notes and the linked Assistant journey. Final worker hooks, affected race suites, all eight hosted Playwright shards, frontend, API and remaining CI tests pass. All 28 reported checks pass after one controlled benchmark repeat. Its first failure and loaded-worker comparison remain recorded, as do the earlier API timeouts. Final source-bound local browser proof covers /alerts at 1440, 900, 768, 767 and 390 widths. Five funded history turns cost US$0.36895475 estimated, with three Astra passes and two Gemini failures. The restored local Gemini route remains unqualified for its unsupported action-absence claims. Passing Astra history explanations do not qualify Gemini or transfer the earlier lab matrix between models. Production-wide readiness requires independent volunteered customer environments and known-condition outcome review beyond this maintainer homelab. Adoption and reported resolutions do not establish population useful-diagnosis, false-alarm, missed-problem or latency rates, which remain unknown. Storage-capacity proof does not qualify backup restore, unattended autonomy or every compatibility filter. Preserve the subscription-provider refusal without retry or bypass. Keep this gap and candidate open while these evidence limits remain. Unattended qualification also remains open after the 2026-10-16 restart-reconciliation work in Pulse PR2989 and enterprise PR121. A clean 36-minute Pro run retained an empty provider response followed by a 20-second final-summary timeout. The narrative fallback was completed as needs_attention and excluded later reinvestigation while the target remained unhealthy. This provider-failure-to-terminal-outcome path remains unresolved. Passing restart readback and unresolved-verification follow-up proofs does not qualify the complete unattended workflow.",
"owner": "project-owner",
"status": "planned",
"recorded_at": "2026-09-05",
@@ -10105,6 +10105,16 @@
"path": "docs/release-control/v6/internal/subsystems/unified-resources.md",
"kind": "file"
},
{
"repo": "pulse",
"path": "internal/ai/chat/agentic_final.go",
"kind": "file"
},
{
"repo": "pulse",
"path": "internal/ai/findings.go",
"kind": "file"
},
{
"repo": "pulse",
"path": "internal/ai/qualification",
@@ -10114,6 +10124,11 @@
"repo": "pulse",
"path": "scripts/check-patrol-assistant-journey.mjs",
"kind": "file"
},
{
"repo": "pulse-enterprise",
"path": "internal/investigation/orchestrator.go",
"kind": "file"
}
]
}
@@ -10237,7 +10252,7 @@
{
"id": "patrol-assistant-customer-outcomes",
"name": "Patrol and Assistant Customer Outcomes",
"summary": "Simplify Patrol around capable-model judgment and one issue-to-verified-outcome journey shared with Assistant. Preserve canonical evidence, mechanical authority and independent verification. The executable redesign plan and exact limits are in docs/qualification/PATROL_ASSISTANT_CUSTOMER_JOURNEY.md. Local implementation and the named lab matrix landed through core PR1960 and enterprise PR23. PR1973 delivered the shared incident-history continuation with final source-bound browser proof and passing CI. Keep this candidate proposed for unresolved Gemini history reliability and the independent volunteered-environment rollout gate. Local implementation proof does not establish production-wide effectiveness, backup restore or unattended autonomy.",
"summary": "Simplify Patrol around capable-model judgment and one issue-to-verified-outcome journey shared with Assistant. Preserve canonical evidence, mechanical authority and independent verification. The executable redesign plan and exact limits are in docs/qualification/PATROL_ASSISTANT_CUSTOMER_JOURNEY.md. Local implementation and the named lab matrix landed through core PR1960 and enterprise PR23. PR1973 delivered the shared incident-history continuation with final source-bound browser proof and passing CI. Keep this candidate proposed for unresolved Gemini history reliability and the independent volunteered-environment rollout gate. Local implementation proof does not establish production-wide effectiveness, backup restore or unattended autonomy. The 2026-10-16 comparison also leaves unattended provider-failure recovery unqualified: an empty response and timed-out final summary can complete an unresolved finding as needs_attention and suppress later automatic investigation.",
"status": "proposed",
"recorded_at": "2026-09-05",
"target_id": "v6-product-lane-expansion",