rcourtman 6185cf3f88 Bound alert lifecycle replay with a durable projection watermark ...

Projection replay walked the entire alert event log on every boot, twice
(monitor start and the resource-store boundary), synchronously on the
serving path, and every replayed event queued a full incident-store JSON
rewrite. A 64k-event log made startup exceed the dev supervisor's
health-kill window, so the backend restarted forever and never served.

The event log now owns per-consumer projection watermarks in
alert_store_meta, WalkOldest takes an AfterID cursor, and the single
catch-up pass runs in the background at the canonical resource-store
boundary with periodic watermark checkpoints. The watermark only
advances when both the incident store and the canonical change recorder
are attached, so partial-surface passes repair without marking events
applied, and lowering the watermark forces a full repair replay.
Incident-store saves now coalesce: a burst of mutations queues one
whole-store serialization instead of one per event, live paths included.

Registers the alert-lifecycle-replay-startup-scalability coverage gap
and amends the alerts and monitoring subsystem contracts accordingly.

2026-08-31 21:57:58 +01:00

..

config

Make informational alerts a first-class severity

2026-08-28 00:45:20 +01:00

eventlog

Bound alert lifecycle replay with a durable projection watermark

2026-08-31 21:57:58 +01:00

reducer

fix(alerts): stabilize noisy lifecycle signals

2026-08-29 17:32:17 +01:00

specs

feat(alerts): cut the canonical lifecycle family over to the reducer core

2026-08-27 00:15:58 +01:00

ack_identity_branchcov0724pm_test.go

Cover the missing arms of the SSRF, clone and classifier guards

2026-07-25 00:39:15 +01:00

ack_state.go

Stabilize backend race tests for v6 RC publish

2026-04-11 22:46:34 +01:00

active_cleanup.go

feat(alerts): detect SMART CRC counter growth

2026-08-27 03:26:21 +01:00

active_lifecycle.go

Harden alert durability and watchdog isolation

2026-08-28 10:14:02 +01:00

active_persistence_sync_unix.go

fix(alerts): make active restart state durable

2026-08-27 15:21:18 +01:00

active_persistence_sync_windows.go

fix(alerts): make active restart state durable

2026-08-27 15:21:18 +01:00

active_persistence.go

Harden alert recovery and qualification

2026-08-28 11:28:38 +01:00

active_state_bootstrap_test.go

Harden alert recovery and qualification

2026-08-28 11:28:38 +01:00

active_state_bootstrap.go

Harden alert recovery and qualification

2026-08-28 11:28:38 +01:00

alert_identity_migration_test.go

feat(alerts): migrate persisted alert identities

2026-08-27 12:04:49 +01:00

alert_identity_migration.go

feat(alerts): migrate persisted alert identities

2026-08-27 12:04:49 +01:00

alert_payload.go

feat: Pulse v6 release

2026-03-18 16:06:30 +00:00

alert_policy_test.go

feat(alerts): resolve alert policy through one declarative fold

2026-08-27 01:10:26 +01:00

alert_policy.go

feat(alerts): resolve alert policy through one declarative fold

2026-08-27 01:10:26 +01:00

alert_store.go

Harden alert durability and watchdog isolation

2026-08-28 10:14:02 +01:00

alerts_test.go

fix(alerts): correlate linked outage signals

2026-08-29 18:19:00 +01:00

backup_snapshot_branchcov0724pm_test.go

Cover the missing arms of the SSRF, clone and classifier guards

2026-07-25 00:39:15 +01:00

backup_snapshot.go

Fix stale backup alert attribution

2026-08-26 04:33:47 +01:00

callback_config_coverage_test.go

refactor: split alert config runtime

2026-05-06 14:29:06 +01:00

callbacks.go

Make alert escalations destination-specific and repeatable

2026-08-27 19:51:12 +01:00

canonical_identity_branchcov0724pm_test.go

Cover the missing arms of the SSRF, clone and classifier guards

2026-07-25 00:39:15 +01:00

canonical_identity.go

Make informational alerts a first-class severity

2026-08-28 00:45:20 +01:00

canonical_lifecycle.go

fix(alerts): correlate linked outage signals

2026-08-29 18:19:00 +01:00

canonical_metric_branchcov0724pm_test.go

Cover the missing arms of the SSRF, clone and classifier guards

2026-07-25 00:39:15 +01:00

canonical_metric.go

fix(alerts): stabilize noisy lifecycle signals

2026-08-29 17:32:17 +01:00

canonical_override_migration_test.go

fix(alerts): key docker container overrides by name so toggles survive updates

2026-08-06 22:04:04 +01:00

canonical_override_migration.go

Integrate trust-gate reliability fixes

2026-07-20 16:03:29 +01:00

canonical_stateful_test.go

fix(alerts): correlate linked outage signals

2026-08-29 18:19:00 +01:00

capacity_forecast_test.go

Add predictive storage capacity alerts

2026-08-27 20:41:08 +01:00

capacity_forecast.go

Add predictive storage capacity alerts

2026-08-27 20:41:08 +01:00

cleanup_test.go

chore(alerts): delete the legacy transition-state maps

2026-08-27 01:00:12 +01:00

clone_test.go

Add unit tests for Alert clone and metadata utility functions (alerts)

2025-11-30 05:19:38 +00:00

concurrency_test.go

feat: Pulse v6 release

2026-03-18 16:06:30 +00:00

config_aliases_test.go

feat: Pulse v6 release

2026-03-18 16:06:30 +00:00

config_facade_alias_branchcov0723am_test.go

Cover agent policy, alias normalization and agent report helpers

2026-07-23 06:44:33 +01:00

config_facade.go

Make informational alerts a first-class severity

2026-08-28 00:45:20 +01:00

config_runtime.go

Add rolling-window metric alert evaluation

2026-08-27 21:11:44 +01:00

config_validation_test.go

Bound alert escalation schedule delays

2026-08-27 20:12:36 +01:00

connection_test.go

chore(alerts): delete the legacy transition-state maps

2026-08-27 01:00:12 +01:00

connection.go

fix(alerts): correlate linked outage signals

2026-08-29 18:19:00 +01:00

constants.go

Bound server state broadcast memory

2026-07-02 23:27:49 +01:00

core.go

feat(alerts): cut the stateful family over to the reducer core

2026-08-27 00:31:27 +01:00

correlation_test.go

fix(alerts): correlate linked outage signals

2026-08-29 18:19:00 +01:00

critical_threshold_test.go

Fix unreachable critical escalation for high percentage thresholds

2026-06-26 22:42:02 +01:00

default_config.go

Add rolling-window metric alert evaluation

2026-08-27 21:11:44 +01:00

default_normalization_test.go

Seed disk temperature type defaults

2026-05-13 10:44:11 +01:00

disk_health.go

Restore physical disk node matching and unify the wearout sentinel

2026-07-24 20:58:09 +01:00

disk_type_infer_test.go

add disk-type-aware threshold field and device inference helper

2026-05-13 07:13:46 +01:00

disk_type_infer.go

add disk-type-aware threshold field and device inference helper

2026-05-13 07:13:46 +01:00

docker_override_migration.go

Resolve docker alert resource IDs in Patrol scope resolution

2026-08-14 06:26:15 +01:00

docker.go

feat(alerts): resolve alert policy through one declarative fold

2026-08-27 01:10:26 +01:00

escalation_repeat_test.go

Make alert escalations destination-specific and repeatable

2026-08-27 19:51:12 +01:00

escalation.go

Make alert escalations destination-specific and repeatable

2026-08-27 19:51:12 +01:00

event_emission_test.go

feat(alerts): append-only alert event log with suppression reasons

2026-08-26 21:15:37 +01:00

event_emission.go

Bound alert lifecycle replay with a durable projection watermark

2026-08-31 21:57:58 +01:00

external_probe_test.go

Harden external probe outage alerting

2026-07-29 20:09:23 +01:00

external_probe.go

feat(alerts): resolve alert policy through one declarative fold

2026-08-27 01:10:26 +01:00

file_read_limits.go

feat: Pulse v6 release

2026-03-18 16:06:30 +00:00

filter_evaluation_test.go

fix: correct Proxmox guest rate sampling

2026-07-24 10:26:50 +01:00

filter_evaluation.go

feat(alerts): resolve alert policy through one declarative fold

2026-08-27 01:10:26 +01:00

flapping_callback_test.go

fire flapping-detected callback on first transition

2026-05-13 00:28:24 +01:00

guest_identity_branchcov0725am_test.go

Cover the alert read-model, guest identity and action-planner validators

2026-07-25 06:34:48 +01:00

guest_metric_migration.go

Harden alert durability and watchdog isolation

2026-08-28 10:14:02 +01:00

guest_override_identity.go

Support guest filesystem alert overrides (#1205)

2026-07-30 10:59:27 +01:00

guest_snapshot_test.go

fix: correct Proxmox guest rate sampling

2026-07-24 10:26:50 +01:00

guest_snapshot.go

fix: correct Proxmox guest rate sampling

2026-07-24 10:26:50 +01:00

guest_tags_test.go

docs(governance): record notification tag routing contract

2026-07-30 14:54:34 +01:00

guest.go

fix(alerts): stabilize noisy lifecycle signals

2026-08-29 17:32:17 +01:00

health_assessment.go

refactor: split alert health assessment runtime

2026-05-06 14:10:41 +01:00

history_concurrency_test.go

Fix main CI fallout from the 50-node demo estate

2026-08-24 08:56:07 +01:00

history_dedup_test.go

fix(alerts): deduplicate flapping history entries on load and periodic cleanup

2026-06-27 16:36:29 +01:00

history_lifecycle_test.go

fix(alerts): harden event history recovery

2026-08-27 10:05:37 +01:00

history_migration_test.go

fix(alerts): make incident timelines lifecycle-driven

2026-08-27 14:45:36 +01:00

history_migration.go

fix(alerts): make incident timelines lifecycle-driven

2026-08-27 14:45:36 +01:00

history_projection_parity_test.go

fix(alerts): harden event history recovery

2026-08-27 10:05:37 +01:00

history_projection.go

feat(alerts): add per-alert snooze

2026-08-27 17:20:32 +01:00

history_recurrence_test.go

feat(alerts): cut the canonical lifecycle family over to the reducer core

2026-08-27 00:15:58 +01:00

history_test.go

fix(alerts): harden event history recovery

2026-08-27 10:05:37 +01:00

history.go

fix(alerts): make incident timelines lifecycle-driven

2026-08-27 14:45:36 +01:00

host_dedup_test.go

feat(alerts): cut the canonical metric-threshold family over to the reducer core

2026-08-27 00:27:01 +01:00

host_disk_type_test.go

chore(alerts): delete the legacy transition-state maps

2026-08-27 01:00:12 +01:00

host_unraid_lifecycle_test.go

feat(agent): add REST custom metrics

2026-07-30 19:08:28 +01:00

host.go

fix(alerts): correlate linked outage signals

2026-08-29 18:19:00 +01:00

incident_synthesis_test.go

Add infrastructure-aware incident synthesis

2026-08-30 22:32:21 +01:00

incident_synthesis.go

Add infrastructure-aware incident synthesis

2026-08-30 22:32:21 +01:00

intent_persistence.go

Add powered-off alert tolerance

2026-07-24 12:23:29 +01:00

intent_policy_branchcov0724pm_test.go

Cover pure helpers and persistence round-trips across the backend

2026-07-25 00:21:35 +01:00

intent_policy_manager_branchcov0721am_test.go

Add branch-coverage tests for unifiedresources helpers, smartctl targets, intent-policy manager

2026-07-21 06:14:26 +01:00

intent_policy_test.go

feat(alerts): add recurring scoped maintenance

2026-08-27 18:20:03 +01:00

intent_policy.go

feat(alerts): add recurring scoped maintenance

2026-08-27 18:20:03 +01:00

issue1497_test.go

fix(websocket): send resource deltas after initial state

2026-08-06 00:48:37 +01:00

lifecycle_contract_test.go

test(alerts): pin the lifecycle contracts as a release gate

2026-08-27 09:09:56 +01:00

lifecycle.go

feat(alerts): append-only alert event log with suppression reasons

2026-08-26 21:15:37 +01:00

manager.go

Harden alert durability and watchdog isolation

2026-08-28 10:14:02 +01:00

metric_hooks.go

refactor: finish alerts manager decomposition

2026-05-06 15:00:30 +01:00

metric_runtime.go

fix(alerts): stabilize noisy lifecycle signals

2026-08-29 17:32:17 +01:00

migration_characterization_test.go

chore(alerts): delete the legacy transition-state maps

2026-08-27 01:00:12 +01:00

model.go

Add infrastructure-aware incident synthesis

2026-08-30 22:32:21 +01:00

node.go

fix(alerts): correlate linked outage signals

2026-08-29 18:19:00 +01:00

notification_activation_boundary_test.go

fix(alerts): make incident timelines lifecycle-driven

2026-08-27 14:45:36 +01:00

notification_policy.go

Add infrastructure-aware incident synthesis

2026-08-30 22:32:21 +01:00

offline_toggle_test.go

chore(alerts): delete the legacy transition-state maps

2026-08-27 01:00:12 +01:00

operational_contract_test.go

feat(alerts): add per-alert snooze

2026-08-27 17:20:32 +01:00

operational_contract.go

Make informational alerts a first-class severity

2026-08-28 00:45:20 +01:00

operational_state_writers_test.go

Harden Operational Trust rollout contracts

2026-07-19 15:11:02 +01:00

override_normalization_test.go

Forward-port stable guest alert override identity

2026-04-01 12:40:51 +01:00

pbs_datastore_override_alias_test.go

Deduplicate PBS datastores and bridge their override key formats

2026-07-18 19:41:53 +01:00

pbs_offline_notification_test.go

chore(alerts): delete the legacy transition-state maps

2026-08-27 01:00:12 +01:00

pbs.go

feat(alerts): resolve alert policy through one declarative fold

2026-08-27 01:10:26 +01:00

per_metric_delay_example_test.go

chore(alerts): delete the legacy transition-state maps

2026-08-27 01:00:12 +01:00

pmg_anomaly_test.go

chore(alerts): delete the legacy transition-state maps

2026-08-27 01:00:12 +01:00

pmg.go

feat(alerts): resolve alert policy through one declarative fold

2026-08-27 01:10:26 +01:00

powered_off_severity_override_test.go

Let a per-resource severity override re-enable disabled offline alerts

2026-08-22 06:24:04 +01:00

powered_off_tolerance_test.go

chore(alerts): delete the legacy transition-state maps

2026-08-27 01:00:12 +01:00

quiet_hours_test.go

Fix alert threshold and disk temperature regressions

2026-06-12 19:19:16 +01:00

read_model_branchcov0725am_test.go

Cover the alert read-model, guest identity and action-planner validators

2026-07-25 06:34:48 +01:00

read_model.go

Make informational alerts a first-class severity

2026-08-28 00:45:20 +01:00

reducer_parity_ack_test.go

chore(alerts): delete the legacy transition-state maps

2026-08-27 01:00:12 +01:00

reducer_parity_backup_test.go

chore(alerts): delete the legacy transition-state maps

2026-08-27 01:00:12 +01:00

reducer_parity_discrete_test.go

chore(alerts): delete the legacy transition-state maps

2026-08-27 01:00:12 +01:00

reducer_parity_intent_test.go

chore(alerts): delete the legacy transition-state maps

2026-08-27 01:00:12 +01:00

reducer_parity_recovery_test.go

chore(alerts): delete the legacy transition-state maps

2026-08-27 01:00:12 +01:00

reducer_parity_refire_test.go

chore(alerts): delete the legacy transition-state maps

2026-08-27 01:00:12 +01:00

reducer_parity_test.go

chore(alerts): delete the legacy transition-state maps

2026-08-27 01:00:12 +01:00

resolved_lock_discipline_test.go

chore(alerts): delete the legacy transition-state maps

2026-08-27 01:00:12 +01:00

resource_monitoring_policy.go

feat(alerts): add recurring scoped maintenance

2026-08-27 18:20:03 +01:00

shadow_feed_test.go

chore(alerts): delete the legacy transition-state maps

2026-08-27 01:00:12 +01:00

shadow.go

feat(alerts): cut the stateful family over to the reducer core

2026-08-27 00:31:27 +01:00

snooze_lifecycle_test.go

Bound alert escalation schedule delays

2026-08-27 20:12:36 +01:00

storage_override_identity.go

Reconcile Ceph pool alert identity

2026-05-28 14:42:43 +01:00

storage.go

Add predictive storage capacity alerts

2026-08-27 20:41:08 +01:00

synology_test.go

refactor: split alert health assessment runtime

2026-05-06 14:10:41 +01:00

system_alert.go

Make informational alerts a first-class severity

2026-08-28 00:45:20 +01:00

telemetry_quality_test.go

Add privacy-safe alert quality telemetry

2026-08-29 14:00:28 +01:00

telemetry_quality.go

Add privacy-safe alert quality telemetry

2026-08-29 14:00:28 +01:00

test_helpers_test.go

chore(alerts): delete the legacy transition-state maps

2026-08-27 01:00:12 +01:00

threshold_resolution_shared_test.go

fix(alerts): stabilize noisy lifecycle signals

2026-08-29 17:32:17 +01:00

threshold_update_test.go

Port v5 alert lifecycle and linked agent overrides

2026-04-15 12:18:57 +01:00

time_threshold_test.go

fix(alerts): stabilize noisy lifecycle signals

2026-08-29 17:32:17 +01:00

tracking_cleanup.go

feat(alerts): detect SMART CRC counter growth

2026-08-27 03:26:21 +01:00

unified_eval_critical_cap_test.go

Keep high percentage triggers evaluable when the critical cap collides

2026-07-18 19:44:06 +01:00

unified_eval_parity_test.go

Track alert save workers during shutdown

2026-06-28 01:39:12 +01:00

unified_eval_test.go

fix(alerts): stabilize noisy lifecycle signals

2026-08-29 17:32:17 +01:00

unified_eval.go

Add predictive storage capacity alerts

2026-08-27 20:41:08 +01:00

unified_incident_confirmation_test.go

chore(alerts): delete the legacy transition-state maps

2026-08-27 01:00:12 +01:00

unified_incidents_test.go

Stop stamping Patrol attention rows with evidence-timing noise

2026-08-10 09:47:06 +01:00

unified_incidents.go

Add infrastructure-aware incident synthesis

2026-08-30 22:32:21 +01:00

update_alerts_test.go

Resolve docker alert resource IDs in Patrol scope resolution

2026-08-14 06:26:15 +01:00

utility_test.go

Disambiguate linked host-agent alert names

2026-06-04 09:33:02 +01:00

windowed_metric_test.go

Add rolling-window metric alert evaluation

2026-08-27 21:11:44 +01:00

windowed_metric.go

Add rolling-window metric alert evaluation

2026-08-27 21:11:44 +01:00