Commit Graph

1342 Commits

Author SHA1 Message Date
rcourtman 1ffcfbeaf6 Guard storage backups from failed polls 2025-10-11 10:00:05 +00:00
rcourtman 74bc5d5229 Merge branch 'pr/532' 2025-10-11 09:13:41 +00:00
rcourtman dfeb670ec3 fix: force C locale for advanced storage listing 2025-10-11 09:13:32 +00:00
rcourtman 96b6454463 Sync alert configuration updates 2025-10-11 07:36:54 +00:00
rcourtman d7cc972265 Improve LXC disk usage reporting 2025-10-11 07:35:44 +00:00
Matthieu 82c82ae093 fixing printf failing under non-C locales
Ensuring numeric values are parsed using a consistent locale.
Fixes an issue where printf failed under non-C locales (e.g. fr_FR) due to the use of . as a decimal separator.
2025-10-11 07:34:16 +02:00
rcourtman 80b4f50532 fix: improve update experience and handle missing releases gracefully
Backend:
- Handle 'no releases found' error gracefully instead of returning 500
- Return proper response indicating no updates available for the channel
- Fixes the 500 error when checking for updates on development versions

Frontend:
- Detect when backend enters 'restarting' phase during updates
- Show 'Pulse is restarting...' message instead of getting stuck on 'Initializing...'
- Implement health check polling with exponential backoff (2s → 15s max)
- Auto-reload page when backend becomes healthy again
- Improve messaging: inform users page will reload automatically

This fixes the stuck update modal issue where users would see
'Initializing...' forever when the backend restarted during updates.
2025-10-10 21:31:36 +00:00
rcourtman f42308456a fix: comprehensive sanitization of diagnostics export for GitHub sharing
Closes all data leakage paths in the sanitized diagnostics export:
- Rebuild nodeStatus from sanitized nodes to prevent name leakage
- Sanitize storage entries (nodes arrays, nodeIds, instance, storage field)
- Sanitize activeAlerts (id, resourceId, resourceName, node, instance)
- Sanitize nested physicalDisks and vmDiskCheck data in nodes array

The sanitized export now properly redacts all sensitive data including
IP addresses, hostnames, node names, instance names, and storage names
while preserving the data structure for debugging purposes.
2025-10-10 21:10:53 +00:00
rcourtman 335c15fb3f refactor: remove Update History tab from Settings UI
The Update History panel was never populated for Manager updates and
only works with InstallShAdapter (systemd deployments). For a home lab
tool, this adds unnecessary UI clutter.

Removed:
- Update History tab from Administration section
- UpdateHistoryPanel import and component usage

The UpdateHistoryPanel.tsx file remains for potential future use with
InstallShAdapter, but is no longer visible in the main Settings UI.
2025-10-10 20:47:53 +00:00
rcourtman b250febcdd refactor: remove update history tracking from Manager
The update history infrastructure (history.go, UI panel) already exists
and is used by InstallShAdapter. However, for a home lab monitoring tool,
tracking every update in the Manager is overkill.

Removed:
- History field and initialization from Manager
- Event tracking in ApplyUpdate function
- Update history population on success/failure

The history.go file and UI panel remain for InstallShAdapter usage,
but the main Manager update path is now simpler and more focused.
2025-10-10 20:43:25 +00:00
rcourtman f05f47f935 fix: comprehensive update system improvements
Fixed 12 critical issues in the update system:

Critical bugs:
- Cache invalidation when channel auto-detected vs explicitly provided
- Data race on cache access (added proper RWMutex locking)
- Incorrect error handling when already on latest version

Security improvements:
- Command injection prevention with version string validation
- Symlink vulnerabilities in backup/restore (replaced cp with safe Go implementations)
- SHA256 checksum verification for downloads
- Improved backup completeness (now includes binary and VERSION file)

Quality improvements:
- Channel-keyed cache map instead of single cache value
- Update history tracking with event IDs and rollback support
- Cleanup of old temp directories (24+ hours)
- Proper resource cleanup with Close() method
2025-10-10 20:35:11 +00:00
rcourtman fe1518457a fix: auto-detect update channel from current version and add background checker
- Auto-detect update channel from current version when config is empty
  (RC users automatically get RC updates, stable users get stable)
- Add background update checker that runs on startup and hourly
- Add GetCachedUpdateInfo() method to return cached update info
- Update /api/version endpoint to include updateAvailable from cache
- Fixes issue where RC users on rc.4 weren't seeing rc.5 updates

This ensures RC testers continue receiving RC notifications while
stable users stay on the stable channel, all without explicit config.
2025-10-10 19:46:52 +00:00
rcourtman 64df42c62c chore: bump version to v4.22.0-rc.5 2025-10-10 19:07:09 +00:00
rcourtman 3ad41829ab revert: undo version bump to 4.22.0-rc.5 2025-10-10 18:51:15 +00:00
rcourtman e305b245f5 fix: remove unused tokenAvailable function in DockerAgents 2025-10-10 18:45:33 +00:00
rcourtman 07d9e389bd chore: bump version to v4.22.0-rc.5 2025-10-10 18:43:15 +00:00
rcourtman ef6adfc121 test: add comprehensive regression tests for memory cache-aware calculation (#435)
Adds TestMemoryStatusEffectiveAvailable_RegressionIssue435 with 5 test scenarios
covering all memory calculation edge cases reported in GitHub issue #435:

1. Proxmox 8.x with 'available' field (most common)
2. Older Proxmox with 'avail' field
3. Derived calculation from free+buffers+cached
4. Real user case: 86% displayed when actual usage was 42%
5. Missing all cache fields (fallback behavior)

Tests verify EffectiveAvailable() correctly returns cache-aware memory values
and calculates realistic usage percentages that exclude reclaimable cache.

These tests ensure future changes don't regress the cache-aware behavior
that was fixed in v4.15.0-rc.3.
2025-10-10 18:35:16 +00:00
rcourtman d6e61e73ec fix: resolve Docker container permission and path errors in v4.22.0-rc.4
- Fix update history using hardcoded /var/lib/pulse instead of configured data dir
- Skip mock.env watching in Docker environments to avoid 'no such file' errors

Fixes issue #529

Update History Path:
- Modified NewUpdateHandlers to accept dataDir parameter
- Pass r.config.DataPath from router (honors PULSE_DATA_DIR=/data in Docker)
- Maintains backward compatibility with default /var/lib/pulse when empty

Mock Env Watcher:
- Check PULSE_DOCKER env var and skip mock.env watching if true
- Only watch /opt/pulse/mock.env if directory exists (not in containers)
- Guard all mock.env operations to prevent errors when path is empty
- Clean up log messages to only show mock_env_path when actually watching
2025-10-10 18:17:38 +00:00
rcourtman 81f96537e2 fix: resolve docker-agent-install 401 error from trailing slash in PULSE_URL
- Strip trailing slash from PULSE_URL in install script to prevent double-slash URLs
- Add path normalization in router for defense-in-depth on public endpoint matching
- Fixes issue #528 where users copying URLs with trailing slashes got 401 errors

The install script now normalizes PULSE_URL with ${PULSE_URL%/} before concatenating
with /download/pulse-docker-agent, preventing https://example.com//download URLs.

The router normalization provides additional resilience for path matching, though the
existing path traversal check already blocks double slashes at ServeHTTP level.
2025-10-10 18:09:55 +00:00
rcourtman 91222face7 fix: comprehensive Docker agent token security improvements
This commit addresses 6 critical security and UX issues in Docker agent
token handling identified through code review:

**High Priority Fixes:**
1. Fix stale token in command preview - Changed DockerAgents to use
   getInstallCommandTemplate() that always returns placeholder, allowing
   CommandBuilder to handle all token substitution reactively. Command
   preview now updates live as user types.

2. Fix misleading "multiple tokens" messaging - Updated token generation
   modal to accurately reflect single-token backend model with red warning:
   "This will immediately invalidate your existing token". Prevents operators
   from unknowingly breaking active Docker agents.

3. Close proxy auth bypass vulnerability - Both HandleRegenerateAPIToken
   and HandleValidateAPIToken now explicitly reject requests when proxy auth
   is configured but validation fails (returns 401). Prevents unauthenticated
   access when proxy auth is enabled.

**Medium Priority Fixes:**
4. Disable buttons when no stored token - "Use This Token" and "Copy" buttons
   now properly disabled with contextual tooltips when browser hasn't saved
   a token, eliminating confusing silent no-ops.

5. Improve frontend error handling - Token validation now distinguishes
   between authentication errors (401/403), rate limiting (429), network
   failures, and actual invalid tokens. No longer mislabels auth failures
   as "invalid token".

**Low Priority Fixes:**
6. Add authentication to validate-token endpoint - Endpoint now requires
   admin authentication (same as regenerate-token), preventing unauthenticated
   token guessing oracle despite rate limiting.

**New Component:**
- CommandBuilder.tsx: Interactive command builder with live preview,
  state-based visual cues, inline token generation, and validation

**Security Impact:**
- Closes unauthenticated validation surface
- Enforces proper proxy auth gating
- Prevents accidental exposure of security model
- Rate limiting maintained (10 attempts/min)

**UX Impact:**
- Clear, accurate error messages
- Live-updating command preview
- Contextual token management
- Disabled states prevent confusion

Reviewed and verified by both Claude Code and Codex with no regressions found.
2025-10-10 17:54:53 +00:00
rcourtman ddd0b7d3d3 fix: remove unused formatRelativeTime import and fix UpdateBanner type safety 2025-10-10 16:09:15 +00:00
rcourtman a1649d2e03 fix: resolve test failures and TypeScript errors
- Add missing postfix queue endpoint to PMG test mock server
- Add 'pmg' to DiscoveredServer type in Settings.tsx
- Fix potentially undefined object in UpdateBanner.tsx
- Remove unused imports and variables in Dashboard.tsx, MailGateway.tsx, NodeSummaryTable.tsx
2025-10-10 16:08:09 +00:00
rcourtman 3aa8e387e4 chore: bump version to v4.22.0-rc.4 2025-10-10 16:04:27 +00:00
rcourtman 8d3acbef5c fix: add navigation to Update History from progress modal
The "View History" button in UpdateProgressModal now properly navigates
to /settings/updates instead of just closing the modal.

This completes the update flow UX - users can now seamlessly transition
from update completion to viewing the full audit log.
2025-10-10 15:59:49 +00:00
rcourtman 5f911afe21 feat: add complete update UI with modals and history panel
Implements full update UX based on adapter system:

Components:
- UpdateConfirmationModal: Shows version jump, prerequisites, root warning, acknowledgement checkbox
- UpdateProgressModal: Real-time polling of /api/updates/status with progress bar and stage display
- UpdateHistoryPanel: Settings tab showing full audit log with filtering and status badges
- UpdateBanner: Enhanced with Apply button for automated deployments, manual instructions accordion with copy buttons

Features:
- Automated deployments: Single-click "Apply Update" button launches confirmation modal
- Manual deployments: Displays instruction steps with individual copy buttons
- Progress tracking: Polls status every 2s during updates, shows success/error states
- History: Dedicated Settings → Update History tab with filterable table
- Banner integration: Shows "Manual steps required" badge for non-automated deployments

All components use proper SolidJS signals and effects, fully typed with TypeScript.
2025-10-10 15:55:26 +00:00
rcourtman df2aae0246 feat: add UpdatePlan and history types to frontend API
Add TypeScript interfaces and API methods for new update system:

**New Types:**
- UpdatePlan: Deployment-specific update plan with canAutoUpdate flag
- UpdateHistoryEntry: Complete audit log entry with all metadata

**New API Methods:**
- getUpdatePlan(version, channel?) - Get deployment-specific update plan
- getUpdateHistory(limit?, status?) - List update history with filters
- getUpdateHistoryEntry(eventId) - Get specific history entry details

These types match the backend Go structs and enable frontend
integration with the adapter-based update system.

Next: Implement UI components (confirmation modal, progress modal,
update banner enhancements, settings history panel).
2025-10-10 15:45:12 +00:00
rcourtman 5294ed8e4e feat: integrate update system with API endpoints
Wire up the adapter-based update system to HTTP API:

**Enhanced UpdateHandlers:**
- Initialize UpdateHistory and UpdaterRegistry
- Register all deployment adapters (systemd, proxmoxve, docker, aur)
- Handlers now have access to history and updater registry

**New API Endpoints:**
- GET /api/updates/plan?version=X - Get update plan for deployment
  * Returns canAutoUpdate, instructions, prerequisites, estimated time
  * Deployment-specific based on detected type
- GET /api/updates/history?limit=N&status=X - List update history
  * Supports filtering by status (success/failed/in_progress)
  * Returns audit log entries with full metadata
- GET /api/updates/history/entry?id=X - Get specific history entry
  * Retrieve detailed information about past update

**Existing Endpoints Still Work:**
- GET /api/updates/check - Check for available updates
- POST /api/updates/apply - Apply update (legacy manager)
- GET /api/updates/status - Get current update status

The system now supports both:
- Legacy update flow (existing install.sh wrapper in manager.go)
- New adapter-based flow (prepared for frontend integration)

Next: Frontend components to consume new endpoints.
2025-10-10 15:42:21 +00:00
rcourtman 2408d8004c feat: add update system foundation with adapter pattern
Add infrastructure for deployment-agnostic update management:

**Update History (Audit Log):**
- JSONL-based audit log (/var/lib/pulse/update-history.jsonl)
- Tracks all update attempts with full metadata
- In-memory cache for fast queries
- Schema designed for future DB migration

**Updater Interface:**
- Defines contract for deployment-specific update logic
- SupportsApply(), PrepareUpdate(), Execute(), Rollback()
- Registry pattern for managing multiple adapters
- Progress callbacks for real-time UI updates

**Adapters Implemented:**
- InstallShAdapter: Wraps install.sh (systemd/LXC)
  * Full automation support
  * Captures stdout/stderr to log files
  * Parses backup paths from output
  * Maintains install.sh as single source of truth
- DockerUpdater: Instruction-only (manual)
- AURUpdater: Instruction-only (package manager)

Key design decisions:
- install.sh remains unchanged (backward compatible)
- All update mechanisms funnel through adapters
- Audit log records all updates (manual + automated)
- Thin wrapper approach - no logic duplication

Next: Wire up API endpoints and frontend integration.
2025-10-10 15:39:47 +00:00
rcourtman fb21f4c909 feat: add version-aware update notifications for RC releases
Implement smart update checking that shows appropriate updates based on user's current version:
- RC users now see both newer RC releases AND newer stable releases
- Stable users continue to see only stable releases (RCs filtered out)
- Both channels use version-aware filtering (only show updates > current version)

Key changes:
- Modified getLatestReleaseForChannel to accept currentVer parameter
- Removed /releases/latest shortcut; both channels now fetch all releases
- RC channel tracks both newest RC and newest stable, returns highest
- Stable channel filters prereleases and returns first stable > currentVer
- Added comprehensive test suite with 15 test cases

Respects semver ordering where 4.22.0 > 4.22.0-rc.3 per RFC.

Consulted with Codex for architectural direction.
2025-10-10 15:20:34 +00:00
rcourtman 3d048ee7ba refactor: remove PMG content from Overview page to maintain PVE focus
Remove PMG instances from the Overview (dashboard) page to keep it
focused solely on PVE resources (VMs and containers). This provides
better separation of concerns, with each Proxmox product type having
its dedicated view:
- Overview tab: PVE nodes, VMs, and containers
- Mail Gateway tab: PMG instances with detailed metrics
- Storage tab: Storage resources
- Backups tab: PBS and backup data

Changes:
- Remove pmgInstances prop from NodeSummaryTable component
- Remove PMG type checks and rendering logic from node table
- Update UnifiedNodeSelector to match new interface
- Clean up PMG-related imports and type definitions
2025-10-10 15:12:03 +00:00
rcourtman 30fa3fd810 feat: add complete Proxmox Mail Gateway (PMG) monitoring support
Add comprehensive PMG monitoring with mail statistics, queue depth tracking,
spam distribution analysis, and quarantine monitoring. Includes full discovery
support and UI consistency improvements across all Proxmox products.

Backend:
- Add pkg/pmg package with complete API client for PMG operations
- Implement mail statistics collection (inbound/outbound, spam, virus, bounces)
- Add queue depth monitoring (active, deferred, hold, incoming queues)
- Support spam score distribution and quarantine totals
- Add PMG-specific discovery logic to differentiate from PVE on port 8006
- Extend mock data generator with realistic PMG instances and metrics
- Add PMG node configuration support in config system

Frontend:
- Create MailGateway.tsx component with detailed PMG dashboard
- Display mail flow statistics with time-series charts
- Show queue depth with color-coded warnings (>50 messages or >30min age)
- Add spam distribution histogram and quarantine status
- Support cluster node status with individual queue monitoring
- Add PMG to network discovery with purple branding and mail icon
- Implement conditional navigation (hide PMG tab when no instances configured)
- Standardize discovery UI controls across PVE/PBS/PMG settings pages

API:
- Add /api/config/pmg endpoints for node configuration
- Support PMG-specific monitoring toggles (mail stats, queues, quarantine)
- Extend system settings with PMG configuration options

Discovery:
- Detect PMG vs PVE on shared port 8006 using /api2/json/statistics/mail endpoint
- Return 'pmg' type for mail gateway servers in discovery results
- Update DiscoveryModal to display PMG servers with appropriate styling

This completes ecosystem monitoring support for all three Proxmox products:
Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
2025-10-10 14:30:51 +00:00
rcourtman 7ab425b07a Publish docker agent image via GHCR workflow 2025-10-10 07:44:34 +00:00
rcourtman ba023f46aa fix: remove unused formatDelayLabel function 2025-10-09 23:25:27 +00:00
rcourtman ba7a1df8aa chore: bump version to v4.22.0-rc.3 2025-10-09 23:24:03 +00:00
rcourtman 8464fba095 feat: improve alert delay UI with collapsible row and better UX
- Add collapsible toggle for alert delay settings row to reduce visual clutter
- Match delay input styling to global threshold inputs (w-16, text-sm)
- Auto-clear delay override when value matches default to avoid confusion
- Remove unnecessary clear button - users can clear by emptying the field
- Simplify placeholder from "5s" to "5" for clarity
2025-10-09 23:20:25 +00:00
rcourtman 7427a75117 feat: support standard Authorization header for API authentication
Add support for Authorization: Bearer <token> header as a fallback
for environments that strip custom headers like X-API-Token. Docker
agent now sends both headers for maximum compatibility.
2025-10-09 23:03:46 +00:00
rcourtman 95f99767e5 Surface shared storage on all nodes refs #522 2025-10-09 22:55:27 +00:00
rcourtman be0660a6ff Restore disk usage rendering for inactive guests refs #520 #522 2025-10-09 22:47:18 +00:00
rcourtman 53012f73ca Improve snapshot polling resiliency 2025-10-09 22:13:06 +00:00
rcourtman 6e3c77b609 fix: properly fix test and remove unused variables
- Bypass UpdateConfig in test to allow TimeThreshold=0
- Remove unused helper functions and variables completely
2025-10-09 16:20:56 +00:00
rcourtman 75ac4d6699 fix: resolve test failures and unused variables
- Fix TestAcknowledgePersistsThroughCheckMetric by setting TimeThreshold to 0
- Prefix unused variables with underscore in ThresholdsTable.tsx
2025-10-09 16:18:45 +00:00
rcourtman 44f52b5718 chore: bump version to v4.22.0-rc.2 2025-10-09 16:16:10 +00:00
rcourtman 667590519a feat: add per-metric alert delay configuration
Add sophisticated alert delay system with per-metric overrides:
- Global delay defaults per resource type (guest/node/storage/pbs)
- Per-metric delay overrides with UI controls
- Dynamic tooltips showing effective delay values
- Clear buttons to reset metric-specific overrides
- Temperature threshold defaults for nodes (80°C/75°C)
- Improved delay configuration persistence and normalization
2025-10-09 16:14:39 +00:00
rcourtman 42f20c5a77 Refine dashboard width handling 2025-10-09 11:47:21 +00:00
rcourtman 7c219e523f Fix TypeScript type errors in ThresholdsTable 2025-10-09 11:28:01 +00:00
rcourtman 30364a56cb Improve alert type safety and add docker container global toggle
- Add explicit typing for threshold records to handle undefined values
- Add temperature and docker threshold support to alert types
- Implement global toggle to disable all docker container alerts
- Add test coverage for docker container toggle behavior
- Add concurrency test for multi-instance node updates
2025-10-09 11:23:25 +00:00
rcourtman 7fdc849f99 Keep resource toggles in sync with global alert switch 2025-10-09 11:21:15 +00:00
rcourtman 5758f1e016 Improve alert notification routing and frontend alert visuals 2025-10-09 10:58:53 +00:00
rcourtman db24633c9e chore: bump version to v4.22.0 2025-10-09 08:21:32 +00:00
rcourtman 0b796ba32b Fix Proxmox memory usage accounting 2025-10-09 08:07:11 +00:00