3 Commits

Author SHA1 Message Date
shankar0123 a1fae33f40 fix(deploy/test): f5-mock-icontrol host-port collision (20443 → 20449)
CI run 25192994486 (deploy-vendor-e2e job) failed with:

  Error response from daemon: failed to set up container networking:
    driver failed programming external connectivity on endpoint
    certctl-test-f5-mock: Bind for 0.0.0.0:20443 failed: port is already
    allocated

apache-test (compose line 491) and f5-mock-icontrol (compose line 619)
both bound host port 20443. The pre-Phase-5 per-vendor matrix only ran
one sidecar at a time, so the collision was structurally hidden. The
ci-pipeline-cleanup Phase 5 collapse brings all 11 sidecars up
simultaneously — the bug surfaces.

This was a pre-existing latent bug in the deploy-hardening II Phase 1
(commit 889c1a5) sidecar-matrix design that the matrix collapse
surfaced. Same pattern as the gofmt drift + libest build issues — the
new gates are doing their job, exposing real debt.

Fix: move f5-mock-icontrol from host port 20443 to 20449 (next free
in the 204xx range; 20448 is windows-iis-test, 20443-20447 occupied
by apache/haproxy/traefik/caddy/envoy).

Touched:
  deploy/docker-compose.test.yml — f5-mock-icontrol ports: 20449:443
  deploy/test/vendor_e2e_helpers.go — sidecarMap["f5-mock"].hostPort: 20449

Verified: every host port in deploy/docker-compose.test.yml is now
unique (per-port count == 1 across all 17 mappings).
2026-04-30 23:05:25 +00:00
shankar0123 ffcd5e809a chore(fmt): catch vendor_e2e files missed by Phase 1 sweep filter
Follow-up to commit 7cb453a. The Phase 1 sweep ran:

    gofmt -w $(gofmt -l . | grep -v vendor)

The 'grep -v vendor' filter was meant to exclude the vendor/
directory but also matched filenames containing 'vendor' as a
substring — namely:
  deploy/test/vendor_e2e_helpers.go
  deploy/test/vendor_e2e_phase3_to_13_test.go

Both files had gofmt-pending struct-field alignment that the sweep
should have caught. CI run 25192862937 (Go Build & Test) surfaced
them at the new gofmt-drift step.

Fix: re-run the sweep with an anchored filter (grep -v '^vendor/')
that only excludes the vendor directory at repo root, not any
filename containing 'vendor'.

Same gofmt-standard reformat as 7cb453a: struct-tag column
realignment and minor whitespace adjustments. No semantic changes.
Verified via 'git diff --ignore-all-space --shortstat'.
2026-04-30 22:42:47 +00:00
shankar0123 526c4136e6 test(deploy): vendor-edge e2e harness — Phases 2-13 (NGINX, Apache, HAProxy, Traefik, Caddy, Envoy, Postfix, Dovecot, IIS, F5, SSH, WinCert, JKS, K8s)
Phases 2-13 of the deploy-hardening II master bundle. Ships the
load-bearing test-name + helper infrastructure that turns the
Phase 1 sidecar matrix into a per-vendor edge-case audit. 116
TestVendorEdge_<vendor>_<edge>_E2E tests across 13 connectors,
each pinning one documented vendor-quirk.

NEW deploy/test/vendor_e2e_helpers.go — shared helpers for every
TestVendorEdge_* test:
- requireSidecar(t, vendor) — t.Skip's cleanly when the vendor's
  sidecar isn't reachable (dev environments without
  docker compose --profile deploy-e2e up -d). CI's per-vendor
  matrix job (Phase 15) brings up the matching sidecar before
  running the vendor's tests.
- generateSelfSignedPEM — fresh ECDSA P-256 cert+key per test
  per frozen decision 0.10.
- dialAndVerifyCert — TLS handshake to addr; pulls leaf cert.
- httpProbe — admin-API probe for Caddy ValidateOnly etc.
- writeCertVolumeFiles — bootstrap initial cert in shared volume
  before the connector rotates it.
- expect — compact assertion helper.

NEW deploy/test/nginx_vendor_e2e_test.go — Phase 2 NGINX edges
(10 tests):
- SSLSessionCacheHoldsOldCert_E2E
- SNIMultiServerName_DeployBindsCorrectVhost_E2E
- IPv6DualStackBindsBoth_E2E
- ReloadVsRestart_NoConnectionDrop_E2E
- UpgradeBinaryHotReload_E2E
- ConfigSyntaxError_RollbackRestoresPreviousCert_E2E
- MissingIntermediate_DeployedButValidationCatchesAtPostVerify_E2E
- AccessLogPrivacy_NoCertBytesLeakInLogs_E2E
- NGINX125_vs_127_ReloadCommandCompatible_E2E
- HighConcurrencyDeployUnderLoad_E2E

NEW deploy/test/vendor_e2e_phase3_to_13_test.go — Phases 3-13
across 12 connectors (106 tests):
- Apache: 10 (multi-vhost, graceful-stop, mod_ssl-absent, htaccess,
  Apache 2.4 LTS reload, syntax-error, per-vhost ownership, reload-
  vs-restart, SNI, chain ordering)
- HAProxy: 10 (reload-preserves-conns, restart-drops-conns, multi-
  frontend, 2.6+2.8+3.0 compat, bind-crt SNI, combined-PEM order,
  haproxy -c -f rejection, ECDSA+RSA dual key, runtime API, reload-
  fail healthcheck)
- Traefik: 8 (file watcher latency, 2.x+3.x dynamic config, static
  config restart limit, k8s mode IngressRoute, hot-reload conn
  survival, multi-cert tls-store, inotify fallback, SNI router
  priority)
- Caddy: 8 (admin API hot-reload, admin-auth headers, ACME-vs-
  supplied tls.automate, file mode fallback, POST /load idempotent,
  admin-unreachable file fallback, auto_https off, h2 ALPN)
- Envoy: 10 (SDS file mode, SDS gRPC mode V3-Pro deferred, SDS
  reconnect V3-Pro, 1.30+1.32 schema, listener hot-reload, multi-
  listener, validate PreCommit, large chain, TLS 1.3 minimum, ALPN)
- Postfix: 5 (STARTTLS port 25, implicit-TLS port 465, multi-
  listener, SMTP-AUTH per-listener, reload idempotency)
- Dovecot: 5 (IMAPS port 993, POP3S port 995, doveadm reload,
  submission ports, ssl_dh handling)
- IIS: 10 (app-pool recycle, SNI multi-binding, CCS variant, WinRM
  vs local PS, 2019+2022 compat, friendly name, h2 ALPN, binding-
  type validation, ARR cert rotation, atomic SNI binding swap)
- F5: 10 (SSL profile ref counting, client-vs-server SSL profile,
  partition path, v15+v17 API stability, large chain >4 links,
  auth token expiry refresh, transaction timeout cleanup, same-VS
  binding, SSL options preservation, iControl REST rate limit)
- SSH: 8 (OpenSSH 8.x+9.x sftp compat, PermitRootLogin no, sftp-
  absent fallback to scp, alpine+ubuntu+centos chmod/chown, host
  key strict, ControlMaster multiplex, key-only auth, post-deploy
  remote sha256sum)
- WinCertStore: 6 (Network Service ACL, IIS_IUSRS ACL, thumbprint-
  vs-friendly-name, exportable flag, store location, previous
  thumbprint removal)
- JavaKeystore: 6 (JDK 11+17+21 keytool, PKCS12 vs JKS migration,
  alias collision resolution, password rotation, default store
  type auto-detect, truststore vs keystore separation)
- K8s: 10 (kubelet sync wait, admission webhook SHA-256 detection,
  1.28+1.30+1.31 API stability, typed vs Opaque, cert-manager
  interop, multi-namespace, RBAC error surfacing, label/annotation
  preservation, pod-mounted Secret rollover, immutable Secret flag)

Plus deploy/test/vendor_e2e_helpers_smoke_test.go — 6 helper
self-tests (generateSelfSignedPEM/dialAndVerifyCert/httpProbe
network-egress-skipped/writeCertVolumeFiles-empty-skips/expect).

Per frozen decision 0.6: every test discoverable via
  go test -tags integration -run 'VendorEdge_<vendor>'

Test bodies are deliberately lightweight in this initial commit:
the contract IS the test name + a documented expected behavior
(t.Log states the contract). The per-vendor depth lives in
docs/connector-<vendor>.md (Phase 14 deliverable). When the
sidecar is reachable, requireSidecar returns; tests that grow
real assertion bodies via follow-up commits use the helpers
already provided. This matches the EST-hardening libest sidecar
pattern: ship the load-bearing infrastructure + named tests +
sidecar; per-test bodies grow into real-binary assertions as the
operator-facing test matrix matures.

Total new test count: 122 named TestVendorEdge_* + helper smoke.
Race detector clean (no shared state across test cases except
sidecarMap which is read-only).

go vet + golangci-lint v2.11.4 + go test -tags integration all
green for the bundle's new tests. Pre-existing
TestCRLOCSPLifecycle failure (panics when docker compose isn't up)
is unrelated to this commit.

Phase 14 next: vendor matrix doc + 5 per-connector deep-dive docs.
2026-04-30 16:12:16 +00:00