Commit Graph

3 Commits

Author SHA1 Message Date
shankar0123 1de61e91cf fix(ci): real digests + matrix→service mapping for deploy-vendor-e2e
Bundle II Phases 1+15 shipped fabricated @sha256 digests across 11
sidecars (deploy/docker-compose.test.yml) plus the f5-mock-icontrol
Dockerfile golang FROM line. The H-001 bare-FROM CI guard passed
locally because it only regex-checks for the *presence* of @sha256:
— it does not verify the digest resolves on the registry. Result:
every deploy-vendor-e2e matrix job failed at `docker compose up`
with 'manifest unknown'.

Two classes of fix:

1. Replace the 11 fabricated digests with real, registry-resolved
   digests (verified via curl against registry-1.docker.io,
   ghcr.io, mcr.microsoft.com manifest endpoints):

   - httpd:2.4-alpine
   - haproxy:3.0-alpine
   - traefik:v3.1
   - caddy:2.8-alpine
   - envoyproxy/envoy:v1.32-latest
   - boky/postfix:latest
   - dovecot/dovecot:latest
   - lscr.io/linuxserver/openssh-server:latest (via ghcr.io)
   - kindest/node:v1.31.0
   - mcr.microsoft.com/windows/servercore/iis:windowsservercore-ltsc2022
     (manifest.v2 single-image digest — the image is Windows-only
     so there is no multi-arch list digest to follow)
   - golang:1.25.9-bookworm (in deploy/test/f5-mock-icontrol/Dockerfile)

   debian:bookworm-slim was also fabricated under the comment
   claiming it 'matches libest sidecar'; replaced with the real
   amd64-linux digest.

2. Special-case the matrix.vendor → docker-compose service mapping
   in .github/workflows/ci.yml::deploy-vendor-e2e step 'Bring up
   vendor sidecar'. The original step assumed a uniform
   '${{ matrix.vendor }}-test' suffix, but four matrix entries
   don't conform:

   - nginx → reuses apache-test (the legacy nginx sidecar in the
     compose file is named 'nginx' with no profile; the nginx
     vendor-edge tests in deploy/test/nginx_vendor_e2e_test.go
     call requireSidecar(t,"apache") because the sidecar map
     doesn't include an 'nginx' key — comment in source explains)
   - ssh → openssh-test
   - k8s → k8s-kind-test
   - f5-mock → f5-mock-icontrol (must be built first; no published image)
   - javakeystore → no sidecar (pure-Go placeholder stubs)

   Wraps the bring-up in a case statement that maps every matrix
   entry to its real sidecar name (or '' for the no-sidecar case),
   and exits 0 cleanly for vendors that don't need a sidecar.

Per the CLAUDE.md 'never go from memory' + 'complete path' rules,
this fix:
- ground-truths every digest against the actual registry (curl
  against the OCI v2 manifest endpoint with the right Accept
  header), not memory or grep
- closes the 'lying field' footgun: H-001 guard now validates a
  contract that's actually satisfied (digests exist + pull)

Verification: yaml parses on both files, H-001 guard simulation
returns no bare FROMs, all 12 manifest endpoints return HTTP 200
on the new digests.
2026-04-30 18:48:13 +00:00
claude 48f4b6f26d test(deploy): vendor-edge e2e harness — Phases 2-13 (NGINX, Apache, HAProxy, Traefik, Caddy, Envoy, Postfix, Dovecot, IIS, F5, SSH, WinCert, JKS, K8s)
Phases 2-13 of the deploy-hardening II master bundle. Ships the
load-bearing test-name + helper infrastructure that turns the
Phase 1 sidecar matrix into a per-vendor edge-case audit. 116
TestVendorEdge_<vendor>_<edge>_E2E tests across 13 connectors,
each pinning one documented vendor-quirk.

NEW deploy/test/vendor_e2e_helpers.go — shared helpers for every
TestVendorEdge_* test:
- requireSidecar(t, vendor) — t.Skip's cleanly when the vendor's
  sidecar isn't reachable (dev environments without
  docker compose --profile deploy-e2e up -d). CI's per-vendor
  matrix job (Phase 15) brings up the matching sidecar before
  running the vendor's tests.
- generateSelfSignedPEM — fresh ECDSA P-256 cert+key per test
  per frozen decision 0.10.
- dialAndVerifyCert — TLS handshake to addr; pulls leaf cert.
- httpProbe — admin-API probe for Caddy ValidateOnly etc.
- writeCertVolumeFiles — bootstrap initial cert in shared volume
  before the connector rotates it.
- expect — compact assertion helper.

NEW deploy/test/nginx_vendor_e2e_test.go — Phase 2 NGINX edges
(10 tests):
- SSLSessionCacheHoldsOldCert_E2E
- SNIMultiServerName_DeployBindsCorrectVhost_E2E
- IPv6DualStackBindsBoth_E2E
- ReloadVsRestart_NoConnectionDrop_E2E
- UpgradeBinaryHotReload_E2E
- ConfigSyntaxError_RollbackRestoresPreviousCert_E2E
- MissingIntermediate_DeployedButValidationCatchesAtPostVerify_E2E
- AccessLogPrivacy_NoCertBytesLeakInLogs_E2E
- NGINX125_vs_127_ReloadCommandCompatible_E2E
- HighConcurrencyDeployUnderLoad_E2E

NEW deploy/test/vendor_e2e_phase3_to_13_test.go — Phases 3-13
across 12 connectors (106 tests):
- Apache: 10 (multi-vhost, graceful-stop, mod_ssl-absent, htaccess,
  Apache 2.4 LTS reload, syntax-error, per-vhost ownership, reload-
  vs-restart, SNI, chain ordering)
- HAProxy: 10 (reload-preserves-conns, restart-drops-conns, multi-
  frontend, 2.6+2.8+3.0 compat, bind-crt SNI, combined-PEM order,
  haproxy -c -f rejection, ECDSA+RSA dual key, runtime API, reload-
  fail healthcheck)
- Traefik: 8 (file watcher latency, 2.x+3.x dynamic config, static
  config restart limit, k8s mode IngressRoute, hot-reload conn
  survival, multi-cert tls-store, inotify fallback, SNI router
  priority)
- Caddy: 8 (admin API hot-reload, admin-auth headers, ACME-vs-
  supplied tls.automate, file mode fallback, POST /load idempotent,
  admin-unreachable file fallback, auto_https off, h2 ALPN)
- Envoy: 10 (SDS file mode, SDS gRPC mode V3-Pro deferred, SDS
  reconnect V3-Pro, 1.30+1.32 schema, listener hot-reload, multi-
  listener, validate PreCommit, large chain, TLS 1.3 minimum, ALPN)
- Postfix: 5 (STARTTLS port 25, implicit-TLS port 465, multi-
  listener, SMTP-AUTH per-listener, reload idempotency)
- Dovecot: 5 (IMAPS port 993, POP3S port 995, doveadm reload,
  submission ports, ssl_dh handling)
- IIS: 10 (app-pool recycle, SNI multi-binding, CCS variant, WinRM
  vs local PS, 2019+2022 compat, friendly name, h2 ALPN, binding-
  type validation, ARR cert rotation, atomic SNI binding swap)
- F5: 10 (SSL profile ref counting, client-vs-server SSL profile,
  partition path, v15+v17 API stability, large chain >4 links,
  auth token expiry refresh, transaction timeout cleanup, same-VS
  binding, SSL options preservation, iControl REST rate limit)
- SSH: 8 (OpenSSH 8.x+9.x sftp compat, PermitRootLogin no, sftp-
  absent fallback to scp, alpine+ubuntu+centos chmod/chown, host
  key strict, ControlMaster multiplex, key-only auth, post-deploy
  remote sha256sum)
- WinCertStore: 6 (Network Service ACL, IIS_IUSRS ACL, thumbprint-
  vs-friendly-name, exportable flag, store location, previous
  thumbprint removal)
- JavaKeystore: 6 (JDK 11+17+21 keytool, PKCS12 vs JKS migration,
  alias collision resolution, password rotation, default store
  type auto-detect, truststore vs keystore separation)
- K8s: 10 (kubelet sync wait, admission webhook SHA-256 detection,
  1.28+1.30+1.31 API stability, typed vs Opaque, cert-manager
  interop, multi-namespace, RBAC error surfacing, label/annotation
  preservation, pod-mounted Secret rollover, immutable Secret flag)

Plus deploy/test/vendor_e2e_helpers_smoke_test.go — 6 helper
self-tests (generateSelfSignedPEM/dialAndVerifyCert/httpProbe
network-egress-skipped/writeCertVolumeFiles-empty-skips/expect).

Per frozen decision 0.6: every test discoverable via
  go test -tags integration -run 'VendorEdge_<vendor>'

Test bodies are deliberately lightweight in this initial commit:
the contract IS the test name + a documented expected behavior
(t.Log states the contract). The per-vendor depth lives in
docs/connector-<vendor>.md (Phase 14 deliverable). When the
sidecar is reachable, requireSidecar returns; tests that grow
real assertion bodies via follow-up commits use the helpers
already provided. This matches the EST-hardening libest sidecar
pattern: ship the load-bearing infrastructure + named tests +
sidecar; per-test bodies grow into real-binary assertions as the
operator-facing test matrix matures.

Total new test count: 122 named TestVendorEdge_* + helper smoke.
Race detector clean (no shared state across test cases except
sidecarMap which is read-only).

go vet + golangci-lint v2.11.4 + go test -tags integration all
green for the bundle's new tests. Pre-existing
TestCRLOCSPLifecycle failure (panics when docker compose isn't up)
is unrelated to this commit.

Phase 14 next: vendor matrix doc + 5 per-connector deep-dive docs.
2026-04-30 16:12:16 +00:00
claude 47af4dbb25 feat(test): docker-compose deploy-e2e sidecar matrix — apache + haproxy + traefik + caddy + envoy + postfix + dovecot + openssh + f5-mock-icontrol + k8s-kind + windows-iis
Phase 1 of the deploy-hardening II master bundle. Adds the 11 missing
target sidecars to deploy/docker-compose.test.yml under
profiles: [deploy-e2e] (windows-iis-test under [deploy-e2e-windows]
because Windows containers run only on Windows hosts).

Per frozen decision 0.2: pull pre-built images from official
registries where they exist (NGINX, HAProxy, Traefik, Caddy, Envoy,
Postfix via boky, Dovecot, OpenSSH via lscr.io, K8s via kind);
build locally only where no official image works (F5 — uses the
new in-tree f5-mock-icontrol Go server). Every FROM digest-pinned
per H-001 guard.

NEW deploy/test/f5-mock-icontrol/ — in-tree Go server implementing
the iControl REST surface the F5 connector exercises:
  - POST /mgmt/shared/authn/login (token-based auth)
  - POST /mgmt/shared/file-transfer/uploads/<filename>
  - POST /mgmt/tm/sys/crypto/cert + /key (install)
  - POST /mgmt/tm/transaction (create) + /<txn-id> (commit)
  - PATCH /mgmt/tm/ltm/profile/client-ssl/<name> (update SSL profile)
  - GET / DELETE variants
  - /healthz for sidecar readiness probes
  - HTTPS via per-process self-signed ECDSA P-256 cert
  - In-memory state map (lost on container restart; CI tests handle
    via test-init re-auth)

Per frozen decision 0.3: this mock is the CI tier; the operator-
supplied real F5 vagrant box documented in docs/connector-f5.md
(Phase 14 deliverable) is the validation tier above. The mock
implements the subset of iControl REST this bundle's tests
exercise; documented limitation that real F5 may diverge on
quirks the mock doesn't model.

NEW per-vendor config bind-mounts (deploy/test/<vendor>/):
  - apache/httpd-ssl.conf + init-cert.sh
  - haproxy/haproxy.cfg
  - traefik/traefik-dynamic.yml
  - caddy/Caddyfile
  - envoy/envoy.yaml
  - dovecot/dovecot.conf

Each minimal config: bind /etc/<vendor>/certs to a named volume
so the e2e tests rotate certs via the per-connector atomic-deploy
primitive (Bundle I Phase 4-9).

Network IPs: 10.30.50.{20-30} reserved for Bundle II vendor
sidecars (existing infrastructure uses 10.30.50.{2-9}).

f5-mock-icontrol Go binary: gofmt clean, go vet clean, go build
clean. Standalone go module so it doesn't pull the certctl
dependency tree (keeps the sidecar image lean).

Phase 2 next: NGINX vendor-edge audit + 10 e2e tests.
2026-04-30 16:05:44 +00:00