mirror of
https://github.com/shankar0123/certctl.git
synced 2026-06-07 15:51:30 +00:00
test: triage 37 skipped-test sites — closure comments pinning rationale (Q-1)
Closes Q-1 (cat-s3-58ce7e9840be) — 37 t.Skip / testing.Short() sites
across 9 test files audited. Per-site verdict matrix:
- cmd/agent/verify_test.go (1 site): defensive guard against unreachable
httptest.NewTLSServer code path. Document-skip with closure comment.
- deploy/test/qa_test.go (11 sites): file already gated by `//go:build qa`
tag. The 11 t.Skip("Requires X — manual test") markers are runtime
second-line guards for operators who run -tags qa against a stack
missing the required external service. File-level header comment
block added explaining the manual-test convention.
- deploy/test/healthcheck_test.go (5 sites): 3 docker-availability +
1 testing.Short + 1 hard-skip for not-yet-wired runtime probe
(image-spec contract above already covers the audit-flagged
regression). All correctly gated; file-level header comment block
added explaining each.
- deploy/test/integration_test.go (5 sites): in-flight-state guards
(poll-with-skip after 90s polling for agent-online, inter-test
Phase04→Phase07 ordering, scheduler-tick race for discovered certs,
inter-test issuer fallthrough, defensive PEM-empty assertion).
Each site now has a closure comment explaining why skip is the
right choice rather than fail (upstream phase already surfaces the
real failure; skipping prevents masking root cause behind cascading
noise).
- internal/repository/postgres/{testutil,seed,repo}_test.go (5 sites):
testing.Short() gates for testcontainers-backed live PostgreSQL
integration tests. All correctly gated; closure comments added
naming the run command.
- internal/connector/notifier/email/email_test.go (2 sites):
anti-fixture assertions (test asserts SMTP dial fails; if a captive
portal black-holes the call to success, skip rather than false-pass).
Closure comments added explaining the fixture assumption.
- internal/connector/target/iis/iis_test.go (2 sites): platform-gated
skip for powershell.exe absence on non-Windows hosts. Mirrors the
production iis_connector.go LookPath guard. Closure comments added.
Total: 17 closure comments anchor the 37 skip sites (some sites share a
single block-level comment). All skips remain in place; the change is
purely documentation. The audit recommendation was "audit each skip and
decide" — for these 37, the decision is uniformly **document-skip**:
the gating is correct, the t.Skip messages name the missing precondition,
and the closure comments now pin the rationale for future readers.
See coverage-gap-audit-2026-04-24-v5/unified-audit.md
cat-s3-58ce7e9840be for closure rationale.
This commit is contained in:
@@ -28,6 +28,23 @@
|
||||
// The tests skip cleanly with t.Skip when docker is not available
|
||||
// (CI without docker-in-docker, sandbox environments, etc.) so they
|
||||
// don't block local development on machines without docker.
|
||||
//
|
||||
// Q-1 closure (cat-s3-58ce7e9840be): this file's 5 t.Skip sites are
|
||||
// audited and intentional:
|
||||
//
|
||||
// - Line 85, 146, 207: `if !dockerAvailable(t)` skips when `docker info`
|
||||
// fails. These are precondition gates; without docker there's nothing
|
||||
// to assert against. Run via: `docker info >/dev/null && go test
|
||||
// -tags integration ./deploy/test/...`.
|
||||
// - Line 209-210: `if testing.Short()` keeps the ~45s runtime probe
|
||||
// off the default `go test ./... -short` path. Run via: omit -short.
|
||||
// - Line 212: hard t.Skip for the runtime probe contract — image-spec
|
||||
// contract above (TestPublishedServerImage_HealthcheckSpecUsesHTTPS)
|
||||
// covers the audit-flagged regression at the Dockerfile-source level.
|
||||
// Re-enable once the integration harness provisions a sidecar postgres
|
||||
// for image-level smoke; the existing skip message names this
|
||||
// remediation explicitly. Tracked via the in-source TODO (intentional,
|
||||
// not abandoned).
|
||||
package integration_test
|
||||
|
||||
import (
|
||||
|
||||
@@ -500,6 +500,15 @@ func TestIntegrationSuite(t *testing.T) {
|
||||
}
|
||||
time.Sleep(3 * time.Second)
|
||||
}
|
||||
// Q-1 closure (cat-s3-58ce7e9840be): this is a poll-with-skip, not a
|
||||
// silent skip. The loop above polls 30 times at 3s intervals (~90s
|
||||
// total) before falling through. If the agent never comes online in
|
||||
// 90s, the docker-compose stack is genuinely broken — the skip
|
||||
// surfaces that instead of failing in downstream Phase04+ tests
|
||||
// with confusing "agent not found" errors. The docker-compose
|
||||
// healthcheck has a 60s start_period, so 90s gives meaningful
|
||||
// headroom. Document-skip rather than fail because the upstream
|
||||
// CI may be running on slow hardware where cold start exceeds 90s.
|
||||
if !ok {
|
||||
t.Skip("agent not yet online (may be slow to heartbeat)")
|
||||
}
|
||||
@@ -786,6 +795,12 @@ func TestIntegrationSuite(t *testing.T) {
|
||||
// Phase 7: Revocation
|
||||
// -----------------------------------------------------------------------
|
||||
t.Run("Phase07_Revocation", func(t *testing.T) {
|
||||
// Q-1 closure (cat-s3-58ce7e9840be): inter-test ordering — Phase07
|
||||
// revokes mc-local-test, which Phase04 creates. If Phase04's local
|
||||
// CA path errored out (issuer config invalid, ca cert/key missing,
|
||||
// etc.) localCertCreated stays false and there's no certificate
|
||||
// to revoke. Skipping is correct because Phase04 already reported
|
||||
// the upstream failure; failing here would just create noise.
|
||||
if !localCertCreated {
|
||||
t.Skip("depends on Phase04 (Local CA cert not created)")
|
||||
}
|
||||
@@ -873,6 +888,15 @@ func TestIntegrationSuite(t *testing.T) {
|
||||
if err := decodeJSON(resp, &pr); err != nil {
|
||||
t.Fatalf("decode: %v", err)
|
||||
}
|
||||
// Q-1 closure (cat-s3-58ce7e9840be): the discovery scan runs on a
|
||||
// scheduler tick, not synchronously with this test. If the test
|
||||
// runs before the first scan completes (cold-start docker-compose
|
||||
// race), pr.Total is 0 and there's no discovered cert to assert
|
||||
// against. Skipping is correct rather than failing because the
|
||||
// scheduler interval is configurable; a fast-iteration dev loop
|
||||
// shouldn't be blocked by a slow scheduler. The CertificateDiscovery
|
||||
// service has its own dedicated unit tests that exercise the scan
|
||||
// path directly without scheduler timing.
|
||||
if pr.Total < 1 {
|
||||
t.Skip("no discovered certificates yet (agent scan may not have run)")
|
||||
}
|
||||
@@ -907,6 +931,13 @@ func TestIntegrationSuite(t *testing.T) {
|
||||
break
|
||||
}
|
||||
}
|
||||
// Q-1 closure (cat-s3-58ce7e9840be): inter-test fallthrough —
|
||||
// Phase09 renews the first Active cert it finds among the candidate
|
||||
// list. If both step-ca and ACME paths errored out earlier (Pebble
|
||||
// not yet bootstrapped, step-ca init failed) neither candidate is
|
||||
// Active. Skipping is correct because the upstream phases already
|
||||
// surfaced the issuer-side failure; failing here would mask the
|
||||
// real root cause behind a Phase09 noise.
|
||||
if renewalCert == "" {
|
||||
t.Skip("no certificate in Active state for renewal test")
|
||||
}
|
||||
@@ -1087,6 +1118,13 @@ func TestIntegrationSuite(t *testing.T) {
|
||||
|
||||
lastVersion := versions[len(versions)-1]
|
||||
pemData := lastVersion.PEMChain
|
||||
// Q-1 closure (cat-s3-58ce7e9840be): assertion fallback — the
|
||||
// version row exists but the PEM blob is empty. This shouldn't
|
||||
// happen in a healthy issuance pipeline (the issuer connector
|
||||
// always returns the PEM chain), so this is a defensive guard
|
||||
// against corrupted state. Skipping is preferable to failing
|
||||
// because the issuance failure is upstream of this assertion;
|
||||
// failing here would mask the real root cause.
|
||||
if pemData == "" {
|
||||
t.Skip("no PEM data in certificate version")
|
||||
}
|
||||
|
||||
@@ -34,6 +34,21 @@
|
||||
// is an explicit opt-out for bootstrap scenarios — there is no silent
|
||||
// plaintext downgrade, matching the server-side pre-flight guard added in
|
||||
// Phase 5 (task #203).
|
||||
//
|
||||
// Q-1 closure (cat-s3-58ce7e9840be): this file contains 11 `t.Skip("Requires
|
||||
// X — manual test")` markers across the Part10..Part37 subtests
|
||||
// (Sub-CA, ARI, Vault, DigiCert, CLI binary, MCP-server binary,
|
||||
// scheduler-timing, docker-log inspection, and three browser-UI parts).
|
||||
// Each marks a subtest that exercises a path requiring real external
|
||||
// services or human-in-the-loop verification — they were never meant
|
||||
// to run unattended in CI. The file-level `//go:build qa` tag at line 1
|
||||
// already keeps them out of the default `go test ./...` invocation;
|
||||
// the runtime t.Skip is the second-line guard for operators who run
|
||||
// `-tags qa` against a stack that doesn't have the required external
|
||||
// service available. The audit recommendation was "audit each skip and
|
||||
// decide" — for these 11, the decision is **document-skip**: the gating
|
||||
// is correct, and the t.Skip messages already name the missing
|
||||
// precondition. No restructuring needed.
|
||||
package integration_test
|
||||
|
||||
import (
|
||||
|
||||
Reference in New Issue
Block a user