mirror of
https://github.com/rustfs/rustfs.git
synced 2026-09-07 20:46:11 +00:00
houseme
4c2a0cdf9a
* fix(scanner): remove unused digest import Co-Authored-By: heihutu <heihutu@gmail.com> Co-Authored-By: zhi22915 <qiuzgang@gmail.com> * feat(scanner): add raw page owner index (#7375) * feat(scanner): add raw page owner index Add a serializable raw enumeration page owner index for scanner resume work. The index exposes unsupported, building, and ready states, validates committed page identity by recomputing digests, and uses generation checks for CAS-style page commits. Focused tests cover small-budget restart progress, page digest/source drift rejection, corrupt deserialized state, CAS failure, precommit crash, empty sources, and invalid entry boundaries. Co-Authored-By: heihutu <heihutu@gmail.com> Co-Authored-By: zhi22915 <qiuzgang@gmail.com> * feat(scanner): persist raw page owner resume state (#7379) Wire the scanner raw enumeration partial-cache writer to the raw page owner index so interrupted bucket walks can retain validated page-builder state across scanner restarts. Keep complete owner sources terminal-only, add partial-source ingestion for in-progress raw directory reads, and validate the persisted page index through bucket checkpoint preparation. Co-authored-by: zhi22915 <qiuzgang@gmail.com> --------- Co-authored-by: zhi22915 <qiuzgang@gmail.com> * test(scanner): fence segment producer observations (#7381) Require the segment observation fixture to carry source, incarnation, key-format, baseline, process epoch, generation-window, gap, overflow, and producer-coverage proof before accepting a narrowed proposal. Keep the diagnostic path fixture-only and remove its ordinary stderr output. Co-authored-by: zhi22915 <qiuzgang@gmail.com> * fix(ecstore): isolate pool metadata read probes (#7367) Co-authored-by: zhi22915 <qiuzgang@gmail.com> * test(heal): cover MRF crash successor matrix (#7369) * test(heal): cover MRF crash successor matrix Add process-boundary MRF replay coverage for the successor snapshot window after a retained startup journal is flushed but before cleanup deletes it. Extend the mixed authoritative/legacy reader fixture with a scoped v2 journal epoch to pin the no-merge contract. Co-Authored-By: heihutu <heihutu@gmail.com> Co-Authored-By: zhi22915 <qiuzgang@gmail.com> * test(heal): cover service-kill MRF replay (#7380) Add a Unix process fixture that waits after publishing the pending MRF successor snapshot, then is terminated by the parent before restart replay. Co-authored-by: zhi22915 <qiuzgang@gmail.com> --------- Co-authored-by: zhi22915 <qiuzgang@gmail.com> * test(heal): cover transport-lost start receipts (#7371) Add gRPC transport fault fixtures for heal-control start admission. The tests distinguish pre-admission transport loss from post-admission response loss, then verify exact envelope retries reuse the canonical receipt while fresh forceStart requests create distinct tasks. Co-authored-by: zhi22915 <qiuzgang@gmail.com> * test(scanner): add crash-restart heal evidence case (#7370) * test(scanner): add crash-restart heal evidence case Add a distinct W21 background target crash case to the scanner/heal evidence registry and oracle path. Keep the existing restart lane on graceful process restart, keep the crash lane on hard kill, and make the wiring checker reject evidence/oracle mismatches. Co-Authored-By: heihutu <heihutu@gmail.com> Co-Authored-By: zhi22915 <qiuzgang@gmail.com> * test(scanner): support older Python wiring checks Let the scanner/heal evidence wiring checker run under Python 3.9/3.10 by falling back to tomli and chunked SHA-256 hashing when the Python 3.11 standard APIs are unavailable. Co-Authored-By: heihutu <heihutu@gmail.com> Co-Authored-By: zhi22915 <qiuzgang@gmail.com> --------- Co-authored-by: zhi22915 <qiuzgang@gmail.com> * fix(scanner): reject stale raw page source seeds (#7382) Do not prefill a resumed raw page owner with previously indexed entries when starting a new raw directory observation pass. The next pass must observe the same prefix again before the page index can advance; otherwise the index is discarded fail-closed. Co-authored-by: zhi22915 <qiuzgang@gmail.com> * fix(scanner): defer raw page revalidation until observed (#7384) A resumed raw page owner index must not prefill entries from older cache state, but it also must not discard a valid multi-entry index before the current raw directory pass has observed enough entries to prove identity. Track the persisted index floor and only run the strict owner identity check once the current pass reaches that floor. Co-authored-by: zhi22915 <qiuzgang@gmail.com> --------- Co-authored-by: zhi22915 <qiuzgang@gmail.com>
57 lines
3.0 KiB
JSON
57 lines
3.0 KiB
JSON
{
|
|
"schema": 1,
|
|
"cases": {
|
|
"background-target-restart": {
|
|
"gate": "G14",
|
|
"task": "W21",
|
|
"lane": "e2e-nightly",
|
|
"suite": "e2e_test",
|
|
"name": "heal_erasure_disk_rebuild_test::tests::test_cluster_root_heal_recovers_remote_shards_after_background_target_restart",
|
|
"oracle": "background-target-restart.json",
|
|
"evidence": "process-restart",
|
|
"unclean_shutdown_marker": false,
|
|
"min_objects": 9,
|
|
"max_objects": 65,
|
|
"topology": {"nodes": 4, "drives_per_node": 1},
|
|
"scope": "Target process restart, exact unversioned S3 bodies and replacement-disk shards; not power loss or EC8+4."
|
|
},
|
|
"background-target-crash": {
|
|
"gate": "G14",
|
|
"task": "W21",
|
|
"lane": "e2e-nightly",
|
|
"suite": "e2e_test",
|
|
"name": "heal_erasure_disk_rebuild_test::tests::test_cluster_root_heal_recovers_remote_shards_after_background_target_crash",
|
|
"oracle": "background-target-crash.json",
|
|
"evidence": "process-crash-restart",
|
|
"unclean_shutdown_marker": true,
|
|
"min_objects": 9,
|
|
"max_objects": 65,
|
|
"topology": {"nodes": 4, "drives_per_node": 1},
|
|
"scope": "Target process killed during partial background rebuild, real unclean-shutdown marker, exact unversioned S3 bodies and replacement-disk shards; not power loss or EC8+4."
|
|
}
|
|
},
|
|
"release_pending": {
|
|
"G01": "W02/W04 complete root and quota authority coverage",
|
|
"G02": "W03 bounded checkpoint progress and independent version inventory",
|
|
"G03": "W17/W18 exact scoped ACK with durable publication and mixed peers",
|
|
"G04": "W03/W15/W16 crash at every cache/root/floor/intent boundary",
|
|
"G05": "W06/W07 per-object outcomes and bounded terminal retention",
|
|
"G06": "W06/W08/W23 concurrent status, legacy clients and truncation",
|
|
"G07": "W12/W13/W14 durable MRF responsibility at every commit boundary",
|
|
"G08": "W12/W13/W14 MRF capacity, disk-full and replica-loss matrix",
|
|
"G09": "W13/W18/W23 actual mixed-version reader/writer and rollback payloads",
|
|
"G10": "W05/W09/W10/W11 bounded scheduling and pressure recovery",
|
|
"G11": "W04/W19/W24 maintenance and complete producer coverage",
|
|
"G12": "W02/W15/W16 both quota paths during reset and settlement",
|
|
"G13": "W07/W14 quorum-minus-one, unknown disks, remount, Object Lock, dry-run, grace and commit tail",
|
|
"G14": "W20/W21 same-window field evidence; 3x4 EC8+4 and multi-set/pool coverage",
|
|
"P1": "W20 measured cold-walk share and foreground latency/throughput",
|
|
"P2": "W20/W24 measured post-stop convergence and cold segment reuse",
|
|
"P3": "W20 measured two-hour pressure/heal capacity and recovery window",
|
|
"P4": "W20 measured MRF scale and replay cost with retained responsibility",
|
|
"R-E": "W03/W05 fixed-budget real process restart through enumeration and classification",
|
|
"R-D": "W07/W14 manager-to-event-to-ledger exact disposition, including grace",
|
|
"R-L": "W13/W14 legacy source conflicts, migration gaps and crash-safe source retirement"
|
|
}
|
|
}
|