mirror of https://github.com/rustfs/rustfs.git synced 2026-11-02 01:00:09 +00:00

Files

T

Chris An b7b26a6a49 refactor(listing): keep paginated listing on ECStore only (#8936 )

* refactor(listing): keep paginated listing on ECStore only

`Sets` and `SetDisks` carried their own copies of `inner_list_objects_v2`,
`list_objects_generic`, `inner_list_object_versions`, `list_path` and
`list_merged`, plus a third copy of the task that converts merged raw entries
into the walk result stream. Only `ECStore` can answer a paginated listing,
since a page merges every set of every pool; the copies drifted (the `Sets`
copy still rejected `//` prefixes that #8605 made literal on `ECStore`) and
were reachable only from tests and one decommission helper.

Remove the `ListOperations` impls for `Sets` and `SetDisks` together with the
duplicated pagination code. `SetDisks::walk` stays as an inherent method for
set-scoped callers and now honors `versions_sort` like the store-wide walk;
`SetDisks::list_path_result` stays for the recursive delete lister. The walk
entry conversion moves into one `spawn_walk_entry_forwarder` shared by both
walks. The decommission receipt lister walks its pool's sets instead of
paginating through the removed `Sets` listing.

Tests that exercised the removed layers now exercise `ECStore` for pagination
or `SetDisks::walk` for per-pool version inspection. The architecture and
logging guard rows that pinned the removed `SetDisks`/`Sets` listing entry
points are dropped, and the error-other ratchet baseline shrinks by one.

* fix(listing): exclude synthetic directories from receipt walks

* fix(listing): stop abandoned walks and filter directory entries

2026-10-26 09:05:11 +08:00

fixtures

test(ecstore): verify encoding inputs against released shards (#8933 )

2026-10-26 00:01:50 +08:00

cleanup_isolation_test.rs

perf(ecstore): isolate cleanup and preserve metadata authority (#8289 )

2026-10-12 22:07:50 -07:00

ecstore_contract_compat_test.rs

refactor(listing): keep paginated listing on ECStore only (#8936 )

2026-10-26 09:05:11 +08:00

fd_relative_io_test.rs

perf(ecstore): isolate cleanup and preserve metadata authority (#8289 )

2026-10-12 22:07:50 -07:00

hotpath_cpu_attribution_contract_test.rs

chore(deps): refresh workspace dependencies and hotpath profiling (#8380 )

2026-10-07 03:02:39 -07:00

inline_heal_staging_test.rs

test(heal): verify backup recovery and tier owner handoff (#8935 )

2026-10-26 08:00:42 +08:00

legacy_bitrot_read_test.rs

fix(rebalance): converge multipart data movement retries (#6057 )

2026-08-13 06:12:26 +00:00

list_prefix_test.rs

fix(listing): accept literal prefixes with repeated slashes (#8605 )

2026-10-19 01:27:51 +08:00

manual_transition_cancel_counter_matrix_test.rs

test(ilm): cover cancelled worker counter persistence (#5285 )

2026-07-26 10:01:03 +00:00

manual_transition_job_matrix_test.rs

fix(ecstore): enforce monotonic transition cursors (#6522 )

2026-08-24 19:33:58 +08:00

metadata_read_lock_reuse_test.rs

perf(ecstore): isolate cleanup and preserve metadata authority (#8289 )

2026-10-12 22:07:50 -07:00

pinned_erasure_fixtures_test.rs

test(ecstore): verify encoding inputs against released shards (#8933 )

2026-10-26 00:01:50 +08:00

protobuf_bytes_regression_test.rs

feat(storage): extend PUT path tuning and observability (#3829 )

2026-06-25 19:24:35 +08:00

put_object_cancellation_test.rs

fix(ecstore): clean completed PUT staging on pre-commit cancellation (#8654 )

2026-10-18 13:36:33 +08:00

README.md

refactor(sse): decouple ecstore and harden KMS lifecycle (#5435 )

2026-07-30 12:39:25 +08:00

replication_facade_compat_test.rs

fix(replication): harden live delete admission (#5599 )

2026-08-02 12:52:11 +08:00

scanner_heal_admission_contract_test.rs

refactor(protos): move compat manifest send-site assertions into owning crates (#6618 )

2026-08-26 11:11:16 +08:00

storage_api.rs

test(heal): verify backup recovery and tier owner handoff (#8935 )

2026-10-26 08:00:42 +08:00

README.md

ecstore Integration Tests

MinIO-generated encrypted fixtures

rustfs/src/storage/minio_generated_read_test.rs validates the bitrot -> GetObjectReader path against raw MinIO backend data captured by .\rustfs\scripts\minio_fixture_lab\lab.py.

It currently covers multipart fixtures for:

sse-s3-multipart-8m
sse-kms-multipart-8m

Required environment variables:

RUSTFS_MINIO_FIXTURE_ROOT
RUSTFS_MINIO_STATIC_KMS_KEY_B64

Example:

$env:RUSTFS_MINIO_FIXTURE_ROOT = '.\rustfs\tmp\minio-fixture-lab-local-key'
$env:RUSTFS_MINIO_STATIC_KMS_KEY_B64 = '<base64-32-byte-local-minio-kms-key>'
cargo +1.97.1 test -p rustfs --features rio-v2 storage::minio_generated_read_test --lib -- --ignored