Ramakrishna Chilaka 0bade0ca3e perf(ecstore,filemeta): batch listings and buffer metacache streams (#8791) ...

* perf(ecstore,filemeta): batch local walk_dir metadata reads and buffer metacache streams

* fix(ecstore): stream completed listing metadata reads

Publish each result before starting the next blocking read, preserving
per-object progress and cancellation without a timed chunk queue.
Keep dispatch batching, byte limits, and namespace/error stops intact.
Cover multiple batches, page boundaries, and oversized-envelope resumption.

Co-Authored-By: heihutu <heihutu@gmail.com>
Co-Authored-By: zhi22915 <qiuzgang@gmail.com>

* test(ecstore,filemeta): verify production listing streams

Replace the simulated directory-walk benchmark with the public local disk
path. Validate fixture output before timing and retain metacache-only
stream benchmarks. Pin fragmented reads, read coalescing, and canonical
UUID namespace probing against the reference behavior.

Co-Authored-By: heihutu <heihutu@gmail.com>
Co-Authored-By: zhi22915 <qiuzgang@gmail.com>

* fix(ecstore): route listing benchmark through storage API

Centralize local listing benchmark imports in the shared benchmark
storage API boundary required by the architecture migration rules.

Co-Authored-By: heihutu <heihutu@gmail.com>
Co-Authored-By: zhi22915 <qiuzgang@gmail.com>

* test(scanner): keep catch-up fixture timestamps consistent

Admit the seeded catch-up using its observation timestamp so a durable
writer claim crossing a wall-clock second cannot spuriously rate-limit it.
Model an older claim timestamp to exercise that boundary deterministically.

Co-Authored-By: heihutu <heihutu@gmail.com>
Co-Authored-By: zhi22915 <qiuzgang@gmail.com>

---------

Co-authored-by: Hauser <housemecn@gmail.com>
Co-authored-by: heihutu <heihutu@gmail.com>
Co-authored-by: zhi22915 <qiuzgang@gmail.com>

2026-10-22 14:54:34 +08:00

..

storage_api

perf(ecstore,filemeta): batch listings and buffer metacache streams (#8791)

2026-10-22 14:54:34 +08:00

comparison_benchmark.rs

refactor: segment residual storage api boundaries (#3905)

2026-06-26 15:56:38 +08:00

erasure_benchmark.rs

perf(ecstore): reduce multipart and object I/O overhead (#8095)

2026-10-03 14:53:00 +08:00

local_walk_dir_benchmark.rs

perf(ecstore,filemeta): batch listings and buffer metacache streams (#8791)

2026-10-22 14:54:34 +08:00

multipart_read_parts_benchmark.rs

perf(ecstore): parallelize multipart I/O setup and metadata reads (#8085)

2026-09-23 22:19:23 +08:00

single_block_non_inline_benchmark.rs

perf(ecstore): reduce small PUT fixed costs (#5987)

2026-08-12 20:07:40 +08:00