Zhengchao An 0fe6cc3641 feat(ecstore): add on-demand migration write-back pipeline (#7079) ...

* feat(ecstore): add on-demand migration pull queue and write-back pipeline

Background pull queue per bucket (bounded by pull_queue_capacity, concurrency via the state's pull slot), OdmWriteBack/PullSource traits, single-part and multipart write-back with a pumped body that enforces idle timeout, cancel and content length, retry policy for retryable source errors, inline commit helper, and stats accounting (rustfs/backlog#2153).

* feat(object): implement on-demand migration write-back over internal put

OdmWriteBack impl mapping source heads onto InternalPutContext (content-header allowlist, x-amz-meta copy, tags, dual-prefix odm-* provenance, ETag policy), injected into OnDemandMigrationSys at startup; removes the dead-code gates left by ODM-06a (rustfs/backlog#2153).

2026-09-03 02:45:24 +08:00

..

audit

feat(info): report all rustfs features (#6722)

2026-08-27 14:45:50 +08:00

checksums

docs(rio): record the checksum hasher verdict and pin shared vectors (#6706)

2026-08-27 10:08:09 +08:00

common

refactor(common): drop transitional heal/scanner contract shims (#6680)

2026-08-26 22:49:55 +08:00

concurrency

refactor(concurrency): consolidate ForegroundPressure into workload owner (#6757)

2026-08-28 06:52:50 +08:00

config

fix(scanner): fit usage persistence within publication lease (#6967)

2026-08-31 22:58:29 +08:00

credentials

feat: extend hotpath coverage across crates (#5505)

2026-07-31 05:42:19 +00:00

crypto

test(crypto): replace the one-file key scan with a repo-wide guard (#6246)

2026-08-19 10:59:54 +08:00

data-usage

fix(scanner): bootstrap pristine usage baseline (#6471)

2026-08-24 14:29:09 +08:00

e2e_test

test(e2e): rename stall timing variable flagged by typos (#7070)

2026-09-02 22:46:28 +08:00

ecstore

feat(ecstore): add on-demand migration write-back pipeline (#7079)

2026-09-03 02:45:24 +08:00

extension-schema

feat: extend hotpath coverage across crates (#5505)

2026-07-31 05:42:19 +00:00

filemeta

fix(ecstore): keep degraded objects listable when drives are offline (#7010)

2026-09-01 20:16:57 +08:00

heal

fix(heal): preserve automatic replacement recovery status (#7018)

2026-09-01 17:21:43 +00:00

heal-contracts

fix(heal): preserve automatic replacement recovery status (#7018)

2026-09-01 17:21:43 +00:00

iam

fix(admin): replicate user secret-key rotation to peer sites (#6893)

2026-08-30 23:32:07 +08:00

io-core

fix(logging): bound ECStore debug output (#6809)

2026-08-29 04:51:37 +00:00

io-metrics

fix(logging): bound ECStore debug output (#6809)

2026-08-29 04:51:37 +00:00

keystone

chore: adjudicate 19 bare dead_code allows across six leaf crates (#6161)

2026-08-17 11:34:47 +08:00

kms

fix(kms): restore persisted configuration after restart (#6821)

2026-08-29 16:21:22 +08:00

license

feat(license): add entitlement provider abstraction (#7006)

2026-09-01 19:31:35 +08:00

lifecycle

chore(deps): refresh s3s and smallvec (#7043)

2026-09-02 05:04:35 +00:00

lock

fix(logging): bound ECStore debug output (#6809)

2026-08-29 04:51:37 +00:00

log-analyzer

fix(ecstore): reserve decommission capacity safely (#6917)

2026-08-31 15:20:09 +08:00

madmin

feat(admin): add on-demand migration bucket admin API (#7076)

2026-09-03 01:58:49 +08:00

notify

test(targets,notify,audit): share a builder MockTarget testkit (#6717)

2026-08-27 11:28:16 +08:00

object-capacity

chore(capacity): update default refresh tuning (#6938)

2026-08-31 14:43:59 +08:00

object-data-cache

fix(logging): bound ECStore debug output (#6809)

2026-08-29 04:51:37 +00:00

obs

feat(info): report all rustfs features (#6722)

2026-08-27 14:45:50 +08:00

policy

feat(admin): add on-demand migration bucket admin API (#7076)

2026-09-03 01:58:49 +08:00

protocols

fix: preserve protocol service account claims (#7062)

2026-09-02 14:16:15 +00:00

protos

fix(heal): preserve automatic replacement recovery status (#7018)

2026-09-01 17:21:43 +00:00

replication

fix(replication): surface failed objects at the default log level (#7021)

2026-09-02 00:25:09 +08:00

rio

feat(rio): add bounded tee reader for one-read two-consumer paths (#7066)

2026-09-02 21:59:46 +08:00

rio-v2

fix(s3): align Snowball codec compatibility (#6943)

2026-08-31 13:09:51 +00:00

s3-client

fix(tier): harden reference proof and audit output (#6807)

2026-08-28 22:46:00 +08:00

s3-ops

feat(obs): add bounded metrics dimensions (#5645)

2026-08-03 09:03:34 +08:00

s3-types

feat(admin): self-service account management and TOTP two-factor authentication (#6596)

2026-08-26 09:35:29 +08:00

s3select-api

feat(s3-select): stream JSON document input (#6980)

2026-09-01 20:17:14 +08:00

s3select-query

feat(s3-select): stream JSON document input (#6980)

2026-09-01 20:17:14 +08:00

scanner

fix(scanner): align usage floor compat marker (#7064)

2026-09-02 14:03:04 +00:00

scanner-contracts

refactor(common): move scanner/heal contracts into dedicated crates (#6615)

2026-08-26 10:49:12 +08:00

security-governance

fix(admin): refuse immediate KMS key deletion through the query string (#5589)

2026-08-02 03:46:11 +08:00

signer

perf(signer): cache signing key to avoid redundant HMAC-SHA256 (#6651)

2026-08-26 17:00:00 +08:00

storage-api

fix(s3): round-trip null-version delete-marker identity (#6765)

2026-08-27 23:55:05 +00:00

targets

fix(logging): bound ECStore debug output (#6809)

2026-08-29 04:51:37 +00:00

test-utils

test(ci): stabilize main fixture paths (#6523)

2026-08-24 19:34:02 +08:00

tls-runtime

feat: extend hotpath coverage across crates (#5505)

2026-07-31 05:42:19 +00:00

trusted-proxies

fix(startup): never panic when the system CA bundle is absent (#6769)

2026-08-28 00:34:51 +00:00

utils

refactor(object): extract internal put entry and ODM provenance keys (#7071)

2026-09-02 22:56:23 +08:00

zip

fix(s3): align Snowball codec compatibility (#6943)

2026-08-31 13:09:51 +00:00

AGENTS.md

docs(agents): streamline instruction routing (#6358)

2026-08-22 08:19:53 +08:00