Commit Graph

3691 Commits

Author SHA1 Message Date
Zhengchao An e37e367390 refactor: route remaining external storage boundaries (#3889) 2026-06-26 06:22:51 +08:00
Zhengchao An 4d6ea453a7 refactor: route scanner heal storage boundaries (#3888) 2026-06-26 05:24:41 +08:00
houseme f7a9a7142b chore: update deps and e2e cache action (#3885)
* chore(deps): update workspace crate versions

* ci: update e2e s3tests cache action
2026-06-26 04:19:28 +08:00
Zhengchao An 19c925c480 refactor: expand storage api boundaries (#3886)
* refactor: route root storage contracts

* refactor: expand storage api boundaries
2026-06-26 04:19:02 +08:00
houseme 7bf411f465 obs(get): add GET read pipeline metrics (#3868) 2026-06-26 04:02:02 +08:00
Zhengchao An 33b7f48f37 refactor: route root storage facades (#3867) 2026-06-25 23:23:45 +08:00
Zhengchao An 987ea4919f refactor: route admin storage facades (#3866) 2026-06-25 22:37:54 +08:00
cxymds 86e9362459 fix(heal): canonicalize scanner object-dir repairs (#3864) 2026-06-25 22:07:38 +08:00
Zhengchao An 1c973bc1d9 refactor: route app facade boundaries (#3865)
* refactor: route app storage error helpers

* refactor: route app bucket owner facades

* refactor: route app runtime facades
2026-06-25 21:57:42 +08:00
Zhengchao An 60c00f7622 refactor: route app and admin storage helpers (#3863)
* refactor: route admin storage helper imports

* refactor: route app storage io helper imports
2026-06-25 21:12:51 +08:00
Henry Guo 30f781871d fix(scanner): preserve dirty usage convergence (#3844)
Co-authored-by: Henry Guo <marshawcoco@users.noreply.github.com>
2026-06-25 21:09:12 +08:00
cxymds 4cdc6ae63f fix(admin): refresh persisted pool states (#3861) 2026-06-25 21:08:55 +08:00
houseme ef0dcec479 feat(ecstore): add deeper zero-copy ingest experiment (#3847)
* feat(storage): add multipart put stage metrics

* feat(scripts): add multipart put focus runner

* docs(operations): add multipart put server-path guides

* chore(scripts): add local rustfs restart helper

* docs(observability): add local metrics backend guide

* docs(observability): add localized multipart guides

* fix(ecstore): validate multipart batching path

* feat(obs): add erasure encode overlap metrics

* docs(ops): update overlap retest summary

* docs(ops): add batchblocks retest matrix

* docs(ops): extend overlap candidate summary

* docs(ops): capture 8-run overlap summary

* feat(storage): switch rename_data to msgpack map

* test(storage): add rename_data payload checks

* feat(object): add zero_copy_eager put path

* docs(ops): add zero_copy_eager put guide

* docs(ops): add deeper zero-copy next steps

* feat(ecstore): add bytesmut erasure ingest gate

* docs(ops): add bytesmut ingest summary

* docs(ops): extend bytesmut ingest matrix summary

* docs(ops): extend bytesmut larger-object summary

* docs(ops): capture bytesmut variability summary

* chore(scripts): add deeper zero-copy capture flow

* chore(scripts): add deeper zero-copy capture support

* docs(ops): add capture-backed bytesmut retest

* docs(ops): update deeper zero-copy retests

* chore(docs): keep issue-712 notes local only

Co-Authored-By: heihutu <heihutu@gmail.com>
2026-06-25 21:05:00 +08:00
houseme 96b1f5c373 feat(storage): optimize gt1g get read path (#3860)
* feat(storage): tune gt1g get read path

* docs(ops): add gt1g get benchmark guide

* feat(scripts): add gt1g get fallback runner

* test(storage): trim gt1g get helper warnings

* test(storage): reduce gt1g get helper type complexity
2026-06-25 20:12:08 +08:00
houseme a30357d21e feat(storage): extend PUT path tuning and observability (#3829)
* feat(storage): add multipart put stage metrics

* feat(scripts): add multipart put focus runner

* docs(operations): add multipart put server-path guides

* chore(scripts): add local rustfs restart helper

* docs(observability): add local metrics backend guide

* docs(observability): add localized multipart guides

* fix(ecstore): validate multipart batching path

* feat(obs): add erasure encode overlap metrics

* docs(ops): update overlap retest summary

* docs(ops): add batchblocks retest matrix

* docs(ops): extend overlap candidate summary

* docs(ops): capture 8-run overlap summary

* feat(storage): switch rename_data to msgpack map

* test(storage): add rename_data payload checks

* feat(object): add zero_copy_eager put path

* docs(ops): add zero_copy_eager put guide

* docs(ops): add deeper zero-copy next steps
2026-06-25 19:24:35 +08:00
Zhengchao An 3942186f3d refactor: route app storage helper imports (#3856) 2026-06-25 18:10:49 +08:00
Zhengchao An a21f3c1a3f refactor: route app s3 api helpers (#3854) 2026-06-25 16:50:17 +08:00
Zhengchao An 2dd98b1f84 refactor: remove app dto wildcard imports (#3853) 2026-06-25 16:07:49 +08:00
Zhengchao An fe0227e9dc refactor: remove app storage wildcard imports (#3851) 2026-06-25 15:10:51 +08:00
cxymds 55cbfe256b fix(heal): skip scanner object-dir recreate misses (#3839) 2026-06-25 14:52:24 +08:00
GatewayJ 06fdbecf9d fix(s3tables): harden warehouse index races (#3849) 2026-06-25 14:35:24 +08:00
cxymds 4cb28abfc9 fix(scanner): reduce non-actionable scan noise (#3840) 2026-06-25 14:35:10 +08:00
Zhengchao An bfb2a95e3d refactor: route admin context imports (#3848) 2026-06-25 14:27:25 +08:00
Zhengchao An 46fa28f542 refactor: centralize root runtime sources (#3846) 2026-06-25 13:19:52 +08:00
Zhengchao An 1c4bcd4372 refactor: centralize admin runtime sources (#3845) 2026-06-25 13:09:02 +08:00
Henry Guo 1c4a279909 feat(table-catalog): add durable strong backing (#3836) 2026-06-25 12:22:30 +08:00
Zhengchao An 928074a97d refactor: centralize server storage runtime sources (#3843) 2026-06-25 12:20:53 +08:00
Zhengchao An 839cab47ce refactor: centralize startup runtime sources (#3838) 2026-06-25 11:31:38 +08:00
GatewayJ fe5961cc16 fix(s3tables): harden warehouse index consistency (#3835) 2026-06-25 11:31:25 +08:00
Henry Guo 1d6a8259c5 feat(table-catalog): add partition-local compaction (#3832)
Co-authored-by: Henry Guo <marshawcoco@users.noreply.github.com>
2026-06-25 11:14:40 +08:00
Zhengchao An 873aea21ca refactor: centralize app context runtime fallbacks (#3837) 2026-06-25 11:00:42 +08:00
Rokton 758677dafe fix(heal): Add podAnnotations to statefulset and deployment templates (#3831) 2026-06-25 09:39:11 +08:00
cxymds e6f04bed47 fix(heal): skip missing object-dir candidates (#3834) 2026-06-25 09:38:08 +08:00
cxymds c6ef37d5a7 fix(server): handle MinIO cluster health probe (#3833) 2026-06-25 09:37:57 +08:00
Zhengchao An ad6184b126 refactor: centralize iam runtime source helpers (#3828) 2026-06-24 22:49:24 +08:00
Zhengchao An a935854b32 refactor: centralize scanner runtime source helpers (#3827)
* refactor: batch lifecycle runtime source handles

* refactor: centralize scanner runtime source helpers
2026-06-24 22:05:03 +08:00
Zhengchao An 5cc8bd7952 refactor: centralize ecstore rpc test runtime sources (#3818) 2026-06-24 21:18:22 +08:00
Henry Guo 90f6371e29 fix(scanner): clear deleted bucket usage stats (#3822)
* fix(scanner): clear deleted bucket usage stats

* fix(scanner): preserve usage timestamp on bucket cleanup

---------

Co-authored-by: Henry Guo <marshawcoco@users.noreply.github.com>
2026-06-24 21:08:32 +08:00
houseme 623fc801f1 feat(replication): support custom TLS for bucket targets (#3825)
* feat(replication): support insecure https bucket targets

* feat(replication): support custom ca bucket targets

* test(replication): satisfy e2e clippy for TLS helpers

* fix(replication): avoid native root panic for custom trust stores

* test(replication): decouple private IP target test from TLS roots

* test(replication): use target TLS client in private IP unit test
2026-06-24 20:23:20 +08:00
Henry Guo fcd0c9ec0f test(table-catalog): add atomic catalog backing fixture (#3821) 2026-06-24 19:05:13 +08:00
houseme efebcb66be feat(perf): add large PUT tuning and encode optimization (#3816) 2026-06-24 19:04:04 +08:00
houseme 3c6e9acfcb fix: route cluster imports through ecstore_cluster module (#3819) 2026-06-24 19:03:31 +08:00
cxymds 0ffd561daf fix(health): decouple liveness and lock RPC deadlines (#3824) 2026-06-24 18:34:51 +08:00
cxymds 57e12e56d2 fix(admin): correct pool lifecycle status mapping (#3823) 2026-06-24 17:05:07 +08:00
cxymds eef8f43251 fix: harden lock timeouts, health, and heal paths (#3815) 2026-06-24 15:48:06 +08:00
Zhengchao An 94034ef406 refactor: centralize ecstore batch sources and aliases (#3817) 2026-06-24 14:12:48 +08:00
houseme cbf526df87 refactor(admin): migrate OIDC consumers to app context (#3800) 2026-06-24 12:51:53 +08:00
GatewayJ 89dfb1357c fix(s3tables): harden catalog guard checks (#3801) 2026-06-24 12:51:40 +08:00
houseme 31b5db9a75 feat(admin): expose cluster snapshot view (#3803) 2026-06-24 12:51:26 +08:00
cxymds 5eda332fee fix(heal): recover shards after node rejoin (#3814) 2026-06-24 12:51:16 +08:00