Commit Graph

238 Commits

Author SHA1 Message Date
weisd e922c70c99 ec use AsyncRead 2024-11-04 17:43:05 +08:00
weisd 69e19fe8ab cargo clippy 2024-11-04 09:08:21 +08:00
weisd 2aba454318 fix cargo clippy err 2024-11-03 10:25:17 +08:00
weisd d4a220bddc cargo fmt 2024-11-03 10:05:50 +08:00
weisd 4a9d44ec28 fix linux get_info 2024-11-03 09:48:55 +08:00
weisd 16a81047e3 Optimization FileReader 2024-11-03 00:19:14 +08:00
weisd 71d4f1568f Optimization FileReader 2024-11-02 23:36:04 +08:00
weisd 2c26ea534f Optimization FileReader 2024-11-02 22:07:33 +08:00
weisd 6ab538050d fix bitrot readat bug 2024-11-02 17:53:30 +08:00
weisd 4a5443996f fix bug 2024-11-02 15:29:47 +08:00
weisd 52a81f8fd5 merge versioning, fix buff bitrot 2024-11-02 15:12:06 +08:00
weisd 09ea11c13d merge versioning, fix bug todo 2024-11-02 00:21:10 +08:00
dependabot[bot] 3d9757e5bf Bump the dependencies group with 13 updates
Bumps the dependencies group with 13 updates:

| Package | From | To |
| --- | --- | --- |
| [bytes](https://github.com/tokio-rs/bytes) | `1.7.2` | `1.8.0` |
| [hyper](https://github.com/hyperium/hyper) | `1.4.1` | `1.5.0` |
| [hyper-util](https://github.com/hyperium/hyper-util) | `0.1.9` | `0.1.10` |
| [pin-project-lite](https://github.com/taiki-e/pin-project-lite) | `0.2.14` | `0.2.15` |
| [protobuf](https://github.com/stepancheg/rust-protobuf) | `3.6.0` | `3.7.1` |
| [serde](https://github.com/serde-rs/serde) | `1.0.210` | `1.0.214` |
| [serde_json](https://github.com/serde-rs/json) | `1.0.128` | `1.0.132` |
| [thiserror](https://github.com/dtolnay/thiserror) | `1.0.64` | `1.0.66` |
| [tokio](https://github.com/tokio-rs/tokio) | `1.40.0` | `1.41.0` |
| [tower](https://github.com/tower-rs/tower) | `0.4.13` | `0.5.1` |
| [uuid](https://github.com/uuid-rs/uuid) | `1.10.0` | `1.11.0` |
| [regex](https://github.com/rust-lang/regex) | `1.11.0` | `1.11.1` |
| [openssl](https://github.com/sfackler/rust-openssl) | `0.10.66` | `0.10.68` |


Updates `bytes` from 1.7.2 to 1.8.0
- [Release notes](https://github.com/tokio-rs/bytes/releases)
- [Changelog](https://github.com/tokio-rs/bytes/blob/master/CHANGELOG.md)
- [Commits](https://github.com/tokio-rs/bytes/compare/v1.7.2...v1.8.0)

Updates `hyper` from 1.4.1 to 1.5.0
- [Release notes](https://github.com/hyperium/hyper/releases)
- [Changelog](https://github.com/hyperium/hyper/blob/master/CHANGELOG.md)
- [Commits](https://github.com/hyperium/hyper/compare/v1.4.1...v1.5.0)

Updates `hyper-util` from 0.1.9 to 0.1.10
- [Release notes](https://github.com/hyperium/hyper-util/releases)
- [Changelog](https://github.com/hyperium/hyper-util/blob/master/CHANGELOG.md)
- [Commits](https://github.com/hyperium/hyper-util/compare/v0.1.9...v0.1.10)

Updates `pin-project-lite` from 0.2.14 to 0.2.15
- [Release notes](https://github.com/taiki-e/pin-project-lite/releases)
- [Changelog](https://github.com/taiki-e/pin-project-lite/blob/main/CHANGELOG.md)
- [Commits](https://github.com/taiki-e/pin-project-lite/compare/v0.2.14...v0.2.15)

Updates `protobuf` from 3.6.0 to 3.7.1
- [Changelog](https://github.com/stepancheg/rust-protobuf/blob/master/CHANGELOG.md)
- [Commits](https://github.com/stepancheg/rust-protobuf/compare/v3.6.0...v3.7.1)

Updates `serde` from 1.0.210 to 1.0.214
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.210...v1.0.214)

Updates `serde_json` from 1.0.128 to 1.0.132
- [Release notes](https://github.com/serde-rs/json/releases)
- [Commits](https://github.com/serde-rs/json/compare/1.0.128...1.0.132)

Updates `thiserror` from 1.0.64 to 1.0.66
- [Release notes](https://github.com/dtolnay/thiserror/releases)
- [Commits](https://github.com/dtolnay/thiserror/compare/1.0.64...1.0.66)

Updates `tokio` from 1.40.0 to 1.41.0
- [Release notes](https://github.com/tokio-rs/tokio/releases)
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.40.0...tokio-1.41.0)

Updates `tower` from 0.4.13 to 0.5.1
- [Release notes](https://github.com/tower-rs/tower/releases)
- [Commits](https://github.com/tower-rs/tower/compare/tower-0.4.13...tower-0.5.1)

Updates `uuid` from 1.10.0 to 1.11.0
- [Release notes](https://github.com/uuid-rs/uuid/releases)
- [Commits](https://github.com/uuid-rs/uuid/compare/1.10.0...1.11.0)

Updates `regex` from 1.11.0 to 1.11.1
- [Release notes](https://github.com/rust-lang/regex/releases)
- [Changelog](https://github.com/rust-lang/regex/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/regex/compare/1.11.0...1.11.1)

Updates `openssl` from 0.10.66 to 0.10.68
- [Release notes](https://github.com/sfackler/rust-openssl/releases)
- [Commits](https://github.com/sfackler/rust-openssl/compare/openssl-v0.10.66...openssl-v0.10.68)

---
updated-dependencies:
- dependency-name: bytes
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: dependencies
- dependency-name: hyper
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: dependencies
- dependency-name: hyper-util
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
- dependency-name: pin-project-lite
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
- dependency-name: protobuf
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: dependencies
- dependency-name: serde
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
- dependency-name: serde_json
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
- dependency-name: thiserror
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
- dependency-name: tokio
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: dependencies
- dependency-name: tower
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: dependencies
- dependency-name: uuid
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: dependencies
- dependency-name: regex
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
- dependency-name: openssl
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-11-01 10:44:33 +00:00
junxiang Mu a8d36fba8f heal object(1)
Signed-off-by: junxiang Mu <1948535941@qq.com>
2024-11-01 17:40:54 +08:00
junxiang Mu 640cf1caf3 support bitrot
Signed-off-by: junxiang Mu <1948535941@qq.com>
2024-11-01 17:40:14 +08:00
junxiang Mu c0e6751893 bitrot streaming
Signed-off-by: junxiang Mu <1948535941@qq.com>
2024-11-01 17:40:14 +08:00
junxiang Mu e6cd184cd6 bitrot test(1)
Signed-off-by: junxiang Mu <1948535941@qq.com>
2024-11-01 17:40:14 +08:00
junxiang Mu 57c6a08b29 bitrot(2)
Signed-off-by: junxiang Mu <1948535941@qq.com>
2024-11-01 17:40:14 +08:00
junxiang Mu edb1e692f1 bitrot(1)
Signed-off-by: junxiang Mu <1948535941@qq.com>
2024-11-01 17:40:14 +08:00
junxiang Mu 49593dd77d Cross platform get_info
Signed-off-by: junxiang Mu <1948535941@qq.com>
2024-11-01 17:40:14 +08:00
junxiang Mu 9ff243a7a9 fmt
Signed-off-by: junxiang Mu <1948535941@qq.com>
2024-11-01 17:40:14 +08:00
junxiang Mu 76fb6775d1 heal object
Signed-off-by: junxiang Mu <1948535941@qq.com>
2024-11-01 17:40:14 +08:00
junxiang Mu 3f2772c74c healing tracker
Signed-off-by: junxiang Mu <1948535941@qq.com>
2024-11-01 17:40:14 +08:00
junxiang Mu e4f5ca7ea8 tmp 2024-11-01 17:40:09 +08:00
loverustfs 762b436e46 Merge pull request #89 from rustfs/adm-api-1
feat: introduce admin-api
2024-10-16 20:41:24 +08:00
weisd f520fda6fb fix list_volumes name 2024-10-15 14:45:50 +00:00
bestgopher a96ac8c024 feat: introduce admin-api
Signed-off-by: bestgopher <84328409@qq.com>
2024-10-15 19:51:00 +08:00
weisd 12114dce16 fix:#38 implement the basic storage functions of bucketmeta config use s3s struct define 2024-10-14 14:58:32 +08:00
junxiang Mu a0e37098bb fix clippy
Signed-off-by: junxiang Mu <1948535941@qq.com>
2024-10-12 14:09:52 +08:00
weisd e18d2d2f28 Merge branch 'main' into nugine/fmt 2024-10-12 00:54:22 +08:00
weisd 81dc3d4404 done bucket policy, need test 2024-10-12 00:41:03 +08:00
Nugine 386e2e0736 style: cargo fmt 2024-10-11 23:21:19 +08:00
weisd f88a8cf8fb Merge branch 'main' into feat/ec_config 2024-10-10 13:06:39 +08:00
weisd 22463c9eb1 get/put BucketVersionin done 2024-10-10 09:40:30 +08:00
weisd 1bbd5168c9 add versioning_sys 2024-10-09 20:45:34 +08:00
weisd 000866556e init BucketVersionin api 2024-10-09 17:38:56 +08:00
weisd c9423038da add bucket sys marshal func 2024-10-09 15:06:50 +08:00
junxiang Mu 9cf7dc128e use asm features
Signed-off-by: junxiang Mu <1948535941@qq.com>
2024-10-08 14:11:28 +08:00
weisd 46f7c010ca add env RUSTFS_ERASURE_SET_DRIVE_COUNT 2024-10-05 12:33:39 +08:00
weisd 10c63effd4 Fix: #38
Squashed commit of the following:

commit ff72105e1ec81b5679401b021fb44e8135444de8
Author: weisd <weishidavip@163.com>
Date:   Sat Oct 5 09:55:09 2024 +0800

    base bucketmetadata_sys done

commit 69d0c7725ae1065d25755c71aa54e42c4f3cdb50
Author: weisd <weishidavip@163.com>
Date:   Sat Oct 5 01:41:19 2024 +0800

    update bucket tagging op use bucketmetadata_sys

commit 39902c73d6f7a817041245af84a23d14115c70dc
Author: weisd <weishidavip@163.com>
Date:   Fri Oct 4 23:32:07 2024 +0800

    test bucketmetadata_sys

commit 15f1dfc765dc383ab26d71aca7c64dd0917b83f3
Author: weisd <weishidavip@163.com>
Date:   Fri Oct 4 23:21:58 2024 +0800

    init bucketmetadata_sys

commit 8c3c5e0f7385fa881b1dc4811d92afe8b86e9a6f
Author: weisd <weishidavip@163.com>
Date:   Tue Oct 1 23:06:09 2024 +0800

    init bucketmetadata_sys

commit e2746d154aa68be9dcf8add0241b38c72ef89b9c
Author: weisd <weishidavip@163.com>
Date:   Tue Oct 1 04:35:25 2024 +0800

    stash
2024-10-05 10:04:59 +08:00
weisd 3a608e5554 Merge branch 'main' of github.com:rustfs/s3-rustfs 2024-10-05 09:52:25 +08:00
dependabot[bot] 66c6e532f6 Bump the dependencies group with 18 updates
Bumps the dependencies group with 18 updates:

| Package | From | To |
| --- | --- | --- |
| [async-trait](https://github.com/dtolnay/async-trait) | `0.1.80` | `0.1.83` |
| [bytes](https://github.com/tokio-rs/bytes) | `1.6.0` | `1.7.2` |
| [clap](https://github.com/clap-rs/clap) | `4.5.7` | `4.5.18` |
| [hyper](https://github.com/hyperium/hyper) | `1.3.1` | `1.4.1` |
| [hyper-util](https://github.com/hyperium/hyper-util) | `0.1.5` | `0.1.9` |
| [http-body](https://github.com/hyperium/http-body) | `1.0.0` | `1.0.1` |
| [prost](https://github.com/tokio-rs/prost) | `0.13.1` | `0.13.3` |
| [prost-types](https://github.com/tokio-rs/prost) | `0.13.1` | `0.13.3` |
| [protobuf](https://github.com/stepancheg/rust-protobuf) | `3.5.1` | `3.6.0` |
| [serde](https://github.com/serde-rs/serde) | `1.0.203` | `1.0.210` |
| [serde_json](https://github.com/serde-rs/json) | `1.0.118` | `1.0.128` |
| [thiserror](https://github.com/dtolnay/thiserror) | `1.0.61` | `1.0.64` |
| [tokio](https://github.com/tokio-rs/tokio) | `1.38.0` | `1.40.0` |
| [tonic](https://github.com/hyperium/tonic) | `0.12.1` | `0.12.3` |
| [tonic-build](https://github.com/hyperium/tonic) | `0.12.1` | `0.12.3` |
| [tonic-reflection](https://github.com/hyperium/tonic) | `0.12.1` | `0.12.3` |
| [regex](https://github.com/rust-lang/regex) | `1.10.5` | `1.11.0` |
| [tokio-util](https://github.com/tokio-rs/tokio) | `0.7.11` | `0.7.12` |


Updates `async-trait` from 0.1.80 to 0.1.83
- [Release notes](https://github.com/dtolnay/async-trait/releases)
- [Commits](https://github.com/dtolnay/async-trait/compare/0.1.80...0.1.83)

Updates `bytes` from 1.6.0 to 1.7.2
- [Release notes](https://github.com/tokio-rs/bytes/releases)
- [Changelog](https://github.com/tokio-rs/bytes/blob/master/CHANGELOG.md)
- [Commits](https://github.com/tokio-rs/bytes/compare/v1.6.0...v1.7.2)

Updates `clap` from 4.5.7 to 4.5.18
- [Release notes](https://github.com/clap-rs/clap/releases)
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md)
- [Commits](https://github.com/clap-rs/clap/compare/clap_complete-v4.5.7...clap_complete-v4.5.18)

Updates `hyper` from 1.3.1 to 1.4.1
- [Release notes](https://github.com/hyperium/hyper/releases)
- [Changelog](https://github.com/hyperium/hyper/blob/master/CHANGELOG.md)
- [Commits](https://github.com/hyperium/hyper/compare/v1.3.1...v1.4.1)

Updates `hyper-util` from 0.1.5 to 0.1.9
- [Release notes](https://github.com/hyperium/hyper-util/releases)
- [Changelog](https://github.com/hyperium/hyper-util/blob/master/CHANGELOG.md)
- [Commits](https://github.com/hyperium/hyper-util/compare/v0.1.5...v0.1.9)

Updates `http-body` from 1.0.0 to 1.0.1
- [Release notes](https://github.com/hyperium/http-body/releases)
- [Commits](https://github.com/hyperium/http-body/compare/v1.0.0...v1.0.1)

Updates `prost` from 0.13.1 to 0.13.3
- [Release notes](https://github.com/tokio-rs/prost/releases)
- [Changelog](https://github.com/tokio-rs/prost/blob/master/CHANGELOG.md)
- [Commits](https://github.com/tokio-rs/prost/compare/v0.13.1...v0.13.3)

Updates `prost-types` from 0.13.1 to 0.13.3
- [Release notes](https://github.com/tokio-rs/prost/releases)
- [Changelog](https://github.com/tokio-rs/prost/blob/master/CHANGELOG.md)
- [Commits](https://github.com/tokio-rs/prost/compare/v0.13.1...v0.13.3)

Updates `protobuf` from 3.5.1 to 3.6.0
- [Changelog](https://github.com/stepancheg/rust-protobuf/blob/master/CHANGELOG.md)
- [Commits](https://github.com/stepancheg/rust-protobuf/compare/v3.5.1...v3.6.0)

Updates `serde` from 1.0.203 to 1.0.210
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.203...v1.0.210)

Updates `serde_json` from 1.0.118 to 1.0.128
- [Release notes](https://github.com/serde-rs/json/releases)
- [Commits](https://github.com/serde-rs/json/compare/v1.0.118...1.0.128)

Updates `thiserror` from 1.0.61 to 1.0.64
- [Release notes](https://github.com/dtolnay/thiserror/releases)
- [Commits](https://github.com/dtolnay/thiserror/compare/1.0.61...1.0.64)

Updates `tokio` from 1.38.0 to 1.40.0
- [Release notes](https://github.com/tokio-rs/tokio/releases)
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.38.0...tokio-1.40.0)

Updates `tonic` from 0.12.1 to 0.12.3
- [Release notes](https://github.com/hyperium/tonic/releases)
- [Changelog](https://github.com/hyperium/tonic/blob/master/CHANGELOG.md)
- [Commits](https://github.com/hyperium/tonic/compare/v0.12.1...v0.12.3)

Updates `tonic-build` from 0.12.1 to 0.12.3
- [Release notes](https://github.com/hyperium/tonic/releases)
- [Changelog](https://github.com/hyperium/tonic/blob/master/CHANGELOG.md)
- [Commits](https://github.com/hyperium/tonic/compare/v0.12.1...v0.12.3)

Updates `tonic-reflection` from 0.12.1 to 0.12.3
- [Release notes](https://github.com/hyperium/tonic/releases)
- [Changelog](https://github.com/hyperium/tonic/blob/master/CHANGELOG.md)
- [Commits](https://github.com/hyperium/tonic/compare/v0.12.1...v0.12.3)

Updates `regex` from 1.10.5 to 1.11.0
- [Release notes](https://github.com/rust-lang/regex/releases)
- [Changelog](https://github.com/rust-lang/regex/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/regex/compare/1.10.5...1.11.0)

Updates `tokio-util` from 0.7.11 to 0.7.12
- [Release notes](https://github.com/tokio-rs/tokio/releases)
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-util-0.7.11...tokio-util-0.7.12)

---
updated-dependencies:
- dependency-name: async-trait
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
- dependency-name: bytes
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: dependencies
- dependency-name: clap
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
- dependency-name: hyper
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: dependencies
- dependency-name: hyper-util
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
- dependency-name: http-body
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
- dependency-name: prost
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
- dependency-name: prost-types
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
- dependency-name: protobuf
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: dependencies
- dependency-name: serde
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
- dependency-name: serde_json
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
- dependency-name: thiserror
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
- dependency-name: tokio
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: dependencies
- dependency-name: tonic
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
- dependency-name: tonic-build
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
- dependency-name: tonic-reflection
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
- dependency-name: regex
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: dependencies
- dependency-name: tokio-util
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-10-01 05:17:37 +00:00
weisd 87a332ee81 stash 2024-09-30 21:40:17 +08:00
weisd 80248981dd Merge remote-tracking branch 'origin/main' into bucketmeta 2024-09-30 21:25:31 +08:00
junxiang Mu 8edd667ff4 fix: make_volume api error
Signed-off-by: junxiang Mu <1948535941@qq.com>
2024-09-29 14:08:48 +08:00
weisd cbaea166c4 init bucketmeta struct 2024-09-27 22:00:45 +08:00
weisd 91e65867bb merge main 2024-09-27 20:12:54 +08:00
weisd b4a95d20e2 init bucketmeta struct 2024-09-27 18:08:33 +08:00
weisd dfb4c9f726 init bucketmeta struct 2024-09-27 17:53:44 +08:00
junxiang Mu bd02676dbc refact error
Signed-off-by: junxiang Mu <1948535941@qq.com>
2024-09-27 16:51:54 +08:00