4559baaeeb
feat: migrate to reed-solomon-simd only implementation
...
- Remove reed-solomon-erasure dependency and all related code
- Simplify ReedSolomonEncoder from enum to struct with SIMD-only implementation
- Eliminate all conditional compilation (#[cfg(feature = ...)])
- Add instance caching with RwLock-based encoder/decoder reuse
- Implement reset mechanism to avoid unnecessary allocations
- Ensure thread safety with proper cache management
- Update documentation and benchmark scripts for SIMD-only approach
- Apply code formatting across all files
Breaking Changes:
- Removes support for reed-solomon-erasure feature flag
- API remains compatible but implementation is now SIMD-only
Performance Impact:
- Improved encoding/decoding performance through SIMD optimization
- Reduced memory allocations via instance caching
- Enhanced thread safety and concurrency support
2025-06-23 10:00:17 +08:00
928453db62
improve code for notify
2025-06-23 03:34:05 +08:00
e0f65e5e24
improve code for notify
2025-06-21 10:35:07 +08:00
48d530cb13
Merge branch 'main' of github.com:rustfs/s3-rustfs into feature/observability-metrics
...
# Conflicts:
# crates/utils/Cargo.toml
# ecstore/src/store_list_objects.rs
# iam/src/manager.rs
# rustfs/src/admin/rpc.rs
2025-06-20 12:58:47 +08:00
d3cc36f6e0
fix
2025-06-20 10:51:36 +08:00
e145586b65
refactor: reorganize RPC modules into unified structure
2025-06-19 17:06:54 +08:00
c658d88d25
Reconstructing Notify module
2025-06-19 15:40:48 +08:00
e6b019c29d
Merge branch 'main' of github.com:rustfs/s3-rustfs into feature/observability-metrics
...
# Conflicts:
# .github/workflows/build.yml
# .github/workflows/ci.yml
# Cargo.lock
# Cargo.toml
# appauth/src/token.rs
# crates/config/src/config.rs
# crates/event-notifier/examples/simple.rs
# crates/event-notifier/src/global.rs
# crates/event-notifier/src/lib.rs
# crates/event-notifier/src/notifier.rs
# crates/event-notifier/src/store.rs
# crates/filemeta/src/filemeta.rs
# crates/notify/examples/webhook.rs
# crates/utils/Cargo.toml
# ecstore/Cargo.toml
# ecstore/src/cmd/bucket_replication.rs
# ecstore/src/config/com.rs
# ecstore/src/disk/error.rs
# ecstore/src/disk/mod.rs
# ecstore/src/set_disk.rs
# ecstore/src/store_api.rs
# ecstore/src/store_list_objects.rs
# iam/Cargo.toml
# iam/src/manager.rs
# policy/Cargo.toml
# rustfs/src/admin/rpc.rs
# rustfs/src/main.rs
# rustfs/src/storage/mod.rs
2025-06-19 13:16:48 +08:00
58faf141bd
feat: rpc auth
2025-06-18 20:00:39 +08:00
039108ee5e
fix test
2025-06-18 18:51:54 +08:00
5b1b527851
fix bitrot
2025-06-18 18:22:30 +08:00
65ff5faada
Merge pull request #480 from rustfs/feat/compress
...
feat: add object compression support
2025-06-17 20:20:45 +08:00
4cadc4c12d
feat(ecstore): MultiWriter concurrent write
2025-06-17 16:22:55 +08:00
da4a4e7cbe
feat(ecstore): erasure encode reuse buf
2025-06-17 16:22:55 +08:00
39e988537c
refactor(ecstore): DiskAPI::read_all use Bytes
2025-06-17 16:22:55 +08:00
e520299c4b
refactor(ecstore): DiskAPI::write_all use Bytes
2025-06-17 16:22:55 +08:00
c48ebd5149
feat: add compress support
2025-06-17 15:06:40 +08:00
ca298b460c
fix test
2025-06-16 11:40:15 +08:00
52342f2f8e
feat(grpc): walk_dir http
...
fix(ecstore): rebalance loop
2025-06-16 10:32:03 +08:00
1606276223
feat(protos): use Bytes for protobuf bytes type fields.
2025-06-15 22:07:01 +08:00
82cc1402c4
feat(ecstore): LocalDisk writes file by spawn_blocking
2025-06-15 21:01:38 +08:00
2f3dbac59b
feat(ecstore): LocalDisk::write_all_internal use InternalBuf
2025-06-15 21:01:38 +08:00
3c5e20b633
refactor(ecstore): DiskAPI::rename_part meta use Bytes
2025-06-15 21:01:38 +08:00
8309d2f8be
refactor(filemeta): FileInfo data use Bytes
2025-06-15 21:01:38 +08:00
3a567768c1
refactor(filemeta): ChecksumInfo hash use Bytes
2025-06-15 21:01:38 +08:00
b14cd7508b
Merge pull request #471 from rustfs/nugine/fix/hash-reduce-allocation
...
fix(utils): hash reduce allocation
2025-06-15 09:43:16 +08:00
09095f2abd
fix(ecstore): fs block_in_place
2025-06-14 23:13:50 +08:00
bb282bcd5d
fix(utils): hash reduce allocation
2025-06-14 20:42:48 +08:00
5cc56784a7
fix bucket-replication clippy error
2025-06-12 14:31:05 +00:00
0ca03465e3
fix(erasure): write_quorum
2025-06-11 23:49:55 +08:00
d529b9abbd
add error log
2025-06-11 23:44:22 +08:00
bdb7e8d321
move xhttp to filemeta
2025-06-11 16:22:20 +08:00
e8a59d7c07
move disk::utils to crates::utils
2025-06-11 15:55:40 +08:00
2eeb9dbcbc
fix cargo test error, delete unnecessary files
2025-06-11 00:35:16 +08:00
7c9046c2cd
feat: update erasure benchmark to use new calc_shard_size import
2025-06-11 00:30:15 +08:00
e40562b03d
fix(ecstore): resolve clippy warnings for io_other_error
2025-06-10 22:29:03 +08:00
98ce64aaae
Merge pull request #457 from rustfs/fix/spelling-errors
...
fix: correct spelling errors in error messages and variable names
2025-06-10 22:16:43 +08:00
7ca9f44fca
Merge pull request #458 from rustfs/fix/proto-spelling-errors
...
fix: correct spelling errors in proto file `RenamePartRequst`
2025-06-10 22:16:21 +08:00
6afb26b377
fix: resolve duplicate Error import and ParseIntError conversion in linux.rs
2025-06-10 22:02:29 +08:00
e6b931f71e
fix: correct spelling errors in proto file RenamePartRequst/RenameFileRequst to RenamePartRequest/RenameFileRequest
2025-06-10 21:51:36 +08:00
7b890108ee
fix: correct spelling errors in error messages and variable names
2025-06-10 21:21:03 +08:00
40d99a5377
fix: correct spelling errors in codebase
2025-06-10 21:04:46 +08:00
7527162bec
fix: correct spelling errors in codebase
2025-06-10 20:39:44 +08:00
3338f3236f
fix fmt
2025-06-10 18:51:06 +08:00
5c610e26c9
Merge branch 'main' into refactor/io
2025-06-10 18:04:50 +08:00
754ffd0ff2
update ec share size
...
update bitrot
2025-06-10 16:41:34 +08:00
6ea0185519
add reed-solomon-simd banchmark
2025-06-10 00:09:05 +08:00
e62947f7b2
add reed-solomon-simd
2025-06-09 18:04:42 +08:00
4bbf1c33b8
fix fmt check
2025-06-09 17:35:42 +08:00
f85ef06783
merge main
2025-06-09 15:31:11 +08:00
weisd