Commit Graph

122 Commits

Author SHA1 Message Date
weisd 7a7ca6e154 moved to the trash and automatically cleaned up in the background 2025-06-25 10:08:09 +08:00
weisd 7e17d7d729 refactor: improve object listing and version handling
- Refactor find_version_index to accept Uuid directly instead of string
- Split from_meta_cache_entries_sorted into separate methods for versions and infos
- Add support for after_version_id filtering in version listing
- Fix S3 error code for replication configuration not found
- Improve error handling and logging levels
- Clean up import statements and remove debug code
2025-06-24 11:10:23 +08:00
likewu 364c3098b2 Fix/main (#508)
* fix error

* fix

* fix cargo

* fix openssl cfg

* fix clippy

* fix clippy

* fix

* fix clippy

* fix clippy
2025-06-24 10:27:41 +08:00
likewu 46c50b1bb1 Fix/main (#505)
* fix error

* fix

* fix cargo
2025-06-23 18:51:31 +08:00
likewu 005881f838 Merge branch 'main' of https://github.com/rustfs/s3-rustfs into feature/ilm
# Conflicts:
#	rustfs/src/storage/ecfs.rs
2025-06-23 16:44:37 +08:00
likewu 81f0c9763f Merge branch 'main' of https://github.com/rustfs/s3-rustfs into feature/ilm
# Conflicts:
#	Cargo.lock
#	Cargo.toml
#	crates/utils/Cargo.toml
#	crates/utils/src/net.rs
#	ecstore/Cargo.toml
#	ecstore/src/set_disk.rs
#	rustfs/src/storage/ecfs.rs
2025-06-23 16:42:18 +08:00
weisd 34ec13e532 change objectinfo metadata use HashMap
add copyobject compresss support

fix listobject size use actual_size
2025-06-23 16:24:11 +08:00
likewu 2c176dd864 fix clippy 2025-06-23 12:03:46 +08:00
weisd 4559baaeeb feat: migrate to reed-solomon-simd only implementation
- Remove reed-solomon-erasure dependency and all related code
- Simplify ReedSolomonEncoder from enum to struct with SIMD-only implementation
- Eliminate all conditional compilation (#[cfg(feature = ...)])
- Add instance caching with RwLock-based encoder/decoder reuse
- Implement reset mechanism to avoid unnecessary allocations
- Ensure thread safety with proper cache management
- Update documentation and benchmark scripts for SIMD-only approach
- Apply code formatting across all files

Breaking Changes:
- Removes support for reed-solomon-erasure feature flag
- API remains compatible but implementation is now SIMD-only

Performance Impact:
- Improved encoding/decoding performance through SIMD optimization
- Reduced memory allocations via instance caching
- Enhanced thread safety and concurrency support
2025-06-23 10:00:17 +08:00
likewu cc71f40a6d ilm feature add 2025-06-22 23:04:40 +08:00
houseme d3cc36f6e0 fix 2025-06-20 10:51:36 +08:00
houseme e6b019c29d Merge branch 'main' of github.com:rustfs/s3-rustfs into feature/observability-metrics
# Conflicts:
#	.github/workflows/build.yml
#	.github/workflows/ci.yml
#	Cargo.lock
#	Cargo.toml
#	appauth/src/token.rs
#	crates/config/src/config.rs
#	crates/event-notifier/examples/simple.rs
#	crates/event-notifier/src/global.rs
#	crates/event-notifier/src/lib.rs
#	crates/event-notifier/src/notifier.rs
#	crates/event-notifier/src/store.rs
#	crates/filemeta/src/filemeta.rs
#	crates/notify/examples/webhook.rs
#	crates/utils/Cargo.toml
#	ecstore/Cargo.toml
#	ecstore/src/cmd/bucket_replication.rs
#	ecstore/src/config/com.rs
#	ecstore/src/disk/error.rs
#	ecstore/src/disk/mod.rs
#	ecstore/src/set_disk.rs
#	ecstore/src/store_api.rs
#	ecstore/src/store_list_objects.rs
#	iam/Cargo.toml
#	iam/src/manager.rs
#	policy/Cargo.toml
#	rustfs/src/admin/rpc.rs
#	rustfs/src/main.rs
#	rustfs/src/storage/mod.rs
2025-06-19 13:16:48 +08:00
weisd 58faf141bd feat: rpc auth 2025-06-18 20:00:39 +08:00
weisd 5b1b527851 fix bitrot 2025-06-18 18:22:30 +08:00
weisd c48ebd5149 feat: add compress support 2025-06-17 15:06:40 +08:00
weisd 52342f2f8e feat(grpc): walk_dir http
fix(ecstore): rebalance loop
2025-06-16 10:32:03 +08:00
Nugine 3c5e20b633 refactor(ecstore): DiskAPI::rename_part meta use Bytes 2025-06-15 21:01:38 +08:00
Nugine 8309d2f8be refactor(filemeta): FileInfo data use Bytes 2025-06-15 21:01:38 +08:00
weisd bdb7e8d321 move xhttp to filemeta 2025-06-11 16:22:20 +08:00
weisd e8a59d7c07 move disk::utils to crates::utils 2025-06-11 15:55:40 +08:00
overtrue 7b890108ee fix: correct spelling errors in error messages and variable names 2025-06-10 21:21:03 +08:00
weisd 754ffd0ff2 update ec share size
update bitrot
2025-06-10 16:41:34 +08:00
weisd f85ef06783 merge main 2025-06-09 15:31:11 +08:00
weisd 91c099e35f add Error test, fix clippy 2025-06-09 11:29:23 +08:00
weisd 152ad57c1d Upgrade rand to 0.9.1 2025-06-09 10:22:22 +08:00
weisd 1d2aeb288a Upgrade rand to 0.9.1 2025-06-09 10:13:03 +08:00
weisd 96de65ebab add disk test 2025-06-09 00:30:29 +08:00
weisd 62a7824d0d fix clippy 2025-06-07 15:39:06 +08:00
weisd b51ee48699 update filereader/writer todo 2025-06-06 18:04:51 +08:00
weisd c589972fa7 mc test ok 2025-06-06 16:15:26 +08:00
weisd 9384b831ec ecstore update ec/disk/error 2025-06-06 01:13:51 +08:00
houseme 15bd320231 Merge branch 'main' of github.com:rustfs/s3-rustfs into feature/observability-metrics
# Conflicts:
#	Cargo.lock
#	README.md
#	README_ZH.md
#	crates/obs/Cargo.toml
#	deploy/config/obs-zh.example.toml
#	scripts/run.sh
2025-05-30 10:52:02 +08:00
junxiang Mu f9310f0b97 decrease scanner frequency
Signed-off-by: junxiang Mu <1948535941@qq.com>
2025-05-29 03:17:54 +00:00
junxiang Mu 155cb546ac improve scanner(1)
Signed-off-by: junxiang Mu <1948535941@qq.com>
2025-05-29 03:17:54 +00:00
houseme 8660c2af12 merge main 2025-05-28 17:26:31 +08:00
houseme a95138868e improve code 2025-05-27 19:07:09 +08:00
houseme ade4d33eb1 fix typo 2025-05-27 16:56:44 +08:00
houseme ca8f399832 format comment 2025-05-27 13:56:19 +08:00
houseme e4ac7d7a3e fix 2025-05-27 12:05:45 +08:00
houseme faf195cc4b Merge branch 'main' of github.com:rustfs/s3-rustfs into feature/observability-metrics
# Conflicts:
#	ecstore/src/file_meta.rs
#	ecstore/src/set_disk.rs
#	ecstore/src/store_api.rs
2025-05-27 12:05:35 +08:00
houseme a9c6bb8f0d add 2025-05-27 11:53:47 +08:00
overtrue cea6ddbdf1 fix: correct test_common_parity assertion for HashMap iteration order 2025-05-26 12:19:40 +08:00
overtrue 8c0d3fa227 feat: add comprehensive tests for set_disk module - Add 21 test functions covering utility and validation functions - Test constants, MD5 calculation, path generation, algorithms - Test error handling, healing logic, data manipulation - All tests pass successfully with proper function behavior verification 2025-05-26 12:19:40 +08:00
overtrue d858cd8d19 fix: correct test_common_parity assertion for HashMap iteration order 2025-05-25 18:52:37 +08:00
overtrue 54972a57b1 feat: add comprehensive tests for set_disk module - Add 21 test functions covering utility and validation functions - Test constants, MD5 calculation, path generation, algorithms - Test error handling, healing logic, data manipulation - All tests pass successfully with proper function behavior verification 2025-05-25 18:50:32 +08:00
houseme 864071d641 cargo fmt 2025-05-25 17:46:59 +08:00
overtrue fb9f8319b2 feat: add comprehensive tests for set_disk module - Add 24 test functions covering utility and validation functions - Test constants, MD5 calculation, path generation, algorithms - Test error handling, healing logic, data manipulation - All tests pass successfully 2025-05-25 16:27:16 +08:00
weisd 41194b3f6b Merge pull request #398 from rustfs/feat/legalhold
add legalhold api
2025-05-13 09:35:11 +08:00
weisd c69a2f83a6 add legalhold api 2025-05-12 15:45:22 +08:00
loverustfs fd85b55d37 Merge pull request #393 from rustfs/pref
improve multi put speed
2025-05-09 22:40:03 +08:00