Commit Graph

685 Commits

Author SHA1 Message Date
安正超 8e75ea07e7 Merge pull request #521 from rustfs/feature-fix/ilm
fix
2025-06-30 21:05:11 +08:00
likewu a96f352fa7 fix 2025-06-30 18:16:15 +08:00
weisd 20054d0a56 fix: simplify filemeta MessagePack serialization and improve code quality
- Refactor `unmarshal_msg` to use `rmp_serde::from_slice` instead of manual parsing
- Add serde field renaming attributes to `FileMetaVersion` struct
- Remove 428 lines of manual MessagePack parsing code
- Improve string comparison using `!object.is_empty()` instead of `object != ""`
- Update volume directory numbering in run script from test{0..4} to test{1..4}
- Clean up unused imports and code

Fixes #517
2025-06-29 22:39:36 +08:00
likewu f30345aaa8 fix 2025-06-28 15:48:35 +08:00
likewu 4d86866d61 fix 2025-06-28 14:54:01 +08:00
likewu f38108d20d fix format 2025-06-28 14:34:21 +08:00
likewu 4ed84a6bc4 separate signer.
fix ilm feature.
2025-06-28 14:33:22 +08:00
likewu e4690c48b4 fix BucketObjectLockSys 2025-06-28 14:27:31 +08:00
houseme 7bd8431006 cargo fmt 2025-06-27 18:53:51 +08:00
houseme 749537664f fix:Apply suggestions from clippy 1.88 2025-06-27 18:16:29 +08:00
houseme 831cb0b6d9 Feature/event: Optimize and Enhance Notify Crate Functionality (#512)
* improve code for notify

* fix

* cargo fmt

* improve code and create `DEFAULT_DELIMITER`

* fix

* fix

* improve code for notify

* fmt

* Update crates/notify/src/registry.rs

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update crates/notify/src/factory.rs

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix cllipy

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-06-26 12:24:00 +08:00
weisd 61e600b9ba fix clippy 2025-06-25 11:13:29 +08:00
weisd 7a7ca6e154 moved to the trash and automatically cleaned up in the background 2025-06-25 10:08:09 +08:00
weisd 7e17d7d729 refactor: improve object listing and version handling
- Refactor find_version_index to accept Uuid directly instead of string
- Split from_meta_cache_entries_sorted into separate methods for versions and infos
- Add support for after_version_id filtering in version listing
- Fix S3 error code for replication configuration not found
- Improve error handling and logging levels
- Clean up import statements and remove debug code
2025-06-24 11:10:23 +08:00
likewu 364c3098b2 Fix/main (#508)
* fix error

* fix

* fix cargo

* fix openssl cfg

* fix clippy

* fix clippy

* fix

* fix clippy

* fix clippy
2025-06-24 10:27:41 +08:00
likewu 46c50b1bb1 Fix/main (#505)
* fix error

* fix

* fix cargo
2025-06-23 18:51:31 +08:00
houseme 833f9c908f fix: remove crate 2025-06-23 18:02:54 +08:00
weisd a0f8b2f2be Merge pull request #503 from rustfs/refactor/unify-bucket-metadata-errors
refactor(ecstore): simplify bucket metadata error handling by using C…
2025-06-23 17:05:35 +08:00
weisd 317cadaed8 refactor(ecstore): simplify bucket metadata error handling by using ConfigNotFound
- Remove specific bucket metadata error variants (BucketPolicyNotFound, etc.)
- Unify all configuration-not-found errors to use StorageError::ConfigNotFound
- Simplify error handling in bucket metadata system by removing redundant error conversions
- Clean up error matching patterns in metadata getter methods
- Remove debug print statement from get_bucket_targets_config
- Update error handling in S3 API layer to use unified ConfigNotFound error

This change improves code maintainability by reducing error type complexity
while preserving the same error semantics for API consumers.
2025-06-23 17:04:14 +08:00
likewu 005881f838 Merge branch 'main' of https://github.com/rustfs/s3-rustfs into feature/ilm
# Conflicts:
#	rustfs/src/storage/ecfs.rs
2025-06-23 16:44:37 +08:00
likewu 81f0c9763f Merge branch 'main' of https://github.com/rustfs/s3-rustfs into feature/ilm
# Conflicts:
#	Cargo.lock
#	Cargo.toml
#	crates/utils/Cargo.toml
#	crates/utils/src/net.rs
#	ecstore/Cargo.toml
#	ecstore/src/set_disk.rs
#	rustfs/src/storage/ecfs.rs
2025-06-23 16:42:18 +08:00
weisd 34ec13e532 change objectinfo metadata use HashMap
add copyobject compresss support

fix listobject size use actual_size
2025-06-23 16:24:11 +08:00
likewu 2c176dd864 fix clippy 2025-06-23 12:03:46 +08:00
weisd 080af2b39f refactor(benches): update benchmarks to use SIMD-only implementation
- Remove all conditional compilation (#[cfg(feature = "reed-solomon-simd")])
- Rewrite erasure_benchmark.rs to focus on SIMD performance testing
- Transform comparison_benchmark.rs into SIMD performance analysis
- Update all documentation and comments to English
- Remove references to reed-solomon-erasure implementation
- Streamline benchmark groups and test configurations
- Add comprehensive SIMD-specific performance tests

Breaking Changes:
- Benchmarks no longer compare different implementations
- All benchmarks now test SIMD implementation exclusively
- Benchmark naming conventions updated for clarity

Performance Testing:
- Enhanced shard size sensitivity analysis
- Improved concurrent performance testing
- Added memory efficiency benchmarks
- Comprehensive error recovery analysis
2025-06-23 10:12:45 +08:00
weisd 4559baaeeb feat: migrate to reed-solomon-simd only implementation
- Remove reed-solomon-erasure dependency and all related code
- Simplify ReedSolomonEncoder from enum to struct with SIMD-only implementation
- Eliminate all conditional compilation (#[cfg(feature = ...)])
- Add instance caching with RwLock-based encoder/decoder reuse
- Implement reset mechanism to avoid unnecessary allocations
- Ensure thread safety with proper cache management
- Update documentation and benchmark scripts for SIMD-only approach
- Apply code formatting across all files

Breaking Changes:
- Removes support for reed-solomon-erasure feature flag
- API remains compatible but implementation is now SIMD-only

Performance Impact:
- Improved encoding/decoding performance through SIMD optimization
- Reduced memory allocations via instance caching
- Enhanced thread safety and concurrency support
2025-06-23 10:00:17 +08:00
houseme 928453db62 improve code for notify 2025-06-23 03:34:05 +08:00
likewu cc71f40a6d ilm feature add 2025-06-22 23:04:40 +08:00
houseme e0f65e5e24 improve code for notify 2025-06-21 10:35:07 +08:00
houseme 48d530cb13 Merge branch 'main' of github.com:rustfs/s3-rustfs into feature/observability-metrics
# Conflicts:
#	crates/utils/Cargo.toml
#	ecstore/src/store_list_objects.rs
#	iam/src/manager.rs
#	rustfs/src/admin/rpc.rs
2025-06-20 12:58:47 +08:00
houseme d3cc36f6e0 fix 2025-06-20 10:51:36 +08:00
weisd e145586b65 refactor: reorganize RPC modules into unified structure 2025-06-19 17:06:54 +08:00
houseme c658d88d25 Reconstructing Notify module 2025-06-19 15:40:48 +08:00
houseme e6b019c29d Merge branch 'main' of github.com:rustfs/s3-rustfs into feature/observability-metrics
# Conflicts:
#	.github/workflows/build.yml
#	.github/workflows/ci.yml
#	Cargo.lock
#	Cargo.toml
#	appauth/src/token.rs
#	crates/config/src/config.rs
#	crates/event-notifier/examples/simple.rs
#	crates/event-notifier/src/global.rs
#	crates/event-notifier/src/lib.rs
#	crates/event-notifier/src/notifier.rs
#	crates/event-notifier/src/store.rs
#	crates/filemeta/src/filemeta.rs
#	crates/notify/examples/webhook.rs
#	crates/utils/Cargo.toml
#	ecstore/Cargo.toml
#	ecstore/src/cmd/bucket_replication.rs
#	ecstore/src/config/com.rs
#	ecstore/src/disk/error.rs
#	ecstore/src/disk/mod.rs
#	ecstore/src/set_disk.rs
#	ecstore/src/store_api.rs
#	ecstore/src/store_list_objects.rs
#	iam/Cargo.toml
#	iam/src/manager.rs
#	policy/Cargo.toml
#	rustfs/src/admin/rpc.rs
#	rustfs/src/main.rs
#	rustfs/src/storage/mod.rs
2025-06-19 13:16:48 +08:00
weisd 58faf141bd feat: rpc auth 2025-06-18 20:00:39 +08:00
weisd 039108ee5e fix test 2025-06-18 18:51:54 +08:00
weisd 5b1b527851 fix bitrot 2025-06-18 18:22:30 +08:00
安正超 81a790f13f Merge pull request #477 from rustfs/docker-images
feat: Add comprehensive Docker build pipeline for multi-architecture images.
2025-06-17 23:55:43 +08:00
overtrue efae4f5203 wip 2025-06-17 22:37:38 +08:00
loverustfs 65ff5faada Merge pull request #480 from rustfs/feat/compress
feat: add object compression support
2025-06-17 20:20:45 +08:00
Nugine 4cadc4c12d feat(ecstore): MultiWriter concurrent write 2025-06-17 16:22:55 +08:00
Nugine da4a4e7cbe feat(ecstore): erasure encode reuse buf 2025-06-17 16:22:55 +08:00
Nugine 39e988537c refactor(ecstore): DiskAPI::read_all use Bytes 2025-06-17 16:22:55 +08:00
Nugine e520299c4b refactor(ecstore): DiskAPI::write_all use Bytes 2025-06-17 16:22:55 +08:00
weisd c48ebd5149 feat: add compress support 2025-06-17 15:06:40 +08:00
weisd ca298b460c fix test 2025-06-16 11:40:15 +08:00
weisd 52342f2f8e feat(grpc): walk_dir http
fix(ecstore): rebalance loop
2025-06-16 10:32:03 +08:00
Nugine 1606276223 feat(protos): use Bytes for protobuf bytes type fields. 2025-06-15 22:07:01 +08:00
Nugine 82cc1402c4 feat(ecstore): LocalDisk writes file by spawn_blocking 2025-06-15 21:01:38 +08:00
Nugine 2f3dbac59b feat(ecstore): LocalDisk::write_all_internal use InternalBuf 2025-06-15 21:01:38 +08:00
Nugine 3c5e20b633 refactor(ecstore): DiskAPI::rename_part meta use Bytes 2025-06-15 21:01:38 +08:00