Commit Graph

182 Commits

Author SHA1 Message Date
houseme e4453adf82 feat(event-notifier): improve environment variable handling
- Fix deserialization error when parsing config from environment variables
- Add proper array format support for adapters configuration
- Update environment variable examples with correct format
- Improve documentation for configuration loading
- Implement helper functions for environment variable validation

This change fixes the "invalid type: map, expected a sequence" error
by ensuring proper formatting of array-type fields in environment variables.
2025-04-22 20:31:38 +08:00
houseme 0ed92b3b6f improve code 2025-04-22 09:14:09 +08:00
houseme 5af648230a improve code 2025-04-21 19:01:31 +08:00
houseme 770f28d205 improve Cargo toml 2025-04-21 15:27:58 +08:00
junxiang Mu 70e94fd018 fix sql
Signed-off-by: junxiang Mu <1948535941@qq.com>
2025-04-21 13:28:32 +08:00
houseme 3b6397012b feat(event-notifier): improve notification system initialization safety
- Add READY atomic flag to track full initialization status
- Implement initialize_safe and start_safe methods with mutex protection
- Add wait_until_ready function with configurable timeout
- Create initialize_and_start_with_ready_check helper method
- Replace sleep-based waiting with proper readiness checks
- Add safety checks before sending events
- Replace chrono with std::time for time handling
- Update error handling to provide clear initialization status

This change reduces race conditions in multi-threaded environments
and ensures events are only processed when the system is fully ready.
2025-04-21 13:28:01 +08:00
houseme bfc165abe0 feat: implement event notification system
- Add core event notification interfaces
- Support multiple notification backends:
  - Webhook (default)
  - Kafka
  - MQTT
  - HTTP Producer
- Implement configurable event filtering
- Add async event dispatching with backpressure handling
- Provide serialization/deserialization for event payloads

This module enables system events to be published to various endpoints
with consistent delivery guarantees and failure handling.
2025-04-21 00:17:27 +08:00
houseme 21a829e7cf init event notifer 2025-04-19 02:20:50 +08:00
Nugine 800ced24b7 build(deps): upgrade s3s
resolves: #322
2025-04-16 15:16:19 +08:00
Nugine 69598b48e3 feat(rustfs/main): use jemalloc 2025-04-16 11:59:08 +08:00
houseme fffa1ec671 Feature/status Support IPV4 and IPV6 dual stack and 308 Permanent Redirect (#329)
* test 308 Permanent Redirect

* improve code and Support IPV4 and IPV6 dual stack

* remove code
2025-04-15 23:29:12 +08:00
Nugine e5b8abcfcd feat(ecstore/erasure): optimize encode_data 2025-04-15 18:07:51 +08:00
Nugine 85c8ea5ba6 build(deps): upgrade s3s 2025-04-15 17:37:08 +08:00
houseme 37109fc618 upgrade crate version 2025-04-11 20:53:51 +08:00
houseme 24d6c555f7 Remove unused crate 2025-04-11 17:38:44 +08:00
houseme 42c8890d4a Merge branch 'main' of github.com:rustfs/s3-rustfs into feature/Systemd.service 2025-04-11 16:48:46 +08:00
houseme ab8b19eb5d improve signal watch 2025-04-11 16:48:07 +08:00
Nugine 1b24fbdb00 fix: upgrade s3s 2025-04-11 16:01:46 +08:00
weisd 0c435c6a05 add admin policy check for user operation 2025-04-11 10:46:36 +08:00
houseme c872901269 improve Cargo.toml and modify README.md conosel web static url 2025-04-09 18:36:17 +08:00
junxiang Mu c900faba81 fix upgrade axum bug
Signed-off-by: junxiang Mu <1948535941@qq.com>
2025-04-09 06:19:36 +00:00
junxiang Mu 99a5866680 degrade rand && object_store
Signed-off-by: junxiang Mu <1948535941@qq.com>
2025-04-09 03:27:03 +00:00
junxiang Mu ebf1a9d9c4 update tonic axum
Signed-off-by: junxiang Mu <1948535941@qq.com>
2025-04-09 02:41:06 +00:00
dependabot[bot] f6b734ca69 Bump the dependencies group across 1 directory with 3 updates
Bumps the dependencies group with 3 updates in the / directory: [rand](https://github.com/rust-random/rand), [tokio](https://github.com/tokio-rs/tokio) and [object_store](https://github.com/apache/arrow-rs).


Updates `rand` from 0.8.5 to 0.9.0
- [Release notes](https://github.com/rust-random/rand/releases)
- [Changelog](https://github.com/rust-random/rand/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-random/rand/compare/0.8.5...0.9.0)

Updates `tokio` from 1.44.1 to 1.44.2
- [Release notes](https://github.com/tokio-rs/tokio/releases)
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.44.1...tokio-1.44.2)

Updates `object_store` from 0.11.2 to 0.12.0
- [Release notes](https://github.com/apache/arrow-rs/releases)
- [Changelog](https://github.com/apache/arrow-rs/blob/main/CHANGELOG-old.md)
- [Commits](https://github.com/apache/arrow-rs/compare/object_store_0.11.2...object_store_0.12.0)

---
updated-dependencies:
- dependency-name: rand
  dependency-version: 0.9.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: dependencies
- dependency-name: tokio
  dependency-version: 1.44.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
- dependency-name: object_store
  dependency-version: 0.12.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: dependencies
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-04-08 15:33:56 +00:00
houseme 9964457d09 upgrade opentelemetry version from 0.29 to 0.29.1 2025-04-08 23:26:02 +08:00
weisd 885944802a license api 2025-04-08 22:32:21 +08:00
houseme 0c7748658c Merge main branches 2025-04-02 15:57:11 +08:00
houseme 15efeb572f improve crate and remove log crate 2025-04-02 00:51:59 +08:00
houseme d017409f5b add rustfs tls 2025-04-02 00:48:08 +08:00
houseme de0e9bee20 Log records uniformly use tracing 2025-04-01 23:27:48 +08:00
houseme 28edca1b63 add rustls 2025-04-01 23:09:47 +08:00
houseme 1994302574 improve tls for console 2025-04-01 22:06:47 +08:00
houseme dad94b5c74 Merge branch 'main' of github.com:rustfs/s3-rustfs into feature/observability
# Conflicts:
#	Cargo.lock
#	Cargo.toml
2025-03-31 15:12:30 +08:00
junxiang Mu b950f61b70 rebase to main
Signed-off-by: junxiang Mu <1948535941@qq.com>
2025-03-31 06:32:05 +00:00
junxiang Mu 0b270bf0cc tmp2
Signed-off-by: junxiang Mu <1948535941@qq.com>
2025-03-31 05:44:48 +00:00
junxiang Mu 63ef986bac tmp1
Signed-off-by: junxiang Mu <1948535941@qq.com>
2025-03-31 05:43:01 +00:00
houseme 147df8ab0b Merge branch 'main' of github.com:rustfs/s3-rustfs into feature/observability
# Conflicts:
#	rustfs/src/storage/ecfs.rs
2025-03-26 16:08:41 +08:00
houseme 23ead0ea99 add prometheus 2025-03-26 15:18:23 +08:00
weisd ab31be8d46 ecstore update bucket policy 2025-03-26 11:39:14 +08:00
weisd c8e13b8ab5 move policy out of iam 2025-03-26 10:19:47 +08:00
houseme 2b57af75ea upgrade opentelemetry create from 0.28.0 to 0.29.0 2025-03-25 19:02:52 +08:00
weisd 545ae79e44 move ecsotre/error to common 2025-03-25 17:42:15 +08:00
houseme 28a4a917d4 replace log to tracing 2025-03-19 22:34:26 +08:00
houseme 197ae72e93 improve code for observability 2025-03-18 22:57:26 +08:00
houseme b3339c258f Merge branch 'main' of github.com:rustfs/s3-rustfs into feature/observability
# Conflicts:
#	Cargo.lock
#	Cargo.toml
2025-03-18 16:51:25 +08:00
houseme ef162396cf improve code 2025-03-16 16:33:52 +08:00
weisd 01cf4c663d opt network io 2025-03-14 23:26:54 +08:00
houseme eaa506add5 improve code for observability 2025-03-12 00:46:01 +08:00
weisd 70031effa7 use http for remote read/write 2025-03-11 16:12:34 +08:00
weisd 7a7aee2049 use filereader as asyncread 2025-03-10 02:39:35 +08:00