Commit Graph

225 Commits

Author SHA1 Message Date
dependabot[bot]
d3575dccce build(deps): bump the dependencies group with 2 updates
Bumps the dependencies group with 2 updates: [aws-sdk-s3](https://github.com/awslabs/aws-sdk-rust) and [reqwest](https://github.com/seanmonstar/reqwest).


Updates `aws-sdk-s3` from 1.94.0 to 1.95.0
- [Release notes](https://github.com/awslabs/aws-sdk-rust/releases)
- [Commits](https://github.com/awslabs/aws-sdk-rust/commits)

Updates `reqwest` from 0.12.21 to 0.12.22
- [Release notes](https://github.com/seanmonstar/reqwest/releases)
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md)
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.12.21...v0.12.22)

---
updated-dependencies:
- dependency-name: aws-sdk-s3
  dependency-version: 1.95.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: dependencies
- dependency-name: reqwest
  dependency-version: 0.12.22
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-07-02 03:29:41 +00:00
houseme
cc63e56b8a improve cargo toml 2025-07-01 22:00:58 +08:00
dependabot[bot]
d736c6224d Bump the dependencies group with 7 updates
Bumps the dependencies group with 7 updates:

| Package | From | To |
| --- | --- | --- |
| [aws-sdk-s3](https://github.com/awslabs/aws-sdk-rust) | `1.91.0` | `1.94.0` |
| [cfg-if](https://github.com/rust-lang/cfg-if) | `1.0.0` | `1.0.1` |
| [flexi_logger](https://github.com/emabee/flexi_logger) | `0.31.1` | `0.31.2` |
| [reqwest](https://github.com/seanmonstar/reqwest) | `0.12.20` | `0.12.21` |
| [shadow-rs](https://github.com/baoyachi/shadow-rs) | `1.1.1` | `1.2.0` |
| [std-next](https://github.com/Nugine/std-next) | `0.1.8` | `0.1.9` |
| [temp-env](https://github.com/vmx/temp-env) | `0.2.0` | `0.3.6` |


Updates `aws-sdk-s3` from 1.91.0 to 1.94.0
- [Release notes](https://github.com/awslabs/aws-sdk-rust/releases)
- [Commits](https://github.com/awslabs/aws-sdk-rust/commits)

Updates `cfg-if` from 1.0.0 to 1.0.1
- [Release notes](https://github.com/rust-lang/cfg-if/releases)
- [Changelog](https://github.com/rust-lang/cfg-if/blob/main/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/cfg-if/compare/1.0.0...v1.0.1)

Updates `flexi_logger` from 0.31.1 to 0.31.2
- [Release notes](https://github.com/emabee/flexi_logger/releases)
- [Changelog](https://github.com/emabee/flexi_logger/blob/main/CHANGELOG.md)
- [Commits](https://github.com/emabee/flexi_logger/commits)

Updates `reqwest` from 0.12.20 to 0.12.21
- [Release notes](https://github.com/seanmonstar/reqwest/releases)
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md)
- [Commits](https://github.com/seanmonstar/reqwest/commits)

Updates `shadow-rs` from 1.1.1 to 1.2.0
- [Release notes](https://github.com/baoyachi/shadow-rs/releases)
- [Commits](https://github.com/baoyachi/shadow-rs/compare/v1.1.1...v1.2.0)

Updates `std-next` from 0.1.8 to 0.1.9
- [Release notes](https://github.com/Nugine/std-next/releases)
- [Commits](https://github.com/Nugine/std-next/compare/v0.1.8...v0.1.9)

Updates `temp-env` from 0.2.0 to 0.3.6
- [Changelog](https://github.com/vmx/temp-env/blob/main/RELEASE.md)
- [Commits](https://github.com/vmx/temp-env/compare/v0.2.0...v0.3.6)

---
updated-dependencies:
- dependency-name: aws-sdk-s3
  dependency-version: 1.94.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: dependencies
- dependency-name: cfg-if
  dependency-version: 1.0.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
- dependency-name: flexi_logger
  dependency-version: 0.31.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
- dependency-name: reqwest
  dependency-version: 0.12.21
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
- dependency-name: shadow-rs
  dependency-version: 1.2.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: dependencies
- dependency-name: std-next
  dependency-version: 0.1.9
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
- dependency-name: temp-env
  dependency-version: 0.3.6
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: dependencies
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-07-01 08:50:46 +00:00
weisd
e9610f1fb7 feat: add IAM export/import
- Add complete IAM configuration export/import functionality with ZIP format
- Add new API endpoints for IAM backup and restore operations
2025-06-30 22:01:07 +08:00
likewu
f38108d20d fix format 2025-06-28 14:34:21 +08:00
houseme
26f84a9696 Feature/event (#513)
* improve code for notify

* fix

* cargo fmt

* improve code and create `DEFAULT_DELIMITER`

* fix

* fix

* improve code for notify

* fmt

* Update crates/notify/src/registry.rs

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update crates/notify/src/factory.rs

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix cllipy

* fix

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-06-27 00:28:28 +08:00
houseme
831cb0b6d9 Feature/event: Optimize and Enhance Notify Crate Functionality (#512)
* improve code for notify

* fix

* cargo fmt

* improve code and create `DEFAULT_DELIMITER`

* fix

* fix

* improve code for notify

* fmt

* Update crates/notify/src/registry.rs

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update crates/notify/src/factory.rs

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix cllipy

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-06-26 12:24:00 +08:00
houseme
39a290e061 improve code for docker 2025-06-24 23:27:29 +08:00
houseme
e8a5b5d12c improve flexi_logger relation 2025-06-24 09:19:26 +08:00
houseme
833f9c908f fix: remove crate 2025-06-23 18:02:54 +08:00
likewu
cc71f40a6d ilm feature add 2025-06-22 23:04:40 +08:00
weisd
e8a59d7c07 move disk::utils to crates::utils 2025-06-11 15:55:40 +08:00
weisd
5c610e26c9 Merge branch 'main' into refactor/io 2025-06-10 18:04:50 +08:00
houseme
3cf265611a modify ci pr-checks 2025-06-10 10:11:47 +08:00
weisd
6ea0185519 add reed-solomon-simd banchmark 2025-06-10 00:09:05 +08:00
weisd
e62947f7b2 add reed-solomon-simd 2025-06-09 18:04:42 +08:00
weisd
f85ef06783 merge main 2025-06-09 15:31:11 +08:00
weisd
1d2aeb288a Upgrade rand to 0.9.1 2025-06-09 10:13:03 +08:00
houseme
1432ddb119 feat(obs): upgrade OpenTelemetry dependencies to latest version (#447)
- Update opentelemetry from 0.29.1 to 0.30.0
- Update related opentelemetry dependencies for compatibility
- Ensure compatibility with existing observability implementation
- Improve tracing and metrics collection capabilities

This upgrade provides better performance and stability for our observability stack.
2025-06-07 00:10:20 +08:00
weisd
c589972fa7 mc test ok 2025-06-06 16:15:26 +08:00
houseme
2fec6d161c fix: remove dep crate openssl relation 2025-06-06 15:13:55 +08:00
houseme
c03458202a fix 2025-06-06 13:50:50 +08:00
houseme
6ea770b6c8 Merge branch 'main' of github.com:rustfs/s3-rustfs
* 'main' of github.com:rustfs/s3-rustfs:
  add Cargo.lock
  fix filemeta/intofileversions

# Conflicts:
#	Cargo.lock
2025-06-06 12:19:29 +08:00
houseme
8c15835414 fix cargo.toml 2025-06-06 12:11:08 +08:00
weisd
998f4578b1 add Cargo.lock 2025-06-06 11:49:24 +08:00
weisd
db355bb26b todo 2025-06-06 11:35:27 +08:00
weisd
9384b831ec ecstore update ec/disk/error 2025-06-06 01:13:51 +08:00
lygn128
3c7b66e039 bucket replication 2025-06-05 14:26:42 +00:00
houseme
3ceec7b5f2 improve code for obs 2025-05-29 21:10:04 +08:00
houseme
c74410858e upgrade crates reqwest from 0.12.15 to 0.12.16 and clap from 4.5.37 to 4.5.39 2025-05-28 16:02:53 +08:00
overtrue
c29841a5e7 feat: add comprehensive test coverage for utils certs module 2025-05-27 22:44:30 +08:00
houseme
864071d641 cargo fmt 2025-05-25 17:46:59 +08:00
overtrue
5fff195295 feat: complete zip compression module implementation 2025-05-25 13:14:38 +08:00
houseme
571cedf4ce feat(obs): implement global OpenTelemetry guard management 2025-05-12 13:32:18 +08:00
houseme
dd7da015e3 Feature/rustfs config (#396)
* init rustfs config

* improve code for rustfs-config crate

* add

* improve code for comment

* fix: modify rustfs-config crate name

* add default fn

* improve error logger

* fix: modify docker config yaml

* improve code for config

* feat: restrict kafka feature to Linux only

- Add target-specific feature configuration in Cargo.toml for obs and event-notifier crates
- Implement conditional compilation for kafka feature only on Linux systems
- Add appropriate error handling for non-Linux platforms
- Ensure backward compatibility with existing code

* refactor(ci): optimize build workflow for better efficiency

- Integrate GUI build steps into main build-rustfs job
- Add conditional GUI build execution based on tag releases
- Simplify workflow by removing redundant build-rustfs-gui job
- Copy binary directly to embedded-rustfs directory without downloading artifacts
- Update merge job dependency to only rely on build-rustfs
- Improve cross-platform compatibility for Windows binary naming (.exe)
- Streamline artifact uploading and OSS publishing process
- Maintain consistent conditional logic for release operations

* refactor(ci): optimize build workflow for better efficiency

- Integrate GUI build steps into main build-rustfs job
- Add conditional GUI build execution based on tag releases
- Simplify workflow by removing redundant build-rustfs-gui job
- Copy binary directly to embedded-rustfs directory without downloading artifacts
- Update merge job dependency to only rely on build-rustfs
- Improve cross-platform compatibility for Windows binary naming (.exe)
- Streamline artifact uploading and OSS publishing process
- Maintain consistent conditional logic for release operations

* fix(ci): add repo-token to setup-protoc action for authentication

- Add GITHUB_TOKEN parameter to arduino/setup-protoc@v3 action
- Ensure proper authentication for Protoc installation in CI workflow
- Maintain consistent setup across different CI environments

* modify config

* improve readme.md

* remove env config relation

* add allow(dead_code)
2025-05-12 01:17:31 +08:00
weisd
76fdefeca4 feat: auto-extract support 2025-05-08 17:42:20 +08:00
houseme
29ddf4dbc8 refactor: standardize constant management and fix typos (#387)
* init rustfs config

* init rustfs-utils crate

* improve code for rustfs-config crate

* add

* improve code for comment

* init rustfs config

* improve code for rustfs-config crate

* add

* improve code for comment

* Unified management of configurations and constants

* fix: modify rustfs-config crate name

* add default fn

* improve code for rustfs config

* refactor: standardize constant management and fix typos

- Create centralized constants module for global static constants
- Replace runtime format! expressions with compile-time constants
- Fix DEFAULT_PORT reference issues in configuration arguments
- Use const-str crate for compile-time string concatenation
- Update tokio dependency from 1.42.2 to 1.45.0
- Ensure consistent naming convention for configuration constants

* fix

* Update common/workers/src/workers.rs

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-05-07 17:23:22 +08:00
junxiang Mu
0ac1095c70 support spec char as delimiter
Signed-off-by: junxiang Mu <1948535941@qq.com>
2025-05-06 11:10:30 +08:00
houseme
fc47ca9dd2 upgrade version (#380) 2025-05-06 08:54:35 +08:00
junxiang Mu
7e1135df8f tmp3
Signed-off-by: junxiang Mu <1948535941@qq.com>
2025-04-29 10:53:03 +00:00
houseme
86353d98d5 feat: add TraceLayer for HTTP service and improve metrics (#361)
* improve code for opentelemetry and add system metrics

* feat: add TraceLayer for HTTP service and improve metrics

- Add TraceLayer to HTTP server for request tracing
- Implement system metrics for process monitoring
- Optimize init_telemetry method for better resource management
- Add graceful shutdown handling for telemetry components
- Fix GracefulShutdown ownership issues with Arc wrapper

* improve code for init_process_observer

* remove tomlfmt.toml

* Translation comment

* improve code for console CompressionLayer params
2025-04-24 19:04:57 +08:00
weisd
cffd4fc28d merge fix/pools 2025-04-23 16:48:57 +08:00
weisd
cf2ed47fe8 fix: #331 admin info version,uptime 2025-04-23 16:34:39 +08:00
houseme
e4453adf82 feat(event-notifier): improve environment variable handling
- Fix deserialization error when parsing config from environment variables
- Add proper array format support for adapters configuration
- Update environment variable examples with correct format
- Improve documentation for configuration loading
- Implement helper functions for environment variable validation

This change fixes the "invalid type: map, expected a sequence" error
by ensuring proper formatting of array-type fields in environment variables.
2025-04-22 20:31:38 +08:00
houseme
0ed92b3b6f improve code 2025-04-22 09:14:09 +08:00
houseme
5af648230a improve code 2025-04-21 19:01:31 +08:00
houseme
770f28d205 improve Cargo toml 2025-04-21 15:27:58 +08:00
junxiang Mu
70e94fd018 fix sql
Signed-off-by: junxiang Mu <1948535941@qq.com>
2025-04-21 13:28:32 +08:00
houseme
3b6397012b feat(event-notifier): improve notification system initialization safety
- Add READY atomic flag to track full initialization status
- Implement initialize_safe and start_safe methods with mutex protection
- Add wait_until_ready function with configurable timeout
- Create initialize_and_start_with_ready_check helper method
- Replace sleep-based waiting with proper readiness checks
- Add safety checks before sending events
- Replace chrono with std::time for time handling
- Update error handling to provide clear initialization status

This change reduces race conditions in multi-threaded environments
and ensures events are only processed when the system is fully ready.
2025-04-21 13:28:01 +08:00
houseme
bfc165abe0 feat: implement event notification system
- Add core event notification interfaces
- Support multiple notification backends:
  - Webhook (default)
  - Kafka
  - MQTT
  - HTTP Producer
- Implement configurable event filtering
- Add async event dispatching with backpressure handling
- Provide serialization/deserialization for event payloads

This module enables system events to be published to various endpoints
with consistent delivery guarantees and failure handling.
2025-04-21 00:17:27 +08:00