366 Commits

Author SHA1 Message Date
houseme
833f9c908f fix: remove crate 2025-06-23 18:02:54 +08:00
likewu
cc71f40a6d ilm feature add 2025-06-22 23:04:40 +08:00
weisd
e8a59d7c07 move disk::utils to crates::utils 2025-06-11 15:55:40 +08:00
weisd
5c610e26c9 Merge branch 'main' into refactor/io 2025-06-10 18:04:50 +08:00
houseme
3cf265611a modify ci pr-checks 2025-06-10 10:11:47 +08:00
weisd
6ea0185519 add reed-solomon-simd banchmark 2025-06-10 00:09:05 +08:00
weisd
e62947f7b2 add reed-solomon-simd 2025-06-09 18:04:42 +08:00
weisd
f85ef06783 merge main 2025-06-09 15:31:11 +08:00
weisd
1d2aeb288a Upgrade rand to 0.9.1 2025-06-09 10:13:03 +08:00
houseme
1432ddb119 feat(obs): upgrade OpenTelemetry dependencies to latest version (#447)
- Update opentelemetry from 0.29.1 to 0.30.0
- Update related opentelemetry dependencies for compatibility
- Ensure compatibility with existing observability implementation
- Improve tracing and metrics collection capabilities

This upgrade provides better performance and stability for our observability stack.
2025-06-07 00:10:20 +08:00
weisd
c589972fa7 mc test ok 2025-06-06 16:15:26 +08:00
houseme
2fec6d161c fix: remove dep crate openssl relation 2025-06-06 15:13:55 +08:00
houseme
c03458202a fix 2025-06-06 13:50:50 +08:00
houseme
6ea770b6c8 Merge branch 'main' of github.com:rustfs/s3-rustfs
* 'main' of github.com:rustfs/s3-rustfs:
  add Cargo.lock
  fix filemeta/intofileversions

# Conflicts:
#	Cargo.lock
2025-06-06 12:19:29 +08:00
houseme
8c15835414 fix cargo.toml 2025-06-06 12:11:08 +08:00
weisd
998f4578b1 add Cargo.lock 2025-06-06 11:49:24 +08:00
weisd
db355bb26b todo 2025-06-06 11:35:27 +08:00
weisd
9384b831ec ecstore update ec/disk/error 2025-06-06 01:13:51 +08:00
lygn128
3c7b66e039 bucket replication 2025-06-05 14:26:42 +00:00
houseme
3ceec7b5f2 improve code for obs 2025-05-29 21:10:04 +08:00
houseme
c74410858e upgrade crates reqwest from 0.12.15 to 0.12.16 and clap from 4.5.37 to 4.5.39 2025-05-28 16:02:53 +08:00
overtrue
c29841a5e7 feat: add comprehensive test coverage for utils certs module 2025-05-27 22:44:30 +08:00
houseme
864071d641 cargo fmt 2025-05-25 17:46:59 +08:00
overtrue
5fff195295 feat: complete zip compression module implementation 2025-05-25 13:14:38 +08:00
houseme
571cedf4ce feat(obs): implement global OpenTelemetry guard management 2025-05-12 13:32:18 +08:00
houseme
dd7da015e3 Feature/rustfs config (#396)
* init rustfs config

* improve code for rustfs-config crate

* add

* improve code for comment

* fix: modify rustfs-config crate name

* add default fn

* improve error logger

* fix: modify docker config yaml

* improve code for config

* feat: restrict kafka feature to Linux only

- Add target-specific feature configuration in Cargo.toml for obs and event-notifier crates
- Implement conditional compilation for kafka feature only on Linux systems
- Add appropriate error handling for non-Linux platforms
- Ensure backward compatibility with existing code

* refactor(ci): optimize build workflow for better efficiency

- Integrate GUI build steps into main build-rustfs job
- Add conditional GUI build execution based on tag releases
- Simplify workflow by removing redundant build-rustfs-gui job
- Copy binary directly to embedded-rustfs directory without downloading artifacts
- Update merge job dependency to only rely on build-rustfs
- Improve cross-platform compatibility for Windows binary naming (.exe)
- Streamline artifact uploading and OSS publishing process
- Maintain consistent conditional logic for release operations

* refactor(ci): optimize build workflow for better efficiency

- Integrate GUI build steps into main build-rustfs job
- Add conditional GUI build execution based on tag releases
- Simplify workflow by removing redundant build-rustfs-gui job
- Copy binary directly to embedded-rustfs directory without downloading artifacts
- Update merge job dependency to only rely on build-rustfs
- Improve cross-platform compatibility for Windows binary naming (.exe)
- Streamline artifact uploading and OSS publishing process
- Maintain consistent conditional logic for release operations

* fix(ci): add repo-token to setup-protoc action for authentication

- Add GITHUB_TOKEN parameter to arduino/setup-protoc@v3 action
- Ensure proper authentication for Protoc installation in CI workflow
- Maintain consistent setup across different CI environments

* modify config

* improve readme.md

* remove env config relation

* add allow(dead_code)
2025-05-12 01:17:31 +08:00
weisd
76fdefeca4 feat: auto-extract support 2025-05-08 17:42:20 +08:00
houseme
29ddf4dbc8 refactor: standardize constant management and fix typos (#387)
* init rustfs config

* init rustfs-utils crate

* improve code for rustfs-config crate

* add

* improve code for comment

* init rustfs config

* improve code for rustfs-config crate

* add

* improve code for comment

* Unified management of configurations and constants

* fix: modify rustfs-config crate name

* add default fn

* improve code for rustfs config

* refactor: standardize constant management and fix typos

- Create centralized constants module for global static constants
- Replace runtime format! expressions with compile-time constants
- Fix DEFAULT_PORT reference issues in configuration arguments
- Use const-str crate for compile-time string concatenation
- Update tokio dependency from 1.42.2 to 1.45.0
- Ensure consistent naming convention for configuration constants

* fix

* Update common/workers/src/workers.rs

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-05-07 17:23:22 +08:00
junxiang Mu
0ac1095c70 support spec char as delimiter
Signed-off-by: junxiang Mu <1948535941@qq.com>
2025-05-06 11:10:30 +08:00
houseme
fc47ca9dd2 upgrade version (#380) 2025-05-06 08:54:35 +08:00
junxiang Mu
7e1135df8f tmp3
Signed-off-by: junxiang Mu <1948535941@qq.com>
2025-04-29 10:53:03 +00:00
houseme
86353d98d5 feat: add TraceLayer for HTTP service and improve metrics (#361)
* improve code for opentelemetry and add system metrics

* feat: add TraceLayer for HTTP service and improve metrics

- Add TraceLayer to HTTP server for request tracing
- Implement system metrics for process monitoring
- Optimize init_telemetry method for better resource management
- Add graceful shutdown handling for telemetry components
- Fix GracefulShutdown ownership issues with Arc wrapper

* improve code for init_process_observer

* remove tomlfmt.toml

* Translation comment

* improve code for console CompressionLayer params
2025-04-24 19:04:57 +08:00
weisd
cffd4fc28d merge fix/pools 2025-04-23 16:48:57 +08:00
weisd
cf2ed47fe8 fix: #331 admin info version,uptime 2025-04-23 16:34:39 +08:00
houseme
e4453adf82 feat(event-notifier): improve environment variable handling
- Fix deserialization error when parsing config from environment variables
- Add proper array format support for adapters configuration
- Update environment variable examples with correct format
- Improve documentation for configuration loading
- Implement helper functions for environment variable validation

This change fixes the "invalid type: map, expected a sequence" error
by ensuring proper formatting of array-type fields in environment variables.
2025-04-22 20:31:38 +08:00
houseme
0ed92b3b6f improve code 2025-04-22 09:14:09 +08:00
houseme
5af648230a improve code 2025-04-21 19:01:31 +08:00
houseme
770f28d205 improve Cargo toml 2025-04-21 15:27:58 +08:00
junxiang Mu
70e94fd018 fix sql
Signed-off-by: junxiang Mu <1948535941@qq.com>
2025-04-21 13:28:32 +08:00
houseme
3b6397012b feat(event-notifier): improve notification system initialization safety
- Add READY atomic flag to track full initialization status
- Implement initialize_safe and start_safe methods with mutex protection
- Add wait_until_ready function with configurable timeout
- Create initialize_and_start_with_ready_check helper method
- Replace sleep-based waiting with proper readiness checks
- Add safety checks before sending events
- Replace chrono with std::time for time handling
- Update error handling to provide clear initialization status

This change reduces race conditions in multi-threaded environments
and ensures events are only processed when the system is fully ready.
2025-04-21 13:28:01 +08:00
houseme
bfc165abe0 feat: implement event notification system
- Add core event notification interfaces
- Support multiple notification backends:
  - Webhook (default)
  - Kafka
  - MQTT
  - HTTP Producer
- Implement configurable event filtering
- Add async event dispatching with backpressure handling
- Provide serialization/deserialization for event payloads

This module enables system events to be published to various endpoints
with consistent delivery guarantees and failure handling.
2025-04-21 00:17:27 +08:00
houseme
21a829e7cf init event notifer 2025-04-19 02:20:50 +08:00
Nugine
800ced24b7 build(deps): upgrade s3s
resolves: #322
2025-04-16 15:16:19 +08:00
Nugine
69598b48e3 feat(rustfs/main): use jemalloc 2025-04-16 11:59:08 +08:00
houseme
fffa1ec671 Feature/status Support IPV4 and IPV6 dual stack and 308 Permanent Redirect (#329)
* test 308 Permanent Redirect

* improve code and Support IPV4 and IPV6 dual stack

* remove code
2025-04-15 23:29:12 +08:00
Nugine
e5b8abcfcd feat(ecstore/erasure): optimize encode_data 2025-04-15 18:07:51 +08:00
Nugine
85c8ea5ba6 build(deps): upgrade s3s 2025-04-15 17:37:08 +08:00
houseme
37109fc618 upgrade crate version 2025-04-11 20:53:51 +08:00
houseme
24d6c555f7 Remove unused crate 2025-04-11 17:38:44 +08:00
houseme
42c8890d4a Merge branch 'main' of github.com:rustfs/s3-rustfs into feature/Systemd.service 2025-04-11 16:48:46 +08:00