Commit Graph

697 Commits

Author SHA1 Message Date
weisd
cf7a930d39 todo 2025-07-01 17:26:47 +08:00
weisd
9d74f56f57 feat: add ExportBucketMetadata handler 2025-07-01 15:23:53 +08:00
weisd
cc440f23a3 fix: clippy 2025-07-01 13:13:26 +08:00
weisd
ddf19b3444 fix: fmt 2025-07-01 13:05:33 +08:00
houseme
18a3902d2c feat(admin): enhance notification event handlers (#530)
* add log

* add logs

* test

* cargo fmt

* add event admin api

* feat: add ImportIam handle

* refact bucket replication

* Update ecstore/src/disk/endpoint.rs

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: weisd <weishidavip@163.com>
Co-authored-by: lygn128 <lygn128@163.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-07-01 12:34:24 +08:00
lygn128
f62db65a39 refact bucket replication 2025-07-01 04:08:02 +00:00
weisd
2b1241de96 fix: fmt 2025-07-01 10:17:20 +08:00
weisd
3fd70de4a6 fix: clippy 2025-07-01 09:41:55 +08:00
likewu
37861d9af6 fix: clippy 2025-07-01 09:40:29 +08:00
weisd
c5358ba62c fix: clippy 2025-06-30 22:47:06 +08:00
weisd
e4971b6d83 fix: resolve clippy warnings for inherent to_string method shadowing Display trait 2025-06-30 21:51:19 +08:00
weisd
bfeb746c5f style: fix code formatting issues
- Fix spacing and line formatting in signer modules
- Remove unnecessary blank lines
- Ensure consistent code style per project standards
2025-06-30 21:36:26 +08:00
安正超
8e75ea07e7 Merge pull request #521 from rustfs/feature-fix/ilm
fix
2025-06-30 21:05:11 +08:00
likewu
a96f352fa7 fix 2025-06-30 18:16:15 +08:00
weisd
20054d0a56 fix: simplify filemeta MessagePack serialization and improve code quality
- Refactor `unmarshal_msg` to use `rmp_serde::from_slice` instead of manual parsing
- Add serde field renaming attributes to `FileMetaVersion` struct
- Remove 428 lines of manual MessagePack parsing code
- Improve string comparison using `!object.is_empty()` instead of `object != ""`
- Update volume directory numbering in run script from test{0..4} to test{1..4}
- Clean up unused imports and code

Fixes #517
2025-06-29 22:39:36 +08:00
likewu
f30345aaa8 fix 2025-06-28 15:48:35 +08:00
likewu
4d86866d61 fix 2025-06-28 14:54:01 +08:00
likewu
f38108d20d fix format 2025-06-28 14:34:21 +08:00
likewu
4ed84a6bc4 separate signer.
fix ilm feature.
2025-06-28 14:33:22 +08:00
likewu
e4690c48b4 fix BucketObjectLockSys 2025-06-28 14:27:31 +08:00
houseme
7bd8431006 cargo fmt 2025-06-27 18:53:51 +08:00
houseme
749537664f fix:Apply suggestions from clippy 1.88 2025-06-27 18:16:29 +08:00
houseme
831cb0b6d9 Feature/event: Optimize and Enhance Notify Crate Functionality (#512)
* improve code for notify

* fix

* cargo fmt

* improve code and create `DEFAULT_DELIMITER`

* fix

* fix

* improve code for notify

* fmt

* Update crates/notify/src/registry.rs

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update crates/notify/src/factory.rs

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix cllipy

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-06-26 12:24:00 +08:00
weisd
61e600b9ba fix clippy 2025-06-25 11:13:29 +08:00
weisd
7a7ca6e154 moved to the trash and automatically cleaned up in the background 2025-06-25 10:08:09 +08:00
weisd
7e17d7d729 refactor: improve object listing and version handling
- Refactor find_version_index to accept Uuid directly instead of string
- Split from_meta_cache_entries_sorted into separate methods for versions and infos
- Add support for after_version_id filtering in version listing
- Fix S3 error code for replication configuration not found
- Improve error handling and logging levels
- Clean up import statements and remove debug code
2025-06-24 11:10:23 +08:00
likewu
364c3098b2 Fix/main (#508)
* fix error

* fix

* fix cargo

* fix openssl cfg

* fix clippy

* fix clippy

* fix

* fix clippy

* fix clippy
2025-06-24 10:27:41 +08:00
likewu
46c50b1bb1 Fix/main (#505)
* fix error

* fix

* fix cargo
2025-06-23 18:51:31 +08:00
houseme
833f9c908f fix: remove crate 2025-06-23 18:02:54 +08:00
weisd
a0f8b2f2be Merge pull request #503 from rustfs/refactor/unify-bucket-metadata-errors
refactor(ecstore): simplify bucket metadata error handling by using C…
2025-06-23 17:05:35 +08:00
weisd
317cadaed8 refactor(ecstore): simplify bucket metadata error handling by using ConfigNotFound
- Remove specific bucket metadata error variants (BucketPolicyNotFound, etc.)
- Unify all configuration-not-found errors to use StorageError::ConfigNotFound
- Simplify error handling in bucket metadata system by removing redundant error conversions
- Clean up error matching patterns in metadata getter methods
- Remove debug print statement from get_bucket_targets_config
- Update error handling in S3 API layer to use unified ConfigNotFound error

This change improves code maintainability by reducing error type complexity
while preserving the same error semantics for API consumers.
2025-06-23 17:04:14 +08:00
likewu
005881f838 Merge branch 'main' of https://github.com/rustfs/s3-rustfs into feature/ilm
# Conflicts:
#	rustfs/src/storage/ecfs.rs
2025-06-23 16:44:37 +08:00
likewu
81f0c9763f Merge branch 'main' of https://github.com/rustfs/s3-rustfs into feature/ilm
# Conflicts:
#	Cargo.lock
#	Cargo.toml
#	crates/utils/Cargo.toml
#	crates/utils/src/net.rs
#	ecstore/Cargo.toml
#	ecstore/src/set_disk.rs
#	rustfs/src/storage/ecfs.rs
2025-06-23 16:42:18 +08:00
weisd
34ec13e532 change objectinfo metadata use HashMap
add copyobject compresss support

fix listobject size use actual_size
2025-06-23 16:24:11 +08:00
likewu
2c176dd864 fix clippy 2025-06-23 12:03:46 +08:00
weisd
080af2b39f refactor(benches): update benchmarks to use SIMD-only implementation
- Remove all conditional compilation (#[cfg(feature = "reed-solomon-simd")])
- Rewrite erasure_benchmark.rs to focus on SIMD performance testing
- Transform comparison_benchmark.rs into SIMD performance analysis
- Update all documentation and comments to English
- Remove references to reed-solomon-erasure implementation
- Streamline benchmark groups and test configurations
- Add comprehensive SIMD-specific performance tests

Breaking Changes:
- Benchmarks no longer compare different implementations
- All benchmarks now test SIMD implementation exclusively
- Benchmark naming conventions updated for clarity

Performance Testing:
- Enhanced shard size sensitivity analysis
- Improved concurrent performance testing
- Added memory efficiency benchmarks
- Comprehensive error recovery analysis
2025-06-23 10:12:45 +08:00
weisd
4559baaeeb feat: migrate to reed-solomon-simd only implementation
- Remove reed-solomon-erasure dependency and all related code
- Simplify ReedSolomonEncoder from enum to struct with SIMD-only implementation
- Eliminate all conditional compilation (#[cfg(feature = ...)])
- Add instance caching with RwLock-based encoder/decoder reuse
- Implement reset mechanism to avoid unnecessary allocations
- Ensure thread safety with proper cache management
- Update documentation and benchmark scripts for SIMD-only approach
- Apply code formatting across all files

Breaking Changes:
- Removes support for reed-solomon-erasure feature flag
- API remains compatible but implementation is now SIMD-only

Performance Impact:
- Improved encoding/decoding performance through SIMD optimization
- Reduced memory allocations via instance caching
- Enhanced thread safety and concurrency support
2025-06-23 10:00:17 +08:00
houseme
928453db62 improve code for notify 2025-06-23 03:34:05 +08:00
likewu
cc71f40a6d ilm feature add 2025-06-22 23:04:40 +08:00
houseme
e0f65e5e24 improve code for notify 2025-06-21 10:35:07 +08:00
houseme
48d530cb13 Merge branch 'main' of github.com:rustfs/s3-rustfs into feature/observability-metrics
# Conflicts:
#	crates/utils/Cargo.toml
#	ecstore/src/store_list_objects.rs
#	iam/src/manager.rs
#	rustfs/src/admin/rpc.rs
2025-06-20 12:58:47 +08:00
houseme
d3cc36f6e0 fix 2025-06-20 10:51:36 +08:00
weisd
e145586b65 refactor: reorganize RPC modules into unified structure 2025-06-19 17:06:54 +08:00
houseme
c658d88d25 Reconstructing Notify module 2025-06-19 15:40:48 +08:00
houseme
e6b019c29d Merge branch 'main' of github.com:rustfs/s3-rustfs into feature/observability-metrics
# Conflicts:
#	.github/workflows/build.yml
#	.github/workflows/ci.yml
#	Cargo.lock
#	Cargo.toml
#	appauth/src/token.rs
#	crates/config/src/config.rs
#	crates/event-notifier/examples/simple.rs
#	crates/event-notifier/src/global.rs
#	crates/event-notifier/src/lib.rs
#	crates/event-notifier/src/notifier.rs
#	crates/event-notifier/src/store.rs
#	crates/filemeta/src/filemeta.rs
#	crates/notify/examples/webhook.rs
#	crates/utils/Cargo.toml
#	ecstore/Cargo.toml
#	ecstore/src/cmd/bucket_replication.rs
#	ecstore/src/config/com.rs
#	ecstore/src/disk/error.rs
#	ecstore/src/disk/mod.rs
#	ecstore/src/set_disk.rs
#	ecstore/src/store_api.rs
#	ecstore/src/store_list_objects.rs
#	iam/Cargo.toml
#	iam/src/manager.rs
#	policy/Cargo.toml
#	rustfs/src/admin/rpc.rs
#	rustfs/src/main.rs
#	rustfs/src/storage/mod.rs
2025-06-19 13:16:48 +08:00
weisd
58faf141bd feat: rpc auth 2025-06-18 20:00:39 +08:00
weisd
039108ee5e fix test 2025-06-18 18:51:54 +08:00
weisd
5b1b527851 fix bitrot 2025-06-18 18:22:30 +08:00
安正超
81a790f13f Merge pull request #477 from rustfs/docker-images
feat: Add comprehensive Docker build pipeline for multi-architecture images.
2025-06-17 23:55:43 +08:00
overtrue
efae4f5203 wip 2025-06-17 22:37:38 +08:00