Commit Graph

24 Commits

Author SHA1 Message Date
DamonXue
9948b1f709 feat: Implement KMS configuration management and dynamic updates
- Added a new KMS configuration subsystem to support dynamic KMS settings.
- Introduced a global ConfigManager for managing KMS and general configurations.
- Implemented KMS configuration validation and connection testing.
- Created REST API endpoints for retrieving and updating KMS configurations.
- Enhanced the existing configuration handling to include KMS-specific parameters.
- Updated the Cargo.toml to include the new KMS feature.
- Added comprehensive tests for KMS configuration management and validation.
2025-06-07 20:56:22 +08:00
DamonXue
4d67c1d0a6 Merge branch 'main' of https://github.com/rustfs/s3-rustfs into dev_objectEncrypt_v1 2025-06-07 17:18:26 +08:00
houseme
5ab2ce3cfe cargo fmt 2025-06-06 15:30:27 +08:00
lygn128
5850c3e8a3 bucket replication 2025-06-05 14:26:42 +00:00
DamonXue
bd4e7c23bb refactor: update encryption metadata handling and improve KMS client initialization 2025-05-30 22:22:09 +08:00
DamonXue
66c2a2fd93 Merge branch 'main' of https://github.com/rustfs/s3-rustfs into dev_objectEncrypt_v1 2025-05-30 20:45:16 +08:00
overtrue
3a32517f79 feat: add comprehensive formatting rules and type inference guidelines 2025-05-28 16:04:38 +08:00
安正超
9ec22255e0 fix: resolve all Clippy warnings across codebase - Fixed field reassignment warnings in ecstore/src/file_meta.rs by using struct initialization instead of default + field assignment - Fixed overly complex boolean expression in ecstore/src/utils/os/mod.rs by removing meaningless assertion - Replaced manual Default implementation with derive in crates/zip/src/lib.rs - Updated io::Error usage to use io::Error::other() instead of deprecated pattern - Removed useless assertions and clone-on-copy warnings - Fixed unwrap usage by replacing with expect() providing meaningful error messages - Fixed useless vec usage by using array repeat instead - All code now passes comprehensive Clippy check with --all-targets --all-features -- -D warnings 2025-05-28 11:00:07 +08:00
overtrue
671263e22c feat: enhance crypto module test coverage with comprehensive test cases 2025-05-27 22:15:57 +08:00
DamonXue
ab88166990 feat: Add KMS support with RustyVault integration for object encryption
- Updated Cargo.lock to include the crypto dependency.
- Modified crypto/Cargo.toml to add KMS feature dependency.
- Enhanced error handling in crypto/src/error.rs with new ErrNotSupported variant.
- Made rusty_vault_client and sse_kms modules public in crypto/src/lib.rs.
- Refactored sse.rs to support KMS initialization and updated SSE headers to lowercase for AWS compatibility.
- Implemented lazy initialization of KMS client in sse_kms.rs, allowing deferred setup until first use.
- Updated SSEKMSEncryption to utilize RustyVault for key management and encryption operations.
- Integrated KMS encryption into the object storage layer in ecstore/src/set_disk.rs, allowing part-level encryption.
- Added metadata handling for encrypted parts in the storage API.
- Cleaned up unused imports and improved code organization across various files.
2025-05-25 21:37:12 +08:00
houseme
ea4a225d70 cargo fmt 2025-05-25 17:46:59 +08:00
DamonXue
1777994de7 feat: update dependencies and improve encryption handling
- Added base64 and ring dependencies to Cargo.toml and Cargo.lock.
- Refactored encryption logic in encrypt.rs to use base64 standard encoding.
- Removed unnecessary decryption checks in store.rs for cleaner code.
2025-05-25 15:46:44 +08:00
overtrue
9c90426032 feat: improve test coverage and fix critical crypto bug - Translate all Chinese comments to English in utils/ip.rs and config/constants/app.rs - Add comprehensive test suite for crypto/encdec/id.rs module (14 new tests) - Fix critical bug in Argon2 key generation that was returning all-zero keys - Improve test coverage for IP utilities and configuration constants - Ensure all test cases follow English naming conventions and meaningful descriptions 2025-05-25 13:53:59 +08:00
DamonXue
a18f549c1f Merge branch 'main' of https://github.com/rustfs/s3-rustfs into dev_objectEncrypt_v1 2025-05-17 10:33:17 +08:00
houseme
4ac4b35c5e Feature/rustfs config (#396)
* init rustfs config

* improve code for rustfs-config crate

* add

* improve code for comment

* fix: modify rustfs-config crate name

* add default fn

* improve error logger

* fix: modify docker config yaml

* improve code for config

* feat: restrict kafka feature to Linux only

- Add target-specific feature configuration in Cargo.toml for obs and event-notifier crates
- Implement conditional compilation for kafka feature only on Linux systems
- Add appropriate error handling for non-Linux platforms
- Ensure backward compatibility with existing code

* refactor(ci): optimize build workflow for better efficiency

- Integrate GUI build steps into main build-rustfs job
- Add conditional GUI build execution based on tag releases
- Simplify workflow by removing redundant build-rustfs-gui job
- Copy binary directly to embedded-rustfs directory without downloading artifacts
- Update merge job dependency to only rely on build-rustfs
- Improve cross-platform compatibility for Windows binary naming (.exe)
- Streamline artifact uploading and OSS publishing process
- Maintain consistent conditional logic for release operations

* refactor(ci): optimize build workflow for better efficiency

- Integrate GUI build steps into main build-rustfs job
- Add conditional GUI build execution based on tag releases
- Simplify workflow by removing redundant build-rustfs-gui job
- Copy binary directly to embedded-rustfs directory without downloading artifacts
- Update merge job dependency to only rely on build-rustfs
- Improve cross-platform compatibility for Windows binary naming (.exe)
- Streamline artifact uploading and OSS publishing process
- Maintain consistent conditional logic for release operations

* fix(ci): add repo-token to setup-protoc action for authentication

- Add GITHUB_TOKEN parameter to arduino/setup-protoc@v3 action
- Ensure proper authentication for Protoc installation in CI workflow
- Maintain consistent setup across different CI environments

* modify config

* improve readme.md

* remove env config relation

* add allow(dead_code)
2025-05-12 01:17:31 +08:00
DamonXue
96de156763 Implement SSE-KMS and SSE-S3 encryption mechanisms with comprehensive encryption and decryption functionalities. Added KMS client initialization and management, integrated AES-GCM and ChaCha20-Poly1305 for data encryption, and established metadata handling for encrypted objects. Enhanced error handling and included integration tests for encryption workflows. 2025-05-11 22:41:20 +08:00
houseme
3cc4eb55b3 upgrade crate version 2025-04-11 20:53:51 +08:00
weisd
671f2b7473 fix admin add user fail 2025-02-11 10:10:12 +08:00
weisd
c90a98e427 feat: add admin user api 2025-01-13 17:25:15 +08:00
Nugine
870ab67be4 style: workspace lints (#148)
* fix: clippy error

* style: workspace lints

* test: ignore failures
2024-12-05 15:12:52 +08:00
bestgopher
345d4d2f95 fix: make cargo check happy 2024-12-04 20:47:31 +08:00
weisd
13a7220af9 test StorageInfoHandler 2024-12-03 17:38:52 +08:00
bestgopher
602b721c0e add default-feature for crypto crate 2024-12-03 11:16:19 +08:00
bestgopher
bf8fac7809 add iam system
add iam store

feat: add crypto crate

introduce decrypt_data and encrypt_data functions

Signed-off-by: bestgopher <84328409@qq.com>
2024-12-02 10:50:31 +08:00