mirrors/seaweedfs
1
0
Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2026-05-21 17:21:34 +00:00
Code Issues Packages Projects Releases Wiki Activity
11,759 Commits 141 Branches 340 Tags
68d86af501ecff5ac400c02523f0982eb4e62b80
Commit Graph

11759 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
chrislu
68d86af501 fix ec volumes list 2025-07-26 19:06:14 -07:00
chrislu
13c0826f2f display ec shard sizes 2025-07-26 16:04:18 -07:00
chrislu
9f540c8449 fix warning 2025-07-26 13:43:30 -07:00
chrislu
965ec4f51b garbage percentage threshold 2025-07-26 13:28:52 -07:00
chrislu
a1e508cd8d integration test with vauuming 2025-07-26 13:23:43 -07:00
chrislu
600bfbf671 rename 2025-07-26 13:23:13 -07:00
chrislu
019de6dc7a interval field UI component 2025-07-26 09:22:59 -07:00
chrislu
8dd9b7cccf show ec volumes 2025-07-26 08:55:39 -07:00
chrislu
3b2c75d2bd ec is mostly working now 
* distribution of ec shards needs improvement
* need configuration to enable ec
 2025-07-25 22:02:28 -07:00
chrislu
379d585cc7 local copy, ec. Need to distribute. 2025-07-25 20:49:48 -07:00
chrislu
0247bf2873 listing ec shards 2025-07-25 19:46:21 -07:00
chrislu
41cbbefb0b move ec task logic 2025-07-25 16:49:12 -07:00
chrislu
ffd91383c6 worker can run ec work and report status 
but:
1. one volume should not be repeatedly worked on.
2. ec shards needs to be distributed and source data should be deleted.
 2025-07-25 15:24:31 -07:00
chrislu
19df3fcc5d worker register itself first 2025-07-25 13:22:33 -07:00
chrislu
a3d727034a clean up logs 2025-07-25 13:16:59 -07:00
chrislu
c557ec0062 worker reconnect to admin 2025-07-25 02:12:51 -07:00
chrislu
63817fe7ee test canScheduleTaskNow 2025-07-25 01:59:54 -07:00
chrislu
afdca513ac sticky worker id 2025-07-25 01:59:22 -07:00
chrislu
14e95186d6 skip task ID column 2025-07-25 00:53:54 -07:00
chrislu
960acc031e rendering pending tasks 2025-07-25 00:48:19 -07:00
chrislu
6cf78754b2 build and restart 2025-07-24 23:50:22 -07:00
chrislu
01e8cc4600 worker retries connecting to admin 2025-07-24 23:24:01 -07:00
chrislu
e7084c5b7e compiles 2025-07-24 22:55:22 -07:00
chrislu
16a29b57f9 compiles, detection uses volumeSizeLimitMB from master 2025-07-24 22:37:09 -07:00
chrislu
a1966e9692 working worker and admin. Task detection is not working yet. 2025-07-24 21:58:08 -07:00
chrislu
f10c6305dc Update .gitignore 2025-07-24 19:43:21 -07:00
chrislu
cd28ce7786 admin start wtih grpc port. worker has its own working directory 2025-07-24 19:43:10 -07:00
chrislu
2941cdf95e tasks are assigned 2025-07-24 13:07:11 -07:00
chrislu
688a91039d generate write load 2025-07-24 12:08:19 -07:00
chrislu
167ab29eb6 start master, volume servers, filer 
Current Status
✅ Master: Healthy and running (port 9333)
✅ Filer: Healthy and running (port 8888)
✅ Volume Servers: All 6 servers running (ports 8080-8085)
🔄 Admin/Workers: Will start when dependencies are ready
 2025-07-24 09:16:10 -07:00
chrislu
a4cf55a741 remove "enhanced" reference 2025-07-24 08:07:50 -07:00
chrislu
30ad65bb5f integration test. ec worker task 2025-07-24 07:50:03 -07:00
chrislu
0d8e1f8a17 reorganized the codebase to move the simulation framework and tests into their own dedicated package 2025-07-24 01:08:10 -07:00
chrislu
a0874d201c added simulation as tests 2025-07-24 01:00:25 -07:00
chrislu
add122484c initial design 2025-07-24 00:37:02 -07:00
chrislu
7ab85c3748 return proper default value for locking and versioning 
fix https://github.com/seaweedfs/seaweedfs/issues/6971
fix https://github.com/seaweedfs/seaweedfs/issues/7028
 2025-07-23 22:20:48 -07:00
chrislu
4f72a1778f minor 2025-07-23 21:59:50 -07:00
Mohamed Sekour
2c5ffe16cf Fix all in one deployment (#7031) 
* make maxVolumes  configurable for allInOne deployment

Signed-off-by: Mohamed Sekour <mohamed.sekour@exfo.com>

* Update all-in-one-deployment.yaml

fix typo

* add robustness

---------

Signed-off-by: Mohamed Sekour <mohamed.sekour@exfo.com>
 2025-07-23 13:18:50 -07:00
Chris Lu
5ac037f763 change priority of admin credentials from env varaibles (#7032) 
* change priority of admin credentials from env varaibles

* address comment
 2025-07-23 11:44:36 -07:00
chrislu
dd464cd339 use latest v3.18.4 2025-07-23 02:23:11 -07:00
chrislu
8531326b55 adding admin credential 2025-07-23 02:21:53 -07:00
Chris Lu
e3d3c495ab S3 API: simpler way to start s3 with credentials (#7030) 
* simpler way to start s3 with credentials

* AWS_ACCESS_KEY_ID=access_key AWS_SECRET_ACCESS_KEY=secret_key weed s3

* last adding credentials from env variables

* Update weed/s3api/auth_credentials.go

Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

* simplify

* adjust doc

---------

Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-07-23 02:05:26 -07:00
chrislu
d5085cd1f7 newer helm version 
fix https://github.com/seaweedfs/seaweedfs/issues/7029
 2025-07-22 23:58:31 -07:00
dependabot[bot]
a81421f393 chore(deps): bump gocloud.dev from 0.42.0 to 0.43.0 (#7023) 
---
updated-dependencies:
- dependency-name: gocloud.dev
  dependency-version: 0.43.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
 2025-07-22 08:42:58 -07:00
Chris Lu
33b9017b48 fix listing objects (#7008) 
* fix listing objects

* add more list testing

* address comments

* fix next marker

* fix isTruncated in listing

* fix tests

* address tests

* Update s3api_object_handlers_multipart.go

* fixes

* store json into bucket content, for tagging and cors

* switch bucket metadata from json to proto

* fix

* Update s3api_bucket_config.go

* fix test issue

* fix test_bucket_listv2_delimiter_prefix

* Update cors.go

* skip special characters

* passing listing

* fix test_bucket_list_delimiter_prefix

* ok. fix the xsd generated go code now

* fix cors tests

* fix test

* fix test_bucket_list_unordered and test_bucket_listv2_unordered

do not accept the allow-unordered and delimiter parameter combination

* fix test_bucket_list_objects_anonymous and test_bucket_listv2_objects_anonymous

The tests test_bucket_list_objects_anonymous and test_bucket_listv2_objects_anonymous were failing because they try to set bucket ACL to public-read, but SeaweedFS only supported private ACL.

Updated PutBucketAclHandler to use the existing ExtractAcl function which already supports all standard S3 canned ACLs
Replaced the hardcoded check for only private ACL with proper ACL parsing that handles public-read, public-read-write, authenticated-read, bucket-owner-read, bucket-owner-full-control, etc.
Added unit tests to verify all standard canned ACLs are accepted

* fix list unordered

The test is expecting the error code to be InvalidArgument instead of InvalidRequest

* allow anonymous listing( and head, get)

* fix test_bucket_list_maxkeys_invalid

Invalid values: max-keys=blah → Returns ErrInvalidMaxKeys (HTTP 400)

* updating IsPublicRead when parsing acl

* more logs

* CORS Test Fix

* fix test_bucket_list_return_data

* default to private

* fix test_bucket_list_delimiter_not_skip_special

* default no acl

* add debug logging

* more logs

* use basic http client

remove logs also

* fixes

* debug

* Update stats.go

* debugging

* fix anonymous test expectation

anonymous user can read, as configured in s3 json.
 2025-07-22 01:07:15 -07:00
dependabot[bot]
632029fd8b chore(deps): bump github.com/a-h/templ from 0.3.906 to 0.3.920 (#7022) 
---
updated-dependencies:
- dependency-name: github.com/a-h/templ
  dependency-version: 0.3.920
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-07-21 17:47:59 -07:00
dependabot[bot]
b3d8ff05b7 chore(deps): bump github.com/aws/aws-sdk-go-v2/config from 1.29.17 to 1.29.18 (#7019) 
chore(deps): bump github.com/aws/aws-sdk-go-v2/config

Bumps [github.com/aws/aws-sdk-go-v2/config](https://github.com/aws/aws-sdk-go-v2) from 1.29.17 to 1.29.18.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases)
- [Changelog](https://github.com/aws/aws-sdk-go-v2/blob/main/changelog-template.json)
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/config/v1.29.17...config/v1.29.18)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2/config
  dependency-version: 1.29.18
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-07-21 17:47:27 -07:00
dependabot[bot]
fd94a026ac chore(deps): bump actions/setup-python from 4 to 5 (#7021) 
Bumps [actions/setup-python](https://github.com/actions/setup-python) from 4 to 5.
- [Release notes](https://github.com/actions/setup-python/releases)
- [Commits](https://github.com/actions/setup-python/compare/v4...v5)

---
updated-dependencies:
- dependency-name: actions/setup-python
  dependency-version: '5'
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-07-21 11:55:34 -07:00
dependabot[bot]
03b6b83419 chore(deps): bump github.com/klauspost/reedsolomon from 1.12.4 to 1.12.5 (#7018) 
---
updated-dependencies:
- dependency-name: github.com/klauspost/reedsolomon
  dependency-version: 1.12.5
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-07-21 11:55:15 -07:00
dependabot[bot]
325d452da6 chore(deps): bump gocloud.dev/pubsub/rabbitpubsub from 0.42.0 to 0.43.0 (#7016) 
---
updated-dependencies:
- dependency-name: gocloud.dev/pubsub/rabbitpubsub
  dependency-version: 0.43.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-07-21 11:54:55 -07:00