Commit Graph

  • ec155022e7 "golang.org/x/exp/slices" => "slices" and go fmt chrislu 2024-12-19 19:23:27 -08:00
  • a1a76ccb8c Fix for DeleteMultipleObjectsHandler wrongly deleting parent folders (#6380) Warren Hodgkinson 2024-12-20 02:00:08 +00:00
  • 4d91ec359b Fix volume replica parallelization within ec.encode. (#6377) Lisandro Pin 2024-12-20 02:46:11 +01:00
  • ba0707af64 Allow configuring the maximum number of concurrent tasks for EC parallelization. (#6376) Lisandro Pin 2024-12-18 22:26:26 +01:00
  • 44c48c929a Parallelize volume replica operations within ec.encode. (#6374) Lisandro Pin 2024-12-18 20:59:48 +01:00
  • 72af97162f [shell] feat:stop vacuum immediately once volume.vacuum.disable was executed (#6375) dsd 2024-12-19 03:56:40 +08:00
  • 9fbc4ea417 Rework shell.EcBalance()'s waitgroup code into a standalone type. (#6373) Lisandro Pin 2024-12-17 18:39:51 +01:00
  • e77e50886e mount metacache add ttl (#6360) zemul 2024-12-17 12:19:32 +08:00
  • b2f26804a0 chore(deps): bump docker/setup-buildx-action from 3.7.1 to 3.8.0 (#6369) dependabot[bot] 2024-12-16 14:09:26 -08:00
  • 52cf759a96 chore(deps): bump golang.org/x/crypto from 0.30.0 to 0.31.0 (#6370) dependabot[bot] 2024-12-16 14:09:12 -08:00
  • 93da4fe4d5 chore(deps): bump wangyoucao577/go-release-action from 1.52 to 1.53 (#6368) dependabot[bot] 2024-12-16 14:08:49 -08:00
  • fa2d28c998 chore(deps): bump helm/kind-action from 1.10.0 to 1.11.0 (#6367) dependabot[bot] 2024-12-16 12:29:07 -08:00
  • 641fbc7a80 chore(deps): bump cloud.google.com/go/storage from 1.45.0 to 1.48.0 (#6366) dependabot[bot] 2024-12-16 12:28:56 -08:00
  • ab7b81bbad chore(deps): bump github.com/schollz/progressbar/v3 from 3.16.0 to 3.17.1 (#6365) dependabot[bot] 2024-12-16 12:28:43 -08:00
  • cbc3afe7d1 chore(deps): bump go.mongodb.org/mongo-driver from 1.16.0 to 1.17.1 (#6364) dependabot[bot] 2024-12-16 12:28:32 -08:00
  • b4bcedf064 chore(deps): bump github.com/getsentry/sentry-go from 0.29.1 to 0.30.0 (#6363) dependabot[bot] 2024-12-16 12:28:22 -08:00
  • 7a92b2cbb9 chore(deps): bump github.com/fclairamb/ftpserverlib from 0.24.1 to 0.25.0 (#6362) dependabot[bot] 2024-12-16 12:28:11 -08:00
  • c531e2eb0e Update disk_location_ec.go (#6359) coffeecloudgit 2024-12-16 14:05:47 +08:00
  • 7eb8257126 Update store.go (#6358) coffeecloudgit 2024-12-16 14:05:22 +08:00
  • 9b48ce0613 Parallelize EC shards balancing within racks (#6354) Lisandro Pin 2024-12-15 22:36:23 +01:00
  • 926cfea3dc Parallelize EC shards balancing across racks. (#6352) Lisandro Pin 2024-12-13 15:05:32 +01:00
  • b81def5e5c Parallelize EC balancing for racks. (#6351) Lisandro Pin 2024-12-13 14:33:53 +01:00
  • d6f3e1970d fix: filer may crash by bucketLastActiveTsNs concurrency access. (#6350) zouyixiong 2024-12-13 21:30:21 +08:00
  • 0a4b1909a2 [shell] only apply the balancing for writable volumes (#6346) Konstantin Lebedev 2024-12-13 11:10:00 +02:00
  • 9987a65e8a fix: record and delete bucket metrics after inactive (#6349) zouyixiong 2024-12-13 12:34:02 +08:00
  • b0210df081 Begin implementing EC balancing parallelization support. (#6342) Lisandro Pin 2024-12-12 18:14:44 +01:00
  • 23ffbb083c Limit EC re-balancing for ec.encode to relevant collections when a volume ID argument is provided. (#6347) Lisandro Pin 2024-12-12 17:41:33 +01:00
  • 6320036c56 Delete legacy balancing code for ec.encode. (#6344) Lisandro Pin 2024-12-12 16:42:03 +01:00
  • 700b95304b [shell] volume.list show only writable volumes (#6338) Konstantin Lebedev 2024-12-11 19:06:15 +02:00
  • c37281735e volume.list avoid output empty data center and rack and disk info (#6341) Konstantin Lebedev 2024-12-11 19:03:16 +02:00
  • 8c82c037b9 Unify the re-balancing logic for ec.encode with ec.balance. (#6339) Lisandro Pin 2024-12-10 22:30:13 +01:00
  • ff1392f7f4 [shell] use constant for hdd of type (#6337) Konstantin Lebedev 2024-12-10 18:43:59 +02:00
  • 4f6c989309 chore(deps): bump golang.org/x/net from 0.31.0 to 0.32.0 (#6330) dependabot[bot] 2024-12-09 09:59:05 -08:00
  • af4c51aee6 chore(deps): bump cloud.google.com/go/pubsub from 1.45.1 to 1.45.3 (#6328) dependabot[bot] 2024-12-09 09:04:45 -08:00
  • 3cd2f06279 chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.69.0 to 1.71.0 (#6329) dependabot[bot] 2024-12-09 08:46:16 -08:00
  • e438fdc16c chore(deps): bump github.com/hanwen/go-fuse/v2 from 2.7.1 to 2.7.2 (#6331) dependabot[bot] 2024-12-09 08:46:00 -08:00
  • 3680bbac56 chore(deps): bump golang.org/x/sys from 0.27.0 to 0.28.0 (#6332) dependabot[bot] 2024-12-09 08:45:26 -08:00
  • 67461ccd27 chore(deps): bump docker/build-push-action from 6.9.0 to 6.10.0 (#6333) dependabot[bot] 2024-12-09 08:45:13 -08:00
  • 522a25790a Remove average constraints when selecting nodes/racks to balance EC shards into. (#6325) Lisandro Pin 2024-12-06 18:00:06 +01:00
  • 914ff0e718 Replaced https.client.enabled with false in scaffold/security (#6320) vadimartynov 2024-12-05 21:39:28 +03:00
  • f3dde99796 adjust error message chrislu 2024-12-05 09:33:49 -08:00
  • 34cdbdd279 Share common parameters for EC re-balancing functions under a single struct. (#6319) Lisandro Pin 2024-12-05 18:00:46 +01:00
  • edef485333 Account for replication placement settings when balancing EC shards within the same rack. (#6317) Lisandro Pin 2024-12-04 19:47:51 +01:00
  • 351efa134d Account for replication placement settings when balancing EC shards across racks. (#6316) Lisandro Pin 2024-12-04 18:00:55 +01:00
  • b65eb2ec45 [security] reload whiteList on http seerver (#6302) Konstantin Lebedev 2024-12-02 23:38:10 +05:00
  • b2ba7d7408 Resolve replica placement for EC volumes from master server defaults. (#6303) Lisandro Pin 2024-12-02 17:44:07 +01:00
  • 9a741a61b1 Display details upon failures to re-balance EC shards racks. (#6299) Lisandro Pin 2024-11-28 17:42:41 +01:00
  • 559a1fd0f4 Improve EC shards rebalancing logic across nodes (#6297) Lisandro Pin 2024-11-27 20:51:57 +01:00
  • 88fa64a01a change comment for expect header (#6289) steve.wei 2024-11-27 00:35:41 +08:00
  • e2e97db917 [master] avoid timeout when assigning for main request with filter by DC or rack (#6291) Konstantin Lebedev 2024-11-26 21:33:31 +05:00
  • fec88e64eb [master] update LastLeaderChangeTime for hashicorp raft (#6292) Konstantin Lebedev 2024-11-26 21:02:45 +05:00
  • d43fa07f06 use readable bytes size string in shell output (#6288) Trim21 2024-11-26 09:25:17 +08:00
  • f965af51b7 chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.66.3 to 1.69.0 (#6287) dependabot[bot] 2024-11-25 14:35:21 -08:00
  • 11042ddb71 chore(deps): bump docker/metadata-action from 5.5.1 to 5.6.1 (#6281) dependabot[bot] 2024-11-25 14:27:46 -08:00
  • e4abb6cbea chore(deps): bump github.com/hanwen/go-fuse/v2 from 2.6.1 to 2.7.1 (#6283) dependabot[bot] 2024-11-25 14:26:51 -08:00
  • 19d01c02c6 chore(deps): bump github.com/stretchr/testify from 1.9.0 to 1.10.0 (#6284) dependabot[bot] 2024-11-25 14:26:44 -08:00
  • d54fbca481 chore(deps): bump github.com/aws/aws-sdk-go-v2/credentials from 1.17.45 to 1.17.46 (#6285) dependabot[bot] 2024-11-25 14:26:37 -08:00
  • 29aaf3e68e chore(deps): bump google.golang.org/protobuf from 1.35.1 to 1.35.2 (#6286) dependabot[bot] 2024-11-25 14:26:29 -08:00
  • 8836fa19b6 use ShouldGrowVolumesByDcAndRack (#6280) Konstantin Lebedev 2024-11-25 22:30:37 +05:00
  • 167b50be88 fix missing register master metric MasterPickForWriteErrorCounter (#6277) Konstantin Lebedev 2024-11-25 21:59:11 +05:00
  • fd6c787c02 fix EcVolumes sorting in volume UI (#6275) Trim21 2024-11-24 14:43:08 +08:00
  • ccf1795e6f wait a bit before getting the next volume id if the leader is recently elected chrislu 2024-11-23 19:58:45 -08:00
  • 04081128a9 use math rand v2 chrislu 2024-11-21 08:54:03 -08:00
  • 54204bc89b format error chrislu 2024-11-21 08:52:37 -08:00
  • ca499de1cb Improve EC shards rebalancing logic across racks (#6270) Lisandro Pin 2024-11-21 17:46:24 +01:00
  • e56327e3b0 ExclusiveLocker only create one renew goroutine (#6269) Numblgw 2024-11-22 00:27:12 +08:00
  • aebf3952b7 filer sync: source path and exclude path support dir suffix (#6268) Numblgw 2024-11-22 00:25:12 +08:00
  • 7fa4e5c2a1 [master] Revert back automatic volume grow in case of compensate for crowded volumes (#6267) Konstantin Lebedev 2024-11-21 21:19:19 +05:00
  • a143c888e5 [shell] don't require lock when there are no changes for volume.fix.replication (#6266) Konstantin Lebedev 2024-11-21 21:17:25 +05:00
  • a49d9e020c [master] avoid crowded more writable for auto grow (#6214) Konstantin Lebedev 2024-11-21 13:57:42 +05:00
  • 75f5afa571 fix compilation chrislu 2024-11-21 00:41:22 -08:00
  • 1c143cfcea display actual offset value chrislu 2024-11-21 00:38:03 -08:00
  • c9f3448692 ReadAt may return io.EOF t end of file chrislu 2024-11-21 00:37:38 -08:00
  • be09d08eb6 adjust error message chrislu 2024-11-20 23:49:01 -08:00
  • 6b2612690b consistent error message if auth is not setup chrislu 2024-11-20 23:11:16 -08:00
  • 254ed8897e [shell] add noLock param for volume.move (#6261) Konstantin Lebedev 2024-11-20 21:35:24 +05:00
  • 96f1a2e01a adjust error message chrislu 2024-11-19 14:16:00 -08:00
  • bb37886f6a chore(deps): bump github.com/rclone/rclone from 1.68.1 to 1.68.2 (#6260) dependabot[bot] 2024-11-19 13:44:32 -08:00
  • e28f55eb08 typo chrislu 2024-11-19 08:32:31 -08:00
  • 98f03862aa rename chrislu 2024-11-19 08:31:54 -08:00
  • 07cf8cf22d minor chrislu 2024-11-19 08:31:33 -08:00
  • 0d5393641e Unify usage of shell.EcNode.dc as DataCenterId. (#6258) Lisandro Pin 2024-11-19 15:33:18 +01:00
  • 2caa0e3741 java 3.80 chrislu 2024-11-18 22:41:59 -08:00
  • bc7650bd61 adds more info on skipped volumes chrislu 2024-11-18 18:25:38 -08:00
  • f2db746690 Introduce logic to resolve volume replica placement within EC rebalancing. (#6254) Lisandro Pin 2024-11-19 03:05:06 +01:00
  • e722ede743 Publish seaweedfs-4.0.380.tgz chrislusf 2024-11-18 17:56:18 +00:00
  • 7b3c0e937f 3.80 3.80 chrislu 2024-11-18 09:48:33 -08:00
  • 180f267867 chore(deps): bump github.com/linxGnu/grocksdb from 1.9.5 to 1.9.7 (#6249) dependabot[bot] 2024-11-18 09:37:06 -08:00
  • b21f599cde chore(deps): bump modernc.org/sqlite from 1.33.1 to 1.34.1 (#6251) dependabot[bot] 2024-11-18 09:36:52 -08:00
  • 3fba0adc9d chore(deps): bump github.com/aws/aws-sdk-go-v2/config from 1.28.0 to 1.28.4 (#6252) dependabot[bot] 2024-11-18 09:36:43 -08:00
  • f8f162aa72 chore(deps): bump go.etcd.io/etcd/client/v3 from 3.5.16 to 3.5.17 (#6253) dependabot[bot] 2024-11-18 09:36:31 -08:00
  • 6d3e38f439 Adjust threshold config (#6246) zemul 2024-11-18 12:51:26 +08:00
  • 4a0dc883cf Fix/parse upload filename (#6241) Kevin Bulteel 2024-11-15 20:25:18 +01:00
  • 8ebbf37e8e Add a loop to wait for master and filer services in post-install-bucket-hook (#6240) Omar Hamadeh 2024-11-15 22:15:33 +03:00
  • 008ac38ebc fix java.lang.IllegalArgumentException: Comparison method violates its general contract! (#6239) fo40225 2024-11-15 09:26:50 +08:00
  • a5fe6e21bc feat(filer.backup): add ignore errors option (#6235) Max Denushev 2024-11-14 19:40:55 +03:00
  • 3003c9e17e added backward compatible CRC check and extra explanatory comments (#6233) Eugeniy E. Mikhailov 2024-11-12 16:56:14 -05:00
  • 31d8907e77 chore(deps): bump github.com/golang-jwt/jwt/v4 from 4.5.0 to 4.5.1 (#6231) dependabot[bot] 2024-11-11 11:54:07 -08:00
  • 7b0a37312d chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.66.2 to 1.66.3 (#6225) dependabot[bot] 2024-11-11 11:15:24 -08:00
  • 623fc3a4fc chore(deps): bump github.com/aws/aws-sdk-go-v2 from 1.32.3 to 1.32.4 (#6227) dependabot[bot] 2024-11-11 11:15:09 -08:00