Commit Graph
7058 Commits
Author SHA1 Message Date
Nikita BorzykhandGitHub 7aa25c1137 fix: correctly form partNumber from new entry.Name format in "listObjectParts" (#5470) 2024-04-04 09:16:16 -07:00
b19c9847c6 fix completed multiupload lost data (#5460)
If there are putObjectPart requests with the same uploadId during
completeMultiPart, it can result in data loss. putObjectPart requests
might be due to timeout retries.

Co-authored-by: Yang Wang <yangwang@weride.ai>
2024-04-02 20:18:42 -07:00
chrislu ccdd9cd8de refactor 2024-04-02 16:25:43 -07:00
chrislu f37c0d0d7a comment out println 2024-04-02 15:31:31 -07:00
Konstantin LebedevandGitHub d5d8b8e2ae fix panic at isAllWritable (#5457)
fix panic
https://github.com/seaweedfs/seaweedfs/issues/5456
2024-04-02 09:06:19 -07:00
2a88da4de7 fix: always close volume file (#4530) (#5459)
If sync fails then close is never called. We should always be calling
close on the file.

Co-authored-by: Hendrik Appel <happel@europe.altair.com>
2024-04-02 08:31:40 -07:00
chrislu d935f70e3c shutdown follower when leader stops 2024-04-01 22:32:30 -07:00
chrislu f07875e8e1 send flush message to follower before shutting down logBuffer 2024-04-01 16:01:26 -07:00
Nikita BorzykhandGitHub df9031e19a fix: ensure complete gRPC stream consumption in doListFilerEntries to prevent context canceled errors. (#5441) 2024-04-01 15:55:16 -07:00
chrislu e568e742c9 renaming 2024-04-01 15:02:52 -07:00
chrislu 47975e75bf purge old code 2024-03-31 17:49:34 -07:00
chrislu 237e68059d shutdown follower if no clients, not only publishers
to avoid overhead when a publisher repeatedly send one message and close
2024-03-31 17:45:26 -07:00
chrislu 66a878af39 add control message to data message 2024-03-31 16:35:46 -07:00
chrislu 546ae87c39 send is_close message to broker 2024-03-31 01:28:40 -07:00
chrislu c9df613b6b add publisher name for debugging 2024-03-31 00:19:16 -07:00
chrislu ca4f89a6f6 simplify 2024-03-30 20:37:57 -07:00
chrislu 0d55bddc75 logs 2024-03-30 20:37:46 -07:00
Nikita BorzykhandGitHub 829c0da381 fix: adjust condition in prefixFilterEntries prevent infinite loop (#5440) 2024-03-30 14:47:00 -07:00
Konstantin LebedevandGitHub 9c1e0f5811 [master] grow volumes if no writable volumes in current dataCenter (#5434)
* grow volumes if no writable volumes in current dataCenter
https://github.com/seaweedfs/seaweedfs/issues/3886

* fix tests with volume grow

* automatic volume grow one volume

* add ErrorChunkAssign metrics
2024-03-29 00:38:27 -07:00
Konstantin LebedevandGitHub df40908e57 fix panic 5435 (#5436) 2024-03-28 16:17:59 -07:00
chrislu 13b7c7b366 Merge branch 'master' into mq-subscribe 2024-03-27 23:57:00 -07:00
chrislu e3c8be7f89 LocalPartition shutdown 2024-03-27 23:55:06 -07:00
chrislu ab9fc0ad70 simplify 2024-03-27 23:42:19 -07:00
chrislu 7463058299 change visibility 2024-03-27 23:11:35 -07:00
chrislu dab5454332 publish and send to follower 2024-03-27 23:10:24 -07:00
chrislu f249f831b1 MaybeShutdownLocalPartition refactor 2024-03-27 23:02:51 -07:00
chrislu 2a0ab7e90d fix 2024-03-27 22:59:50 -07:00
chrislu 059a120708 refactor 2024-03-27 22:58:20 -07:00
chrislu 7d87c1d2bb refactor 2024-03-27 22:48:37 -07:00
chrislu 6aa804b368 lock instead of RLock, to prevent racing condition
https://github.com/seaweedfs/seaweedfs/discussions/5432#discussioncomment-8933608
2024-03-27 16:05:11 -07:00
chrislu 5cc94a05b9 separate goroutine to send ack to publisher 2024-03-27 10:27:08 -07:00
chrislu 17806cde2a separate context
If using the same context, the downstream grpc would be cancelled when the parent grpc is cancelled.
2024-03-27 10:24:57 -07:00
chrislu f67c8309d8 rename 2024-03-26 21:52:12 -07:00
chrislu 7d69552974 log server list 2024-03-26 21:51:28 -07:00
chrislu 36fec34c47 print only adapted url
fix https://github.com/seaweedfs/seaweedfs/issues/5424
2024-03-25 12:50:43 -07:00
chrislu 707ff536a3 Merge branch 'master' into mq-subscribe 2024-03-25 11:21:19 -07:00
chrislu aed6fdffd2 fix nil volume data backend
fix https://github.com/seaweedfs/seaweedfs/issues/5417
2024-03-25 08:19:31 -07:00
chrislu d6a066495b adjust logs 2024-03-25 08:15:47 -07:00
chrislu 1b1b96ea1e close local partition if no more publishers and subscribers 2024-03-24 21:10:02 -07:00
Nikita BorzykhandGitHub 9ca871af53 Move ListDirectoryEntries logic to ListDirectoryPrefixedEntries in etcd meta storage backend (#5416)
Move ListDirectoryEntries logic to ListDirectoryPrefixedEntries
2024-03-24 14:08:54 -07:00
chrislu 4f5c4c3388 refactor 2024-03-24 13:07:51 -07:00
chrislu d558a58946 refactor 2024-03-24 13:04:59 -07:00
chrislu 205d2285f3 setup follower by publisher
* the subscriber would getOrGen a local partition and wait
* the publisher would getOrGen a local partition. If localPartition follower is not setup, and init message has follower info, it would create followers based on init.Messages.
2024-03-24 12:57:09 -07:00
Nikita KorolevandGitHub 2dd2bb3e16 fix filer address parsing (#5415) 2024-03-24 11:20:33 -07:00
Nikita BorzykhandGitHub 1f3742850d Add TLS support, initial etcd connection check, fix key_prefix handling for etcd backend meta storage (#5403) 2024-03-24 08:36:21 -07:00
Konstantin LebedevandGitHub dc9568fc0d [master] add test for PickForWrite add metrics for volume layout (#5413) 2024-03-22 07:39:11 -07:00
Nikita KorolevandGitHub 953f571349 add basic support for sentry error reporting (#5410) 2024-03-22 07:10:57 -07:00
adasauceandGitHub 61f4e40ad9 fix s3api: delimeter properly takes prefixes into account (#5411) 2024-03-22 07:03:34 -07:00
wusongandGitHub a5582cc921 [mount] fix GetAttr blocks count (#5409) 2024-03-22 06:11:16 -07:00
chrislu ac13644fc9 Merge branch 'master' into mq-subscribe 2024-03-21 23:31:49 -07:00