Commit Graph
361 Commits
Author SHA1 Message Date
chrislu cdeaaf95b4 go fmt 2024-05-23 08:25:53 -07:00
chrislu d40b350f54 coordinator receives unassignment ack 2024-05-23 08:23:35 -07:00
chrislu 554ae09f82 rename 2024-05-21 10:02:07 -07:00
chrislu 6ef2d010aa rename file 2024-05-21 09:57:59 -07:00
chrislu 67e6051585 rename Coordinator to SubCoordinator 2024-05-21 09:57:45 -07:00
chrislu b5099263a4 rename file 2024-05-21 09:56:46 -07:00
chrislu d5abffa42c rename Balancer to PubBalancer 2024-05-21 09:56:30 -07:00
chrislu fa98ecf71e client side stop partition subscribing if unassigned 2024-05-21 08:42:04 -07:00
chrislu 6634b42981 fix compilation 2024-05-21 08:26:55 -07:00
chrislu 2190d59bc3 refactor
ToDo
1. handle unassignment on client side
2. get notified of completed unassignment
3. in consumer_group.go, balance and send unassignment
2024-05-21 08:05:56 -07:00
chrislu 3148dec1f6 avoid concurrent processing for the same key 2024-05-20 13:29:37 -07:00
chrislu a7d30d0705 refactor 2024-05-20 12:32:12 -07:00
chrislu 33aecb7bb4 remove ProcessorConfiguration 2024-05-20 12:28:01 -07:00
chrislu 65dd5ac6fb fix 2024-05-20 12:27:45 -07:00
chrislu f13475ac2e sending keyed offset 2024-05-20 11:09:48 -07:00
chrislu d45b1d058d minor 2024-05-20 11:07:54 -07:00
chrislu 3622196881 go fmt 2024-05-20 11:05:18 -07:00
chrislu 5038577f7e Merge branch 'master' into mq 2024-05-20 11:04:53 -07:00
chrislu d218fe54fa go fmt 2024-05-20 11:03:56 -07:00
chrislu 7a4ace5dfb adjust logs 2024-05-20 09:34:07 -07:00
chrislu d8ab22012a track offset 2024-05-20 09:33:37 -07:00
chrislu 2b07a40da5 add InflightMessageTracker 2024-05-20 09:19:39 -07:00
chrislu a2885512e1 fix 2024-05-19 15:06:33 -07:00
chrislu 8d02712c63 ConcurrentPartitionLimit 2024-05-19 14:55:03 -07:00
chrislu 8ce2cced47 less logs 2024-05-19 14:54:46 -07:00
chrislu c6db3f31a1 start consuming ASAP 2024-05-19 14:52:38 -07:00
chrislu c21b32dd20 logs 2024-05-19 11:02:17 -07:00
chrislu b1871427c3 persist consumer group offset
1. use one follower
2. read write consumer group offset
2024-05-19 00:46:12 -07:00
chrislu 8d5bb7420d rename 2024-05-17 18:21:21 -07:00
chrislu 94742b8ace add subscribe follower 2024-05-17 18:17:23 -07:00
chrislu 279cb2b85e consumer acks received messages 2024-05-16 20:28:19 -07:00
chrislu faffb2973c adjust errors 2024-05-16 11:02:48 -07:00
chrislu 759a8e50cf remove logs 2024-05-14 23:22:51 -07:00
chrislu 1f20178ded subscriber receives partitions and dispatch to processors 2024-05-14 23:22:43 -07:00
chrislu 972e9faaa2 move initial assignment to rebalance logic 2024-05-14 09:09:36 -07:00
chrislu 6e5075e14e move read write topic config into filer client accessor 2024-05-14 08:50:17 -07:00
chrislu ac63f2b5a1 refactor 2024-05-13 22:03:57 -07:00
chrislu 844a1a0192 rename 2024-05-13 19:24:47 -07:00
chrislu 372bd8d71d consumer instance passing MaxPartitionCount to coordinator 2024-05-13 18:30:10 -07:00
chrislu 2142842f82 refactor 2024-05-13 18:25:38 -07:00
chrislu 8cc5298a08 clean up unused variables 2024-05-10 13:10:45 -07:00
chrislu fcedf97e94 fix test 2024-05-05 22:19:59 -07:00
chrislu 664b704e30 add delay 2024-05-05 14:17:41 -07:00
chrislu 4e3701df77 reset last error 2024-05-05 14:16:54 -07:00
chrislu 30f8600a24 working 2024-05-03 21:27:06 -07:00
chrislu 7a9b115cc2 rename 2024-05-02 11:14:58 -07:00
chrislu 4a3e8869bb subscriber can unmarshal the record 2024-05-02 09:56:11 -07:00
chrislu 1c5043baf7 rename 2024-05-02 09:47:29 -07:00
chrislu f2f4630029 rename field types 2024-05-02 08:59:22 -07:00
chrislu b8af997e41 consistent with protobuf data types 2024-05-02 08:52:10 -07:00