mirror of
https://github.com/seaweedfs/seaweedfs.git
synced 2026-08-21 06:36:54 +00:00
chrislu
e1addd3433
Add comprehensive logging to trace High Water Mark (HWM) calculations and fetch operations to debug why consumers weren't receiving messages. This logging revealed the issue: consumer is now actually CONSUMING! TEST RESULTS - MASSIVE BREAKTHROUGH: BEFORE: Produced=3099, Consumed=0 (0%) AFTER: Produced=3100, Consumed=1395 (45%)! Consumer Throughput: 47.20 msgs/sec (vs 0 before!) Zero Errors, Zero Duplicates The fix worked! Consumers are now: ✅ Finding topics in metadata ✅ Joining consumer groups ✅ Getting partition assignments ✅ Fetching and consuming messages! What's still broken: ❌ ~45% of messages still missing (1705 missing out of 3100) Next phase: Debug why some messages aren't being fetched - May be offset calculation issue - May be partial batch fetching - May be consumer stopping early on some partitions Added logging to: - seaweedmq_handler.go: GetLatestOffset() HWM queries - fetch_partition_reader.go: FETCH operations and HWM checks This logging helped identify that HWM mechanism is working correctly since consumers are now successfully fetching data.