Commit Graph

50 Commits

Author SHA1 Message Date
Asias He
aa012ba374 streaming: Send STREAM_MUTATION in parallel
At the moment, when local node send a mutation to remote node, it will
wait for remote node to apply the mutation and send back a response,
then it will send the next mutation. This means the sender are sending
mutations one by one. To optimize, we can make the sender send more
mutations in parallel without waiting for the response. In order to
apply back pressure from remote node, a per shard mutation send limiter
is introduced so that the sender will not overwhelm the receiver.
2015-08-17 10:52:30 +08:00
Asias He
d934b2c761 streaming: Fix prepare_message and stream_request deserialization
vector(size_type count) constructs the container with count
default-inserted instances of T. So, current code will end up with 2*num
elements which is wrong.
2015-07-22 11:49:30 +08:00
Asias He
fa2aee57ac utils: Move util/serialization.hh to utils/serialization.hh
Now we will not have the ugly utils and util directories, only utils.
2015-07-21 16:12:54 +08:00
Asias He
1aab3c7bb9 streaming: Drop serialization interface for {outgoing,incoming}_file_message
We will send mutations using the frozen_mutation verb
2015-07-09 15:52:28 +08:00
Asias He
4718211d4a streaming: Wire up stream_transfer_task::add_transfer_file
Wire up with outgoing_file_message
2015-07-09 15:52:27 +08:00
Asias He
e8156ca552 streaming: Implement serialize interface for file_message_header 2015-06-30 12:19:01 +08:00
Asias He
b35d29f91f streaming: Implement serialize interface for prepare_message 2015-06-30 11:43:29 +08:00
Asias He
237fedb1fc streaming: Implement serialize interface for received_message 2015-06-30 10:37:49 +08:00
Asias He
85ecd6b2f2 streaming: Implement serialize interface for retry_message 2015-06-30 10:33:13 +08:00
Asias He
8c67244a13 streaming: Implement serialize interface for stream_init_message 2015-06-30 10:33:13 +08:00
Asias He
29cb6fe003 streaming: Add message type for session_failed_message 2015-06-24 16:13:31 +08:00
Asias He
f9a7d20919 streaming: Add message type for retry_message 2015-06-24 16:13:31 +08:00
Asias He
3586de623c streaming: Add message type for received_message 2015-06-24 16:13:31 +08:00
Asias He
8555a28ef6 streaming: Add message type for prepare_message 2015-06-24 16:13:31 +08:00
Asias He
79d2bf1629 streaming: Add message type for outgoing_file_message 2015-06-24 16:13:31 +08:00
Asias He
044dbca5a4 streaming: Add message type for incoming_file_message 2015-06-24 16:13:31 +08:00
Asias He
8425cb126f streaming: Add message type for complete_message 2015-06-24 16:13:30 +08:00
Asias He
052a126d10 streaming: Add stream_message type 2015-06-24 16:13:30 +08:00
Asias He
320c6b57de streaming: Add constructor to incoming_file_message 2015-06-24 16:13:30 +08:00
Asias He
705e4de58c streaming: Fix uninitialized error in outgoing_file_message
./streaming/messages/file_message_header.hh:63:39: error: ‘format’ is
used uninitialized in this function [-Werror=uninitialized]
2015-06-24 16:13:30 +08:00
Asias He
5d4f533e14 streaming: Add constructor for outgoing_file_message 2015-06-24 14:18:11 +08:00
Asias He
fe61c0d8d4 streaming: Convert more of file_message_header.hh 2015-06-23 16:06:28 +08:00
Asias He
2f7ab6f293 streaming: Add fields to stream_init_message 2015-06-18 14:55:07 +08:00
Asias He
6c8b002e41 streaming: Enable requests and summaries in prepare_message 2015-06-18 14:55:07 +08:00
Asias He
cde1676274 streaming: Add SESSION_FAILED_MESSAGE handler 2015-06-18 14:55:06 +08:00
Asias He
8170f6ee0a streaming: Add COMPLETE_MESSAGE handler 2015-06-18 14:55:06 +08:00
Asias He
e2b986910b streaming: Add RETRY_MESSAGE handler 2015-06-18 14:55:06 +08:00
Asias He
11df6fafc3 streaming: Add OUTGOING_FILE_MESSAGE handler 2015-06-17 16:08:38 +08:00
Asias He
2abf015d82 streaming: Add PREPARE_MESSAGE handler 2015-06-17 16:08:38 +08:00
Asias He
35e5bb7c72 streaming: Add STREAM_INIT_MESSAGE handler 2015-06-17 16:08:37 +08:00
Asias He
6e83f70954 streaming: Convert SessionFailedMessage.java to C++ 2015-06-17 13:37:52 +08:00
Asias He
e86d3d7712 streaming: Convert RetryMessage.java to C++ 2015-06-17 13:37:52 +08:00
Asias He
a277df83ad streaming: Convert ReceivedMessage.java to C++ 2015-06-17 13:37:52 +08:00
Asias He
61081ce816 streaming: Convert PrepareMessage.java to C++ 2015-06-17 13:37:52 +08:00
Asias He
22346102b7 streaming: Convert FileMessageHeader.java to C++ 2015-06-17 13:37:52 +08:00
Asias He
35ccd02db3 streaming: Convert OutgoingFileMessage.java to C++ 2015-06-17 13:37:52 +08:00
Asias He
edbae6a542 streaming: Convert IncomingFileMessage.java to C++ 2015-06-17 13:37:52 +08:00
Asias He
be31293d61 streaming: Convert CompleteMessage.java to C++ 2015-06-17 13:37:52 +08:00
Asias He
082aeab0a7 streaming: Convert StreamInitMessage.java to C++ 2015-06-17 13:37:52 +08:00
Asias He
15a1d71049 streaming: Convert StreamMessage.java to C++ 2015-06-17 13:37:52 +08:00
Asias He
6393d3d707 streaming: Import StreamInitMessage.java 2015-06-17 13:37:47 +08:00
Asias He
4482c82be9 streaming: Import SessionFailedMessage.java 2015-06-17 12:47:12 +08:00
Asias He
ab373ffa1a streaming: Import RetryMessage.java 2015-06-17 12:46:55 +08:00
Asias He
f2766d86b3 streaming: Import ReceivedMessage.java 2015-06-17 12:46:31 +08:00
Asias He
06cc99d895 streaming: Import PrepareMessage.java 2015-06-17 12:45:44 +08:00
Asias He
96a5e66b62 streaming: Import OutgoingFileMessage.java 2015-06-17 12:45:25 +08:00
Asias He
0cf3d67c35 streaming: Import IncomingFileMessage.java 2015-06-17 12:45:09 +08:00
Asias He
4aad3080ea streaming: Import FileMessageHeader.java 2015-06-17 12:44:44 +08:00
Asias He
4cb06059d9 streaming: Import CompleteMessage.java 2015-06-17 12:44:09 +08:00
Asias He
e2165791f8 streaming: Import StreamMessage.java 2015-06-17 12:43:14 +08:00