Asias He 54d482afe4 streaming: Test both pushing and pulling of data ...

stream_plan.transfer_ranges() sends data from local to remote node.

stream_plan.request_ranges() asks remote to send data to local.

After streaming, both nodes contains all the keys.

$ cat /tmp/out1|grep "\[Stream"
[Stream #9fd8c3c0-3023-11e5-b450-000000000000] Executing streaming plan for MYPLAN
[Stream #9fd8c3c0-3023-11e5-b450-000000000000] Starting streaming to 127.0.0.2
[Stream #9fd8c3c0-3023-11e5-b450-000000000000] Sending stream init for incoming stream
[Stream #9fd8c3c0-3023-11e5-b450-000000000000 ID#0] Beginning stream session with 127.0.0.2
[Stream #9fd8c3c0-3023-11e5-b450-000000000000 ID#0] Prepare completed.  Receiving 1 files(105553124400080 bytes), sending 1 files(105553124104160 bytes)
[Stream #9fd8c3c0-3023-11e5-b450-000000000000] Session with 127.0.0.2 is complete
[Stream #9fd8c3c0-3023-11e5-b450-000000000000] All sessions completed

$ cat /tmp/out2|grep "\[Stream"
[Stream #9fd8c3c0-3023-11e5-b450-000000000000 ID#0] Creating new streaming plan for MYPLAN
[Stream #9fd8c3c0-3023-11e5-b450-000000000000 ID#0] Received streaming plan for MYPLAN
[Stream #9fd8c3c0-3023-11e5-b450-000000000000 ID#0] Prepare completed.  Receiving 1 files(105553124104160 bytes), sending 1 files(105553124400080 bytes)
[Stream #9fd8c3c0-3023-11e5-b450-000000000000] Session with 127.0.0.1 is complete
[Stream #9fd8c3c0-3023-11e5-b450-000000000000] All sessions completed

Node 1
$ sstable2json tmp/1/ks/*/la-1-big-Data.db | grep key | sort
{"key": "1",
{"key": "2",
{"key": "3",
{"key": "4",
{"key": "5",
{"key": "6",

Node 2
$ sstable2json tmp/2/ks/*/la-1-big-Data.db | grep key | sort
{"key": "1",
{"key": "2",
{"key": "3",
{"key": "4",
{"key": "5",
{"key": "6",

2015-07-22 11:49:30 +08:00

..

compress

streaming: Convert CompressionInfo.java to C++

2015-06-23 16:06:28 +08:00

messages

streaming: Fix prepare_message and stream_request deserialization

2015-07-22 11:49:30 +08:00

progress_info.cc

streaming: Convert ProgressInfo.java to C++

2015-06-18 23:02:31 +08:00

progress_info.hh

streaming: Complete session_info

2015-06-24 16:13:30 +08:00

session_info.cc

streaming: Complete session_info

2015-06-24 16:13:30 +08:00

session_info.hh

streaming: Rename getTotalFilesToSend to get_total_files_to_send

2015-07-21 16:12:54 +08:00

stream_coordinator.cc

streaming: Fix info printout format

2015-07-22 11:49:30 +08:00

stream_coordinator.hh

streaming: Enable logger in stream_coordinator

2015-07-21 16:12:54 +08:00

stream_detail.hh

streaming: Wire up stream_transfer_task::add_transfer_file

2015-07-09 15:52:27 +08:00

stream_event_handler.hh

streaming: Implement stream_result_future::handle_session_prepared

2015-07-21 16:12:54 +08:00

stream_event.hh

streaming: Swith to use shared_ptr from std::shared_ptr

2015-07-14 20:41:14 +08:00

stream_manager.cc

streaming: Convert StreamManager.java to C++

2015-07-14 20:41:14 +08:00

stream_manager.hh

streaming: Start stream_manager on startup

2015-07-14 20:41:14 +08:00

stream_plan.cc

streaming: Hold a shared_ptr inside stream_plan

2015-07-14 20:41:14 +08:00

stream_plan.hh

streaming: Hold a shared_ptr inside stream_plan

2015-07-14 20:41:14 +08:00

stream_receive_task.cc

streaming: Swith to use shared_ptr from std::shared_ptr

2015-07-14 20:41:14 +08:00

stream_receive_task.hh

streaming: Swith to use shared_ptr from std::shared_ptr

2015-07-14 20:41:14 +08:00

stream_request.cc

streaming: Improve query::range<token> deserialization a bit

2015-07-22 11:49:30 +08:00

stream_request.hh

streaming: Add operator<< for stream_request

2015-07-22 11:49:30 +08:00

stream_result_future.cc

streaming: Fix a logger printout

2015-07-21 16:12:54 +08:00

stream_result_future.hh

streaming: Register to stream_manager in create_and_register

2015-07-21 16:12:54 +08:00

stream_session_state.hh

streaming: Add stream_session_state

2015-06-24 16:13:30 +08:00

stream_session.cc

streaming: Test both pushing and pulling of data

2015-07-22 11:49:30 +08:00

stream_session.hh

streaming: Implement session completion logic

2015-07-21 16:12:54 +08:00

stream_state.hh

streaming: Implement stream_result_future::handle_session_complete

2015-07-21 16:12:54 +08:00

stream_summary.cc

utils: Move util/serialization.hh to utils/serialization.hh

2015-07-21 16:12:54 +08:00

stream_summary.hh

streaming: Implement serialize interface for prepare_message

2015-06-30 11:43:29 +08:00

stream_task.cc

streaming: Swith to use shared_ptr from std::shared_ptr

2015-07-14 20:41:14 +08:00

stream_task.hh

streaming: Swith to use shared_ptr from std::shared_ptr

2015-07-14 20:41:14 +08:00

stream_transfer_task.cc

streaming: Implement stream_transfer_task completion logic

2015-07-21 16:12:54 +08:00

stream_transfer_task.hh

streaming: Add stream_transfer_task::complete

2015-07-21 16:12:54 +08:00

streaming.cc

streaming: Convert StreamManager.java to C++

2015-07-14 20:41:14 +08:00