mirrors/scylladb
1
0
Fork 0
mirror of https://github.com/scylladb/scylladb.git synced 2026-04-25 02:50:33 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
4aa5d83590e2d03fae91000b5822c30cdca3815d
scylladb/tests
History
Paweł Dziepak 4aa5d83590 Merge "Optimize sstable writing of the MC format" from Tomasz 
"
Tested with perf_fast_forward from:

  github.com/tgrabiec/scylla.git perf_fast_forward-for-sst3-opt-write-v1

Using the following command line:

  build/release/tests/perf/perf_fast_forward_g --populate --sstable-format=mc \
     --data-directory /tmp/perf-mc --rows=10000000 -c1 -m4G \
     --datasets small-part

The average reported flush throughput was (stdev for the avergages is around 4k):
  - for mc before the series: 367848 frag/s
  - for lc before the series: 463458 frag/s (= mc.before +25%)
  - for mc after the series: 429276 frag/s (= mc.before +16%)
  - for lc after the series: 466495 frag/s (= mc.before +26%)

Refs #3874.
"

* tag 'sst3-opt-write-v2' of github.com:tgrabiec/scylla:
  sstables: mc: Avoid serialization of promoted index when empty
  sstables: mc: Avoid double serialization of rows
  tests: sstable 3.x: Do not compare Statistics component
  utils: Introduce memory_data_sink
  schema: Optimize column count getters
  sstables: checksummed_file_data_sink_impl: Bypass output_stream
2018-11-21 13:11:40 +00:00
..
perf
Update seastar submodule
2018-11-21 00:01:44 +02:00
snitch_property_files
…
sstables
tests: Test writing empty static rows for partitions in tables with static columns.
2018-11-05 13:47:30 -08:00
aggregate_fcts_test.cc
Update seastar submodule
2018-11-21 00:01:44 +02:00
allocation_strategy_test.cc
…
anchorless_list_test.cc
…
auth_passwords_test.cc
auth: Shorten random_device instance life-span
2018-09-12 12:14:21 +01:00
auth_resource_test.cc
tests: convert sprint() to format()
2018-11-01 13:16:17 +00:00
auth_test.cc
query_processor: require clients to specify timeout configuration
2018-05-14 09:41:06 +03:00
batchlog_manager_test.cc
Update seastar submodule
2018-11-21 00:01:44 +02:00
big_decimal_test.cc
…
bytes_ostream_test.cc
bytes_ostream: add remove_suffix()
2018-06-25 09:21:47 +01:00
cache_flat_mutation_reader_test.cc
Update seastar submodule
2018-11-21 00:01:44 +02:00
caching_options_test.cc
…
canonical_mutation_test.cc
tests: reduce dependencies in test_services.hh
2018-03-12 20:05:23 +02:00
cartesian_product_test.cc
…
castas_fcts_test.cc
Update seastar submodule
2018-11-21 00:01:44 +02:00
cell_locker_test.cc
tests/cell_locker_test: Prevent timeout underflow
2018-06-19 16:26:52 +03:00
chunked_vector_test.cc
…
clustering_ranges_walker_test.cc
…
commitlog_test.cc
Update seastar submodule
2018-11-21 00:01:44 +02:00
compound_test.cc
…
compress_test.cc
sstables/compress: Fix race condition in segmented offset reading of shared sstable
2018-02-06 12:10:10 +02:00
config_test.cc
Update seastar submodule
2018-11-21 00:01:44 +02:00
continuous_data_consumer_test.cc
Merge seastar upstream
2018-04-29 11:03:21 +03:00
counter_test.cc
atomic_cell: introduce fragmented buffer value interface
2018-05-31 15:51:11 +01:00
cql_assertions.cc
tests: convert sprint() to format()
2018-11-01 13:16:17 +00:00
cql_assertions.hh
Update seastar submodule
2018-11-21 00:01:44 +02:00
cql_auth_query_test.cc
tests: convert sprint() to format()
2018-11-01 13:16:17 +00:00
cql_auth_syntax_test.cc
cql: Elaborate error for quoted user names
2018-03-01 12:06:59 -05:00
cql_query_test.cc
Merge "compress: Restore lz4 as default compressor" from Duarte
2018-11-21 14:20:39 +02:00
cql_test_env.cc
Update seastar submodule
2018-11-21 00:01:44 +02:00
cql_test_env.hh
Update seastar submodule
2018-11-21 00:01:44 +02:00
crc_test.cc
utils/crc: calculate crc in parallel
2018-11-01 10:19:32 +02:00
database_test.cc
tests: convert sprint() to format()
2018-11-01 13:16:17 +00:00
duration_test.cc
…
dynamic_bitset_test.cc
Merge seastar upstream
2018-04-29 11:03:21 +03:00
ec2_snitch_test.cc
locator: de-inline production_snitch_base
2018-03-11 18:22:49 +02:00
enum_set_test.cc
enum_set: Add iterator
2018-02-14 14:15:59 -05:00
eventually.hh
tests/mutation_reader_test: Extract eventually_true() to eventually.hh
2018-08-27 19:24:05 +01:00
extensions_test.cc
Extract sstable::component_type to separete header
2018-04-24 11:29:57 +02:00
failure_injecting_allocation_strategy.hh
lsa: add free() that does not require object size
2018-05-09 16:52:26 +01:00
flat_mutation_reader_assertions.hh
tests: convert sprint() to format()
2018-11-01 13:16:17 +00:00
flat_mutation_reader_test.cc
tests: convert sprint() to format()
2018-11-01 13:16:17 +00:00
flush_queue_test.cc
tests/flush_queue_test: Don't assume continuations run immediately
2018-03-05 15:22:33 +02:00
fragmented_temporary_buffer_test.cc
utils: fragmented_temporary_buffer::view: add remove_prefix()
2018-09-18 17:22:59 +01:00
frozen_mutation_test.cc
atomic_cell_or_collection: make operator<< show cell content
2018-10-24 13:29:51 +03:00
gce_snitch_test.cc
locator: de-inline production_snitch_base
2018-03-11 18:22:49 +02:00
gossip_test.cc
Update seastar submodule
2018-11-21 00:01:44 +02:00
gossip.cc
Update seastar submodule
2018-11-21 00:01:44 +02:00
gossiping_property_file_snitch_test.cc
…
hash_test.cc
…
hint_test.cc
Update seastar submodule
2018-11-21 00:01:44 +02:00
idl_test.cc
tests: fix a typo in idl_test.cc
2018-06-15 09:56:45 +01:00
imr_test.cc
tests/imr: add test for exception safety in imr::utils::object::make()
2018-08-01 16:50:58 +01:00
index_reader_assertions.hh
tests: convert sprint() to format()
2018-11-01 13:16:17 +00:00
input_stream_test.cc
…
json_cql_query_test.cc
Update seastar submodule
2018-11-21 00:01:44 +02:00
json_test.cc
tests: add JSON unit test
2018-07-25 13:16:06 +02:00
keys_test.cc
keys_test: add a test for nodetool_style string
2018-05-28 18:12:12 +03:00
limiting_data_source_test.cc
Add tests for make_limiting_data_source
2018-04-16 21:00:35 +02:00
loading_cache_test.cc
tests: loading_cache_test: configure a validity timeout in test_loading_cache_loading_different_keys to a greater value
2018-09-05 10:19:59 +03:00
log_heap_test.cc
…
logalloc_test.cc
Merge seastar upstream
2018-10-25 12:53:30 +03:00
lsa_async_eviction_test.cc
Update seastar submodule
2018-11-21 00:01:44 +02:00
lsa_sync_eviction_test.cc
Update seastar submodule
2018-11-21 00:01:44 +02:00
make_random_string.hh
…
managed_vector_test.cc
…
map_difference_test.cc
…
memory_footprint.cc
treewide: require type for creating atomic_cell
2018-05-31 15:51:11 +01:00
memtable_snapshot_source.hh
flat_mutation_reader: make timeout opt-out rather than opt-in
2018-09-20 11:31:24 +02:00
memtable_test.cc
Update seastar submodule
2018-11-21 00:01:44 +02:00
message.cc
Update seastar submodule
2018-11-21 00:01:44 +02:00
meta_test.cc
tests: introduce tests for metaprogramming helpers
2018-05-31 10:09:01 +01:00
multishard_mutation_query_test.cc
tests: convert sprint() to format()
2018-11-01 13:16:17 +00:00
multishard_writer_test.cc
flat_mutation_reader: make timeout opt-out rather than opt-in
2018-09-20 11:31:24 +02:00
murmur_hash_test.cc
Update seastar submodule
2018-11-21 00:01:44 +02:00
mutation_assertions.hh
tests: convert sprint() to format()
2018-11-01 13:16:17 +00:00
mutation_diff
tests: mutation_diff: Ignore differences in memory addresses
2018-07-17 16:32:04 +03:00
mutation_fragment_test.cc
flat_mutation_reader: make timeout opt-out rather than opt-in
2018-09-20 11:31:24 +02:00
mutation_query_test.cc
Update seastar submodule
2018-11-21 00:01:44 +02:00
mutation_reader_test.cc
Update seastar submodule
2018-11-21 00:01:44 +02:00
mutation_source_test.cc
random_mutation_generator: Add row_marker to rows regardless of whether they're deleted.
2018-11-16 13:17:07 +01:00
mutation_source_test.hh
tests: Allow random_mutation_generator to generate mutations belong to remote shrard
2018-06-28 17:20:28 +08:00
mutation_test.cc
Update seastar submodule
2018-11-21 00:01:44 +02:00
mvcc_test.cc
tests: convert sprint() to format()
2018-11-01 13:16:17 +00:00
network_topology_strategy_test.cc
Update seastar submodule
2018-11-21 00:01:44 +02:00
nonwrapping_range_test.cc
…
normalizing_reader.cc
Update seastar submodule
2018-11-21 00:01:44 +02:00
normalizing_reader.hh
Update seastar submodule
2018-11-21 00:01:44 +02:00
observable_test.cc
observable: allow an observable to disconnect() twice without penalty
2018-07-11 10:15:01 +01:00
partition_data_test.cc
tests: test imr representation of cells
2018-05-31 15:51:11 +01:00
partitioner_test.cc
tests: fix compilation of partitioner_test with boost 1.68 on IBM Z
2018-11-21 11:43:42 +02:00
perf_row_cache_update.cc
Update seastar submodule
2018-11-21 00:01:44 +02:00
querier_cache.cc
tests: convert sprint() to format()
2018-11-01 13:16:17 +00:00
query_processor_test.cc
Update seastar submodule
2018-11-21 00:01:44 +02:00
random-utils.hh
tests/random-utils: print seed
2018-07-18 12:28:06 +01:00
range_assert.hh
…
range_test.cc
…
range_tombstone_list_assertions.hh
tests: convert sprint() to format()
2018-11-01 13:16:17 +00:00
range_tombstone_list_test.cc
tests: convert sprint() to format()
2018-11-01 13:16:17 +00:00
result_set_assertions.cc
tests: convert sprint() to format()
2018-11-01 13:16:17 +00:00
result_set_assertions.hh
…
reusable_buffer_test.cc
tests/reusable_buffer: test fragmented_temporary_buffer support
2018-07-18 12:28:06 +01:00
role_manager_test.cc
auth: Remove unused "performer" argument
2018-02-14 14:15:58 -05:00
row_cache_alloc_stress.cc
Update seastar submodule
2018-11-21 00:01:44 +02:00
row_cache_stress_test.cc
Update seastar submodule
2018-11-21 00:01:44 +02:00
row_cache_test.cc
Update seastar submodule
2018-11-21 00:01:44 +02:00
row_locker_test.cc
db: add row locking metrics
2018-05-22 16:52:58 +02:00
schema_change_test.cc
cql3: schema_change_test: add test_multiple_columns_add_and_drop
2018-10-07 19:14:29 +03:00
schema_registry_test.cc
schema_tables: Require context object in schema load path
2018-02-07 10:11:46 +00:00
secondary_index_test.cc
tests: convert sprint() to format()
2018-11-01 13:16:17 +00:00
serialized_action_test.cc
tests/serialized_action_test: Don't rely on task execution order
2018-02-19 13:08:58 +00:00
simple_schema.hh
tests: convert sprint() to format()
2018-11-01 13:16:17 +00:00
snitch_reset_test.cc
…
sstable_3_x_test.cc
Merge "Optimize sstable writing of the MC format" from Tomasz
2018-11-21 13:11:40 +00:00
sstable_datafile_test.cc
Merge "compress: Restore lz4 as default compressor" from Duarte
2018-11-21 14:20:39 +02:00
sstable_mutation_test.cc
Update seastar submodule
2018-11-21 00:01:44 +02:00
sstable_resharding_test.cc
Update seastar submodule
2018-11-21 00:01:44 +02:00
sstable_test.cc
Update seastar submodule
2018-11-21 00:01:44 +02:00
sstable_test.hh
Update seastar submodule
2018-11-21 00:01:44 +02:00
sstable_utils.cc
database, sstables, tests: add large_partition_handler
2018-05-04 14:38:13 +02:00
sstable_utils.hh
tests: Allow random_mutation_generator to generate mutations belong to remote shrard
2018-06-28 17:20:28 +08:00
storage_proxy_test.cc
tests: convert sprint() to format()
2018-11-01 13:16:17 +00:00
streaming_histogram_test.cc
…
test_services.hh
tests: reduce dependencies in test_services.hh
2018-03-12 20:05:23 +02:00
test-serialization.cc
…
tmpdir.hh
…
top_k_test.cc
Space-Saving Top-k algorithm for handling stream summary statistics
2018-10-28 10:10:28 +02:00
total_order_check.hh
tests: convert sprint() to format()
2018-11-01 13:16:17 +00:00
transport_test.cc
transport: switch to fragmented_temporary_buffer
2018-07-18 12:28:06 +01:00
types_test.cc
Update seastar submodule
2018-11-21 00:01:44 +02:00
UUID_test.cc
tests/uuid: add more tests including make_randm_uuid()
2018-07-26 12:03:37 +01:00
view_build_test.cc
db/view/view_builder: Don't timeout waiting for view to be built
2018-11-15 19:41:43 +02:00
view_complex_test.cc
view_complex_test: fix another ttl
2018-11-15 18:03:28 +02:00
view_schema_test.cc
db/view/view_builder: Don't timeout waiting for view to be built
2018-11-15 19:41:43 +02:00
vint_serialization_test.cc
Cover serialized_size_from_first_byte in tests
2018-04-16 20:26:44 +02:00
virtual_reader_test.cc
Update seastar submodule
2018-11-21 00:01:44 +02:00