mirrors/scylladb
1
0
Fork 0
mirror of https://github.com/scylladb/scylladb.git synced 2026-05-12 19:02:12 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
b3ff37e67fd4a4df31793fc59c17295afa512cd7
scylladb/tests
History
Nadav Har'El b3ff37e67f repair: iterator over subranges instead of list 
When starting repair, we divided the large token ranges (vnodes) linto small
subranges of a desired length (around 100 partition), and built a huge list
of those subranges - to iterate over them later and compare checksums of
those chunks.

However, building this list up-front is completely unnecessary, and wastes
a lot of memory: In a test with 1 TB of data, as much as 3 gigabytes was
spent on this list. Instead, what we do in this patch is to find the next
chunk in a DFS-like splitting algorithm, using only the token range
midpoint() function (as before). The amount of memory needed for this is
O(logN), instead of O(N) in the previous implementation.

Refs #2430.

Signed-off-by: Nadav Har'El <nyh@scylladb.com>
2017-06-07 08:50:56 +08:00
..
perf
Merge seatar upstream (seastar namespace)
2017-05-21 12:26:15 +03:00
snitch_property_files
…
sstables
tests/sstables: test reading and writing counters
2017-02-02 10:35:14 +00:00
allocation_strategy_test.cc
build: support for linking statically with boost
2016-10-26 08:51:21 +03:00
anchorless_list_test.cc
build: support for linking statically with boost
2016-10-26 08:51:21 +03:00
auth_test.cc
build: support for linking statically with boost
2016-10-26 08:51:21 +03:00
batchlog_manager_test.cc
Merge seatar upstream (seastar namespace)
2017-05-21 12:26:15 +03:00
bytes_ostream_test.cc
build: support for linking statically with boost
2016-10-26 08:51:21 +03:00
canonical_mutation_test.cc
tests/canonical_mutation: don't try to upgrade incompatible schemas
2017-02-07 15:17:14 +00:00
cartesian_product_test.cc
build: support for linking statically with boost
2016-10-26 08:51:21 +03:00
cell_locker_test.cc
cell_locker: add metrics for lock acquisition
2017-03-02 09:05:12 +00:00
commitlog_test.cc
tests: Remove unintentional enablement of trace-level logging
2016-12-14 10:58:07 +01:00
compound_test.cc
compound_compat: Return composite from serialize_value()
2017-03-28 18:10:39 +02:00
config_test.cc
build: support for linking statically with boost
2016-10-26 08:51:21 +03:00
counter_test.cc
tests/counter: test transform_counter_updates_to_shards
2017-04-28 16:29:34 +01:00
cql_assertions.cc
Merge seatar upstream (seastar namespace)
2017-05-21 12:26:15 +03:00
cql_assertions.hh
Merge seatar upstream (seastar namespace)
2017-05-21 12:26:15 +03:00
cql_query_test.cc
Merge seatar upstream (seastar namespace)
2017-05-21 12:26:15 +03:00
cql_test_env.cc
Merge seatar upstream (seastar namespace)
2017-05-21 12:26:15 +03:00
cql_test_env.hh
Merge seatar upstream (seastar namespace)
2017-05-21 12:26:15 +03:00
crc_test.cc
utils: Put crc32 under utils namespace
2016-12-05 11:48:29 +02:00
database_test.cc
storage_proxy: pass maximum result size to replicas
2016-12-22 17:16:23 +01:00
dynamic_bitset_test.cc
build: support for linking statically with boost
2016-10-26 08:51:21 +03:00
ec2_snitch_test.cc
build: support for linking statically with boost
2016-10-26 08:51:21 +03:00
flush_queue_test.cc
Merge seatar upstream (seastar namespace)
2017-05-21 12:26:15 +03:00
frozen_mutation_test.cc
build: support for linking statically with boost
2016-10-26 08:51:21 +03:00
gossip_test.cc
Merge seatar upstream (seastar namespace)
2017-05-21 12:26:15 +03:00
gossip.cc
Merge seatar upstream (seastar namespace)
2017-05-21 12:26:15 +03:00
gossiping_property_file_snitch_test.cc
build: support for linking statically with boost
2016-10-26 08:51:21 +03:00
hash_test.cc
build: support for linking statically with boost
2016-10-26 08:51:21 +03:00
idl_test.cc
Merge seatar upstream (seastar namespace)
2017-05-21 12:26:15 +03:00
input_stream_test.cc
build: support for linking statically with boost
2016-10-26 08:51:21 +03:00
keys_test.cc
build: support for linking statically with boost
2016-10-26 08:51:21 +03:00
log_histogram_test.cc
tests: log_historgram_test: Fix compiation on Ubuntu
2017-04-25 12:15:28 +03:00
logalloc_test.cc
logalloc: reduce descriptor overhead
2017-04-24 12:23:12 +02:00
lsa_async_eviction_test.cc
tests: lsa_async_eviction_test: Allocate objects under allocating section
2017-03-16 10:21:10 +01:00
lsa_sync_eviction_test.cc
Fix pre-ScyllaDB copyright statements
2016-04-08 08:12:47 +03:00
make_random_string.hh
tests: Extract simple_schema
2017-03-10 14:42:22 +01:00
managed_vector_test.cc
build: support for linking statically with boost
2016-10-26 08:51:21 +03:00
map_difference_test.cc
build: support for linking statically with boost
2016-10-26 08:51:21 +03:00
memory_footprint.cc
drop key readers
2016-10-19 15:29:08 +01:00
memtable_test.cc
database: rework dirty memory hierarchy
2016-12-13 14:07:53 -05:00
message.cc
Merge seatar upstream (seastar namespace)
2017-05-21 12:26:15 +03:00
murmur_hash_test.cc
build: support for linking statically with boost
2016-10-26 08:51:21 +03:00
mutation_assertions.hh
tests: Extract ensure_monotonic_positions() to streamed_mutation_assertions
2017-03-10 14:42:22 +01:00
mutation_query_test.cc
db: Enable creating forwardable readers via mutation_source
2017-02-23 18:50:44 +01:00
mutation_reader_assertions.hh
tests: mutation_reader_assertions: Log expectations
2017-04-27 18:43:49 +02:00
mutation_reader_test.cc
Convert to use dht::partition_range_vector and dht::token_range_vector
2016-12-19 14:08:50 +08:00
mutation_source_test.cc
Merge "Fix fast_forward_to() on sstable reader being ignored in some cases" from Tomasz
2017-05-17 15:35:30 +01:00
mutation_source_test.hh
tests: Add range generators to random_mutation_generator
2017-02-23 18:50:53 +01:00
mutation_test.cc
mutation: Make compare_*_for_merge() consistent with equals()
2017-05-23 13:35:03 +02:00
network_topology_strategy_test.cc
Merge seatar upstream (seastar namespace)
2017-05-21 12:26:15 +03:00
nonwrapping_range_test.cc
Convert to use dht::partition_range
2016-12-19 08:04:30 +08:00
partitioner_test.cc
repair: iterator over subranges instead of list
2017-06-07 08:50:56 +08:00
perf_row_cache_update.cc
db: Use incremental selector in partition_presence_checker
2016-12-19 14:20:58 +01:00
query_processor_test.cc
build: support for linking statically with boost
2016-10-26 08:51:21 +03:00
range_assert.hh
Fix pre-ScyllaDB copyright statements
2016-04-08 08:12:47 +03:00
range_test.cc
tests: Add test case for nonwrapping_range::intersection()
2017-05-17 10:33:18 +02:00
range_tombstone_list_test.cc
tests: range_tombstone_list_test: Improve error message
2017-05-23 13:16:03 +02:00
result_set_assertions.cc
Merge "Fix query digest mismatch" from Tomasz
2016-04-08 12:13:29 +03:00
result_set_assertions.hh
Merge "Fix query digest mismatch" from Tomasz
2016-04-08 12:13:29 +03:00
row_cache_alloc_stress.cc
db: Use incremental selector in partition_presence_checker
2016-12-19 14:20:58 +01:00
row_cache_test.cc
tests: row_cache_test: Induce update failure more reliably
2017-04-20 14:51:47 +02:00
schema_change_test.cc
v3 schema test fixes
2017-05-10 16:44:48 +00:00
schema_registry_test.cc
build: support for linking statically with boost
2016-10-26 08:51:21 +03:00
simple_schema.hh
tests: sstable: Add test for fast forwarding within partition using index
2017-03-28 18:34:55 +02:00
snitch_reset_test.cc
build: support for linking statically with boost
2016-10-26 08:51:21 +03:00
sstable_atomic_deletion_test.cc
sstables: add unit tests for atomic deletion
2016-11-04 15:48:43 +02:00
sstable_datafile_test.cc
sstables: Introduce sstable::as_mutation_source()
2017-05-25 19:30:20 +03:00
sstable_mutation_test.cc
sstables: Introduce sstable::as_mutation_source()
2017-05-25 19:30:20 +03:00
sstable_resharding_test.cc
sstables: Introduce sstable::as_mutation_source()
2017-05-25 19:30:20 +03:00
sstable_test.cc
sstables: Read and write shadowable tombstones
2017-04-25 11:46:33 +02:00
sstable_test.hh
sstables: Introduce sstable::as_mutation_source()
2017-05-25 19:30:20 +03:00
storage_proxy_test.cc
Convert to use dht::partition_range_vector and dht::token_range_vector
2016-12-19 14:08:50 +08:00
streamed_mutation_test.cc
tests: Add tests for ordering of position_in_partition relative to composites
2017-03-28 18:10:39 +02:00
test_services.hh
Merge seatar upstream (seastar namespace)
2017-05-21 12:26:15 +03:00
test-serialization.cc
utils::serialization: remove not used deserialization_xxx() functions
2017-05-26 19:26:20 +03:00
tmpdir.hh
Fix pre-ScyllaDB copyright statements
2016-04-08 08:12:47 +03:00
total_order_check.hh
utils: Extract to_boost_visitor() to a separate header
2017-05-22 19:30:02 +02:00
types_test.cc
Merge "Migrate schema tables to v3 format" from Calle
2017-05-17 11:25:52 +03:00
UUID_test.cc
utils::UUID: operator< should behave as comparison of hex strings/bytes
2017-02-22 09:19:22 +00:00
view_schema_test.cc
tests/view_schema_test: Add more test cases
2017-05-17 11:21:58 +02:00
virtual_reader_test.cc
tests: Fix failure virtual_reader_test
2017-04-23 14:06:35 +03:00