mirrors/scylladb
1
0
Fork 0
mirror of https://github.com/scylladb/scylladb.git synced 2026-04-25 19:10:42 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
d845fde5609ff62358def08bf91623bcdf0dbfcd
scylladb/sstables
History
Raphael S. Carvalho c350b864e8 compaction: Short-circuit TWCS interposer if only a single time window is needed 
If we know in advance that only a single window is needed, the TWCS interposer
can be short-circuited.

perf_sstable shows up to ~14% performance regression in compaction with interposer
enabled for a table with schema containing 10 columns.

no interposer (50k partitions)
81090.77 +- 33.82 partitions / sec (100 runs, 1 concurrent ops)

TWCS interposer (50k partitions)
71149.80 +- 26.06 partitions / sec (100 runs, 1 concurrent ops)

no interposer (100k partitions)
83791.13 +- 22.65 partitions / sec (100 runs, 1 concurrent ops)

TWCS interposer (100k partitions)
72147.81 +- 13.39 partitions / sec (100 runs, 1 concurrent ops)

command used:
./build/dev/test/perf/perf_sstable --num_columns 10 --partitions 100000 \
--iterations 100 --mode compaction --sstables 1 --testdir /home/fedora/xfs \
--smp 1 --cpuset 3-3 --poll-mode

Signed-off-by: Raphael S. Carvalho <raphaelsc@scylladb.com>
Message-Id: <20200409194235.6004-3-raphaelsc@scylladb.com>
2020-04-19 17:06:05 +03:00
..
mc
sstables: Delete never overwritten methods
2020-04-17 09:16:16 +03:00
binary_search.hh
schema: get_partitioner return const&
2020-03-06 13:33:53 +01:00
checksum_utils.hh
…
column_name_helper.hh
header: De-bloat schema.hh
2020-03-03 11:34:00 +01:00
column_translation.hh
sstables: freeze types nested in collection types in legacy sstables
2020-04-16 18:44:56 +03:00
compaction_backlog_manager.hh
…
compaction_manager.cc
Revert "api: support table auto compaction control"
2020-04-11 17:56:02 +03:00
compaction_manager.hh
compaction_manager: scrub: don't piggy-back on upgrade_sstables()
2020-02-13 15:02:37 +02:00
compaction_strategy_impl.hh
…
compaction_strategy.cc
compaction: Fix partition estimation with TWCS interposer
2020-04-19 17:04:48 +03:00
compaction_weight_registration.hh
…
compaction.cc
compaction: Short-circuit TWCS interposer if only a single time window is needed
2020-04-19 17:06:05 +03:00
compaction.hh
resharding: get rid of special reshard_sstables
2020-03-31 19:57:53 -04:00
component_type.hh
treewide: add missing headers and/or forward declarations
2020-03-23 09:29:45 +02:00
compress.cc
…
compress.hh
treewide: replace calls to engine().some_api() with some_api()
2020-04-05 12:46:04 +03:00
consumer.hh
sstables/continuous_data_consumer: track buffers used for parsing
2020-01-28 08:13:16 +02:00
data_consume_context.hh
treewide: replace reader_resource_tracer with reader_permit
2020-01-28 08:13:16 +02:00
date_tiered_compaction_strategy.hh
sstables: date_tiered_compaction_strategy.hh: move methods out-of-line
2020-03-23 09:26:19 +02:00
disk_types.hh
…
downsampling.hh
treewide: add missing headers and/or forward declarations
2020-03-23 09:29:45 +02:00
exceptions.hh
treewide: add missing headers and/or forward declarations
2020-03-23 09:29:45 +02:00
filter.hh
treewide: add missing headers and/or forward declarations
2020-03-23 09:29:45 +02:00
hyperloglog.hh
treewide: add missing headers and/or forward declarations
2020-03-23 09:29:45 +02:00
index_entry.hh
index_entry: stop calling global_partitioner()
2020-02-17 10:59:15 +01:00
index_reader.hh
index_entry: stop calling global_partitioner()
2020-02-17 10:59:15 +01:00
integrity_checked_file_impl.cc
…
integrity_checked_file_impl.hh
treewide: replace calls to engine().some_api() with some_api()
2020-04-05 12:46:04 +03:00
key.hh
header: De-bloat schema.hh
2020-03-03 11:34:00 +01:00
leveled_compaction_strategy.cc
sstables/LCS: Fix increased write amplification due to incorrect SSTable demotion
2019-09-22 10:46:38 +03:00
leveled_compaction_strategy.hh
…
leveled_manifest.hh
compaction: use a larger min_threshold during bootstrap, replace
2020-04-01 10:06:27 +03:00
liveness_info.hh
…
m_format_read_helpers.cc
…
m_format_read_helpers.hh
sstables: print invalid boundary type as unsigned int
2020-04-07 10:18:19 +02:00
metadata_collector.hh
…
mp_row_consumer.cc
sstables: freeze types nested in collection types in legacy sstables
2020-04-16 18:44:56 +03:00
mp_row_consumer.hh
header: De-bloat schema.hh
2020-03-03 11:34:00 +01:00
mutation_fragment_filter.hh
…
partition.cc
dht: add dht::decorate_key
2020-02-17 10:59:06 +01:00
prepended_input_stream.cc
…
prepended_input_stream.hh
…
progress_monitor.hh
sstables: Delete never overwritten methods
2020-04-17 09:16:16 +03:00
random_access_reader.hh
treewide: add missing headers and/or forward declarations
2020-03-23 09:29:45 +02:00
remove.hh
treewide: add missing headers and/or forward declarations
2020-03-23 09:29:45 +02:00
row.hh
sstables: freeze types nested in collection types in legacy sstables
2020-04-16 18:44:56 +03:00
segmented_compress_params.hh
…
shareable_components.hh
…
shared_index_lists.hh
…
shared_sstable.hh
…
size_tiered_backlog_tracker.hh
sstables: size_tiered_backlog_tracker: move methods out-of-line
2020-03-23 09:29:45 +02:00
size_tiered_compaction_strategy.cc
compaction: use a larger min_threshold during bootstrap, replace
2020-04-01 10:06:27 +03:00
size_tiered_compaction_strategy.hh
sstables/stcs: kill FIXME
2020-03-09 15:47:48 +02:00
sstable_set.hh
…
sstable_version_k_l.hh
…
sstable_version_m.hh
…
sstable_version.cc
…
sstable_version.hh
…
sstables_manager.cc
sstable: Move sstables_manager constructor out of line
2020-03-21 19:47:29 +02:00
sstables_manager.hh
sstable: Move sstables_manager constructor out of line
2020-03-21 19:47:29 +02:00
sstables.cc
sstables: Delete never overwritten methods
2020-04-17 09:16:16 +03:00
sstables.hh
sstables: freeze types nested in collection types in legacy sstables
2020-04-16 18:44:56 +03:00
stats.hh
treewide: add missing headers and/or forward declarations
2020-03-23 09:29:45 +02:00
time_window_compaction_strategy.hh
compaction: Fix partition estimation with TWCS interposer
2020-04-19 17:04:48 +03:00
types.hh
sstables: freeze types nested in collection types in legacy sstables
2020-04-16 18:44:56 +03:00
version.hh
sstables: Move all_sstable_versions to version.hh
2020-04-17 11:34:02 +02:00
writer_impl.hh
header: De-bloat schema.hh
2020-03-03 11:34:00 +01:00
writer.hh
sstable_writer_config: Extend with more db::config stuff
2020-02-25 14:31:34 +03:00