mirrors/scylladb
1
0
Fork 0
mirror of https://github.com/scylladb/scylladb.git synced 2026-06-03 13:37:04 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
52f7ff4ee4803ce2952fc58d57b1304a2864d8a9
scylladb/sstables
History
Raphael S. Carvalho ee39eb9042 sstables: Fix slow off-strategy compaction on STCS tables 
Off-strategy compaction on a table using STCS is slow because of
the needless write amplification of 2. That's because STCS reshape
isn't taking advantage of the fact that sstables produced by
a repair-based operation are disjoint. So the ~256 input sstables
were compacted (in batches of 32) into larger sstables, which in
turn were compacted into even larger ones. That write amp is very
significant on large data sets, making the whole operation 2x
slower.

Fixes #8449.

Signed-off-by: Raphael S. Carvalho <raphaelsc@scylladb.com>
Message-Id: <20210524213426.196407-1-raphaelsc@scylladb.com>
2021-05-25 11:24:42 +03:00
..
kl
Merge 'sstables: remove large allocations when parsing cells' from Wojciech Mitros
2021-04-22 15:38:10 +02:00
mx
Merge "treewide: various header cleanups" from Pavel S
2021-05-24 14:24:20 +03:00
binary_search.hh
…
checksum_utils.hh
…
column_translation.hh
treewide: reduce boost headers usage in scylla header files
2021-05-20 01:33:18 +03:00
compaction_backlog_manager.hh
…
compaction_descriptor.hh
sstables: compaction/scrub: add segregate mode
2021-05-05 14:33:49 +03:00
compaction_manager.cc
Merge "Introduce segregate scrub mode" from Botond
2021-05-18 13:43:01 +03:00
compaction_manager.hh
sstables: compaction/scrub: replace skip_corrupted with mode enum
2021-05-05 12:03:42 +03:00
compaction_strategy_impl.hh
…
compaction_strategy.cc
treewide: remove extraneous database.hh includes from headers
2021-05-20 01:59:14 +03:00
compaction_weight_registration.hh
…
compaction.cc
compaction: resharding_compaction: drop unused _shard field
2021-05-21 21:01:54 +03:00
compaction.hh
sstables: compaction/scrub: replace skip_corrupted with mode enum
2021-05-05 12:03:42 +03:00
component_type.hh
…
compress.cc
sstables: Report buffer size from compressed file sink
2021-05-04 12:01:27 +03:00
compress.hh
…
consumer.hh
sstables: index_reader: mark close noexcept
2021-04-25 11:16:10 +03:00
date_tiered_compaction_strategy.hh
…
disk_types.hh
…
downsampling.hh
…
exceptions.hh
…
filter.hh
…
hyperloglog.hh
…
index_entry.hh
sstables: index_reader: mark close noexcept
2021-04-25 11:16:10 +03:00
index_reader.hh
sstables: index_consumer: drop unused max_quantity field
2021-05-21 21:02:16 +03:00
integrity_checked_file_impl.cc
files: Construct file_impls properly
2021-03-26 00:22:11 +01:00
integrity_checked_file_impl.hh
…
key.hh
…
leveled_compaction_strategy.cc
treewide: remove extraneous database.hh includes from headers
2021-05-20 01:59:14 +03:00
leveled_compaction_strategy.hh
treewide: remove extraneous database.hh includes from headers
2021-05-20 01:59:14 +03:00
leveled_manifest.hh
treewide: remove extraneous database.hh includes from headers
2021-05-20 01:59:14 +03:00
liveness_info.hh
…
m_format_read_helpers.cc
…
m_format_read_helpers.hh
sstables: read_vint(): convert enable_if to concepts
2021-03-18 18:45:05 +02:00
metadata_collector.cc
…
metadata_collector.hh
…
mutation_fragment_filter.hh
…
open_info.hh
…
prepended_input_stream.cc
…
prepended_input_stream.hh
…
progress_monitor.hh
…
promoted_index_blocks_reader.hh
sstables: add non-contiguous parsing of byte strings to the primitive_consumer
2021-03-31 12:09:52 +02:00
random_access_reader.cc
…
random_access_reader.hh
…
scanning_clustered_index_cursor.hh
sstables: index_reader: mark close noexcept
2021-04-25 11:16:10 +03:00
segmented_compress_params.hh
…
shareable_components.hh
…
shared_index_lists.hh
…
shared_sstable.hh
Revert "Merge 'sstables: add versioning to the sstable_set ' from Wojciech Mitros"
2021-03-02 13:21:22 +02:00
size_tiered_backlog_tracker.hh
…
size_tiered_compaction_strategy.cc
sstables: Fix slow off-strategy compaction on STCS tables
2021-05-25 11:24:42 +03:00
size_tiered_compaction_strategy.hh
treewide: remove extraneous database.hh includes from headers
2021-05-20 01:59:14 +03:00
sstable_directory.cc
…
sstable_directory.hh
…
sstable_mutation_reader.cc
treewide: reduce boost headers usage in scylla header files
2021-05-20 01:33:18 +03:00
sstable_mutation_reader.hh
sstables: sstable_mutation_reader: implement close
2021-04-25 11:16:10 +03:00
sstable_set_impl.hh
time_series_sstable_set: return partition start if some sstables were ck-filtered out
2021-04-14 13:16:00 +02:00
sstable_set.cc
treewide: remove extraneous database.hh includes from headers
2021-05-20 01:59:14 +03:00
sstable_set.hh
sstables: Extract code to count amount of overlapping into a function
2021-04-21 11:03:16 -03:00
sstable_version_k_l.hh
…
sstable_version_m.hh
…
sstable_version.cc
…
sstable_version.hh
…
sstables_manager.cc
sstables,test: remove variables depending on old features
2021-03-30 09:37:41 +02:00
sstables_manager.hh
…
sstables.cc
sstables: parse statistics: improve error handling
2021-05-24 15:12:48 +03:00
sstables.hh
sstables: make the _open field more useful
2021-05-12 03:48:07 +03:00
stats.hh
statistics: add some sstable management metrics
2021-05-12 03:48:07 +03:00
time_window_compaction_strategy.cc
treewide: remove extraneous database.hh includes from headers
2021-05-20 01:59:14 +03:00
time_window_compaction_strategy.hh
treewide: reduce boost headers usage in scylla header files
2021-05-20 01:33:18 +03:00
types.hh
sstables: convert write() to concepts
2021-03-18 19:26:43 +02:00
version.hh
…
writer_impl.hh
mutation_fragment_stream_validating_filter: make validation levels more fine-grained
2021-03-01 07:49:23 +02:00
writer.cc
…
writer.hh
sstables/writer: remove extraneous service/storage_service.hh include
2021-05-20 02:03:24 +03:00