mirrors/scylladb
1
0
Fork 0
mirror of https://github.com/scylladb/scylladb.git synced 2026-05-30 11:36:54 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
bcbb39999b04c803e1e136e5ae83b980f07e554b
scylladb/sstables
History
Raphael S. Carvalho bcbb39999b LCS: Fix terrible write amplification when reshaping level 0 
LCS reshape is basically 'major compacting' level 0 until it contains less than
N sstables.

That produces terrible write amplification, because any given byte will be
compacted (initial # of sstables / max_threshold (32)) times. So if L0 initially
contained 256 ssts, there would be a WA of about 8.

This terrible write amplification can be reduced by performing STCS instead on
L0, which will leave L0 in a good shape without hurting WA as it happens
now.

Fixes #8345.

Signed-off-by: Raphael S. Carvalho <raphaelsc@scylladb.com>
Message-Id: <20210322150655.27011-1-raphaelsc@scylladb.com>
2021-03-24 17:48:50 +02:00
..
kl
sstable: writer: ka/la: Write row marker cell after row tombstone
2021-03-23 16:13:47 +01:00
mx
sstables: move promoted_index_blocks_reader into own header
2021-03-18 11:15:59 +02:00
binary_search.hh
…
checksum_utils.hh
…
column_translation.hh
…
compaction_backlog_manager.hh
…
compaction_descriptor.hh
…
compaction_manager.cc
sstables/compaction_manager: Add function to submit off-strategy work
2021-03-18 11:47:49 -03:00
compaction_manager.hh
sstables/compaction_manager: Add function to submit off-strategy work
2021-03-18 11:47:49 -03:00
compaction_strategy_impl.hh
…
compaction_strategy.cc
sstable_set: preparatory work to change sstable_set::all() api
2021-03-10 12:02:12 -03:00
compaction_weight_registration.hh
…
compaction.cc
compaction: introduce function to map compaction name to respective type
2021-03-11 09:29:59 -03:00
compaction.hh
compaction: introduce function to map compaction name to respective type
2021-03-11 09:29:59 -03:00
component_type.hh
…
compress.cc
…
compress.hh
sstables: remove std::iterator from const_iterator
2020-11-17 16:53:20 +01:00
consumer.hh
…
date_tiered_compaction_strategy.hh
…
disk_types.hh
…
downsampling.hh
…
exceptions.hh
…
filter.hh
…
hyperloglog.hh
…
index_entry.hh
sstables: move promoted_index_blocks_reader into own header
2021-03-18 11:15:59 +02:00
index_reader.hh
sstables: Share partition index pages between readers
2021-02-04 15:24:07 +01:00
integrity_checked_file_impl.cc
…
integrity_checked_file_impl.hh
…
key.hh
…
leveled_compaction_strategy.cc
LCS: Fix terrible write amplification when reshaping level 0
2021-03-24 17:48:50 +02:00
leveled_compaction_strategy.hh
…
leveled_manifest.hh
…
liveness_info.hh
…
m_format_read_helpers.cc
…
m_format_read_helpers.hh
sstables: read_vint(): convert enable_if to concepts
2021-03-18 18:45:05 +02:00
metadata_collector.cc
keys, compound: switch from bytes_view to managed_bytes_view
2021-01-08 14:16:08 +01:00
metadata_collector.hh
…
mutation_fragment_filter.hh
…
open_info.hh
…
prepended_input_stream.cc
…
prepended_input_stream.hh
…
progress_monitor.hh
…
promoted_index_blocks_reader.hh
sstables: move promoted_index_blocks_reader into own header
2021-03-18 11:15:59 +02:00
random_access_reader.cc
…
random_access_reader.hh
…
scanning_clustered_index_cursor.hh
sstables: move promoted_index_blocks_reader into own header
2021-03-18 11:15:59 +02:00
segmented_compress_params.hh
…
shareable_components.hh
…
shared_index_lists.hh
…
shared_sstable.hh
Revert "Merge 'sstables: add versioning to the sstable_set ' from Wojciech Mitros"
2021-03-02 13:21:22 +02:00
size_tiered_backlog_tracker.hh
…
size_tiered_compaction_strategy.cc
reshape: STCS: preserve token contiguity when reshaping disjoint sstables
2021-03-18 11:36:18 -03:00
size_tiered_compaction_strategy.hh
…
sstable_directory.cc
distributed_loader: Add get_sstables_from_upload_dir
2021-01-16 20:03:17 +08:00
sstable_directory.hh
distributed_loader: Add get_sstables_from_upload_dir
2021-01-16 20:03:17 +08:00
sstable_mutation_reader.cc
sstables: get rid of mp_row_consumer.{hh,cc}
2021-03-11 12:17:13 +02:00
sstable_mutation_reader.hh
sstables: get rid of mp_row_consumer.{hh,cc}
2021-03-11 12:17:13 +02:00
sstable_set_impl.hh
sstable_set: Introduce compound sstable set
2021-03-18 11:42:49 -03:00
sstable_set.cc
sstables: clean up partitioned_sstable_set::insert()
2021-03-22 15:30:32 +02:00
sstable_set.hh
table: extend add_sstable_and_update_cache() for off-strategy
2021-03-18 11:47:49 -03:00
sstable_version_k_l.hh
…
sstable_version_m.hh
…
sstable_version.cc
…
sstable_version.hh
…
sstables_manager.cc
sstables: enable token monotonicity validation by default
2021-03-01 07:49:23 +02:00
sstables_manager.hh
sstables: sstable_writer_config: add origin member
2021-02-01 16:45:52 +02:00
sstables.cc
Merge 'sstables: convert enable_if to equivalent concepts' from Avi Kivity
2021-03-18 23:09:34 +02:00
sstables.hh
dht: ring_position, decorated_key: convert tri_comparators to std::strong_ordering
2021-03-18 12:40:05 +02:00
stats.hh
sstables: stats: remove now unused sstable_partition_reads counter
2021-01-27 17:38:17 +02:00
time_window_compaction_strategy.cc
reshape/TWCS: Fix off-by-one in threshold check
2021-02-24 15:12:40 +02:00
time_window_compaction_strategy.hh
sstables: use time_series_sstable_set in time_window_compaction_strategy
2020-12-18 16:33:27 +01:00
types.hh
sstables: convert write() to concepts
2021-03-18 19:26:43 +02:00
version.hh
test: test_env: pick the highest sstable version by default
2021-01-24 10:38:55 +02:00
writer_impl.hh
mutation_fragment_stream_validating_filter: make validation levels more fine-grained
2021-03-01 07:49:23 +02:00
writer.cc
sstable_writer: add validation
2021-01-11 09:12:56 +02:00
writer.hh
sstables: vector write: convert to concepts
2021-03-18 19:26:54 +02:00