Avi Kivity 19316dee94 Merge 'auto-scale promoted index' from Benny Halevy ...

Add column_index_auto_scale_threshold_in_kb to the configuration (defaults to 10MB).

When the promoted index (serialized) size gets to this
threshold, it's halved by merging each two adjacent blocks
into one and doubling the desired_block_size.

Fixes #4217

Signed-off-by: Benny Halevy <bhalevy@scylladb.com>

Closes #10646

* github.com:scylladb/scylla:
  sstables: mx: add pi_auto_scale_events metric
  sstables: mx/writer: auto-scale promoted index

2022-05-25 10:27:19 +03:00

..

kl

sstables/kl: make reader impl v2 native

2022-04-28 14:12:24 +03:00

mx

sstables: mx: add pi_auto_scale_events metric

2022-05-24 13:32:39 +03:00

binary_search.hh

treewide: use Software Package Data Exchange (SPDX) license identifiers

2022-01-18 12:15:18 +01:00

checksum_utils.hh

treewide: use Software Package Data Exchange (SPDX) license identifiers

2022-01-18 12:15:18 +01:00

column_translation.hh

treewide: use Software Package Data Exchange (SPDX) license identifiers

2022-01-18 12:15:18 +01:00

component_type.hh

treewide: use Software Package Data Exchange (SPDX) license identifiers

2022-01-18 12:15:18 +01:00

compress.cc

treewide: use Software Package Data Exchange (SPDX) license identifiers

2022-01-18 12:15:18 +01:00

compress.hh

treewide: use Software Package Data Exchange (SPDX) license identifiers

2022-01-18 12:15:18 +01:00

consumer.hh

sstables: consumer: reuse the fragmented_temporary_buffer in read_bytes()

2022-05-07 13:04:16 +02:00

disk_types.hh

code: Convert is_integral assertions to concepts

2022-02-24 19:44:29 +03:00

downsampling.hh

treewide: remove empty comments in top-of-files

2022-05-13 07:11:58 +02:00

exceptions.hh

treewide: use Software Package Data Exchange (SPDX) license identifiers

2022-01-18 12:15:18 +01:00

filter.hh

treewide: use Software Package Data Exchange (SPDX) license identifiers

2022-01-18 12:15:18 +01:00

generation_type.hh

sstables: define generation_type for sstables

2022-05-11 14:46:30 +02:00

hyperloglog.hh

treewide: use Software Package Data Exchange (SPDX) license identifiers

2022-01-18 12:15:18 +01:00

index_entry.hh

treewide: use Software Package Data Exchange (SPDX) license identifiers

2022-01-18 12:15:18 +01:00

index_reader.hh

sstables/index_reader: push down eof() check to advance_to(index_bound&, dht::ring_position_view)

2022-05-11 14:46:30 +02:00

integrity_checked_file_impl.cc

treewide: use Software Package Data Exchange (SPDX) license identifiers

2022-01-18 12:15:18 +01:00

integrity_checked_file_impl.hh

treewide: use Software Package Data Exchange (SPDX) license identifiers

2022-01-18 12:15:18 +01:00

key.hh

treewide: use Software Package Data Exchange (SPDX) license identifiers

2022-01-18 12:15:18 +01:00

liveness_info.hh

treewide: use Software Package Data Exchange (SPDX) license identifiers

2022-01-18 12:15:18 +01:00

m_format_read_helpers.cc

treewide: use Software Package Data Exchange (SPDX) license identifiers

2022-01-18 12:15:18 +01:00

m_format_read_helpers.hh

treewide: use Software Package Data Exchange (SPDX) license identifiers

2022-01-18 12:15:18 +01:00

metadata_collector.cc

sstables/metadata_collector: use position_in_partition for min/max keys

2022-03-10 07:03:49 +02:00

metadata_collector.hh

treewide: remove empty comments in top-of-files

2022-05-13 07:11:58 +02:00

mutation_fragment_filter.hh

compile: Fix headers so that *-headers targets compile cleanly.

2022-03-25 16:19:26 +02:00

open_info.hh

sstables: define generation_type for sstables

2022-05-11 14:46:30 +02:00

partition_index_cache.hh

sstable: partition_index_cache: Fix abort on bad_alloc during page loading

2022-05-25 09:27:04 +03:00

prepended_input_stream.cc

treewide: use Software Package Data Exchange (SPDX) license identifiers

2022-01-18 12:15:18 +01:00

prepended_input_stream.hh

treewide: use Software Package Data Exchange (SPDX) license identifiers

2022-01-18 12:15:18 +01:00

processing_result_generator.hh

sstables/processing_result_generator.hh: refine check for coroutine standard

2022-05-19 11:31:40 +03:00

progress_monitor.hh

treewide: use Software Package Data Exchange (SPDX) license identifiers

2022-01-18 12:15:18 +01:00

promoted_index_blocks_reader.hh

compile: Fix headers so that *-headers targets compile cleanly.

2022-03-25 16:19:26 +02:00

random_access_reader.cc

treewide: use Software Package Data Exchange (SPDX) license identifiers

2022-01-18 12:15:18 +01:00

random_access_reader.hh

treewide: use Software Package Data Exchange (SPDX) license identifiers

2022-01-18 12:15:18 +01:00

scanning_clustered_index_cursor.hh

treewide: use Software Package Data Exchange (SPDX) license identifiers

2022-01-18 12:15:18 +01:00

segmented_compress_params.hh

treewide: use Software Package Data Exchange (SPDX) license identifiers

2022-01-18 12:15:18 +01:00

shareable_components.hh

treewide: use Software Package Data Exchange (SPDX) license identifiers

2022-01-18 12:15:18 +01:00

shared_sstable.hh

treewide: use Software Package Data Exchange (SPDX) license identifiers

2022-01-18 12:15:18 +01:00

sstable_directory.cc

sstable_directory: parallel_for_each_restricted: keep func alive across calls

2022-05-20 17:07:53 +03:00

sstable_directory.hh

sstables: define generation_type for sstables

2022-05-11 14:46:30 +02:00

sstable_mutation_reader.cc

sstables: move mp_row_consumer_reader_k_l to kl/reader.cc

2022-04-28 14:12:24 +03:00

sstable_mutation_reader.hh

sstables: move mp_row_consumer_reader_k_l to kl/reader.cc

2022-04-28 14:12:24 +03:00

sstable_set_impl.hh

readers: move combined reader into readers/

2022-03-30 15:42:51 +03:00

sstable_set.cc

readers: move combined reader into readers/

2022-03-30 15:42:51 +03:00

sstable_set.hh

flat_mutation_reader: Split readers by file and remove unnecessary includes.

2022-03-14 13:20:25 +02:00

sstable_version_k_l.hh

treewide: use Software Package Data Exchange (SPDX) license identifiers

2022-01-18 12:15:18 +01:00

sstable_version_m.hh

treewide: use Software Package Data Exchange (SPDX) license identifiers

2022-01-18 12:15:18 +01:00

sstable_version.cc

add support for the ME sstable format

2022-02-16 18:21:24 +02:00

sstable_version.hh

treewide: use Software Package Data Exchange (SPDX) license identifiers

2022-01-18 12:15:18 +01:00

sstable_writer.hh

sstables: convert mx writer to v2

2022-03-10 07:03:49 +02:00

sstables_manager.cc

sstables: mx/writer: auto-scale promoted index

2022-05-24 13:32:35 +03:00

sstables_manager.hh

sstables: define generation_type for sstables

2022-05-11 14:46:30 +02:00

sstables.cc

sstables: mx: add pi_auto_scale_events metric

2022-05-24 13:32:39 +03:00

sstables.hh

sstables: mx/writer: auto-scale promoted index

2022-05-24 13:32:35 +03:00

stats.hh

sstables: mx: add pi_auto_scale_events metric

2022-05-24 13:32:39 +03:00

types.hh

add support for the ME sstable format

2022-02-16 18:21:24 +02:00

version.hh

add support for the ME sstable format

2022-02-16 18:21:24 +02:00

writer_impl.hh

sstables: convert mx writer to v2

2022-03-10 07:03:49 +02:00

writer.cc

treewide: fix compilation issues with fmtlib 8.1.0+

2022-03-16 12:31:50 +03:00

writer.hh

sstables: writer: pass bytes_ostream by reference

2022-05-15 17:53:38 +03:00