Michał Chojnowski cee504f66f sstables/compress: discard hidden compression options after the decompressor is created ...

Dictionary contents are kept in the list of "compression options" in the
header of `CompressionInfo.db`, and they are loaded from disk into
memory when the `sstable::compression` object is populated.

After the decompressor for the SSTable is created based on those
dict contents, they are not needed in RAM anymore. And since
they take up a sizeable amount of memory, we would like to free them.

In this patch, we discard all "hidden compression options"
(currently: only the dictionary contents) from the
`sstable::compression` object right after the decompressor is created.
(Those options are not supposed to be used for anything else anyway).

2025-04-01 00:07:30 +02:00

..

kl

remove redundant std::move() from position_in_partition::key()

2025-03-03 12:51:40 +03:00

mx

sstables: delegate compressor creation to the compressor factory

2025-04-01 00:07:28 +02:00

binary_search.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

checksum_utils.hh

utils: do not include unused headers

2025-01-14 07:56:39 -05:00

checksummed_data_source.cc

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

checksummed_data_source.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

CMakeLists.txt

cmake/check_headers: correct typos

2024-10-08 09:38:16 +03:00

column_translation.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

component_type.hh

sstables: Introduce struct component_name

2025-03-19 12:45:21 +03:00

compress.cc

sstables/compress: discard hidden compression options after the decompressor is created

2025-04-01 00:07:30 +02:00

compress.hh

sstables/compress: discard hidden compression options after the decompressor is created

2025-04-01 00:07:30 +02:00

consumer.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

data_source_types.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

disk_types.hh

sstables: disk_types: disk_set_of_tagged_union: boost::variant -> std::variant

2025-01-27 09:29:26 -05:00

downsampling.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

exceptions.hh

sstable: Remove unused malformed_sstable_exctpion(string filename)

2025-03-19 13:03:29 +03:00

file_writer.hh

sstables: Make file_writer keep component_name on board

2025-03-19 13:03:29 +03:00

filter.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

generation_type.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

hyperloglog.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

index_entry.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

index_reader.hh

utils: do not include unused headers

2025-01-14 07:56:39 -05:00

integrity_checked_file_impl.cc

sstables: switch from boost to std::ranges::all_of()

2025-02-10 15:44:55 +03:00

integrity_checked_file_impl.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

key.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

liveness_info.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

m_format_read_helpers.cc

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

m_format_read_helpers.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

metadata_collector.cc

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

metadata_collector.hh

sstables: Make get_filename() return component_name

2025-03-19 13:03:29 +03:00

mutation_fragment_filter.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

open_info.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

partition_index_cache_stats.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

partition_index_cache.hh

utils: do not include unused headers

2025-01-14 07:56:39 -05:00

prepended_input_stream.cc

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

prepended_input_stream.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

processing_result_generator.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

progress_monitor.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

promoted_index_blocks_reader.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

random_access_reader.cc

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

random_access_reader.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

scanning_clustered_index_cursor.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

segmented_compress_params.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

shareable_components.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

shared_sstable.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

sstable_compressor_factory.hh

sstables: introduce sstable_compressor_factory

2025-04-01 00:07:28 +02:00

sstable_directory.cc

sstables: Make toc_filename() return component_name

2025-03-19 13:03:29 +03:00

sstable_directory.hh

sstable_directory: Move sstable_directory::pending_delete_result

2025-02-19 13:09:04 +03:00

sstable_mutation_reader.cc

db,sstables: migate boost::range::stable_partition to std library

2024-12-19 14:56:07 +02:00

sstable_mutation_reader.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

sstable_set_impl.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

sstable_set.cc

sstables: explicitly call parent's default constructor in copy constructor

2025-02-28 13:52:24 +03:00

sstable_set.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

sstable_version_k_l.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

sstable_version_m.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

sstable_version.cc

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

sstable_version.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

sstable_writer.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

sstables_manager.cc

sstables: plug an sstable_compressor_factory into sstables_manager

2025-04-01 00:07:28 +02:00

sstables_manager.hh

sstables: plug an sstable_compressor_factory into sstables_manager

2025-04-01 00:07:28 +02:00

sstables_registry.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

sstables.cc

sstables/compress: discard hidden compression options after the decompressor is created

2025-04-01 00:07:30 +02:00

sstables.hh

sstables: store features early in write path

2025-03-31 09:33:56 +03:00

stats.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

storage.cc

sstables::storage: Move wrapping sstable components to storage provider

2025-03-20 14:54:24 +00:00

storage.hh

sstable_directory: Move sstable_directory::pending_delete_result

2025-02-19 13:09:04 +03:00

types_fwd.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

types.hh

sstables: store features early in write path

2025-03-31 09:33:56 +03:00

version.hh

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

writer_impl.hh

sstables: store features early in write path

2025-03-31 09:33:56 +03:00

writer.cc

treewide: relicense to ScyllaDB-Source-Available-1.0

2024-12-18 17:45:13 +02:00

writer.hh

compress: remove compressor::option_names()

2025-04-01 00:07:27 +02:00