mirrors/scylladb
1
0
Fork 0
mirror of https://github.com/scylladb/scylladb.git synced 2026-04-28 04:06:59 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
fbca8a764408fa759ff01d2ce16ae859eb45d373
scylladb/sstables
History
Michał Chojnowski 30a6a2c7a7 sstables/trie/trie_writer: free nodes after they are flushed 
Somehow, the line of code responsible for freeing flushed nodes
in `trie_writer` is missing from the implementation.

This effectively means that `trie_writer` keeps the whole index in
memory until the index writer is closed, which for many dataset
is a guaranteed OOM.

Fix that, and add some test that catches this.

Fixes scylladb/scylladb#27082

Closes scylladb/scylladb#27083

(cherry picked from commit d8e299dbb2)

Closes scylladb/scylladb#27122
2025-11-20 10:37:40 +02:00
..
kl
treewide: Move type related files to a type directory As requested in #22110, moved the files and fixed other includes and build system.
2025-09-17 17:32:19 +03:00
mx
sstables/mx/reader: use the same hashed_key for the bloom filter and the index reader
2025-09-29 13:01:22 +02:00
trie
sstables/trie/trie_writer: free nodes after they are flushed
2025-11-20 10:37:40 +02:00
abstract_index_reader.hh
sstables/trie/bti_index_reader: allow the caller to passing a precalculated murmur hash
2025-09-29 13:01:21 +02:00
basic_info.hh
system_keyspace: Upgrade compaction_history table
2025-05-14 08:32:05 +02:00
binary_search.hh
treewide: relicense to ScyllaDB-Source-Available-1.0
2024-12-18 17:45:13 +02:00
checksum_utils.hh
utils: do not include unused headers
2025-01-14 07:56:39 -05:00
checksummed_data_source.cc
sstables: Start using make_data_or_index_source in sstable
2025-07-15 10:10:23 +03:00
checksummed_data_source.hh
sstables: Start using make_data_or_index_source in sstable
2025-07-15 10:10:23 +03:00
CMakeLists.txt
sstables/trie: introduce bti_index_reader
2025-09-07 00:32:02 +02:00
column_translation.hh
treewide: relicense to ScyllaDB-Source-Available-1.0
2024-12-18 17:45:13 +02:00
component_type.hh
sstables: implement an alternative way to rebuild bloom filters for sstables without Index
2025-09-29 13:01:21 +02:00
compress.cc
compress: move compress.cc/hh to sstables/compressor
2025-07-31 13:10:41 +03:00
compress.hh
compress: move compress.cc/hh to sstables/compressor
2025-07-31 13:10:41 +03:00
compressor.cc
db/config: Deprecate sstable_compression_dictionaries_allow_in_ddl
2025-11-04 15:40:46 +02:00
compressor.hh
db/config: Deprecate sstable_compression_dictionaries_allow_in_ddl
2025-11-04 15:40:46 +02:00
consumer.hh
sstables/consumer: add read_56()
2025-09-07 00:30:15 +02:00
data_source_types.hh
treewide: relicense to ScyllaDB-Source-Available-1.0
2024-12-18 17:45:13 +02:00
disk_types.hh
sstables: disk_types: disk_set_of_tagged_union: boost::variant -> std::variant
2025-01-27 09:29:26 -05:00
downsampling.hh
treewide: relicense to ScyllaDB-Source-Available-1.0
2024-12-18 17:45:13 +02:00
exceptions.hh
sstables,compaction: move compaction exceptions to compaction/
2025-09-29 06:49:14 +03:00
file_writer.hh
sstables: Make file_writer keep component_name on board
2025-03-19 13:03:29 +03:00
filter.hh
treewide: relicense to ScyllaDB-Source-Available-1.0
2024-12-18 17:45:13 +02:00
generation_type.hh
sstables: sstable_generation_generator: stop tracking highest generation
2025-08-08 11:46:21 +03:00
hyperloglog.hh
treewide: relicense to ScyllaDB-Source-Available-1.0
2024-12-18 17:45:13 +02:00
index_entry.hh
sstables: add sstable::make_index_reader() and use where appropriate
2025-07-17 10:32:57 +02:00
index_reader.hh
sstables/trie/bti_index_reader: allow the caller to passing a precalculated murmur hash
2025-09-29 13:01:21 +02:00
integrity_checked_file_impl.cc
sstables: switch from boost to std::ranges::all_of()
2025-02-10 15:44:55 +03:00
integrity_checked_file_impl.hh
treewide: relicense to ScyllaDB-Source-Available-1.0
2024-12-18 17:45:13 +02:00
key.hh
treewide: Move keys related files to a new keys directory
2025-07-25 10:45:32 +03:00
liveness_info.hh
treewide: Move mutation related files to a mutation directory
2025-09-24 13:23:38 +03:00
m_format_read_helpers.cc
treewide: relicense to ScyllaDB-Source-Available-1.0
2024-12-18 17:45:13 +02:00
m_format_read_helpers.hh
treewide: Move mutation related files to a mutation directory
2025-09-24 13:23:38 +03:00
metadata_collector.cc
treewide: relicense to ScyllaDB-Source-Available-1.0
2024-12-18 17:45:13 +02:00
metadata_collector.hh
treewide: Move mutation related files to a mutation directory
2025-09-24 13:23:38 +03:00
mutation_fragment_filter.hh
treewide: Move keys related files to a new keys directory
2025-07-25 10:45:32 +03:00
open_info.hh
scylla-sstable: correctly dump sharding_metadata
2025-11-16 16:58:58 +02:00
partition_index_cache_stats.hh
treewide: relicense to ScyllaDB-Source-Available-1.0
2024-12-18 17:45:13 +02:00
partition_index_cache.hh
sstables: replace SCYLLA_ASSERT() with parse_assert() on the read path
2025-06-24 09:16:28 +03:00
prepended_input_stream.cc
treewide: relicense to ScyllaDB-Source-Available-1.0
2024-12-18 17:45:13 +02:00
prepended_input_stream.hh
treewide: relicense to ScyllaDB-Source-Available-1.0
2024-12-18 17:45:13 +02:00
processing_result_generator.hh
treewide: relicense to ScyllaDB-Source-Available-1.0
2024-12-18 17:45:13 +02:00
progress_monitor.hh
treewide: relicense to ScyllaDB-Source-Available-1.0
2024-12-18 17:45:13 +02:00
promoted_index_blocks_reader.hh
sstables: replace SCYLLA_ASSERT() with parse_assert() on the read path
2025-06-24 09:16:28 +03:00
random_access_reader.cc
treewide: relicense to ScyllaDB-Source-Available-1.0
2024-12-18 17:45:13 +02:00
random_access_reader.hh
sstables: replace SCYLLA_ASSERT() with parse_assert() on the read path
2025-06-24 09:16:28 +03:00
scanning_clustered_index_cursor.hh
sstables: replace SCYLLA_ASSERT() with parse_assert() on the read path
2025-06-24 09:16:28 +03:00
segmented_compress_params.hh
treewide: Add missing #pragma once
2025-09-01 14:58:21 +03:00
shareable_components.hh
treewide: relicense to ScyllaDB-Source-Available-1.0
2024-12-18 17:45:13 +02:00
shared_sstable.hh
treewide: relicense to ScyllaDB-Source-Available-1.0
2024-12-18 17:45:13 +02:00
sstable_compressor_factory.hh
compress: add some test-only APIs
2025-05-07 14:43:20 +02:00
sstable_directory.cc
sstables/sstable_directory: don't forget to delete other components when deleting TemporaryHashes.db
2025-10-06 10:22:50 +00:00
sstable_directory.hh
compaction: move code to namespace compaction
2025-09-25 15:03:56 +03:00
sstable_mutation_reader.cc
treewide: Move type related files to a type directory As requested in #22110, moved the files and fixed other includes and build system.
2025-09-17 17:32:19 +03:00
sstable_mutation_reader.hh
Merge 'sstables/mx/reader: accommodate inexact partition indexes' from Michał Chojnowski
2025-07-27 19:39:36 +03:00
sstable_set_impl.hh
sstables: Fix quadratic space complexity in partitioned_sstable_set
2025-04-29 15:47:33 -03:00
sstable_set.cc
Merge 'sstables: introduce sstable version ms' from Michał Chojnowski
2025-09-30 09:40:02 +03:00
sstable_set.hh
sstables: Fix quadratic space complexity in partitioned_sstable_set
2025-04-29 15:47:33 -03:00
sstable_version_k_l.hh
treewide: relicense to ScyllaDB-Source-Available-1.0
2024-12-18 17:45:13 +02:00
sstable_version_m.hh
sstables: introduce ms sstable format version
2025-09-29 22:15:24 +02:00
sstable_version.cc
sstables: introduce ms sstable format version
2025-09-29 22:15:24 +02:00
sstable_version.hh
treewide: relicense to ScyllaDB-Source-Available-1.0
2024-12-18 17:45:13 +02:00
sstable_writer.hh
sstables/writer: add an accessor for the current write position in Data.db
2025-09-07 00:32:02 +02:00
sstables_manager_subscription.hh
sstables_manager: add subscriptions
2025-04-09 08:54:07 +03:00
sstables_manager.cc
db/config: expose "ms" format to the users via database config
2025-09-29 22:15:25 +02:00
sstables_manager.hh
db: get rid of sstables-format-selector
2025-09-19 16:17:56 +03:00
sstables_registry.hh
treewide: relicense to ScyllaDB-Source-Available-1.0
2024-12-18 17:45:13 +02:00
sstables.cc
scylla-sstable: correctly dump sharding_metadata
2025-11-16 16:58:58 +02:00
sstables.hh
sstables/mx/reader: use the same hashed_key for the bloom filter and the index reader
2025-09-29 13:01:22 +02:00
stats.hh
treewide: relicense to ScyllaDB-Source-Available-1.0
2024-12-18 17:45:13 +02:00
storage.cc
sstables: implement an alternative way to rebuild bloom filters for sstables without Index
2025-09-29 13:01:21 +02:00
storage.hh
sstables: implement an alternative way to rebuild bloom filters for sstables without Index
2025-09-29 13:01:21 +02:00
types_fwd.hh
treewide: relicense to ScyllaDB-Source-Available-1.0
2024-12-18 17:45:13 +02:00
types.hh
sstables: introduce ms sstable format version
2025-09-29 22:15:24 +02:00
version.hh
sstables: add ms to all_sstable_versions
2025-09-29 22:15:25 +02:00
writer_impl.hh
sstables/writer: add an accessor for the current write position in Data.db
2025-09-07 00:32:02 +02:00
writer.cc
sstables/writer: add an accessor for the current write position in Data.db
2025-09-07 00:32:02 +02:00
writer.hh
treewide: Move mutation related files to a mutation directory
2025-09-24 13:23:38 +03:00