mirrors/scylladb
1
0
Fork 0
mirror of https://github.com/scylladb/scylladb.git synced 2026-04-28 20:27:03 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
3e92bcaa20f259715c63c33af0545d36f5e17a4e
scylladb/test/boost
History
Botond Dénes 3e92bcaa20 Merge 'utils: redesign reusable_buffer' from Michał Chojnowski 
Common compression libraries work on contiguous buffers.
Contiguous buffers are a problem for the allocator. However, as long as they are short-lived,
we can avoid the expensive allocations by reusing buffers across tasks.

This idea is already applied to the compression of CQL frames, but with some deficiencies.
`utils: redesign reusable_buffer` attempts to improve upon it in a few ways. See its commit message for an extended discussion.

Compression buffer reuse also happens in the zstd SSTable compressor, but the implementation is misguided. Every `zstd_processor` instance reuses a buffer, but each instance has its own buffer. This is very bad, because a healthy database might have thousands of concurrent instances (because there is one for each sstable reader). Together, the buffers might require gigabytes of memory, and the reuse actually *increases* memory pressure significantly, instead of reducing it.
`zstd: share buffers between compressor instances` aims to improve that by letting a single buffer be shared across all instances on a shard.

Closes #13324

* github.com:scylladb/scylladb:
  zstd: share buffers between compressor instances
  utils: redesign reusable_buffer
2023-04-27 09:09:09 +03:00
..
aggregate_fcts_test.cc
test: do not initialize a time_t with braces
2023-03-07 17:54:53 +08:00
allocation_strategy_test.cc
…
alternator_unit_test.cc
…
anchorless_list_test.cc
…
auth_passwords_test.cc
…
auth_resource_test.cc
auth: remove unused operator<<(.., resource_kind)
2023-04-07 20:32:28 +08:00
auth_test.cc
treewide: do not define/capture unused variables
2023-02-28 21:56:53 +08:00
batchlog_manager_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
big_decimal_test.cc
…
bptree_test.cc
…
broken_sstable_test.cc
test: sstables: use generation_type::int_t
2023-03-22 13:48:50 +02:00
btree_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
bytes_ostream_test.cc
…
cache_flat_mutation_reader_test.cc
Introduce schema/ module
2023-02-15 11:01:50 +02:00
cached_file_test.cc
test: fix some mismatched signed/unsigned comparisons
2023-03-21 13:15:12 +02:00
caching_options_test.cc
Introduce schema/ module
2023-02-15 11:01:50 +02:00
canonical_mutation_test.cc
Introduce mutation/ module
2023-02-14 11:19:03 +02:00
cartesian_product_test.cc
…
castas_fcts_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
cdc_generation_test.cc
…
cdc_test.cc
types: move types.{cc,hh} into types
2023-02-19 21:05:45 +02:00
cell_locker_test.cc
Introduce schema/ module
2023-02-15 11:01:50 +02:00
checksum_utils_test.cc
…
chunked_managed_vector_test.cc
test: fix some mismatched signed/unsigned comparisons
2023-03-21 13:15:12 +02:00
chunked_vector_test.cc
test/boost/chunked_vector_test: remove defaulted exception_safe_class's move ctor
2023-02-19 12:58:22 +08:00
clustering_ranges_walker_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
CMakeLists.txt
build: cmake: add more tests
2023-04-13 14:57:00 +03:00
column_mapping_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
commitlog_test.cc
reader_permit: keep trace_state pointer on permit
2023-03-22 04:58:01 -04:00
compound_test.cc
Introduce schema/ module
2023-02-15 11:01:50 +02:00
compress_test.cc
…
config_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
continuous_data_consumer_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
counter_test.cc
Introduce schema/ module
2023-02-15 11:01:50 +02:00
cql_auth_query_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
cql_auth_syntax_test.cc
…
cql_functions_test.cc
treewide: do not define/capture unused variables
2023-02-28 21:56:53 +08:00
cql_query_group_test.cc
Introduce schema/ module
2023-02-15 11:01:50 +02:00
cql_query_large_test.cc
Introduce schema/ module
2023-02-15 11:01:50 +02:00
cql_query_like_test.cc
Introduce schema/ module
2023-02-15 11:01:50 +02:00
cql_query_test.cc
test: s/std::regex/boost::regex/
2023-04-06 09:51:32 -04:00
crc_test.cc
utils: spell "barrett" correctly
2022-11-16 16:30:38 +02:00
data_listeners_test.cc
treewide: stop using 'using namespace std' in namespace scope
2023-04-17 14:08:37 +03:00
database_test.cc
Merge 'sstables, replica: add generation generator' from Kefu Chai
2023-04-24 09:31:08 +03:00
dirty_memory_manager_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
double_decker_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
duration_test.cc
…
dynamic_bitset_test.cc
…
enum_option_test.cc
…
enum_set_test.cc
move to_string.hh to utils/
2023-02-15 11:09:04 +02:00
error_injection_test.cc
treewide: do not define/capture unused variables
2023-02-28 21:56:53 +08:00
estimated_histogram_test.cc
…
exception_container_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
exceptions_fallback_test.cc
…
exceptions_optimized_test.cc
…
exceptions_test.inc.cc
…
expr_test.cc
expr_test: more tests for preparing bind variables with type hints
2023-03-09 18:31:45 +01:00
extensions_test.cc
treewide: do not define/capture unused variables
2023-02-28 21:56:53 +08:00
filtering_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
flat_mutation_reader_test.cc
Merge 'readers/nonforwarding: don't emit partition_end on next_partition,fast_forward_to' from Gusev Petr
2023-03-01 09:58:14 +02:00
flush_queue_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
fragmented_temporary_buffer_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
frozen_mutation_test.cc
Introduce schema/ module
2023-02-15 11:01:50 +02:00
gossiping_property_file_snitch_test.cc
treewide: do not define/capture unused variables
2023-02-28 21:56:53 +08:00
group0_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
hash_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
hashers_test.cc
utils: hashing: add simple_xx_hasher
2023-04-24 14:06:43 +03:00
hint_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
idl_test.cc
…
index_with_paging_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
input_stream_test.cc
…
intrusive_array_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
json_cql_query_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
json_test.cc
…
keys_test.cc
types: move types.{cc,hh} into types
2023-02-19 21:05:45 +02:00
large_paging_state_test.cc
types: move types.{cc,hh} into types
2023-02-19 21:05:45 +02:00
like_matcher_test.cc
…
limiting_data_source_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
linearizing_input_stream_test.cc
…
lister_test.cc
test: fix some mismatched signed/unsigned comparisons
2023-03-21 13:15:12 +02:00
loading_cache_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
locator_topology_test.cc
locator: topology: Fix move assignment
2023-04-20 23:39:18 +02:00
log_heap_test.cc
…
logalloc_standard_allocator_segment_pool_backend_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
logalloc_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
managed_bytes_test.cc
…
managed_vector_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
map_difference_test.cc
treewide: stop using 'using namespace std' in namespace scope
2023-04-17 14:08:37 +03:00
memtable_test.cc
test: fix some mismatched signed/unsigned comparisons
2023-03-21 13:15:12 +02:00
multishard_combining_reader_as_mutation_source_test.cc
Introduce schema/ module
2023-02-15 11:01:50 +02:00
multishard_mutation_query_test.cc
Merge 'test/boost/multishard_mutation_query: use random schema' from Botond Dénes
2023-04-05 10:32:58 +02:00
murmur_hash_test.cc
…
mutation_fragment_test.cc
reader_permit: keep trace_state pointer on permit
2023-03-22 04:58:01 -04:00
mutation_query_test.cc
Introduce schema/ module
2023-02-15 11:01:50 +02:00
mutation_reader_test.cc
Move TWCS option from table into TWCS itself
2023-04-14 08:28:16 +03:00
mutation_test.cc
dht: print pk in decorated_key with "pk" prefix
2023-04-25 09:53:47 +02:00
mutation_writer_test.cc
treewide: do not define/capture unused variables
2023-02-28 21:56:53 +08:00
mvcc_test.cc
treewide: do not define/capture unused variables
2023-02-28 21:56:53 +08:00
network_topology_strategy_test.cc
tests: topology: Test that topology clearing preserves information about local node
2023-04-20 23:39:18 +02:00
nonwrapping_range_test.cc
Introduce schema/ module
2023-02-15 11:01:50 +02:00
observable_test.cc
…
partitioner_test.cc
test: fix some mismatched signed/unsigned comparisons
2023-03-21 13:15:12 +02:00
per_partition_rate_limit_test.cc
Introduce mutation/ module
2023-02-14 11:19:03 +02:00
querier_cache_test.cc
code: Remove some headers from query_processor.hh
2023-03-31 07:08:41 +03:00
query_processor_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
radix_tree_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
range_assert.hh
…
range_test.cc
Introduce schema/ module
2023-02-15 11:01:50 +02:00
range_tombstone_list_assertions.hh
Introduce mutation/ module
2023-02-14 11:19:03 +02:00
range_tombstone_list_test.cc
mutation: specialize fmt::formatter<range_tombstone_{entry,list}>
2023-04-26 09:00:25 +03:00
rate_limiter_test.cc
treewide: do not define/capture unused variables
2023-02-28 21:56:53 +08:00
reader_concurrency_semaphore_test.cc
reader_concurrency_semaphore: don't evict inactive readers needlessly
2023-04-13 15:20:18 +03:00
recent_entries_map_test.cc
utils: introduce recent_entries_map datatype to track least recent visited entries.
2023-02-03 19:04:32 +01:00
repair_test.cc
treewide: do not define/capture unused variables
2023-02-28 21:56:53 +08:00
restrictions_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
result_utils_test.cc
treewide: do not define/capture unused variables
2023-02-28 21:56:53 +08:00
reusable_buffer_test.cc
utils: redesign reusable_buffer
2023-04-26 22:09:17 +02:00
role_manager_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
row_cache_test.cc
tests: row_cache: Add reproducer for reader producing missing closing range tombstone
2023-04-25 14:20:57 +02:00
rust_test.cc
…
s3_test.cc
s3/test: Rename MINIO_SERVER_ADDRESS environment variable
2023-04-19 12:51:12 +03:00
schema_change_test.cc
schema_change_test: Use proxy from cql_test_env
2023-04-21 14:18:00 +03:00
schema_changes_test.cc
everywhere: use sstables::generation_type
2023-03-22 13:59:47 +02:00
schema_loader_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
schema_registry_test.cc
Introduce schema/ module
2023-02-15 11:01:50 +02:00
secondary_index_test.cc
test: do not initialize plain number with {}
2023-03-07 17:54:53 +08:00
serialization_test.cc
treewide: s/boost::lexical_cast<std::string>/fmt::to_string()/
2023-04-21 09:43:53 +03:00
serialized_action_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
service_level_controller_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
small_vector_test.cc
utils: small_vector: define operator<=>
2023-02-28 20:04:22 +02:00
snitch_reset_test.cc
treewide: do not define/capture unused variables
2023-02-28 21:56:53 +08:00
sstable_3_x_test.cc
sstable: specialize fmt::formatter<component_type>
2023-04-21 09:49:24 +03:00
sstable_compaction_test.cc
sstables: add a printer for shared_sstable
2023-04-10 23:31:35 +03:00
sstable_conforms_to_mutation_source_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
sstable_datafile_test.cc
keys: specialize fmt::formatter<partition_key> and friends
2023-04-14 13:21:30 +08:00
sstable_directory_test.cc
sstable: Make storage instance based on storage options
2023-04-10 16:43:01 +03:00
sstable_move_test.cc
test: sstables: use generation_type::int_t
2023-03-22 13:48:50 +02:00
sstable_mutation_test.cc
everywhere: use sstables::generation_type
2023-03-22 13:59:47 +02:00
sstable_partition_index_cache_test.cc
sstables: partition_index_cache: clean up an unused type alias
2023-02-17 17:58:26 +03:00
sstable_resharding_test.cc
test: add verify_mutation helpers.
2023-03-19 17:48:22 +02:00
sstable_set_test.cc
Move TWCS option from table into TWCS itself
2023-04-14 08:28:16 +03:00
sstable_test.cc
replica, test: create generation id using generator
2023-04-21 22:02:30 +08:00
sstable_test.hh
everywhere: use sstables::generation_type
2023-03-22 13:59:47 +02:00
stall_free_test.cc
utils: clear_gently: add variants for optional values
2023-04-23 21:34:02 +03:00
statement_restrictions_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
storage_proxy_test.cc
test: storage_proxy_test: provide valid endpoint_dc_rack
2023-04-02 19:13:05 +03:00
suite.yaml
test/boost: add multishard_mutation_query_test more memory
2023-03-27 01:44:00 -04:00
summary_test.cc
…
top_k_test.cc
treewide: stop using 'using namespace std' in namespace scope
2023-04-17 14:08:37 +03:00
total_order_check.hh
move to_string.hh to utils/
2023-02-15 11:09:04 +02:00
tracing_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
transport_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
types_test.cc
types: move types.{cc,hh} into types
2023-02-19 21:05:45 +02:00
user_function_test.cc
cql3: enforce permissions on DROP FUNCTION
2023-03-09 17:51:15 +01:00
user_types_test.cc
treewide: do not define/capture unused variables
2023-02-28 21:56:53 +08:00
utf8_test.cc
…
UUID_test.cc
treewide: do not use std::rel_ops
2023-04-26 14:09:58 +08:00
view_build_test.cc
reader_permit: keep trace_state pointer on permit
2023-03-22 04:58:01 -04:00
view_complex_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
view_schema_ckey_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
view_schema_pkey_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
view_schema_test.cc
treewide: use fmt::join() when appropriate
2023-03-16 20:34:18 +08:00
vint_serialization_test.cc
…
virtual_reader_test.cc
test: Make cql_test_env::get_system_keyspace() return sharded
2023-03-06 13:17:21 +03:00
virtual_table_mutation_source_test.cc
Introduce schema/ module
2023-02-15 11:01:50 +02:00
virtual_table_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
wasm_alloc_test.cc
wasm: return wasm instance cache as a reference instead of a pointer
2023-03-28 18:18:48 +02:00
wasm_test.cc
wasm: return wasm instance cache as a reference instead of a pointer
2023-03-28 18:18:48 +02:00