mirrors/scylladb
1
0
Fork 0
mirror of https://github.com/scylladb/scylladb.git synced 2026-06-04 22:13:19 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
0ae0f75a0457898aa0606638824965db845fca9d
scylladb/test/boost
History
Botond Dénes f6575344df Merge 'Collect dangling object-store sstables' from Pavel Emelyanov 
Sstables in transitional states are marked with the respective 'status' in the registry. Currently there are two of such -- 'creating' and 'removing'. And the 'sealed' status for sstables in use.

On boot the distributed loader tries to garbage collect the dangling sstables. For filesystem storage it's done with the help of temorary sstables' dirs and pending deletion logs. For s3-backed sstables, the garbage collection means fetching all non-sealed entries and removing the corresponding objects from the storage.

Test included (last patch)

fixes #13024

Closes scylladb/scylladb#15318

* github.com:scylladb/scylladb:
  test: Extend object_store test to validate GC works
  sstable_directory: Garbage collect S3 sstables on reboot
  sstable_directory: Pass storage to garbage_collect()
  sstable_directory: Create storage instance too
2023-09-21 09:15:00 +03:00
..
aggregate_fcts_test.cc
test: do not initialize a time_t with braces
2023-03-07 17:54:53 +08:00
allocation_strategy_test.cc
…
alternator_unit_test.cc
alternator: unit test for number magnitude and precision function
2023-05-02 11:04:05 +03:00
anchorless_list_test.cc
…
auth_passwords_test.cc
…
auth_resource_test.cc
auth: remove unused operator<<(.., resource_kind)
2023-04-07 20:32:28 +08:00
auth_test.cc
treewide: do not define/capture unused variables
2023-02-28 21:56:53 +08:00
batchlog_manager_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
big_decimal_test.cc
…
bptree_test.cc
…
broken_sstable_test.cc
test: sstables: use generation_type::int_t
2023-03-22 13:48:50 +02:00
btree_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
bytes_ostream_test.cc
…
cache_algorithm_test.cc
test: boost/cache_algorithm_test: add cache_algorithm_test
2023-09-01 22:34:41 +02:00
cache_flat_mutation_reader_test.cc
partition_version: remove the schema argument from partition_entry::read()
2023-05-04 02:37:29 +02:00
cached_file_test.cc
utils: cached_file: deglobalize cached_file metrics
2023-09-01 22:34:41 +02:00
caching_options_test.cc
Introduce schema/ module
2023-02-15 11:01:50 +02:00
canonical_mutation_test.cc
Introduce mutation/ module
2023-02-14 11:19:03 +02:00
cartesian_product_test.cc
…
castas_fcts_test.cc
make timestamp string format cassandra compatible
2023-07-27 12:01:09 +03:00
cdc_generation_test.cc
cdc: use chunked_vector for topology_description entries
2023-09-18 23:17:01 +03:00
cdc_test.cc
test: Open-code ks.cf name parse into cdc_test
2023-08-12 11:46:36 +03:00
cell_locker_test.cc
Introduce schema/ module
2023-02-15 11:01:50 +02:00
checksum_utils_test.cc
…
chunked_managed_vector_test.cc
treewide: use unsigned variable to compare with unsigned
2023-07-18 10:27:18 +08:00
chunked_vector_test.cc
test/boost/chunked_vector_test: remove defaulted exception_safe_class's move ctor
2023-02-19 12:58:22 +08:00
clustering_ranges_walker_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
CMakeLists.txt
test: boost/cache_algorithm_test: add cache_algorithm_test
2023-09-01 22:34:41 +02:00
column_mapping_test.cc
schema_tables: Add system_keyspace& argument to ..._column_mapping() calls
2023-07-28 15:55:13 +03:00
commitlog_test.cc
db, storage_proxy: Drop mutation/frozen_mutation ::shard_of()
2023-06-21 00:58:24 +02:00
compound_test.cc
Introduce schema/ module
2023-02-15 11:01:50 +02:00
compress_test.cc
…
config_test.cc
config: remove "experimental" option
2023-09-05 10:09:04 +03:00
continuous_data_consumer_test.cc
build: disable implicit fallthrough
2023-07-10 19:36:06 +02:00
counter_test.cc
Merge ' mvcc: make schema upgrades gentle' from Michał Chojnowski
2023-05-24 22:58:43 +02:00
cql_auth_query_test.cc
test: use NetworkTopologyStrategy in all unit tests
2023-05-23 08:52:56 +03:00
cql_auth_syntax_test.cc
…
cql_functions_test.cc
test/boost/cql_functions_test: split long running tests
2023-06-26 11:29:36 +03:00
cql_query_group_test.cc
Introduce schema/ module
2023-02-15 11:01:50 +02:00
cql_query_large_test.cc
replica: iterate safely over tables related maps
2023-07-25 17:13:04 +02:00
cql_query_like_test.cc
Introduce schema/ module
2023-02-15 11:01:50 +02:00
cql_query_test.cc
cql_query_test: Fix indentation after previous patch
2023-09-06 16:54:25 +03:00
crc_test.cc
utils: spell "barrett" correctly
2022-11-16 16:30:38 +02:00
data_listeners_test.cc
treewide: stop using 'using namespace std' in namespace scope
2023-04-17 14:08:37 +03:00
database_test.cc
config.cc: drop db::config::host_id
2023-09-13 23:00:15 +04:00
dirty_memory_manager_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
double_decker_test.cc
treewide: use defaulted operator!=() and operator==()
2023-04-27 10:24:46 +03:00
duration_test.cc
…
dynamic_bitset_test.cc
…
enum_option_test.cc
…
enum_set_test.cc
move to_string.hh to utils/
2023-02-15 11:09:04 +02:00
error_injection_test.cc
tests: utils: error injection: add test for injection's parameters
2023-07-13 10:10:52 +02:00
estimated_histogram_test.cc
…
exception_container_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
exceptions_fallback_test.cc
…
exceptions_optimized_test.cc
…
exceptions_test.inc.cc
…
expr_test.cc
make timestamp string format cassandra compatible
2023-07-27 12:01:09 +03:00
extensions_test.cc
test: Optionally initialize proxy remote for cql_test_env
2023-07-19 19:32:10 +03:00
filtering_test.cc
test: Use BOOST_REQUIRE(db.has_schema())
2023-08-12 11:46:32 +03:00
flat_mutation_reader_test.cc
code: Switch to seastar API level 7
2023-06-06 13:29:16 +03:00
flush_queue_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
fragmented_temporary_buffer_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
frozen_mutation_test.cc
Introduce schema/ module
2023-02-15 11:01:50 +02:00
gossiping_property_file_snitch_test.cc
treewide: do not define/capture unused variables
2023-02-28 21:56:53 +08:00
group0_cmd_merge_test.cc
service: migration_manager: change the prepare_ methods to functions
2023-07-28 13:55:27 +02:00
group0_test.cc
test: use correct timestamp resolution in test_group0_history_clearing_old_entries
2023-07-13 10:33:52 +03:00
hash_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
hashers_test.cc
utils: hashing: add simple_xx_hasher
2023-04-24 14:06:43 +03:00
hint_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
idl_test.cc
…
index_with_paging_test.cc
test/boost/index_with_paging_test: parallel insert
2023-06-28 16:11:58 +02:00
input_stream_test.cc
…
intrusive_array_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
json_cql_query_test.cc
test: Use BOOST_REQUIRE(db.has_schema())
2023-08-12 11:46:32 +03:00
json_test.cc
…
keys_test.cc
types: move types.{cc,hh} into types
2023-02-19 21:05:45 +02:00
large_paging_state_test.cc
types: move types.{cc,hh} into types
2023-02-19 21:05:45 +02:00
like_matcher_test.cc
…
limiting_data_source_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
linearizing_input_stream_test.cc
…
lister_test.cc
test: Generalize touch_file() into test_utils.*
2023-05-23 10:40:55 +03:00
loading_cache_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
locator_topology_test.cc
topology: unindex_node: erase dc from datacenters when empty
2023-08-02 09:08:24 +03:00
log_heap_test.cc
…
logalloc_standard_allocator_segment_pool_backend_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
logalloc_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
managed_bytes_test.cc
…
managed_vector_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
map_difference_test.cc
treewide: stop using 'using namespace std' in namespace scope
2023-04-17 14:08:37 +03:00
memtable_test.cc
test: always pass empty description to migration_manager::announce
2023-08-07 14:38:11 +02:00
multishard_combining_reader_as_mutation_source_test.cc
code: Switch to seastar API level 7
2023-06-06 13:29:16 +03:00
multishard_mutation_query_test.cc
schema: add scylla specific options to schema description
2023-07-18 11:16:19 +03:00
murmur_hash_test.cc
…
mutation_fragment_test.cc
code: Switch to seastar API level 7
2023-06-06 13:29:16 +03:00
mutation_query_test.cc
code: Switch to seastar API level 7
2023-06-06 13:29:16 +03:00
mutation_reader_test.cc
replica/table: add optional compacting to make_multishard_streaming_reader()
2023-07-27 03:22:11 -04:00
mutation_test.cc
system_keyspace: drop load phases
2023-09-13 23:17:20 +04:00
mutation_writer_test.cc
stream_transfer_task, multishard_writer: Work with table sharder
2023-07-25 21:08:51 +02:00
mvcc_test.cc
test: mvcc_test: add a test for gentle schema upgrades
2023-05-04 03:35:15 +02:00
network_topology_strategy_test.cc
locator: topology: node::state: make fine grained
2023-07-31 10:33:48 +03:00
nonwrapping_range_test.cc
Introduce schema/ module
2023-02-15 11:01:50 +02:00
observable_test.cc
…
partitioner_test.cc
treewide: use unsigned variable to compare with unsigned
2023-07-18 10:27:18 +08:00
per_partition_rate_limit_test.cc
treewide: Replace dht::shard_of() uses with table::shard_of() / erm::shard_of()
2023-06-21 00:58:24 +02:00
pretty_printers_test.cc
utils: drop operator<< for pretty printers
2023-07-17 14:02:13 +08:00
querier_cache_test.cc
test: Use BOOST_REQUIRE(db.has_schema())
2023-08-12 11:46:32 +03:00
query_processor_test.cc
test: Optionally initialize proxy remote for cql_test_env
2023-07-19 19:32:10 +03:00
radix_tree_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
range_assert.hh
…
range_test.cc
Introduce schema/ module
2023-02-15 11:01:50 +02:00
range_tombstone_list_assertions.hh
Introduce mutation/ module
2023-02-14 11:19:03 +02:00
range_tombstone_list_test.cc
mutation: specialize fmt::formatter<range_tombstone_{entry,list}>
2023-04-26 09:00:25 +03:00
rate_limiter_test.cc
treewide: do not define/capture unused variables
2023-02-28 21:56:53 +08:00
reader_concurrency_semaphore_test.cc
test: Use BOOST_REQUIRE(db.has_schema())
2023-08-12 11:46:32 +03:00
recent_entries_map_test.cc
Fix test.py with compaction groups
2023-07-18 16:57:11 +03:00
repair_test.cc
database.hh: add_column_family: add readonly parameter
2023-09-13 23:17:20 +04:00
restrictions_test.cc
Merge 'mv: forbid IS NOT NULL on columns outside the primary key' from Jan Ciołek
2023-06-07 12:12:19 +03:00
result_utils_test.cc
treewide: do not define/capture unused variables
2023-02-28 21:56:53 +08:00
reusable_buffer_test.cc
utils: redesign reusable_buffer
2023-04-26 22:09:17 +02:00
role_manager_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
row_cache_test.cc
compact and remove expired range tombstones from cache on read
2023-09-01 07:17:49 +03:00
rust_test.cc
…
s3_test.cc
Merge 'Add metrics to S3 client' from Pavel Emelyanov
2023-09-14 09:49:08 +03:00
schema_change_test.cc
Merge 'Collect dangling object-store sstables' from Pavel Emelyanov
2023-09-21 09:15:00 +03:00
schema_changes_test.cc
test/boost/schema_changes_test: split long-running test
2023-06-26 11:24:07 +03:00
schema_loader_test.cc
test: use NetworkTopologyStrategy in all unit tests
2023-05-23 08:52:56 +03:00
schema_registry_test.cc
schema_tables: remove default value for reload in merge_schema
2023-09-15 13:04:04 +02:00
secondary_index_test.cc
db, storage_proxy: Drop mutation/frozen_mutation ::shard_of()
2023-06-21 00:58:24 +02:00
serialization_test.cc
treewide: s/boost::lexical_cast<std::string>/fmt::to_string()/
2023-04-21 09:43:53 +03:00
serialized_action_test.cc
serialized_action: make serialized_action abortable
2023-05-11 16:31:23 +03:00
service_level_controller_test.cc
treewide: use defaulted operator!=() and operator==()
2023-04-27 10:24:46 +03:00
small_vector_test.cc
treewide: use defaulted operator!=() and operator==()
2023-04-27 10:24:46 +03:00
snitch_reset_test.cc
treewide: do not define/capture unused variables
2023-02-28 21:56:53 +08:00
sstable_3_x_test.cc
system_keyspace: drop load phases
2023-09-13 23:17:20 +04:00
sstable_compaction_test.cc
system_keyspace: drop load phases
2023-09-13 23:17:20 +04:00
sstable_conforms_to_mutation_source_test.cc
test: flat_mutation_reader_assertions: squash r_t_cs with the same position
2023-06-27 14:37:25 +02:00
sstable_datafile_test.cc
sstable_set: maintain total bytes_on_disk
2023-08-14 21:07:27 +03:00
sstable_directory_test.cc
test: Make sstables with upload state in some cases
2023-08-14 15:28:54 +03:00
sstable_generation_test.cc
Revert "Revert "Merge 'treewide: add uuid_sstable_identifier_enabled support' from Kefu Chai""
2023-06-21 13:02:40 +03:00
sstable_move_test.cc
sstable: Make .change_state() accept state, not directory string
2023-08-14 15:40:44 +03:00
sstable_mutation_test.cc
sstables: partition_index_cache: deglobalize stats
2023-09-01 22:34:41 +02:00
sstable_partition_index_cache_test.cc
sstables: partition_index_cache: deglobalize stats
2023-09-01 22:34:41 +02:00
sstable_resharding_test.cc
test: remove unused #include in sstable_*_test.cc
2023-08-02 11:58:03 +03:00
sstable_set_test.cc
sstable_set: maintain total bytes_on_disk
2023-08-14 21:07:27 +03:00
sstable_test.cc
test: remove unused #include in sstable_*_test.cc
2023-08-02 11:58:03 +03:00
sstable_test.hh
compaction_manager: on_compaction_completion: erase sstables from sstables_requiring_cleanup
2023-08-08 08:16:46 +03:00
stall_free_test.cc
utils: clear_gently: add variants for optional values
2023-04-23 21:34:02 +03:00
statement_restrictions_test.cc
test: silence the deprecation warning.
2023-07-12 13:10:33 +03:00
storage_proxy_test.cc
token_metadata: update_topology: make endpoint_dc_rack arg optional
2023-09-11 16:16:19 +02:00
string_format_test.cc
Revert "test: string_format_test: don't compare std::string with sstring"
2023-05-29 23:03:24 +03:00
suite.yaml
test: boost/cache_algorithm_test: add cache_algorithm_test
2023-09-01 22:34:41 +02:00
summary_test.cc
…
tablets_test.cc
tests: tablets: do not compare signed integer with unsigned integer
2023-09-18 13:17:16 +02:00
tagged_integer_test.cc
utils: tagged_integer: implement std::numeric_limits::{min,max}
2023-05-15 10:19:39 +03:00
token_metadata_test.cc
locator: erm: Make get_endpoints_for_reading() always return read replicas
2023-07-25 21:08:01 +02:00
top_k_test.cc
treewide: stop using 'using namespace std' in namespace scope
2023-04-17 14:08:37 +03:00
total_order_check.hh
move to_string.hh to utils/
2023-02-15 11:09:04 +02:00
tracing_test.cc
tracing: remove qp.get_migration_manager() calls
2023-06-15 09:48:54 +02:00
transport_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
types_test.cc
make timestamp string format cassandra compatible
2023-07-27 12:01:09 +03:00
user_function_test.cc
cql3: enforce permissions on DROP FUNCTION
2023-03-09 17:51:15 +01:00
user_types_test.cc
test: use NetworkTopologyStrategy in all unit tests
2023-05-23 08:52:56 +03:00
utf8_test.cc
…
UUID_test.cc
treewide: do not use std::rel_ops
2023-04-26 14:09:58 +08:00
view_build_test.cc
test/boost/view_build_test: add test_view_update_generator_buffering_with_empty_mutations
2023-07-26 03:09:53 -04:00
view_complex_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
view_schema_ckey_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
view_schema_pkey_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
view_schema_test.cc
test: remove invalid IS NOT NULL restrictions from tests
2023-05-17 15:38:03 +02:00
vint_serialization_test.cc
…
virtual_reader_test.cc
test: Make cql_test_env::get_system_keyspace() return sharded
2023-03-06 13:17:21 +03:00
virtual_table_mutation_source_test.cc
code: Switch to seastar API level 7
2023-06-06 13:29:16 +03:00
virtual_table_test.cc
test: Enable Scylla test command line options for boost tests
2023-02-01 20:14:51 -03:00
wasm_alloc_test.cc
treewide: use #include <seastar/...> for seastar headers
2023-06-06 08:36:09 +03:00
wasm_test.cc
treewide: use #include <seastar/...> for seastar headers
2023-06-06 08:36:09 +03:00