Avi Kivity adf9c426c2 Merge 'db/config: Change default SSTable compressor to LZ4WithDictsCompressor' from Nikos Dragazis ...

`sstable_compression_user_table_options` allows configuring a node-global SSTable compression algorithm for user tables via scylla.yaml. The current default is LZ4Compressor (inherited from Cassandra).

Make LZ4WithDictsCompressor the new default. Metrics from real datasets in the field have shown significant improvements in compression ratios.

If the dictionary compression feature is not enabled in the cluster (e.g., during an upgrade), fall back to the `LZ4Compressor`. Once the feature is enabled, flip the default back to the dictionary compressor using with a listener callback.

Fixes #26610.

Closes scylladb/scylladb#26697

* github.com:scylladb/scylladb:
  test/cluster: Add test for default SSTable compressor
  db/config: Change default SSTable compressor to LZ4WithDictsCompressor
  db/config: Deprecate sstable_compression_dictionaries_allow_in_ddl
  boost/cql_query_test: Get expected compressor from config

2025-10-31 21:15:18 +02:00

..

auth_cluster

test: add test_anonymous_user to test_raft_service_levels

2025-10-24 12:23:34 +02:00

dtest

test: cluster: dtest: alternator: Force RF=1 in test_putitem_contention

2025-10-29 23:32:58 +01:00

lwt

Revert "tests(lwt): new test for LWT testing during tablet resize"

2025-10-30 08:50:40 +01:00

mv

test: cluster: mv: Do not move tablets across racks

2025-10-29 23:32:57 +01:00

object_store

test: object_store: test_backup: Adjust for rack lists

2025-10-29 23:32:57 +01:00

random_failures

test/cluster/random_failures: Re-enable index events

2025-10-28 14:17:14 +01:00

tasks

test: Fix drain api in task_manager_client.py

2025-08-11 10:10:07 +08:00

__init__.py

…

conftest.py

test::cluster::conftest: Add key_provider fixture

2025-10-22 10:53:02 +00:00

suite.yaml

test: dtest: limits_test.py: make the tests work

2025-09-29 12:39:53 +02:00

test_aggregation.py

…

test_alternator.py

test: alternator: Adjust for rack lists

2025-10-29 23:32:58 +01:00

test_automatic_cleanup.py

test_automatic_cleanup: fix comment

2025-10-28 17:55:20 +01:00

test_bad_initial_token.py

test: cluster: add test_bad_initial_token

2025-04-25 12:25:15 +02:00

test_batchlog_manager.py

test: add reproducer for data resurrection

2025-10-23 10:39:43 +02:00

test_blocked_bootstrap.py

…

test_boot_after_ip_change.py

…

test_boot_nodes.py

test: Add test_boot_nodes.py

2025-07-10 10:56:53 +08:00

test_bti_index.py

test/cluster/test_bti_index.py: avoid a race with CQL tracing

2025-10-09 13:22:06 +03:00

test_cdc_generation_clearing.py

test_cdc_generation_clearing: wait for generations to propagate

2025-06-09 12:59:04 +02:00

test_cdc_generation_data.py

raft_group0: split shutdown into abort_and_drain and destroy

2025-07-25 17:16:14 +02:00

test_cdc_generation_publishing.py

test_cdc_generation_publishing: fix to read monotonically

2025-05-30 08:35:56 +02:00

test_cdc_with_alter.py

test: test_cdc_with_alter: adjust for cdc with tablets

2025-09-17 14:47:13 +02:00

test_cdc_with_tablets.py

test: cdc: extend cdc with tablets tests

2025-10-28 15:06:21 +01:00

test_change_ip.py

test/cluster: Adjust simple tests to RF-rack-validity

2025-05-10 16:30:18 +02:00

test_change_replication_factor_1_to_0.py

test: cluster: deflake consistency checks after decommission

2025-09-09 19:01:12 +02:00

test_change_rpc_address.py

test/cluster: Adjust simple tests to RF-rack-validity

2025-05-10 16:30:18 +02:00

test_cluster_features.py

…

test_commitlog_segment_data_resurrection.py

…

test_commitlog.py

…

test_concurrent_schema.py

…

test_config_live_updates.py

test: add test for live updates of generic server config

2025-06-23 17:56:26 +02:00

test_config.py

…

test_conflicting_keys_read_repair.py

test/cluster: Adjust simple tests to RF-rack-validity

2025-05-10 16:30:18 +02:00

test_coordinator_queue_management.py

test.py: rework log_browsing for dtest migration

2025-05-19 11:50:55 +00:00

test_crash_coordinator_before_streaming.py

…

test_data_resurrection_after_cleanup.py

test: cluster: deflake consistency checks after decommission

2025-09-09 19:01:12 +02:00

test_data_resurrection_in_memtable.py

test/cluster: Adjust simple tests to RF-rack-validity

2025-05-10 16:30:18 +02:00

test_decommission.py

test: cluster: deflake consistency checks after decommission

2025-09-09 19:01:12 +02:00

test_deprecating_cluster_features.py

…

test_describe.py

cql3: Represent create_statement using managed_string

2025-07-01 12:58:02 +02:00

test_different_group0_ids.py

test.py: rewrite the wait_for_first_completed

2025-10-22 01:13:43 +03:00

test_encryption.py

test::cluster::test_encryption: Port dtest EAR tests

2025-10-22 14:06:30 +00:00

test_error_becoming_voter.py

…

test_fencing.py

test_fencing: fix due to new version increment

2025-10-22 16:31:43 +02:00

test_global_ignore_nodes.py

test/cluster: Adjust simple tests to RF-rack-validity

2025-05-10 16:30:18 +02:00

test_gossip_boot.py

…

test_gossiper_empty_self_id_on_shadow_round.py

gossiper: fix empty initial local node state

2025-09-08 11:38:31 +02:00

test_gossiper_orphan_remover.py

…

test_gossiper_race.py

gossiper: check for a race condition in do_apply_state_locally

2025-09-08 11:38:30 +02:00

test_gossiper.py

…

test_group0_schema_versioning.py

test: Create cluster with multiple racks in multi-dc setups

2025-10-29 23:32:57 +01:00

test_hints.py

test.py: rewrite the wait_for_first_completed

2025-10-22 01:13:43 +03:00

test_incremental_repair.py

repair: Rename incremental mode name

2025-10-10 15:21:54 +03:00

test_initial_token.py

test/cluster/conftest: cluster_con: provide default values for port and use_ssl

2025-08-22 09:51:24 +03:00

test_ip_mappings.py

…

test_keyspace_rf.py

test: Generalize tests to work with both numeric RF and rack lists

2025-10-29 23:32:58 +01:00

test_long_join.py

test: improve async execution in test_long_join

2025-09-08 17:14:37 +02:00

test_long_query_timeout_erm.py

test.py: rewrite the wait_for_first_completed

2025-10-22 01:13:43 +03:00

test_lwt_semaphore.py

…

test_maintenance_mode.py

test/cluster/conftest: cluster_con: provide default values for port and use_ssl

2025-08-22 09:51:24 +03:00

test_major_compaction.py

replica/table: do not stop major compaction when disabling auto compaction

2025-10-29 19:22:07 +05:30

test_metadata_id.py

test/cluster/conftest: cluster_con: provide default values for port and use_ssl

2025-08-22 09:51:24 +03:00

test_multidc.py

cql3: ks_prop_defs: Expand numeric RF to rack list

2025-10-29 23:32:59 +01:00

test_mutation_schema_change.py

…

test_mv.py

…

test_no_dc_rack_change.py

…

test_no_removed_node_event_on_ip_change.py

test/cluster/conftest: cluster_con: provide default values for port and use_ssl

2025-08-22 09:51:24 +03:00

test_node_isolation.py

tiering (test.py): introduce tiering labels

2025-08-04 15:38:16 +03:00

test_node_ops_metrics.py

test/pylib/rest_client: fix ScyllaMetrics filtering

2025-08-10 10:16:00 +02:00

test_node_shutdown_waits_for_pending_requests.py

…

test_nodetool.py

…

test_not_enough_token_owners.py

tablets: scheduler: Balance racks separately when rf_rack_valid_keyspaces is true

2025-09-23 00:30:37 +02:00

test_query_rebounce.py

…

test_raft_cluster_features.py

test/cluster: Add test_simulate_upgrade_legacy_to_raft_listener_registration

2025-10-28 17:32:15 +01:00

test_raft_fix_broken_snapshot.py

…

test_raft_ignore_nodes.py

…

test_raft_no_quorum.py

test: test_raft_no_quorum: test_can_restart: deflake the read barrier call

2025-10-10 15:22:39 +03:00

test_raft_recovery_basic.py

…

test_raft_recovery_during_join.py

test: assert that majority is lost in some tests of the recovery procedure

2025-10-07 17:48:55 +02:00

test_raft_recovery_entry_loss.py

test: unskip test_raft_recovery_entry_loss

2025-10-24 21:23:41 +03:00

test_raft_recovery_majority_loss.py

…

test_raft_recovery_stuck.py

test: test_raft_recovery_stuck: reconnect driver after rolling restarts

2025-10-28 13:24:23 +03:00

test_raft_recovery_user_data.py

test: assert that majority is lost in some tests of the recovery procedure

2025-10-07 17:48:55 +02:00

test_raft_snapshot_request.py

…

test_raft_snapshot_truncation.py

…

test_raft_voters.py

test/cluster/conftest: cluster_con: provide default values for port and use_ssl

2025-08-22 09:51:24 +03:00

test_random_tables.py

…

test_read_repair.py

test/cluster/test_read_repair: write 100 rows in trace test

2025-06-27 16:23:08 +03:00

test_refresh.py

Add nodetool refresh --scope option

2025-05-29 16:12:09 +03:00

test_remove_alive_node.py

…

test_remove_rpc_client_with_pending_requests.py

test/cluster: Adjust simple tests to RF-rack-validity

2025-05-10 16:30:18 +02:00

test_repair.py

test/cluster/test_repair: test_vnode_keyspace_describe_ring: verify that describe_ring results agree with natural_endpoints

2025-08-21 11:48:17 +03:00

test_replace_alive_node.py

…

test_replace_ignore_nodes.py

…

test_replace_with_encryption.py

…

test_replace_with_same_ip_twice.py

…

test_replace.py

test.py: rework log_browsing for dtest migration

2025-05-19 11:50:55 +00:00

test_replica_exceptions.py

test: cluster: test replica write timeout

2025-10-17 11:52:11 +02:00

test_restart_cluster.py

…

test_resurrection.py

…

test_reversed_queries_during_simulated_upgrade_process.py

test/cluster: Adjust simple tests to RF-rack-validity

2025-05-10 16:30:18 +02:00

test_rpc_compression.py

test/cluster: Adjust simple tests to RF-rack-validity

2025-05-10 16:30:18 +02:00

test_select_from_mutation_fragments.py

test/cluster: Adjust simple tests to RF-rack-validity

2025-05-10 16:30:18 +02:00

test_shutdown_hang.py

…

test_snapshot.py

test: add type creation to test_snapshot

2025-07-10 10:46:55 +02:00

test_sstable_cleanup_stop.py

compaction: Fix stop of sstable cleanup

2025-09-11 08:55:10 +03:00

test_sstable_compression_config.py

test/cluster: Add test for default SSTable compressor

2025-10-30 15:53:54 +02:00

test_sstable_compression_dictionaries_autotrain.py

test/cluster: Adjust simple tests to RF-rack-validity

2025-05-10 16:30:18 +02:00

test_sstable_compression_dictionaries_basic.py

db/config: Deprecate sstable_compression_dictionaries_allow_in_ddl

2025-10-29 20:13:08 +02:00

test_sstable_compression_dictionaries_upgrade.py

pylib: extract upgrade helpers from test_sstable_compression_dictionaries_upgrade.py

2025-09-15 12:34:45 +02:00

test_sstable_set.py

test: Verify partitioned set store split and unsplit correctly

2025-04-29 15:47:33 -03:00

test_start_bootstrapped_with_invalid_seed.py

…

test_streaming_deadlock.py

test: limit test_streaming_deadlock_removenode concurrency

2025-09-19 12:50:20 +03:00

test_table_desc_read_barrier.py

…

test_table_drop.py

test: test table drop during flush

2025-04-23 14:29:28 +02:00

test_tablet_repair_scheduler.py

repair: Avoid too many fragments in a single repair_row_on_wire

2025-07-29 13:43:53 +08:00

test_tablet_stats.py

topology_coordinator: Make tablet_load_stats_refresh_interval configurable

2025-07-31 14:31:55 +03:00

test_tablets2.py

Merge 'tablet_sstable_streamer: defer SSTable unlinking until fully streamed' from Taras Veretilnyk

2025-10-28 13:25:40 +03:00

test_tablets_colocation.py

test: adjust existing tests

2025-08-27 10:23:04 +02:00

test_tablets_cql.py

test: Switch to rack-list based RF

2025-10-29 23:32:58 +01:00

test_tablets_intranode.py

…

test_tablets_lwt.py

test_tablets_lwt: add test_tablets_merge_waits_for_lwt

2025-10-22 11:33:20 +02:00

test_tablets_merge.py

test_tablets_merge: test_tablet_split_merge_with_many_tables: reduce number of tables in debug mode

2025-09-29 15:30:13 +03:00

test_tablets_migration.py

test: cluster: tablets: Do not move tablet across racks in test_tablet_transition_sanity

2025-10-29 23:32:57 +01:00

test_tablets_removenode.py

test/cluster: Disable rf_rack_valid_keyspaces in problematic tests

2025-05-10 16:30:49 +02:00

test_tablets.py

Merge 'Auto expand to rack list' from Tomasz Grabiec

2025-10-30 21:54:08 +02:00

test_tls.py

test/cluster: Adjust simple tests to RF-rack-validity

2025-05-10 16:30:18 +02:00

test_tombstone_gc.py

Merge 'raft topology: fix group0 tombstone GC in the Raft-based recovery procedure' from Patryk Jędrzejczak

2025-10-22 16:40:11 +03:00

test_topology_failure_recovery.py

…

test_topology_ops_encrypted.py

test: cluster: deflake consistency checks after decommission

2025-09-09 19:01:12 +02:00

test_topology_ops.py

test: cluster: deflake consistency checks after decommission

2025-09-09 19:01:12 +02:00

test_topology_recovery_basic.py

test.py: apply the nightly label on test_topology_recovery_basic

2025-09-01 14:16:29 +02:00

test_topology_recovery_majority_loss.py

test/cluster/conftest: cluster_con: provide default values for port and use_ssl

2025-08-22 09:51:24 +03:00

test_topology_rejoin.py

…

test_topology_remove_decom.py

raft_topology: Modify the conditional logic in remove node operation to enhance concurrency for raft enabled clusters.

2025-09-17 15:23:32 +05:30

test_topology_remove_garbage_group0.py

…

test_topology_schema.py

…

test_topology_smp.py

test/cluster: Adjust simple tests to RF-rack-validity

2025-05-10 16:30:18 +02:00

test_topology_upgrade_not_stuck_after_recent_removal.py

…

test_topology_upgrade_stuck.py

test.py: rewrite the wait_for_first_completed

2025-10-22 01:13:43 +03:00

test_topology_upgrade.py

…

test_truncate_concurrent_writes.py

truncate: add test for truncate with concurrent writes

2025-08-05 13:54:14 +02:00

test_truncate_with_drop.py

system_keyspace: Prune dropped tables from truncation on start/drop

2025-09-03 07:25:34 +03:00

test_truncate_with_tablets.py

topology coordinator: allow running multiple global commands in parallel

2025-06-11 11:29:33 +03:00

test_unfinished_writes_during_shutdown.py

storage_service: Cancel all write requests on storage_proxy shutdown

2025-07-22 15:03:30 +02:00

test_view_build_status.py

test/cluster: add view build status tests

2025-08-27 10:23:04 +02:00

test_view_building_coordinator.py

test: Switch to rack-list based RF

2025-10-29 23:32:58 +01:00

test_write_query_during_cql_server_shutdown.py

generic_server: Two-step connection shutdown.

2025-07-28 10:08:06 +02:00

test_writes_to_previous_cdc_generations.py

…

test_zero_token_nodes_multidc.py

test: cluster: test_zero_token_nodes_multidc: Adjust to rack list RF

2025-10-29 23:32:58 +01:00

test_zero_token_nodes_no_replication.py

test/cluster/conftest: cluster_con: provide default values for port and use_ssl

2025-08-22 09:51:24 +03:00

test_zero_token_nodes_topology_ops.py

test/cluster/test_zero_token_nodes_topology_ops: Adjust to RF-rack-validity

2025-05-10 16:30:34 +02:00

util.py

test: Generalize tests to work with both numeric RF and rack lists

2025-10-29 23:32:58 +01:00