mirrors/scylladb
1
0
Fork 0
mirror of https://github.com/scylladb/scylladb.git synced 2026-05-23 16:22:15 +00:00
Code Issues Packages Projects Releases Wiki Activity
53,948 Commits 247 Branches 552 Tags
b7fc661fa983f754ed25cd94de5dd8dd1bc9a98c
Commit Graph

80 Commits

Author SHA1 Message Date
Aleksandra Martyniuk
197635b44b compaction: delete generation of new sequence number for table tasks 
Compaction tasks covering table major, cleanup, offstrategy,
and upgrade sstables compaction inherit sequence number from their
parents. Thus they do not need to have a new sequence number
generated as it will be overwritten anyway.

Closes #14379
 2023-06-26 10:36:10 +03:00
Aleksandra Martyniuk
1960904a72 compaction: add shard_reshaping_compaction_task_impl 
shard_reshaping_compaction_task_impl covers reshaping compaction
on one shard.
 2023-06-23 16:22:38 +02:00
Aleksandra Martyniuk
e3e2d6b886 compaction: add table_reshaping_compaction_task_impl 2023-06-23 15:57:37 +02:00
Aleksandra Martyniuk
981a50e490 compaction: add reshaping_compaction_task_impl 
reshaping_compaction_task_impl serves as a base class of all
concrete reshaping compaction task classes.
 2023-06-23 12:53:15 +02:00
Aleksandra Martyniuk
53c24c0f7d compaction: create table_upgrade_sstables_compaction_task_impl 
Implementation of task_manager's task that covers upgrade sstables
compaction of one table.
 2023-05-31 14:59:24 +02:00
Aleksandra Martyniuk
143919cfa7 compaction: create table_offstrategy_keyspace_compaction_task_impl 
Implementation of task_manager's task that covers offstrategy keyspace
compaction of one table.
 2023-05-31 14:59:24 +02:00
Aleksandra Martyniuk
55ef1c24e1 compaction: create table_cleanup_keyspace_compaction_task_impl 
Implementation of task_manager's task that covers cleanup keyspace
compaction of one table.
 2023-05-31 14:59:24 +02:00
Aleksandra Martyniuk
5c7832ab59 compaction: create table_major_keyspace_compaction_task_impl 
Implementation of task_manager's task that covers major keyspace
compaction of one table.
 2023-05-31 14:59:24 +02:00
Aleksandra Martyniuk
f48b57e7b9 compaction: use table_info in compaction tasks 
Task manager compaction tasks need table names for logs.
Thus, compaction tasks store table infos instead of table ids.

get_table_ids function is deleted as it isn't used anywhere.
 2023-05-30 09:58:55 +02:00
Aleksandra Martyniuk
24864e39dd compaction: delete unnecessary sequence number incrementations 
Task manager's tasks that have parent task inherit sequence number
from their parents. Thus they do not need to have a new sequence number
generated as it will be overwritten anyway.

Closes #14045
 2023-05-29 23:03:25 +03:00
Aleksandra Martyniuk
83d3463d10 compaction: add table_scrub_sstables_compaction_task_impl 
Implementation of task_manager's task covering scrub sstables
compaction of one table.
 2023-05-09 11:15:25 +02:00
Aleksandra Martyniuk
d8e4a2fee3 compaction: add shard_scrub_sstables_compaction_task_impl 
Implementation of task_manager's task covering scrub sstables
compaction on one shard.
 2023-05-09 11:14:36 +02:00
Aleksandra Martyniuk
8d32579fe6 compaction: add scrub_sstables_compaction_task_impl 
Implementation of task_manager's task covering scrub sstables
compaction.
 2023-05-09 11:13:57 +02:00
Aleksandra Martyniuk
40809c887e compaction: rename rewrite_sstables_compaction_task_impl 
Rename rewrite_sstables_compaction_task_impl to
sstables_compaction_task_impl as a new name describes the class
of tasks better. Rewriting sstables is a slightly more fine-grained
type of sstable compaction task then the one needed here.
 2023-05-09 10:31:44 +02:00
Botond Dénes
525b21042f Merge 'Rewrite sstables keyspace compaction task' from Aleksandra Martyniuk 
Task manager task implementations of classes that cover
rewrite sstables keyspace compaction which can be start
through /storage_service/keyspace_compaction/ api.

Top level task covers the whole compaction and creates child
tasks on each shard.

Closes #12714

* github.com:scylladb/scylladb:
  test: extend test_compaction_task.py to test rewrite sstables compaction
  compaction: create task manager's task for rewrite sstables keyspace compaction on one shard
  compaction: create task manager's task for rewrite sstables keyspace compaction
  compaction: create rewrite_sstables_compaction_task_impl
 2023-04-12 08:38:59 +03:00
Aleksandra Martyniuk
25cfffc3ae compaction: rename local_offstrategy_keyspace_compaction_task_impl to shard_offstrategy_keyspace_compaction_task_impl 
Closes #13475
 2023-04-12 08:38:25 +03:00
Aleksandra Martyniuk
a93f044efa compaction: create task manager's task for rewrite sstables keyspace compaction on one shard 
Implementation of task_manager's task that covers rewrite sstables keyspace
compaction on one shard.
 2023-04-11 13:07:17 +02:00
Aleksandra Martyniuk
c4098df4ec compaction: create task manager's task for rewrite sstables keyspace compaction 
Implementation of task_manager's task covering rewrite sstables keyspace
compaction that can be started through storage_service api.
 2023-04-11 11:04:21 +02:00
Aleksandra Martyniuk
814254adfd compaction: create rewrite_sstables_compaction_task_impl 
rewrite_sstables_compaction_task_impl serves as a base class of all
concrete rewrite sstables compaction task classes.
 2023-04-11 11:03:09 +02:00
Aleksandra Martyniuk
8afa54d4f6 compaction: create task manager's task for offstrategy keyspace compaction on one shard 
Implementation of task_manager's task that covers local offstrategy keyspace compaction.
 2023-03-30 10:49:09 +02:00
Aleksandra Martyniuk
73860b7c9d compaction: create task manager's task for offstrategy keyspace compaction 
Implementation of task_manager's task covering offstrategy keyspace compaction
that can be started through storage_service api.
 2023-03-30 10:44:56 +02:00
Aleksandra Martyniuk
e8ef8a51d5 compaction: create offstrategy_compaction_task_impl 
offstrategy_compaction_task_impl serves as a base class of all
concrete offstrategy compaction task classes.
 2023-03-30 10:28:17 +02:00
Aleksandra Martyniuk
27b999808f compaction: create task manager's task for cleanup keyspace compaction on one shard 
Implementation of task_manager's task that covers cleanup keyspace compaction
on one shard.
 2023-03-13 16:35:39 +01:00
Aleksandra Martyniuk
7dd27205f6 compaction: create task manager's task for cleanup keyspace compaction 
Implementation of task_manager's task covering cleanup keyspace compaction
that can be started through storage_service api.
 2023-03-13 16:35:39 +01:00
Aleksandra Martyniuk
8801f326c6 compaction: create cleanup_compaction_task_impl 2023-03-13 16:35:39 +01:00
Aleksandra Martyniuk
b188060535 compaction: create task manager's task for major keyspace compaction on one shard 
Implementation of task_manager's task that covers major keyspace compaction
on one shard.
 2023-03-01 18:56:26 +01:00
Aleksandra Martyniuk
159e603ac4 compaction: create task manager's task for major keyspace compaction 
Implementation of task_manager's task covering major keyspace compaction
that can be started through storage_service api.
 2023-02-23 15:48:05 +01:00
Aleksandra Martyniuk
b908369e85 compaction: add major_compaction_task_impl 
All major compaction tasks will share some methods like
type or abort. The common part of the tasks should be
inherited from major_compaction_task_impl.
 2023-02-22 09:52:04 +01:00
Aleksandra Martyniuk
be101078a0 compacition: add pure virtual compaction_task_impl 
Add compaction_task_impl that is a pure virtual class from which
all compaction tasks implementations will inherit.
 2023-02-22 09:51:57 +01:00
Aleksandra Martyniuk
47ef689077 compaction: create and register task manager's module for compaction 
As an initial part of integration of compaction with task manager, compaction
module is added. Compaction module inherits from tasks::task_manager::module
and shared_ptr to it is kept in compaction manager. No compaction tasks are
created yet.
 2023-02-03 13:52:30 +01:00