Ping Qiu da1b81d1c9 feat: CP8-3-1 durability modes + testrunner platform + 21 adversarial tests ...

Durability mode implementation (sync_all, sync_quorum, best_effort):
- DurabilityMode type with superblock persistence, parse/validate/string
- MakeDistributedSync mode-aware barrier enforcement in dist_group_commit
- blockerr sentinel package (ErrDurabilityBarrierFailed, ErrDurabilityQuorumLost)
- gRPC create path: mode validation, idempotent create consistency, partial cleanup
- F1: strict mode rejects partial replica provisioning with cleanup
- F3: empty heartbeat does not overwrite persisted strict mode
- F4: SCSI error mapping uses errors.Is sentinels (not string matching)
- Proto/wire/blockapi/CLI/UI plumbing for durability_mode field
- Observability dashboard: cluster health cards + per-volume columns

Testrunner platform (YAML-driven integration test framework):
- Engine, parser, registry, reporter (JUnit XML + HTML), metrics scraping
- 52 registered actions: block, iSCSI, I/O, fault injection, assertions
- Baseline regression framework with 7 hard-fail conditions
- 15 YAML scenarios (smoke, crash, HA, fault, consistency, snapshot)
- 49 unit tests for testrunner internals

QA adversarial suite (21 tests, all PASS):
- Idempotent create mode/RF mismatch detection
- Heartbeat mode downgrade prevention (F3)
- sync_all/sync_quorum partial replica enforcement (F1)
- Concurrent create race safety
- Failover/expand mode preservation
- Cleanup resilience when delete fails
- Master restart auto-register mode handling
- Superblock roundtrip all 3 modes
- Validate edge cases (mode×RF matrix)
- RequiredReplicas quorum math verification
- Sentinel error categorization

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

2026-03-06 01:06:51 -08:00

..

command_block_volume.go

feat: CP8-3-1 durability modes + testrunner platform + 21 adversarial tests

2026-03-06 01:06:51 -08:00

command_cluster_check.go

chore: execute goimports to format the code (#7983)

2026-01-07 13:06:08 -08:00

command_cluster_ps.go

chore: execute goimports to format the code (#7983)

2026-01-07 13:06:08 -08:00

command_cluster_raft_add.go

chore: execute goimports to format the code (#7983)

2026-01-07 13:06:08 -08:00

command_cluster_raft_leader_transfer_test.go

chore: execute goimports to format the code (#7983)

2026-01-07 13:06:08 -08:00

command_cluster_raft_leader_transfer.go

chore: execute goimports to format the code (#7983)

2026-01-07 13:06:08 -08:00

command_cluster_raft_ps.go

chore: execute goimports to format the code (#7983)

2026-01-07 13:06:08 -08:00

command_cluster_raft_remove.go

chore: execute goimports to format the code (#7983)

2026-01-07 13:06:08 -08:00

command_cluster_status_test.go

Update cluster.status to resolve file details on EC volumes. (#8268)

2026-02-09 17:52:43 -08:00

command_cluster_status.go

Fix file stat collection metric bug for the cluster.status command. (#8302)

2026-02-11 13:34:20 -08:00

command_collection_delete.go

Unify the parameter to disable dry-run on weed shell commands to -apply (instead of -force). (#7450)

2025-11-09 19:58:38 -08:00

command_collection_list.go

chore: execute goimports to format the code (#7983)

2026-01-07 13:06:08 -08:00

command_ec_balance.go

ec: add -diskType flag to EC commands for SSD support (#7607)

2025-12-10 22:42:52 -08:00

command_ec_common_avoid_test.go

Enhance EC balancing to separate parity and data shards (#8038)

2026-01-15 12:43:44 -08:00

command_ec_common_test.go

fix: EC rebalance fails with replica placement 000 (#7812)

2025-12-19 13:29:12 -08:00

command_ec_common.go

Add volume.scrub and ec.scrub shell commands to scrub regular & EC volumes on demand. (#8188)

2026-02-04 17:08:31 -08:00

command_ec_decode.go

Fix reporting of EC shard sizes from nodes to masters. (#7835)

2025-12-28 19:30:42 -08:00

command_ec_encode_test.go

add tests

2026-02-09 01:37:56 -08:00

command_ec_encode.go

fix ec.encode skipping volumes when one replica is on a full disk (#8227)

2026-02-09 14:23:11 -08:00

command_ec_rebuild_test.go

avoid extra missing shard warning

2026-01-04 00:38:53 -08:00

command_ec_rebuild.go

opt: reduce ShardsInfo memory usage with bitmap and sorted slice (#7974)

2026-01-06 00:09:52 -08:00

command_ec_scrub.go

Implement local scrubbing for EC volumes. (#8283)

2026-02-11 11:04:08 -08:00

command_ec_test.go

Fix reporting of EC shard sizes from nodes to masters. (#7835)

2025-12-28 19:30:42 -08:00

command_fs_cat.go

Shell: Added a helper function isHelpRequest() (#7380)

2025-10-24 20:21:35 -07:00

command_fs_cd.go

Shell: Added a helper function isHelpRequest() (#7380)

2025-10-24 20:21:35 -07:00

command_fs_configure.go

Unify the parameter to disable dry-run on weed shell commands to -apply (instead of -force). (#7450)

2025-11-09 19:58:38 -08:00

command_fs_du.go

Shell: Added a helper function isHelpRequest() (#7380)

2025-10-24 20:21:35 -07:00

command_fs_log.go

chore: execute goimports to format the code (#7983)

2026-01-07 13:06:08 -08:00

command_fs_ls.go

Shell: Added a helper function isHelpRequest() (#7380)

2025-10-24 20:21:35 -07:00

command_fs_merge_volumes.go

Fix volume.fsck -forcePurging -reallyDeleteFromVolume to fail fast on filer traversal errors (#8015)

2026-01-14 21:37:50 -08:00

command_fs_meta_cat.go

Shell: Added a helper function isHelpRequest() (#7380)

2025-10-24 20:21:35 -07:00

command_fs_meta_change_volume_id.go

Fix volume.fsck -forcePurging -reallyDeleteFromVolume to fail fast on filer traversal errors (#8015)

2026-01-14 21:37:50 -08:00

command_fs_meta_load.go

use ReadFull (#40) (#8240)

2026-02-06 20:51:47 -08:00

command_fs_meta_notify.go

Fix volume.fsck -forcePurging -reallyDeleteFromVolume to fail fast on filer traversal errors (#8015)

2026-01-14 21:37:50 -08:00

command_fs_meta_save.go

shell: fix potential deadlock in fs.meta.save BFS traversal

2026-01-29 14:42:10 -08:00

command_fs_mkdir.go

Shell: Added a helper function isHelpRequest() (#7380)

2025-10-24 20:21:35 -07:00

command_fs_mv.go

Shell: Added a helper function isHelpRequest() (#7380)

2025-10-24 20:21:35 -07:00

command_fs_pwd.go

Shell: Added a helper function isHelpRequest() (#7380)

2025-10-24 20:21:35 -07:00

command_fs_rm.go

Shell: Added a helper function isHelpRequest() (#7380)

2025-10-24 20:21:35 -07:00

command_fs_tree.go

Shell: Added a helper function isHelpRequest() (#7380)

2025-10-24 20:21:35 -07:00

command_fs_verify.go

shell: update fs.verify and volume.fsck for new BFS signature

2026-01-29 14:42:10 -08:00

command_lock_unlock.go

chore: execute goimports to format the code (#7983)

2026-01-07 13:06:08 -08:00

command_mount_configure.go

Clean up logs and deprecated functions (#7339)

2025-10-17 22:11:50 -07:00

command_mq_balance.go

chore: execute goimports to format the code (#7983)

2026-01-07 13:06:08 -08:00

command_mq_topic_compact.go

Add Kafka Gateway (#7231)

2025-10-13 18:05:17 -07:00

command_mq_topic_configure.go

chore: execute goimports to format the code (#7983)

2026-01-07 13:06:08 -08:00

command_mq_topic_desc.go

chore: execute goimports to format the code (#7983)

2026-01-07 13:06:08 -08:00

command_mq_topic_list.go

chore: execute goimports to format the code (#7983)

2026-01-07 13:06:08 -08:00

command_mq_topic_truncate.go

Message Queue: Add sql querying (#7185)

2025-09-09 01:01:03 -07:00

command_remote_cache.go

s3: fix remote object not caching (#7790)

2025-12-16 12:41:04 -08:00

command_remote_configure.go

add one example

2025-12-28 11:39:06 -08:00

command_remote_copy_local.go

Add remote.copy.local command to copy local files to remote storage (#8033)

2026-01-15 00:52:57 -08:00

command_remote_meta_sync.go

Fix remote.meta.sync TTL issue (#8021) (#8030)

2026-01-14 14:45:52 -08:00

command_remote_mount_buckets.go

chore: execute goimports to format the code (#7983)

2026-01-07 13:06:08 -08:00

command_remote_mount.go

Fix remote.meta.sync TTL issue (#8021) (#8030)

2026-01-14 14:45:52 -08:00

command_remote_uncache_test.go

shell: add minCacheAge flag to remote.uncache command (#8225)

2026-02-05 12:57:27 -08:00

command_remote_uncache.go

shell: add minCacheAge flag to remote.uncache command (#8225)

2026-02-05 12:57:27 -08:00

command_remote_unmount.go

chore: execute goimports to format the code (#7983)

2026-01-07 13:06:08 -08:00

command_s3_bucket_create.go

feat(shell): add Object Lock management commands (#8141)

2026-01-27 10:50:16 -08:00

command_s3_bucket_delete.go

fix: admin UI bucket delete now properly deletes collection and checks Object Lock (#7734)

2025-12-13 13:41:25 -08:00

command_s3_bucket_list.go

shell: add -owner flag to s3.bucket.create command (#7728)

2025-12-12 18:06:13 -08:00

command_s3_bucket_lock.go

feat(shell): add Object Lock management commands (#8141)

2026-01-27 10:50:16 -08:00

command_s3_bucket_owner.go

shell: add -owner flag to s3.bucket.create command (#7728)

2025-12-12 18:06:13 -08:00

command_s3_bucket_quota_check.go

Reduce memory allocations in hot paths (#7725)

2025-12-12 12:51:48 -08:00

command_s3_bucket_quota.go

convert error fromating to %w everywhere (#6995)

2025-07-16 23:39:27 -07:00

command_s3_bucket_versioning.go

Chart createBuckets config #8368: Add TTL, Object Lock, and Versioning support (#8375)

2026-02-26 11:56:10 -08:00

command_s3_circuitbreaker_test.go

refactor(shell): readability improvements (#3704)

2022-09-16 02:43:49 -07:00

command_s3_circuitbreaker.go

chore(deps): bump gocloud.dev from 0.40.0 to 0.41.0 (#6679)

2025-03-31 21:42:54 -07:00

command_s3_clean_uploads.go

convert error fromating to %w everywhere (#6995)

2025-07-16 23:39:27 -07:00

command_s3_configure.go

fix(iam): ensure access key status is persisted and defaulted to Active (#8341)

2026-02-13 20:28:41 -08:00

command_s3_policy.go

IAM Policy Management via gRPC (#8109)

2026-01-25 13:39:30 -08:00

command_s3tables_bucket.go

Add s3tables shell and admin UI (#8172)

2026-01-30 22:57:05 -08:00

command_s3tables_namespace.go

Add s3tables shell and admin UI (#8172)

2026-01-30 22:57:05 -08:00

command_s3tables_table.go

Add s3tables shell and admin UI (#8172)

2026-01-30 22:57:05 -08:00

command_s3tables_tag.go

Add s3tables shell and admin UI (#8172)

2026-01-30 22:57:05 -08:00

command_volume_balance_test.go

Shell: support regular expression for collection selection (#7158)

2025-08-23 11:04:24 -07:00

command_volume_balance.go

[shell]: volume balance capacity by min volume density (#8026)

2026-02-19 13:30:59 -08:00

command_volume_check_disk_test.go

Mutex command output writes for volume.check.disk. (#7605)

2025-12-02 10:14:24 -08:00

command_volume_check_disk.go

Fix handling of fixed read-only volumes for volume.check.disk. (#7612)

2025-12-03 11:33:35 -08:00

command_volume_configure_replication.go

Fix #8040: Support '_default' keyword in collectionPattern to match default collection (#8046)

2026-01-16 12:31:48 -08:00

command_volume_copy.go

Fix live volume move tail timestamp (#8440)

2026-02-24 20:07:26 -08:00

command_volume_delete_empty.go

Unify the parameter to disable dry-run on weed shell commands to -apply (instead of -force). (#7450)

2025-11-09 19:58:38 -08:00

command_volume_delete.go

chore: execute goimports to format the code (#7983)

2026-01-07 13:06:08 -08:00

command_volume_fix_replication_test.go

Fix/copy before delete replication (#6064)

2024-09-26 08:34:13 -07:00

command_volume_fix_replication.go

Fix #8040: Support '_default' keyword in collectionPattern to match default collection (#8046)

2026-01-16 12:31:48 -08:00

command_volume_fsck.go

Fix volume.fsck crashing on EC volumes and add multi-volume vacuum support (#8406)

2026-02-22 22:07:15 -08:00

command_volume_grow.go

chore: execute goimports to format the code (#7983)

2026-01-07 13:06:08 -08:00

command_volume_list_test.go

opt: reduce ShardsInfo memory usage with bitmap and sorted slice (#7974)

2026-01-06 00:09:52 -08:00

command_volume_list.go

Fix inconsistent TTL reporting in volume.list #8158 (#8164)

2026-01-29 14:16:42 -08:00

command_volume_mark.go

refactor

2024-09-29 10:38:22 -07:00

command_volume_merge_test.go

go fmt

2026-02-25 10:25:23 -08:00

command_volume_merge.go

Adds volume.merge command with deduplication and disk-based backend (#8441)

2026-02-25 10:12:09 -08:00

command_volume_mount.go

chore: execute goimports to format the code (#7983)

2026-01-07 13:06:08 -08:00

command_volume_move.go

Fix live volume move tail timestamp (#8440)

2026-02-24 20:07:26 -08:00

command_volume_replica_check_test.go

chore: execute goimports to format the code (#7983)

2026-01-07 13:06:08 -08:00

command_volume_replica_check.go

fix: sync replica entries before ec.encode and volume.tier.move (#7798)

2025-12-16 23:16:07 -08:00

command_volume_scrub.go

Implement full scrubbing for regular volumes (#8254)

2026-02-13 15:47:29 -08:00

command_volume_server_evacuate_test.go

fix tests

2023-03-13 10:00:27 -07:00

command_volume_server_evacuate.go

Enhance EC balancing to separate parity and data shards (#8038)

2026-01-15 12:43:44 -08:00

command_volume_server_leave.go

Unify the parameter to disable dry-run on weed shell commands to -apply (instead of -force). (#7450)

2025-11-09 19:58:38 -08:00

command_volume_server_state.go

Add weed shell command volumeServer.state to query/update volume server state settings. (#8271)

2026-02-11 11:02:37 -08:00

command_volume_tier_download.go

Shell: support regular expression for collection selection (#7158)

2025-08-23 11:04:24 -07:00

command_volume_tier_move.go

Fix #8040: Support '_default' keyword in collectionPattern to match default collection (#8046)

2026-01-16 12:31:48 -08:00

command_volume_tier_upload.go

Shell: support regular expression for collection selection (#7158)

2025-08-23 11:04:24 -07:00

command_volume_unmount.go

chore: execute goimports to format the code (#7983)

2026-01-07 13:06:08 -08:00

command_volume_vacuum_disable.go

refactor

2024-09-29 10:38:22 -07:00

command_volume_vacuum_enable.go

refactor

2024-09-29 10:38:22 -07:00

command_volume_vacuum.go

Fix volume.fsck crashing on EC volumes and add multi-volume vacuum support (#8406)

2026-02-22 22:07:15 -08:00

command.go

refactor

2024-09-29 10:38:22 -07:00

commands.go

[shell]: volume balance capacity by min volume density (#8026)

2026-02-19 13:30:59 -08:00

common_test.go

Humanize output for weed.server by default (#7758)

2025-12-15 11:18:45 -08:00

common.go

Fix #8040: Support '_default' keyword in collectionPattern to match default collection (#8046)

2026-01-16 12:31:48 -08:00

ec_proportional_rebalance_test.go

fix: EC rebalance fails with replica placement 000 (#7812)

2025-12-19 13:29:12 -08:00

ec_proportional_rebalance.go

Fix reporting of EC shard sizes from nodes to masters. (#7835)

2025-12-28 19:30:42 -08:00

ec_rebalance_slots_test.go

opt: reduce ShardsInfo memory usage with bitmap and sorted slice (#7974)

2026-01-06 00:09:52 -08:00

s3tables_helpers.go

Add s3tables shell and admin UI (#8172)

2026-01-30 22:57:05 -08:00

shell_liner_test.go

shell: allow spaces in arguments via quoting (#8157) (#8165)

2026-01-29 19:06:17 -08:00

shell_liner.go

shell: allow spaces in arguments via quoting (#8157) (#8165)

2026-01-29 19:06:17 -08:00

volume.ecshards.txt

Humanize output for weed.server by default (#7758)

2025-12-15 11:18:45 -08:00

volume.list2.txt

Humanize output for weed.server by default (#7758)

2025-12-15 11:18:45 -08:00

volume.list.txt

Humanize output for weed.server by default (#7758)

2025-12-15 11:18:45 -08:00