Chris LuandGitHub ee54fd6c08 perf(weed/storage/super_block): intern the byte-encoded replica placements (#10610) ...

NewReplicaPlacementFromByte formatted the byte with fmt.Sprintf and parsed the
result back, allocating a string and a ReplicaPlacement every call. The master
calls it once per volume in every heartbeat, and keeps the pointer for the
lifetime of the volume, so a cluster with 1.6M volume replicas carries 1.6M of
these where a handful of distinct values exist.

The table is a flat pointer-free array, so it costs 6KB of static data and no
heap objects however few placements a cluster actually uses.

A byte only ever decodes to a valid placement, so the table is complete and the
error return stays nil.

BenchmarkSyncDataNodeRegistration/100000Volumes  500601 allocs/op -> 300589 allocs/op

2026-08-07 00:53:02 -07:00

..

backend

Add codespell support with configuration and typo fixes (#10393)

2026-07-22 14:38:06 -07:00

erasure_coding

mount: report data sizes to df with -df.logical (#10459)

2026-07-27 14:28:29 -07:00

idx

fix(scrub): don't flag offset-0 logical tombstones in volume scrub (#10148)

2026-06-30 02:01:14 -07:00

needle

perf(weed/storage/needle): intern the stored ttl values (#10611)

2026-08-07 00:51:52 -07:00

needle_map

Add codespell support with configuration and typo fixes (#10393)

2026-07-22 14:38:06 -07:00

super_block

perf(weed/storage/super_block): intern the byte-encoded replica placements (#10610)

2026-08-07 00:53:02 -07:00

test_files

Have volume scrubs account for zero-sized volumes. (#9609)

2026-05-21 09:42:07 -07:00

types

volume.fsck: fix orphan purge against the rust volume server (#10289)

2026-07-09 11:19:31 -07:00

volume_info

storage: register tier backends at the binary composition root (#9989)

2026-06-16 11:47:32 -07:00

volume_replica

fix(ec): bring ec.encode worker and EC/volume helpers to parity with shell (#9599)

2026-05-21 02:16:28 -07:00

disk_location_ec_realworld_test.go

EC bitrot detection: per-shard checksum sidecars (#9761)

2026-05-31 18:52:44 -07:00

disk_location_ec_shard_size_test.go

fix(volume_server): load orphan EC shards across disks on startup (#9212) (#9244)

2026-04-27 16:01:10 -07:00

disk_location_ec_test.go

fix(ec): never delete recoverable EC shards on startup/reconcile (the non-empty-.dat sibling of the stub bug) (#9941)

2026-06-12 23:51:29 -07:00

disk_location_ec.go

volume: fix EC decode/reconstruct index locality under -dir.idx (#10442)

2026-07-25 23:45:02 -07:00

disk_location_test.go

Implement RPC skeleton for regular/EC volumes scrubbing. (#8187)

2026-02-02 17:55:04 -08:00

disk_location.go

volume: fix EC decode/reconstruct index locality under -dir.idx (#10442)

2026-07-25 23:45:02 -07:00

ec_startup_shard_safety_test.go

fix(ec): never delete recoverable EC shards on startup/reconcile (the non-empty-.dat sibling of the stub bug) (#9941)

2026-06-12 23:51:29 -07:00

needle_map_leveldb_test.go

fix(volume): persist the leveldb needle map watermark at batch boundaries (#10557)

2026-08-04 13:33:31 -07:00

needle_map_leveldb.go

fix(volume): persist the leveldb needle map watermark at batch boundaries (#10557)

2026-08-04 13:33:31 -07:00

needle_map_memory.go

fix(volume): keep vacuum running past dangling .idx entries (#9115)

2026-04-16 22:01:34 -07:00

needle_map_metric_test.go

fix(volume): keep vacuum running past dangling .idx entries (#9115)

2026-04-16 22:01:34 -07:00

needle_map_metric.go

fix(volume): keep vacuum running past dangling .idx entries (#9115)

2026-04-16 22:01:34 -07:00

needle_map_sorted_file_test.go

fix(volume): seed indexFileOffset in SortedFileNeedleMap so Delete appends (#9483)

2026-05-13 10:22:01 -07:00

needle_map_sorted_file.go

volume: reject needle blob writes to read-only volumes (#10435)

2026-07-24 23:10:35 -07:00

needle_map.go

fix(volume): keep vacuum running past dangling .idx entries (#9115)

2026-04-16 22:01:34 -07:00

remote_tier_integration_test.go

volume: reload a remote-tiered volume without re-entering the data lock (#10266)

2026-07-08 01:27:10 -07:00

store_consolidate_index_test.go

volume: fix EC decode/reconstruct index locality under -dir.idx (#10442)

2026-07-25 23:45:02 -07:00

store_disk_space_test.go

[CheckDisk]: implement disk health detection (#9560)

2026-06-02 09:02:05 -07:00

store_duplicate_vid_test.go

fix(storage): delete/unmount every copy of a duplicate volume id (#9954)

2026-06-14 06:36:47 -07:00

store_ec_9plus3_reboot_repro_test.go

[CheckDisk]: implement disk health detection (#9560)

2026-06-02 09:02:05 -07:00

store_ec_delete.go

admin: report file and delete counts for EC volumes (#9060)

2026-04-13 21:10:36 -07:00

store_ec_disk_type_test.go

batch drain delta heartbeat messages (#9914)

2026-06-10 13:33:45 -07:00

store_ec_hybrid_repro_test.go

fix(ec): never delete recoverable EC shards on startup/reconcile (the non-empty-.dat sibling of the stub bug) (#9941)

2026-06-12 23:51:29 -07:00

store_ec_mirror_test.go

[CheckDisk]: implement disk health detection (#9560)

2026-06-02 09:02:05 -07:00

store_ec_mirror.go

fix(ec): mirror EC sidecars onto every shard-bearing disk at startup (#9525)

2026-05-17 19:55:15 -07:00

store_ec_mount_cross_disk_test.go

[CheckDisk]: implement disk health detection (#9560)

2026-06-02 09:02:05 -07:00

store_ec_orphan_shard_test.go

[CheckDisk]: implement disk health detection (#9560)

2026-06-02 09:02:05 -07:00

store_ec_phantom_dat_test.go

fix(storage): never let an empty .dat delete healthy distributed EC shards (#9930)

2026-06-11 20:26:20 -07:00

store_ec_reconcile.go

Add codespell support with configuration and typo fixes (#10393)

2026-07-22 14:38:06 -07:00

store_ec_recover_test.go

ec: recover EC shards whose .ecx index lives only on a peer server (#10108)

2026-06-25 10:38:14 -07:00

store_ec_recover.go

ec: recover EC shards whose .ecx index lives only on a peer server (#10108)

2026-06-25 10:38:14 -07:00

store_ec_recovery_test.go

Update store_ec_recovery_test.go

2026-01-23 16:38:36 -08:00

store_ec_scrub.go

EC scrubbing: list shards for needles failing scrubs in the result output. (#10510)

2026-08-01 00:27:06 -07:00

store_ec_target_location_test.go

[CheckDisk]: implement disk health detection (#9560)

2026-06-02 09:02:05 -07:00

store_ec.go

fix(ec): recover EC shards with the volume's own ratio, not the build default (#9958)

2026-06-14 07:32:36 -07:00

store_load_balancing_simple_test.go

create new volumes on less occupied disk locations (#7349)

2025-10-20 16:11:29 -07:00

store_load_balancing_test.go

volume: keep tier-uploaded volume reporting to master after volume.tier.upload (#10259)

2026-07-07 23:00:22 -07:00

store_maxvolume_deadzone_test.go

[CheckDisk]: implement disk health detection (#9560)

2026-06-02 09:02:05 -07:00

store_state.go

chore: remove ~50k lines of unreachable dead code (#8913)

2026-04-03 16:04:27 -07:00

store_status_test.go

volume server: fill in ModifiedAtSecond on the /status volume list (#10351)

2026-07-16 15:18:38 -07:00

store_vacuum_test.go

fix tests

2025-06-30 13:57:28 -07:00

store_vacuum.go

Process .ecj deletions during EC decode and vacuum decoded volume (#8863)

2026-04-01 01:15:26 -07:00

store.go

volume: fix EC decode/reconstruct index locality under -dir.idx (#10442)

2026-07-25 23:45:02 -07:00

volume_backup_test.go

…

volume_backup.go

add version to volume proto

2025-06-16 22:05:06 -07:00

volume_checking_test.go

fix(scrub): don't flag offset-0 logical tombstones in volume scrub (#10148)

2026-06-30 02:01:14 -07:00

volume_checking.go

fix(scrub): don't flag offset-0 logical tombstones in volume scrub (#10148)

2026-06-30 02:01:14 -07:00

volume_destroy_ec_vif_test.go

fix(storage): keep EC .vif when deleting a coexisting regular volume (#9723)

2026-05-28 15:39:31 -07:00

volume_idx_repair_test.go

volume: recover .idx rows overwritten by tiered deletes (#10474)

2026-07-28 16:48:30 -07:00

volume_idx_repair.go

volume: recover .idx rows overwritten by tiered deletes (#10474)

2026-07-28 16:48:30 -07:00

volume_info_test.go

…

volume_info.go

shell: show remote storage name/key in volume.list output (#9987)

2026-06-16 10:35:06 -07:00

volume_io_error_test.go

fix(volume): sticky EIO quarantine; track streamed reads (#9384)

2026-05-09 09:55:02 -07:00

volume_loading_corrupt_idx_test.go

fix(volume): avoid nil-deref when needle map loader errors (#9694) (#9697)

2026-05-26 16:56:49 -07:00

volume_loading.go

volume: recover .idx rows overwritten by tiered deletes (#10474)

2026-07-28 16:48:30 -07:00

volume_mark_writable_test.go

fix(volume): reopen .idx writable after MarkVolumeWritable (fixes #9515) (#9526)

2026-05-18 20:51:04 -07:00

volume_read_all.go

…

volume_read_test.go

fix(volume): don't panic on read when needle map is nil (#9342)

2026-05-06 18:23:06 -07:00

volume_read.go

fix(volume): sticky EIO quarantine; track streamed reads (#9384)

2026-05-09 09:55:02 -07:00

volume_super_block_replication_test.go

test: pin that a .vif replication outranks the superblock (#10499)

2026-07-30 17:03:38 -07:00

volume_super_block.go

Fix: Fail fast on unsupported volume versions (#8047)

2026-01-16 19:19:18 -08:00

volume_tier.go

volume: reload a remote-tiered volume without re-entering the data lock (#10266)

2026-07-08 01:27:10 -07:00

volume_vacuum_crash_safe_test.go

fix(vacuum): crash-safe compaction commit with a durable .cpc marker, fsync-before-rename, and a reload fence (#9944)

2026-06-13 20:06:24 -07:00

volume_vacuum_test.go

test: random needles always carry at least one byte (#10523)

2026-08-01 00:37:22 -07:00

volume_vacuum.go

volume: skip directory fsync on Windows, report a failed makeupDiff (#10572)

2026-08-04 21:02:52 -07:00

volume_write_test.go

Fix volume.merge corrupting every needle it copies (#10565)

2026-08-04 16:58:25 -07:00

volume_write.go

Fix volume.merge corrupting every needle it copies (#10565)

2026-08-04 16:58:25 -07:00

volume.go

volume: fix EC decode/reconstruct index locality under -dir.idx (#10442)

2026-07-25 23:45:02 -07:00