Commit Graph

  • 3b3fe1699f volume: read the leader field first on each heartbeat reply (rust) Chris Lu 2026-10-21 12:22:30 -07:00
  • f453a37a26 volume: ask the masters for the leader after losing the heartbeat (rust) Chris Lu 2026-10-21 12:21:36 -07:00
  • ea4987f941 volume: publish the master only once it is known leader (rust) Chris Lu 2026-10-21 12:21:00 -07:00
  • bb1ba8b247 iam: take the implicit user name from the verified identity (#11903) Chris LuandGitHub 2026-10-21 12:21:04 -07:00
  • 593cfee85b s3tables: accept Puffin statistics files in a table's metadata/ (#11892) 2026-10-21 15:19:53 -04:00
  • e6afa30579 volume: publish the answering leader before a duplicate-uuid retry Chris LuandDevin <158243242+devin-ai-integration[bot]@users.noreply.github.com> 2026-10-21 12:15:25 -07:00
  • 3d9757859f s3: list nothing under an empty directory's own prefix fix-11744-list-empty-dir Chris Lu 2026-10-21 11:41:34 -07:00
  • 03065155db filer.remote.sync: do not upload an entry whose only content is the remote object (#11890) Daniel GarcíaandGitHub 2026-10-21 13:32:20 -05:00
  • aa3a9e8770 volume: keep volumeSizeLimit 64-bit aligned on 32-bit builds DevinandDevin <158243242+devin-ai-integration[bot]@users.noreply.github.com> 2026-10-21 11:23:10 -07:00
  • 49d15f4287 volume: clear the leader when no master names one Lisandro PinandClaude Opus 5.5 2026-10-21 15:44:10 +02:00
  • c127f065d0 test: stop the heartbeat on a failed assertion Lisandro PinandClaude Opus 5.5 2026-10-21 15:22:34 +02:00
  • a5925906c8 volume: ask the masters for the leader after losing the heartbeat Lisandro PinandClaude Opus 5.5 2026-10-21 15:14:10 +02:00
  • e680a78d68 volume: route lookups to the leader master only (#11887) Lisandro PinandClaude Opus 5.5 2026-10-21 15:07:04 +02:00
  • f8cfea0dcf gcs: size the upload buffer from the entry instead of reserving the default 16 MiB chunk per writer (#11854) 2026-10-21 00:03:38 -07:00
  • c90da999f2 s3: answer a conditional write on a missing object with 404, not 412 (#11882) Jay HemnaniandGitHub 2026-10-21 12:13:30 +05:30
  • 379abbe278 volume: repair torn tails on canDelete volumes; reject damaged 1-3 byte records (#11876)
    Chris LuGitHubDevin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
    2026-10-20 23:40:51 -07:00
  • c601712cc4 README: describe OLake Go and fix its wiki link (#11880) 2026-10-21 12:01:18 +05:30
  • ab738bfd33 rust volume: repair an unindexed .dat tail at load (#11878)
    Chris LuGitHubDevin <158243242+devin-ai-integration[bot]@users.noreply.github.com>Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
    2026-10-20 23:13:51 -07:00
  • 222e96d6ab iceberg maintenance: merge bin files across parquet schema spellings (#11875)
    Chris LuGitHubDevin <158243242+devin-ai-integration[bot]@users.noreply.github.com>Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
    2026-10-20 23:13:43 -07:00
  • a724f4296c s3, s3tables: create buckets and namespaces exclusively (#11872) Chris LuandGitHub 2026-10-20 19:01:08 -07:00
  • f05d743459 s3: resolve versionId tagging requests to the version-tagging actions (#11874) Chris LuandGitHub 2026-10-20 18:59:19 -07:00
  • 03a75cbc52 s3tables: only the admin repairs a table bucket that has no owner metadata (#11873) Chris LuandGitHub 2026-10-20 18:58:54 -07:00
  • efa9d304d2 build(deps): bump github.com/klauspost/compress from 1.18.0 to 1.18.7 in /test/kafka/kafka-client-loadtest (#11879)
    dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    2026-10-20 17:49:47 -07:00
  • b7f5d04428 docs: regenerate star history chart github-actions[bot] 2026-10-21 00:43:43 +00:00
  • ece2f7a7c2 iam: targeted writes for single-user IAM actions (#11877)
    Chris LuGitHubDevin <158243242+devin-ai-integration[bot]@users.noreply.github.com>Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
    2026-10-20 17:41:37 -07:00
  • 610346ae8c iceberg: keep version-hint.text out of remove_orphans (#11867) (#11871)
    Chris LuGitHubDevin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
    2026-10-20 13:05:38 -07:00
  • df89afbef4 volume: repair an unindexed .dat tail at load instead of loading read-only (#11870) 2026-10-20 16:03:00 -04:00
  • 1253b97303 build(deps): bump github.com/klauspost/compress from 1.15.9 to 1.18.7 in /test/kafka/kafka-client-loadtest/tools (#11866)
    dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    2026-10-20 13:02:26 -07:00
  • a1d8739464 build(deps): bump github.com/klauspost/compress from 1.17.0 to 1.18.7 in /test/kafka/simple-consumer (#11869)
    dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    2026-10-20 13:01:44 -07:00
  • 1cfd9bbb4c volume: run the durable sync outside the reader-visible lock (#11863)
    Chris LuGitHubDevin <158243242+devin-ai-integration[bot]@users.noreply.github.com>Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
    2026-10-20 12:58:02 -07:00
  • 0de6347b11 s3: mask anonymous misses behind AccessDenied unless the bucket is listable (#11857)
    Chris LuGitHubDevin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
    2026-10-20 12:52:58 -07:00
  • 6936bbdc3e rust volume: score EC shard placement with the volume's own ratio (#11862) Chris LuandGitHub 2026-10-20 07:40:43 -07:00
  • 4d06742664 Detect and quarantine duplicate volume ids (#11763) (#11828) Chris LuandGitHub 2026-10-20 07:37:33 -07:00
  • de0c00b30e topology: cover etcd allocator failures and mid-call bound growth (#11763) vid-etcd-allocator Chris Lu 2026-10-19 16:06:49 -07:00
  • f5bfcd8814 allocator: never hand out an id below the freshest local bound (#11763) Chris Lu 2026-10-19 16:06:49 -07:00
  • dbe850f13d master: build etcd TLS config when any of ca/client cert/key is set Chris Lu 2026-10-19 02:46:58 -07:00
  • e0e24d6f49 master: close etcd volume id allocator client on shutdown Chris Lu 2026-10-18 20:59:44 -07:00
  • c2b7e50b2b allocator: never go below local bound, replicate external allocations via raft Chris Lu 2026-10-18 20:59:44 -07:00
  • 165d967dc8 master: wire the etcd volume id allocator behind master.volume_id_allocator=etcd (#11763) Chris Lu 2026-10-18 20:34:47 -07:00
  • 16f4ea5822 topology: pluggable VolumeIdAllocator with an etcd CAS backend (#11763) Chris Lu 2026-10-18 20:34:47 -07:00
  • d4a1685cf5 shell: group ec shards by collection in the duplicate id audit (#11763) Chris Lu 2026-10-20 05:36:55 -07:00
  • 9f1febb2ac master: treat rp-only layout differences as an in-flight replication change (#11763) Chris Lu 2026-10-20 05:36:55 -07:00
  • d78fccf453 master: retry unenforced quarantine marks and restore server writability on release (#11763) Chris Lu 2026-10-20 05:36:42 -07:00
  • 945b4a6210 master: push duplicate-vid quarantine to the volume server (#11763) Chris Lu 2026-10-19 15:11:11 -07:00
  • 11d44177a0 master: quarantine every conflicting layout at the layout level (#11763) Chris Lu 2026-10-19 15:05:06 -07:00
  • be4bead284 shell: do not flag ec-only volumes as duplicates Chris Lu 2026-10-19 02:47:06 -07:00
  • f32be4c16e master: keep quarantine release current and cover all removal paths Chris Lu 2026-10-19 02:47:06 -07:00
  • b01ff0b450 shell: include ec shards in volume.check.duplicate_ids Chris Lu 2026-10-18 21:12:52 -07:00
  • 0160bc9cbc master: release duplicate-vid quarantine when the conflict resolves Chris Lu 2026-10-18 21:12:51 -07:00
  • 35ef8b3512 topology: return a copy from VolumeLayout.Lookup Chris Lu 2026-10-18 21:12:51 -07:00
  • ca718f4181 master: quarantine all copies of a duplicated volume id Chris Lu 2026-10-18 21:04:22 -07:00
  • cea59ad729 master: persist duplicate-vid quarantine across heartbeats (#11763) Chris Lu 2026-10-18 20:51:09 -07:00
  • 3ea9125e02 shell: volume.check.duplicate_ids audit command (#11763) Chris Lu 2026-10-18 20:37:58 -07:00
  • 1f12bf6588 master: detect and quarantine duplicate volume ids across layouts (#11763) Chris Lu 2026-10-18 20:37:58 -07:00
  • 2874bd05fb Freeze volume growth on topology id mismatch (#11763) (#11820) Chris LuandGitHub 2026-10-20 07:34:31 -07:00
  • 1144bf15d4 rust volume: group-commit fsync uploads on the direct write path (#11860)
    Chris LuGitHubDevin <158243242+devin-ai-integration[bot]@users.noreply.github.com>Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
    2026-10-20 07:32:58 -07:00
  • 8d2b417c69 iceberg, lance: vend read-only credentials to callers that may only read (#11859) Chris LuandGitHub 2026-10-20 07:16:27 -07:00
  • 7ed26deaae s3: list keys in byte order around directory markers (#11832)
    Chris LuGitHubDevin <devin-ai-integration[bot]@users.noreply.github.com>Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
    2026-10-20 05:36:22 -07:00
  • 4fb5e5a154 test: honor Retry-After in cold-start assign retry fix-cold-start-assign-flake Chris LuandDevin <158243242+devin-ai-integration[bot]@users.noreply.github.com> 2026-10-20 05:17:33 -07:00
  • da0d423bd9 Add OLake to README and Admin UI; fix catalog_olake path-style docs (#11858) 2026-10-20 17:27:55 +05:30
  • 2095c905ba server: give heartbeat-options test a topology (#11853)
    Chris LuGitHubDevin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
    2026-10-19 21:01:31 -07:00
  • 6b6a268903 volume balance: stop replica-fallback moves between equally full servers (#11851) Chris LuandGitHub 2026-10-19 20:52:30 -07:00
  • 79daffb2d2 test: retry retryable 503s in cold-start assign test (#11852)
    Chris LuGitHubDevin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
    2026-10-19 20:51:13 -07:00
  • 207d06863a docs: regenerate star history chart github-actions[bot] 2026-10-20 02:55:28 +00:00
  • 4791d44d2c test: retry retryable 503s in cold-start assign test Chris LuandDevin <158243242+devin-ai-integration[bot]@users.noreply.github.com> 2026-10-19 18:57:03 -07:00
  • 7e348951c2 s3: strip internal metadata headers on auth entry (#11850)
    Chris LuGitHubDevin <158243242+devin-ai-integration[bot]@users.noreply.github.com>Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
    2026-10-19 18:35:20 -07:00
  • 8b09c96cec s3: keep a signed content-length in the canonical request (#11849)
    Chris LuGitHubDevin <devin-ai-integration[bot]@users.noreply.github.com>
    2026-10-19 18:32:44 -07:00
  • 27a6a4c6c5 s3: test internal header scrub through the auth-disabled wrapper fix-ghsa-g45g-internal-lock-headers Chris LuandDevin <158243242+devin-ai-integration[bot]@users.noreply.github.com> 2026-10-19 18:24:36 -07:00
  • 9136d2711c s3: scrub internal headers before the auth-enabled early return Chris LuandDevin <158243242+devin-ai-integration[bot]@users.noreply.github.com> 2026-10-19 18:23:46 -07:00
  • 859f953d48 s3: strip internal SSE headers on auth entry Chris LuandDevin <158243242+devin-ai-integration[bot]@users.noreply.github.com> 2026-10-19 18:19:47 -07:00
  • c953054e9b s3: strip internal object-lock and version headers on auth entry Chris LuandDevin <158243242+devin-ai-integration[bot]@users.noreply.github.com> 2026-10-19 18:19:07 -07:00
  • 0fb6c0e77d filer.sync: unstick sync on chunks the source no longer has (#11845) Chris LuandGitHub 2026-10-19 18:11:51 -07:00
  • 60b06b6881 s3: sort ListMultipartUploads by key and honor key-marker (#11833) 2026-10-20 06:40:06 +05:30
  • dbcf6850b6 ci: fail the awscli multipart retry loop on the last attempt (#11848)
    Chris LuGitHubDevin <devin-ai-integration[bot]@users.noreply.github.com>
    2026-10-19 17:59:50 -07:00
  • f5d53639a9 ci: retry the awscli multipart download on transient failures fix-awscli-multipart-flake Devin 2026-10-19 16:57:27 -07:00
  • 04eff7d613 ci: retry the awscli multipart download on transient failures (#11846)
    Chris LuGitHubDevin <devin-ai-integration[bot]@users.noreply.github.com>
    2026-10-19 17:09:58 -07:00
  • 4feb30deff Federated volume-id bound via heartbeat stamps (#11763) (#11819) Chris LuandGitHub 2026-10-19 17:01:19 -07:00
  • 117ea58a83 s3tables: accept .puffin deletion vectors in table data/ (#11844) Chris LuandGitHub 2026-10-19 16:59:08 -07:00
  • ce93660abb build(deps): bump github.com/linxGnu/grocksdb from 1.10.8 to 1.11.1 (#11836)
    dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    2026-10-19 16:28:08 -07:00
  • 73391a2e2f build(deps): bump github.com/tidwall/gjson from 1.19.0 to 1.20.0 (#11834)
    dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    2026-10-19 16:27:54 -07:00
  • 3a30ee177a build(deps): bump github.com/klauspost/compress from 1.20.1 to 1.20.3 (#11837)
    dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    2026-10-19 16:27:28 -07:00
  • 109dd24f52 build(deps): bump github/codeql-action from 4.38.3 to 4.39.0 (#11840)
    dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    2026-10-19 16:05:07 -07:00
  • a2f8f4943c build(deps): bump gocloud.dev/pubsub/rabbitpubsub from 0.46.0 to 0.47.0 (#11835)
    dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    2026-10-19 16:03:18 -07:00
  • 4909843748 build(deps): bump modernc.org/sqlite from 1.57.0 to 1.60.1 (#11838)
    dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    2026-10-19 16:03:12 -07:00
  • 0a96972a99 s3: verify X-Forwarded-Prefix only from trusted proxies (#11843) Chris LuandGitHub 2026-10-19 15:55:18 -07:00
  • 4e5fed9e9e s3: list the size of a directory marker that has a body (#11830) Jay HemnaniandGitHub 2026-10-19 17:05:23 +05:30
  • e7923c14d1 s3tables: honor resource policy Deny on remaining operations (#11825)
    Chris LuGitHubDevin <158243242+devin-ai-integration[bot]@users.noreply.github.com>Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
    2026-10-19 03:59:18 -07:00
  • 51a4c092c8 rust volume: release the store write lock during needle I/O (#11823) Chris LuandGitHub 2026-10-19 03:00:26 -07:00
  • 0b3ed4502f Design + master mirror of max volume id outside raft (#11763) (#11818) Chris LuandGitHub 2026-10-19 02:42:42 -07:00
  • ab559bca76 storage: hash index-metric bloom filter with xxhash Chris Lu 2026-10-19 01:47:25 -07:00
  • d04d838ebd ec: compare live idx NeedleId sets before encode (#11812)
    Чепурнов СемёнGitHubChepurnov SimonDevin <devin-ai-integration[bot]@users.noreply.github.com>Chris Lu
    2026-10-19 13:56:17 +06:00
  • 10ce19cb17 test: poll for TopologyId convergence in multi-master failover tests Chris Lu 2026-10-19 00:55:41 -07:00
  • e20640acb4 fix(admin): improve Total Volumes count contrast (#11817) 2026-10-19 10:04:09 +05:30
  • 8ac5133abe admin: default to port 12535, keep 23646 as a best-effort compat listener (#11816) Chris LuandGitHub 2026-10-18 21:21:05 -07:00
  • d3ee817b2e docs: regenerate star history chart github-actions[bot] 2026-10-19 00:47:21 +00:00
  • 863efb3d35 webdav: delete a folder with its contents (#11811) 2026-10-19 01:27:10 +05:30
  • 8cb42cd69f build(deps): bump github.com/seaweedfs/raft from 1.2.1 to 1.2.2 (#11815) Chris LuandGitHub 2026-10-18 12:56:29 -07:00
  • 6a594da739 filer: free orphaned hard-link chunks and remote objects in delete sweeps (#11809) Chris LuandGitHub 2026-10-18 12:23:30 -07:00
  • eea3f232da iam: scope CreateServiceAccount's ParentUser by policy resource (#11736) 2026-10-18 21:48:01 +03:00
  • 4a57432488 s3: list children of the directory a ListObjects marker names (#11805) Chris LuandGitHub 2026-10-18 11:44:29 -07:00