seaweedfs

mirrors/seaweedfs

Fork 0

mirror of https://github.com/seaweedfs/seaweedfs.git synced 2026-09-18 22:14:33 +00:00

Files

T

History

f58721b22f s3api: optimize encodePath memory allocations (#10252 )

* Optimize s3api encodePath to eliminate O(n^2) allocations

encodePath built its result via string concatenation in a loop, which is
O(n^2) in allocations. For non-ASCII (e.g. Chinese) runes it additionally
called make + hex.EncodeToString + strings.ToUpper per byte (~10 allocations
per character). Under high QPS with long non-ASCII object keys this produced
a very high allocation rate, frequent GC and long GC pauses, causing S3
request latency spikes.

Replace with a preallocated strings.Builder, a manual hex lookup table, and a
zero-allocation fast path. EncodePath now delegates to encodePath to remove
the duplicated implementation. Output is byte-for-byte identical, verified by
TestEncodePath and TestEncodePathEqual.

Benchmark (long Chinese path): 261 -> 1 allocs/op, 35810 -> 480 B/op, 7.5x faster.
Load test (50M calls): 212x fewer allocations, 76x fewer GC cycles.

* s3api: drop regexp from encodePath fast path

The unreserved-character scan already decides whether any byte needs
encoding, so reservedObjectNames.MatchString was a redundant second pass
that also ran the RE2 engine on every authenticated request. Rely on the
scan alone; output is unchanged. The ASCII fast path drops from ~188ns to
~11ns per call.

---------

Co-authored-by: LiuDoge <liudoge@LiuDogedeMacBook-Air.local>
Co-authored-by: Chris Lu <chris.lu@gmail.com>

2026-07-07 12:36:47 -07:00

cors

go fmt

2026-01-28 14:34:07 -08:00

iceberg

s3tables: fix create-after-rename overwriting the renamed table (#10091 )

2026-06-24 14:37:04 -07:00

lifecycle_xml

refactor(s3api): move Lifecycle XML structs to leaf package lifecycle_xml (#9360 )

2026-05-07 18:54:06 -07:00

policy

chore(weed/s3api/policy): prune unused test functions (#9150 )

2026-04-20 12:04:41 -07:00

policy_engine

s3: support AWS object form for bucket policy Principal, add NotPrincipal (#10125 )

2026-06-27 22:36:26 -07:00

s3_constants

s3api: FULL_OBJECT checksums for CRC multipart uploads (#10236 )

2026-07-05 20:19:20 -07:00

s3_objectlock

mount: make metadata cache rebuilds snapshot-consistent (#8531 )

2026-03-07 09:19:40 -08:00

s3bucket

s3: reject reserved bucket name "filemeta" (#9760 )

2026-05-31 11:15:05 -07:00

s3err

s3: paginate ListBuckets and serve it from a bucket owner index (#10214 )

2026-07-02 21:11:41 -07:00

s3lifecycle

wdclient, dailyrun: add equal jitter to retry backoff (#9737 )

2026-05-29 20:54:54 -07:00

s3tables

s3tables: allow hyphens in namespace and table names (#10093 )

2026-06-24 16:24:45 -07:00

AmazonS3.xsd

s3: paginate ListBuckets and serve it from a bucket owner index (#10214 )

2026-07-02 21:11:41 -07:00

auth_account_collapse_test.go

s3: lazy, bounded, entry-free per-bucket caches (#10213 )

2026-07-02 21:11:34 -07:00

auth_copy_source_test.go

s3api: verify source permission on CopyObject and UploadPartCopy (#9555 )

2026-05-18 21:35:53 -07:00

auth_credentials_policy_sync_test.go

fix(s3): sync IAM policies to advanced IAM Manager policy engine (#9577 )

2026-05-21 00:39:42 -07:00

auth_credentials_static_config_test.go

fix(s3api): apply static config file updates on reload (#10096 )

2026-06-24 16:26:35 -07:00

auth_credentials_subscribe_test.go

go fmt

2026-02-20 18:40:47 -08:00

auth_credentials_subscribe.go

s3: paginate ListBuckets and serve it from a bucket owner index (#10214 )

2026-07-02 21:11:41 -07:00

auth_credentials_trust.go

Add AssumeRole and AssumeRoleWithLDAPIdentity STS actions (#8003 )

2026-01-12 10:45:24 -08:00

auth_credentials.go

s3: paginate ListBuckets and serve it from a bucket owner index (#10214 )

2026-07-02 21:11:41 -07:00

auth_jwt_streaming_unsigned_test.go

fix(s3): authenticate JWT unsigned-streaming uploads (#9729 )

2026-05-28 18:10:24 -07:00

auth_proxy_integration_test.go

feat: drop table location mapping support (#8458 )

2026-02-26 16:36:24 -08:00

auth_prune_bucket_test.go

s3: embedded IAM inline policy honors prefix-scoped resources (#10192 )

2026-07-02 09:14:54 -07:00

auth_security_test.go

fix(s3): allow anonymous unsigned-streaming PutObject (#9727 )

2026-05-28 17:00:41 -07:00

auth_signature_v2_test.go

fix(s3): verify SigV2 using percent-encoded path for Unicode object keys (#10022 )

2026-06-20 08:28:40 -07:00

auth_signature_v2.go

fix(s3): verify SigV2 using percent-encoded path for Unicode object keys (#10022 )

2026-06-20 08:28:40 -07:00

auth_signature_v4_sts_test.go

s3: give STS sessions a distinct owner account instead of admin (#9963 )

2026-06-14 13:55:11 -07:00

auth_signature_v4_test.go

fix(s3api): sort repeated SigV4 query values (#10031 )

2026-06-22 02:00:27 -07:00

auth_signature_v4_unsigned_headers_test.go

security(s3api): reject unsigned x-amz-* headers in SigV4 requests (#9121 )

2026-04-17 12:20:28 -07:00

auth_signature_v4.go

s3api: optimize encodePath memory allocations (#10252 )

2026-07-07 12:36:47 -07:00

auth_sts_identity_test.go

S3: Implement IAM defaults and STS signing key fallback (#8348 )

2026-02-16 13:59:13 -08:00

auth_sts_v4_test.go

fix(s3): strip client-supplied X-SeaweedFS-Principal/Session-Token in AuthSignatureOnly (#9120 )

2026-04-17 12:23:21 -07:00

auto_signature_v4_test.go

fix(s3): allow anonymous ListBuckets with prefix-scoped List action (#9073 )

2026-04-14 10:52:00 -07:00

bucket_metadata_test.go

s3: lazy, bounded, entry-free per-bucket caches (#10213 )

2026-07-02 21:11:34 -07:00

bucket_metadata.go

s3: lazy, bounded, entry-free per-bucket caches (#10213 )

2026-07-02 21:11:34 -07:00

bucket_paths.go

s3: paginate ListBuckets and serve it from a bucket owner index (#10214 )

2026-07-02 21:11:41 -07:00

bucket_size_metrics_test.go

s3: enforce bucket quota on logical size and surface read-only state in Admin UI (#10224 )

2026-07-03 12:39:45 -07:00

bucket_size_metrics.go

s3: enforce bucket quota on logical size and surface read-only state in Admin UI (#10224 )

2026-07-03 12:39:45 -07:00

chunked_bug_reproduction_test.go

S3 API: unsigned streaming (no cred) but chunks contain signatures (#7118 )

2025-08-11 10:31:01 -07:00

chunked_reader_v4_test.go

fix(s3api): normalize checksum trailer header names (#9905 )

2026-06-10 00:30:43 -07:00

chunked_reader_v4.go

fix(s3api): normalize checksum trailer header names (#9905 )

2026-06-10 00:30:43 -07:00

copy_source_decode_test.go

[s3] validate indirect filer path inputs (#9931 )

2026-06-11 21:56:16 -07:00

crc_combine_test.go

s3api: FULL_OBJECT checksums for CRC multipart uploads (#10236 )

2026-07-05 20:19:20 -07:00

crc_combine.go

s3api: FULL_OBJECT checksums for CRC multipart uploads (#10236 )

2026-07-05 20:19:20 -07:00

credential_iam_errors.go

fix(s3api,iamapi): avoid full SaveConfiguration when creating a single IAM user (#9261 )

2026-05-01 01:14:15 -07:00

custom_types.go

S3: Directly read write volume servers (#7481 )

2025-11-18 23:18:35 -08:00

filer_multipart_checksum_test.go

s3api: FULL_OBJECT checksums for CRC multipart uploads (#10236 )

2026-07-05 20:19:20 -07:00

filer_multipart_etag_test.go

fix(s3api): Fix multipart upload ETag compatibility with Hadoop S3A (#9772 )

2026-06-01 13:03:46 -07:00

filer_multipart_sse_s3_test.go

fix(s3api): backfill multipart SSE-S3 metadata at completion (#9224 )

2026-04-25 23:06:37 -07:00

filer_multipart.go

s3api: FULL_OBJECT checksums for CRC multipart uploads (#10236 )

2026-07-05 20:19:20 -07:00

filer_util_delete_test.go

Fix S3 delete for non-empty directory markers (#8740 )

2026-03-23 13:35:16 -07:00

filer_util_tags.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

filer_util.go

refactor(s3api): strip back-stamp from PutBucketLifecycleConfiguration (Phase 4) (#9367 )

2026-05-08 11:03:03 -07:00

iam_batch_delete_test.go

fix(s3api): authorize DeleteObjects per key so object-scoped policies match (#9793 )

2026-06-02 14:45:05 -07:00

iam_defaults_test.go

Fix IAM defaults and S3Tables IAM regression (#8374 )

2026-02-18 18:20:03 -08:00

iam_list_prefix_regression_test.go

fix(s3api): keep ListBucket resource ARN at bucket level (#9792 )

2026-06-02 14:45:45 -07:00

iam_optional_test.go

fix(s3): keep anonymous access working with EnableIam default (fixes #9557 ) (#9567 )

2026-05-19 13:03:30 -07:00

identity_reflection_test.go

Enforce IAM for S3 Tables bucket creation (#8388 )

2026-02-19 22:52:05 -08:00

object_lock_utils.go

fix(s3api): clear stale object lock years (#9890 )

2026-06-09 00:48:38 -07:00

README.txt

add s3test for sql (#5718 )

2024-07-04 11:00:41 -07:00

s3_action_resolver_test.go

feat(s3): add STS GetFederationToken support (#8891 )

2026-04-02 17:37:05 -07:00

s3_action_resolver.go

feat(s3): add STS GetFederationToken support (#8891 )

2026-04-02 17:37:05 -07:00

s3_bucket_encryption.go

chore: remove ~50k lines of unreachable dead code (#8913 )

2026-04-03 16:04:27 -07:00

s3_content_encoding_test.go

S3: Fix Content-Encoding header not preserved (#7894 ) (#7895 )

2025-12-27 12:25:33 -08:00

s3_encodepath_test.go

s3api: optimize encodePath memory allocations (#10252 )

2026-07-07 12:36:47 -07:00

s3_end_to_end_test.go

fix(s3): keep anonymous access working with EnableIam default (fixes #9557 ) (#9567 )

2026-05-19 13:03:30 -07:00

s3_error_utils.go

s3: surface transient store errors during multipart resume/copy instead of masking them (#10207 )

2026-07-02 13:25:04 -07:00

s3_existing_object_tag_test.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3_granular_action_security_test.go

S3: add context aware action resolution (#7479 )

2025-11-13 16:10:46 -08:00

s3_iam_middleware.go

security: add BearerPrefix constant for Authorization headers (#10101 )

2026-06-24 19:36:42 -07:00

s3_iam_role_selection_test.go

S3 API: Advanced IAM System (#7160 )

2025-08-30 11:15:48 -07:00

s3_jwt_auth_test.go

fix(s3): strip client-supplied X-SeaweedFS-Principal/Session-Token in AuthSignatureOnly (#9120 )

2026-04-17 12:23:21 -07:00

s3_list_parts_action_test.go

S3: add context aware action resolution (#7479 )

2025-11-13 16:10:46 -08:00

s3_metadata_util.go

s3: do not persist multi part "Response-Content-Disposition" in request header (#7887 )

2025-12-26 13:21:15 -08:00

s3_sse_c.go

chore: remove ~50k lines of unreachable dead code (#8913 )

2026-04-03 16:04:27 -07:00

s3_sse_ctr_test.go

S3: Directly read write volume servers (#7481 )

2025-11-18 23:18:35 -08:00

s3_sse_kms_utils.go

fix(s3): add HMAC-SHA256 key commitment to SSE-S3 and SSE-KMS (#8879 )

2026-05-04 19:14:41 -07:00

s3_sse_kms.go

s3: lazy, bounded, entry-free per-bucket caches (#10213 )

2026-07-02 21:11:34 -07:00

s3_sse_metadata.go

fix(s3api): cross-SSE copy operations and bring them back into CI (#9281 ) (#9282 )

2026-04-29 10:06:51 -07:00

s3_sse_s3_integration_test.go

fix(s3api): stream multipart-SSE chunks lazily to avoid truncated GETs (#8908 ) (#9228 )

2026-04-26 16:31:42 -07:00

s3_sse_s3_kek_passphrase_test.go

fix(s3): encrypt SSE-S3 KEK at rest with AES-GCM wrapping (#8880 )

2026-05-04 19:21:41 -07:00

s3_sse_s3_multipart_test.go

S3: Directly read write volume servers (#7481 )

2025-11-18 23:18:35 -08:00

s3_sse_s3.go

fix(s3): encrypt SSE-S3 KEK at rest with AES-GCM wrapping (#8880 )

2026-05-04 19:21:41 -07:00

s3_sse_test_utils_test.go

S3 API: Fix SSE-S3 decryption on object download (#7366 )

2025-10-23 20:10:12 -07:00

s3_sse_utils.go

S3: Directly read write volume servers (#7481 )

2025-11-18 23:18:35 -08:00

s3_token_differentiation_test.go

fix: comprehensive go vet error fixes and add CI enforcement (#7861 )

2025-12-23 14:48:50 -08:00

s3_validation_utils_require_test.go

fix(s3): add HMAC-SHA256 key commitment to SSE-S3 and SSE-KMS (#8879 )

2026-05-04 19:14:41 -07:00

s3_validation_utils.go

fix(s3): add HMAC-SHA256 key commitment to SSE-S3 and SSE-KMS (#8879 )

2026-05-04 19:14:41 -07:00

s3api_acl_helper.go

s3: lazy, bounded, entry-free per-bucket caches (#10213 )

2026-07-02 21:11:34 -07:00

s3api_acp.go

s3: give account-less identities a distinct owner instead of admin (#9962 )

2026-06-14 13:54:49 -07:00

s3api_auth.go

Fix critical authentication bypass vulnerability (#7912 ) (#7915 )

2025-12-30 12:40:59 -08:00

s3api_bucket_config_stubs_test.go

s3: lazy, bounded, entry-free per-bucket caches (#10213 )

2026-07-02 21:11:34 -07:00

s3api_bucket_config_stubs.go

feat(s3): stub bucket configuration list endpoints (#9571 )

2026-05-19 17:34:51 -07:00

s3api_bucket_config_update_test.go

s3: lazy, bounded, entry-free per-bucket caches (#10213 )

2026-07-02 21:11:34 -07:00

s3api_bucket_config.go

s3: read bucket owner and crtime from the entry-free bucket config

2026-07-02 21:27:58 -07:00

s3api_bucket_cors_handlers.go

S3: add fallback for CORS (#7404 )

2025-10-29 13:43:27 -07:00

s3api_bucket_handlers_list_test.go

s3: paginate ListBuckets and serve it from a bucket owner index (#10214 )

2026-07-02 21:11:41 -07:00

s3api_bucket_handlers_misc_test.go

s3: lazy, bounded, entry-free per-bucket caches (#10213 )

2026-07-02 21:11:34 -07:00

s3api_bucket_handlers_misc.go

feat(s3): add four bucket configuration handlers (#9570 )

2026-05-19 17:35:08 -07:00

s3api_bucket_handlers_object_lock_config.go

Add table operations test (#8241 )

2026-02-07 13:27:47 -08:00

s3api_bucket_handlers.go

s3: read bucket owner and crtime from the entry-free bucket config

2026-07-02 21:27:58 -07:00

s3api_bucket_lifecycle_config.go

s3: lazy, bounded, entry-free per-bucket caches (#10213 )

2026-07-02 21:11:34 -07:00

s3api_bucket_lifecycle_response_test.go

s3: lazy, bounded, entry-free per-bucket caches (#10213 )

2026-07-02 21:11:34 -07:00

s3api_bucket_metadata_test.go

S3 API: Add SSE-KMS (#7144 )

2025-08-21 08:28:07 -07:00

s3api_bucket_owner_index_test.go

s3: paginate ListBuckets and serve it from a bucket owner index (#10214 )

2026-07-02 21:11:41 -07:00

s3api_bucket_owner_index.go

s3: read bucket owner and crtime from the entry-free bucket config

2026-07-02 21:27:58 -07:00

s3api_bucket_policy_arn_test.go

s3api: fix AccessDenied by correctly propagating principal ARN in vended tokens (#8330 )

2026-02-12 23:11:41 -08:00

s3api_bucket_policy_engine.go

s3: support s3:x-amz-server-side-encryption policy condition (#8806 )

2026-03-27 23:15:01 -07:00

s3api_bucket_policy_handlers.go

fix(s3): omit NotResource:null from bucket policy JSON response (#8658 )

2026-03-16 12:58:26 -07:00

s3api_bucket_tagging_handlers.go

S3 API: Add SSE-KMS (#7144 )

2025-08-21 08:28:07 -07:00

s3api_circuit_breaker_test.go

s3api: add optional request interceptor to circuit breaker (#9994 )

2026-06-16 16:29:30 -07:00

s3api_circuit_breaker.go

s3api: add optional request interceptor to circuit breaker (#9994 )

2026-06-16 16:29:30 -07:00

s3api_copy_size_calculation.go

chore: remove ~50k lines of unreachable dead code (#8913 )

2026-04-03 16:04:27 -07:00

s3api_copy_source_classify_test.go

s3: surface transient store errors during multipart resume/copy instead of masking them (#10207 )

2026-07-02 13:25:04 -07:00

s3api_copy_validation.go

fix(s3api): preserve requested AES256 copy encryption (#10049 )

2026-06-22 22:19:24 -07:00

s3api_domain_test.go

fix: Use a mixed of virtual and path styles within a single subdomain (#7357 )

2025-10-24 01:45:22 -07:00

s3api_embedded_iam_oidc.go

feat(iam): OIDC provider mutations + multi-client + TLS thumbprints (Phase 2b) (#9320 )

2026-05-05 11:26:08 -07:00

s3api_embedded_iam_test.go

s3: embedded IAM inline policy honors prefix-scoped resources (#10192 )

2026-07-02 09:14:54 -07:00

s3api_embedded_iam_user_tags_test.go

feat(s3): add TagUser, UntagUser, ListUserTags IAM actions (#9572 )

2026-05-19 17:35:44 -07:00

s3api_embedded_iam.go

s3: embedded IAM inline policy honors prefix-scoped resources (#10192 )

2026-07-02 09:14:54 -07:00

s3api_encrypted_volume_copy_test.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3api_governance_permissions_test.go

s3: enforce authentication and JSON error format for Iceberg REST Catalog (#8192 )

2026-02-03 11:55:12 -08:00

s3api_handlers.go

s3: defer a recently-unreachable owner that is also the current filer (#9808 )

2026-06-03 00:28:56 -07:00

s3api_iam_oidc_test.go

feat(iam): OIDC provider mutations + multi-client + TLS thumbprints (Phase 2b) (#9320 )

2026-05-05 11:26:08 -07:00

s3api_implicit_directory_test.go

Add table operations test (#8241 )

2026-02-07 13:27:47 -08:00

s3api_inline_policy_condition_test.go

s3api: support group inline policies + Condition enforcement (#9569 )

2026-05-19 16:03:45 -07:00

s3api_internal_lifecycle_test.go

refactor(s3/lifecycle): extract entryUsesMetadataOnlyDelete predicate (#9417 )

2026-05-10 09:39:05 -07:00

s3api_internal_lifecycle.go

feat(s3/versioning): grep-able heal logs + scan-anomaly diagnostics + audit cmd (#9468 )

2026-05-13 10:48:58 -07:00

s3api_list_normalization_test.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3api_multipart_path_validation_test.go

[s3] validate indirect filer path inputs (#9931 )

2026-06-11 21:56:16 -07:00

s3api_multipart_ssekms_test.go

fix(s3api): stream multipart-SSE chunks lazily to avoid truncated GETs (#8908 ) (#9228 )

2026-04-26 16:31:42 -07:00

s3api_nextmarker_test.go

fix: S3 listing NextMarker missing intermediate directory component (#8089 )

2026-01-22 16:56:35 -08:00

s3api_object_handlers_acl.go

s3: return BucketAlreadyOwnedByYou when recreating your own bucket (#9822 )

2026-06-04 15:33:03 -07:00

s3api_object_handlers_attributes.go

s3api: add GetObjectAttributes API support (#8504 )

2026-03-04 12:52:09 -08:00

s3api_object_handlers_copy_alloc_test.go

fix(s3api): cap copy-chunk receive buffer to avoid append-grow blowup (#9420 )

2026-05-10 12:08:06 -07:00

s3api_object_handlers_copy_bench_test.go

feat(s3api): full-chunk gzip pass-through skips volume-side decompress (#9427 )

2026-05-10 14:55:59 -07:00

s3api_object_handlers_copy_checksum_test.go

[s3]: preserve multipart copy checksums (#9948 )

2026-06-14 00:16:14 -07:00

s3api_object_handlers_copy_chunk_upload_test.go

fix: cap pool retention so chunk-copy buffers don't hoard memory (#9422 )

2026-05-10 13:34:25 -07:00

s3api_object_handlers_copy_collection_test.go

fix(s3): keep server-side copy data in the bucket collection (#9607 )

2026-05-21 09:35:42 -07:00

s3api_object_handlers_copy_etag_test.go

fix(s3api): standardize ETag calculation in copy handlers (#9829 )

2026-06-05 12:41:18 -07:00

s3api_object_handlers_copy_mime_test.go

fix(s3api): preserve requested AES256 copy encryption (#10049 )

2026-06-22 22:19:24 -07:00

s3api_object_handlers_copy_part_sse.go

[s3]: preserve multipart copy checksums (#9948 )

2026-06-14 00:16:14 -07:00

s3api_object_handlers_copy_stream.go

security: add BearerPrefix constant for Authorization headers (#10101 )

2026-06-24 19:36:42 -07:00

s3api_object_handlers_copy_unified.go

fix(s3): keep server-side copy data in the bucket collection (#9607 )

2026-05-21 09:35:42 -07:00

s3api_object_handlers_copy.go

s3: surface transient store errors during multipart resume/copy instead of masking them (#10207 )

2026-07-02 13:25:04 -07:00

s3api_object_handlers_delete_test.go

[s3] validate indirect filer path inputs (#9931 )

2026-06-11 21:56:16 -07:00

s3api_object_handlers_delete.go

[s3] validate indirect filer path inputs (#9931 )

2026-06-11 21:56:16 -07:00

s3api_object_handlers_dir_test.go

s3: answer directory-path probes like AWS so Flink savepoints restore (#10225 )

2026-07-04 00:41:57 -07:00

s3api_object_handlers_legal_hold.go

adjust logs

2026-01-17 18:40:48 -08:00

s3api_object_handlers_list_directory_test.go

fix(s3): list empty directories as directory markers (#9615 )

2026-05-21 14:05:16 -07:00

s3api_object_handlers_list_test.go

fix(s3api): ListObjects with trailing-slash prefix matches sibling directories (#8599 )

2026-03-11 02:28:34 -07:00

s3api_object_handlers_list_versioned_test.go

fix(s3): skip directories before marker in ListObjectVersions pagination (#8890 )

2026-04-02 15:59:52 -07:00

s3api_object_handlers_list.go

fix(s3api/list): cancel ListEntries stream in hasChildren (#9617 )

2026-05-21 15:48:47 -07:00

s3api_object_handlers_multipart.go

s3api: FULL_OBJECT checksums for CRC multipart uploads (#10236 )

2026-07-05 20:19:20 -07:00

s3api_object_handlers_postpolicy_test.go

s3: lazy, bounded, entry-free per-bucket caches (#10213 )

2026-07-02 21:11:34 -07:00

s3api_object_handlers_postpolicy.go

[s3] validate indirect filer path inputs (#9931 )

2026-06-11 21:56:16 -07:00

s3api_object_handlers_put_checksum_test.go

fix(s3): honor ChecksumAlgorithm on presigned URL uploads (#9076 )

2026-04-14 21:52:49 -07:00

s3api_object_handlers_put_error_test.go

s3: return IncompleteBody instead of 500 for truncated PUT bodies (#10186 )

2026-07-01 18:45:17 -07:00

s3api_object_handlers_put.go

s3: return IncompleteBody instead of 500 for truncated PUT bodies (#10186 )

2026-07-01 18:45:17 -07:00

s3api_object_handlers_retention.go

refactor (#6999 )

2025-07-19 00:49:56 -07:00

s3api_object_handlers_tagging.go

Add Iceberg admin UI (#8246 )

2026-02-08 20:06:32 -08:00

s3api_object_handlers.go

s3api: FULL_OBJECT checksums for CRC multipart uploads (#10236 )

2026-07-05 20:19:20 -07:00

s3api_object_lifecycle_ttl_test.go

s3: lazy, bounded, entry-free per-bucket caches (#10213 )

2026-07-02 21:11:34 -07:00

s3api_object_lifecycle_ttl.go

feat(s3api): apply lifecycle TTL at write time (#9377 )

2026-05-08 21:35:27 -07:00

s3api_object_lock_fix_test.go

s3: lazy, bounded, entry-free per-bucket caches (#10213 )

2026-07-02 21:11:34 -07:00

s3api_object_lock_headers_test.go

Test object lock and retention (#6997 )

2025-07-18 22:25:58 -07:00

s3api_object_ownership_test.go

s3: lazy, bounded, entry-free per-bucket caches (#10213 )

2026-07-02 21:11:34 -07:00

s3api_object_range_test.go

s3api: reject malformed Range offsets (#10034 )

2026-06-22 07:52:01 -07:00

s3api_object_retention_test.go

fix(s3api): clear stale object lock years (#9890 )

2026-06-09 00:48:38 -07:00

s3api_object_retention.go

Prune Unused Functions from weed/s3api (#8815 )

2026-03-28 13:24:11 -07:00

s3api_object_routed_read_test.go

s3: route object reads to the key's owner filer (#9806 )

2026-06-03 00:12:28 -07:00

s3api_object_routed_read.go

s3: route object reads to the key's owner filer (#9806 )

2026-06-03 00:12:28 -07:00

s3api_object_routed_write_test.go

fix(s3api): accept HTTP-date conditionals (#9863 )

2026-06-08 01:12:07 -07:00

s3api_object_routed_write.go

s3: commit a versioned PutObject and its latest pointer in one transaction (#9756 )

2026-05-31 00:13:36 -07:00

s3api_object_versioned_finalize.go

[s3] validate indirect filer path inputs (#9931 )

2026-06-11 21:56:16 -07:00

s3api_object_versioning_self_heal_test.go

fix(s3): recover versioned reads when the .versions latest pointer is absent (#9782 )

2026-06-01 20:01:30 -07:00

s3api_object_versioning.go

s3: surface transient store errors during multipart resume/copy instead of masking them (#10207 )

2026-07-02 13:25:04 -07:00

s3api_path_validation_test.go

[s3] validate indirect filer path inputs (#9931 )

2026-06-11 21:56:16 -07:00

s3api_path_validation.go

[s3] validate indirect filer path inputs (#9931 )

2026-06-11 21:56:16 -07:00

s3api_put_handlers.go

Prune Unused Functions from weed/s3api (#8815 )

2026-03-28 13:24:11 -07:00

s3api_put_object_helper_test.go

S3: Implement IAM defaults and STS signing key fallback (#8348 )

2026-02-16 13:59:13 -08:00

s3api_put_object_helper.go

s3api: remove redundant auth verification in getRequestDataReader (#7685 )

2025-12-09 10:24:35 -08:00

s3api_remote_storage_test.go

s3: bound streaming remote-cache wait so large cold GetObject returns 503, not a hang (#9988 )

2026-06-16 14:02:41 -07:00

s3api_server_grpc.go

iam: add IAM group management (#8560 )

2026-03-09 11:54:32 -07:00

s3api_server_routing_test.go

fix(s3): keep host-less bucket catch-all so reverse proxies work (#9540 )

2026-05-18 19:44:19 -07:00

s3api_server.go

s3: paginate ListBuckets and serve it from a bucket owner index (#10214 )

2026-07-02 21:11:41 -07:00

s3api_sosapi.go

chore: remove ~50k lines of unreachable dead code (#8913 )

2026-04-03 16:04:27 -07:00

s3api_sse_decrypt_test.go

fix(s3api): backfill multipart SSE-S3 metadata at completion (#9224 )

2026-04-25 23:06:37 -07:00

s3api_sse_s3_upload_test.go

S3: Directly read write volume servers (#7481 )

2025-11-18 23:18:35 -08:00

s3api_status_handlers.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3api_stream_error_test.go

Client disconnects create context cancelled errors, 500x errors and Filer lookup failures (#8845 )

2026-03-30 12:11:30 -07:00

s3api_sts_assume_role_authz_test.go

sts: enforce session-policy explicit deny during role chaining (#10103 )

2026-06-24 21:38:21 -07:00

s3api_sts_assume_role_dispatch_test.go

fix(iam): four phase-3 follow-ups (provider scoping, public path wrapper, static mirror, claim-mode RoleArn) (#9333 )

2026-05-05 19:14:44 -07:00

s3api_sts_assume_role_empty_arn_test.go

fix(iam): four phase-3 follow-ups (provider scoping, public path wrapper, static mirror, claim-mode RoleArn) (#9333 )

2026-05-05 19:14:44 -07:00

s3api_sts_assume_role_test.go

Embed role policies in AssumeRole STS tokens (#8421 )

2026-02-23 22:59:53 -08:00

s3api_sts_get_caller_identity_test.go

STS: add GetCallerIdentity support (#8893 )

2026-04-02 15:59:09 -07:00

s3api_sts_get_federation_token_test.go

feat(s3): add STS GetFederationToken support (#8891 )

2026-04-02 17:37:05 -07:00

s3api_sts.go

fix(sts): authorize AssumeRole by the role's trust policy (#10097 )

2026-06-24 20:14:26 -07:00

s3api_tables_rest_validation_test.go

s3tables: allow hyphens in namespace and table names (#10093 )

2026-06-24 16:24:45 -07:00

s3api_tables_routing_test.go

fix(s3): stop S3 Tables routes from swallowing buckets named "buckets" or "get-table" (#9566 )

2026-05-19 14:24:25 -07:00

s3api_tables.go

fix(s3): stop S3 Tables routes from swallowing buckets named "buckets" or "get-table" (#9566 )

2026-05-19 14:24:25 -07:00

s3api_test.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3api_version_id_test.go

[s3] validate indirect filer path inputs (#9931 )

2026-06-11 21:56:16 -07:00

s3api_version_id.go

[s3] validate indirect filer path inputs (#9931 )

2026-06-11 21:56:16 -07:00

s3api_versioning_heal_log_test.go

feat(s3/versioning): grep-able heal logs + scan-anomaly diagnostics + audit cmd (#9468 )

2026-05-13 10:48:58 -07:00

s3api_versioning_reconciler_test.go

feat(s3/versioning): grep-able heal logs + scan-anomaly diagnostics + audit cmd (#9468 )

2026-05-13 10:48:58 -07:00

s3api_versioning_reconciler.go

feat(s3/versioning): grep-able heal logs + scan-anomaly diagnostics + audit cmd (#9468 )

2026-05-13 10:48:58 -07:00

s3api_xsd_generated_helper.go

add s3test for sql (#5718 )

2024-07-04 11:00:41 -07:00

s3api_xsd_generated.go

s3: paginate ListBuckets and serve it from a bucket owner index (#10214 )

2026-07-02 21:11:41 -07:00

sses3_multipart_repro_test.go

fix(s3api): stream multipart-SSE chunks lazily to avoid truncated GETs (#8908 ) (#9228 )

2026-04-26 16:31:42 -07:00

stats_test.go

fix(s3/audit): emit audit log for successful GET/HEAD (#9467 )

2026-05-13 09:24:59 -07:00

stats.go

fix(s3/audit): populate requester for GET/HEAD/IAM operations (#9581 )

2026-05-20 10:13:33 -07:00

sts_packed_policy_test.go

feat(iam): STS web-identity AWS-fidelity polish (Phase 1) (#9318 )

2026-05-04 22:10:49 -07:00

sts_params_test.go

s3/iam: reuse one request id per request (#8538 )

2026-03-06 15:22:39 -08:00

sts_session_name_test.go

feat(iam): STS web-identity AWS-fidelity polish (Phase 1) (#9318 )

2026-05-04 22:10:49 -07:00

tags_test.go

s3api: preserve equals signs in tag values (#10058 )

2026-06-23 01:25:32 -07:00

tags.go

s3api: preserve equals signs in tag values (#10058 )

2026-06-23 01:25:32 -07:00

README.txt

see https://blog.aqwari.net/xml-schema-go/

1. go get aqwari.net/xml/cmd/xsdgen
2. Add EncodingType element for ListBucketResult in AmazonS3.xsd
3. xsdgen -o s3api_xsd_generated.go -pkg s3api AmazonS3.xsd
4. Remove empty Grantee struct in s3api_xsd_generated.go
5. Remove xmlns: sed s'/http:\/\/s3.amazonaws.com\/doc\/2006-03-01\/\ //' s3api_xsd_generated.go