mirrors/versitygw
1
0
Fork 0
mirror of https://github.com/versity/versitygw.git synced 2026-07-27 18:42:53 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,473 Commits 36 Branches 53 Tags
ben/plugin
Commit Graph
1473 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Luke McCrone 7a56c7e15e test: multipart upload - list parts, uploads 2024-02-12 19:36:24 -03:00
jonaustin09 e21e514997 feat: Added 20 integration tests for v4 authentication with query params. Fixed few bugs in v4 query params authentication 2024-02-12 16:31:01 -05:00
dependabot[bot]andGitHub 660709fe6d chore(deps): bump the dev-dependencies group with 4 updates 
Bumps the dev-dependencies group with 4 updates: [github.com/Azure/azure-sdk-for-go/sdk/azcore](https://github.com/Azure/azure-sdk-for-go), [github.com/Azure/azure-sdk-for-go/sdk/storage/azblob](https://github.com/Azure/azure-sdk-for-go), [github.com/valyala/fasthttp](https://github.com/valyala/fasthttp) and [golang.org/x/sys](https://github.com/golang/sys).


Updates `github.com/Azure/azure-sdk-for-go/sdk/azcore` from 1.9.1 to 1.9.2
- [Release notes](https://github.com/Azure/azure-sdk-for-go/releases)
- [Changelog](https://github.com/Azure/azure-sdk-for-go/blob/main/documentation/release.md)
- [Commits](https://github.com/Azure/azure-sdk-for-go/compare/sdk/azcore/v1.9.1...sdk/azcore/v1.9.2)

Updates `github.com/Azure/azure-sdk-for-go/sdk/storage/azblob` from 1.2.1 to 1.3.0
- [Release notes](https://github.com/Azure/azure-sdk-for-go/releases)
- [Changelog](https://github.com/Azure/azure-sdk-for-go/blob/main/documentation/release.md)
- [Commits](https://github.com/Azure/azure-sdk-for-go/compare/sdk/azidentity/v1.2.1...sdk/azcore/v1.3.0)

Updates `github.com/valyala/fasthttp` from 1.51.0 to 1.52.0
- [Release notes](https://github.com/valyala/fasthttp/releases)
- [Commits](https://github.com/valyala/fasthttp/compare/v1.51.0...v1.52.0)

Updates `golang.org/x/sys` from 0.16.0 to 0.17.0
- [Commits](https://github.com/golang/sys/compare/v0.16.0...v0.17.0)

---
updated-dependencies:
- dependency-name: github.com/Azure/azure-sdk-for-go/sdk/azcore
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dev-dependencies
- dependency-name: github.com/Azure/azure-sdk-for-go/sdk/storage/azblob
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: dev-dependencies
- dependency-name: github.com/valyala/fasthttp
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: dev-dependencies
- dependency-name: golang.org/x/sys
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: dev-dependencies
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-02-12 21:21:05 +00:00
Ben McClellandandGitHub 5931d713f2 Merge pull request #398 from versity/test_cmdline_multipart_abort 
test: multipart abort
 2024-02-08 18:34:25 -08:00
Luke McCrone 08e5eb02a0 test: multipart abort 2024-02-08 18:31:19 -03:00
Ben McClellandandGitHub 7cba952546 Merge pull request #394 from versity/test_cmdline_obj_tag 
Test cmdline obj tag
 2024-02-07 10:20:26 -08:00
Luke McCrone 5d6c0f8b67 another shellcheck fix 2024-02-07 14:58:06 -03:00
jonaustin09 be17b3fd33 feat: Closes #355. Added support for presigned URLs, particularly v4 authentication with query params 2024-02-07 09:17:35 -05:00
Ben McClellandandGitHub e6440da30a Merge pull request #393 from versity/ben/releaser_naming 
fix: add release version to release artifacts
 2024-02-06 08:42:26 -08:00
Ben McClelland 443da7f9a4 fix: add release version to release artifacts 2024-02-05 11:04:51 -08:00
Ben McClellandandGitHub 6c56307746 Merge pull request #391 from versity/ben/docker_actions 
feat: add docker images to release
v0.13 		2024-02-04 10:21:07 -08:00
Ben McClelland 9765eadd84 feat: add docker images to release 2024-02-04 10:17:15 -08:00
Ben McClellandandGitHub 4619171f86 Merge pull request #389 from versity/test_cmdline_head_data 
Test cmdline head data
 2024-02-02 11:35:35 -08:00
Luke McCroneandBen McClelland 89b4b615ab test: cmdline tests (acls, get bucket/object info) 2024-02-02 11:32:13 -08:00
Jon AustinandGitHub 0c056f935b ListObjectsV2 start-after prop (#388) 
* fix: Fixes #138, Added StartAfter property in ListObjectsV2 action, added couple of integration tests for ListObjectsV2
 2024-02-01 11:04:52 -08:00
Ben McClellandandGitHub bf1e2c83d5 Merge pull request #385 from versity/bucket-tagging-actions 
Bucket tagging actions
 2024-01-31 10:15:22 -08:00
Ben McClelland 68794518af fix: remove special proxy handling for bucket acls in posix backend 2024-01-31 10:10:12 -08:00
jonaustin09andBen McClelland 3cce3a5201 feat: Added unit and integration test cases for posix bucket tagging related actions 2024-01-31 10:09:48 -08:00
jonaustin09andBen McClelland d70ea61830 feat: Added the following actions support in posix backend: PutBucketTagging, GetBucketTagging, DeleteBucketTagging 2024-01-31 10:09:48 -08:00
Ben McClellandandGitHub 9d0cf77b25 Merge pull request #387 from versity/bucket-acl-on-creation 
Bucket ACL on bucket creation
 2024-01-31 09:55:12 -08:00
jonaustin09andBen McClelland 0d3a238ceb feat: Implemented logic to add bucket ACL on bucket creation 2024-01-31 09:49:56 -08:00
Ben McClellandandGitHub 99d0d9a007 Merge pull request #384 from versity/luke/posix_test 
Luke/posix test
v0.12 		2024-01-29 15:20:54 -08:00
Luke McCrone 1409d664b4 test: initial aws cli bats tests 2024-01-29 20:07:00 -03:00
Ben McClellandandGitHub b908a4b981 Merge pull request #386 from versity/dependabot/go_modules/dev-dependencies-55f64e24bf 
chore(deps): bump the dev-dependencies group with 3 updates
 2024-01-29 14:53:14 -08:00
dependabot[bot]andGitHub ac06b5c4ae chore(deps): bump the dev-dependencies group with 3 updates 
Bumps the dev-dependencies group with 3 updates: [github.com/aws/aws-sdk-go-v2/service/s3](https://github.com/aws/aws-sdk-go-v2), [github.com/google/uuid](https://github.com/google/uuid) and [github.com/aws/aws-sdk-go-v2/feature/s3/manager](https://github.com/aws/aws-sdk-go-v2).


Updates `github.com/aws/aws-sdk-go-v2/service/s3` from 1.48.0 to 1.48.1
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases)
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/service/s3/v1.48.0...service/s3/v1.48.1)

Updates `github.com/google/uuid` from 1.5.0 to 1.6.0
- [Release notes](https://github.com/google/uuid/releases)
- [Changelog](https://github.com/google/uuid/blob/master/CHANGELOG.md)
- [Commits](https://github.com/google/uuid/compare/v1.5.0...v1.6.0)

Updates `github.com/aws/aws-sdk-go-v2/feature/s3/manager` from 1.15.14 to 1.15.15
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases)
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/config/v1.15.14...config/v1.15.15)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2/service/s3
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dev-dependencies
- dependency-name: github.com/google/uuid
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: dev-dependencies
- dependency-name: github.com/aws/aws-sdk-go-v2/feature/s3/manager
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dev-dependencies
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-01-29 22:03:46 +00:00
Ben McClellandandGitHub 3146556293 Merge pull request #380 from versity/ben/chunked_reader 
feat: add chunked upload support
 2024-01-25 13:41:43 -08:00
Ben McClellandandGitHub 1c03fce3f5 Merge pull request #383 from versity/dependabot/go_modules/dev-dependencies-83121c2333 
chore(deps): bump the dev-dependencies group with 3 updates
 2024-01-22 15:39:54 -08:00
dependabot[bot]andGitHub b83e2393a5 chore(deps): bump the dev-dependencies group with 3 updates 
Bumps the dev-dependencies group with 3 updates: [github.com/Azure/azure-sdk-for-go/sdk/azidentity](https://github.com/Azure/azure-sdk-for-go), [github.com/aws/aws-sdk-go-v2/config](https://github.com/aws/aws-sdk-go-v2) and [github.com/aws/aws-sdk-go-v2/feature/s3/manager](https://github.com/aws/aws-sdk-go-v2).


Updates `github.com/Azure/azure-sdk-for-go/sdk/azidentity` from 1.4.0 to 1.5.1
- [Release notes](https://github.com/Azure/azure-sdk-for-go/releases)
- [Changelog](https://github.com/Azure/azure-sdk-for-go/blob/main/documentation/release.md)
- [Commits](https://github.com/Azure/azure-sdk-for-go/compare/sdk/azcore/v1.4.0...sdk/internal/v1.5.1)

Updates `github.com/aws/aws-sdk-go-v2/config` from 1.26.3 to 1.26.6
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases)
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/config/v1.26.3...config/v1.26.6)

Updates `github.com/aws/aws-sdk-go-v2/feature/s3/manager` from 1.15.11 to 1.15.14
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases)
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/config/v1.15.11...config/v1.15.14)

---
updated-dependencies:
- dependency-name: github.com/Azure/azure-sdk-for-go/sdk/azidentity
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: dev-dependencies
- dependency-name: github.com/aws/aws-sdk-go-v2/config
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dev-dependencies
- dependency-name: github.com/aws/aws-sdk-go-v2/feature/s3/manager
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dev-dependencies
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-01-22 21:45:22 +00:00
Ben McClelland 1366408baa feat: add chunked upload support 
As described in
https://docs.aws.amazon.com/AmazonS3/latest/API/sigv4-streaming.html
this adds support for reading from a chunked upload encoded request
body. The chunked reader modifies the data stream to remove the
chunk encoding while validating the chunk signatures in line. This
allows the upper layers to get just the object data stream.
 2024-01-22 11:35:01 -08:00
Jon AustinGitHubBen McClelland
 		cf92b6fd80 Fix/azure copy object (#382) 
* fix: Added destination bucket acl check and metadata comparision for CopyObject action in azure backend

---------

Co-authored-by: Ben McClelland <ben.mcclelland@versity.com>
 2024-01-22 10:01:16 -08:00
Jon AustinandGitHub d956ecacd7 Fix/azure iam (#381) 
* fix: Fixed iam internal iam file removal bug
 2024-01-22 10:00:41 -08:00
Jon AustinandGitHub 68e800492e Fix/azure list objects (#379) 
* fix: Added pagination to ListObjects and ListObjectsV2 actions, fixed multipart upload non existing key error handling
 2024-01-22 09:54:45 -08:00
Ben McClellandandGitHub f836d96717 Merge pull request #378 from versity/ben/signature 2024-01-17 13:18:54 -08:00
Ben McClelland b5894dd714 fix: allow spaces in Authorization string 
This change removes all spaces after the algorithm to have
standard parsing for the following key/value pairs. This fixes
some clients that were using a slightly different format than
the example AWS request strings.
 2024-01-17 10:45:57 -08:00
Ben McClellandandGitHub 17bdc58da9 Merge pull request #374 from versity/ben/test_fixup 
Ben/test fixup
 2024-01-17 10:45:43 -08:00
jonaustin09andBen McClelland 03e4a28d57 fix: Fixed couple of bugs regarding to GetObject range errors, blob metadata reference losing 2024-01-17 08:27:37 -08:00
jonaustin09andBen McClelland 240db54feb feat: Added ChangeBucketOwner, ListBucketsAndOwners action implementation in azure backend. Fixed acl key bug in getting container metadata. Added container owner in ListBuckets action 2024-01-17 08:27:37 -08:00
Ben McClelland d404f96320 fix: translate azure errors to s3 for compatibility 2024-01-17 08:27:37 -08:00
Ben McClelland 1cdf0706e7 fix: fix crashes in test cases when fields missing 2024-01-17 08:27:37 -08:00
Ben McClelland ca6d9e3c11 fix: docker env set to tests defaults 2024-01-17 08:27:37 -08:00
Ben McClellandandGitHub e16c54c1a3 Merge pull request #375 from versity/dependabot/go_modules/dev-dependencies-88fd56ff93 
chore(deps): bump the dev-dependencies group with 1 update
 2024-01-16 08:12:42 -08:00
dependabot[bot]andGitHub 15daec9f51 chore(deps): bump the dev-dependencies group with 1 update 
Bumps the dev-dependencies group with 1 update: [github.com/nats-io/nats.go](https://github.com/nats-io/nats.go).


Updates `github.com/nats-io/nats.go` from 1.31.0 to 1.32.0
- [Release notes](https://github.com/nats-io/nats.go/releases)
- [Commits](https://github.com/nats-io/nats.go/compare/v1.31.0...v1.32.0)

---
updated-dependencies:
- dependency-name: github.com/nats-io/nats.go
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: dev-dependencies
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-01-15 21:10:11 +00:00
Ben McClellandandGitHub c406d7069f Merge pull request #371 from versity/ben/default_acl 
fix: cleanup backend ACLs
 2024-01-11 12:30:44 -08:00
Ben McClelland 6481e2aac5 fix: cleanup backend ACLs 
This adds the default ACL to the CreateBucket backend method so
that the backend doesn't need to know how to construct and ACL.

This also moves the s3proxy ACLs to a tag key/value because the
gateway ACLs are not the same accounts as the backend s3 server.
TODO: we may need to mask this tag key/value if we add support
for the Get/PutBucketTagging API.
 2024-01-10 09:36:00 -08:00
Ben McClellandandGitHub 45cf5e6373 Merge pull request #366 from versity/ben/az_ident 
feat: add azure local env auth
 2024-01-09 22:24:43 -08:00
Ben McClelland 3db43b7206 feat: add azure local env auth 
This is the recommended auth from the following:
https://github.com/Azure-Samples/storage-blobs-go-quickstart/blob/master/storage-quickstart.go
https://learn.microsoft.com/en-us/azure/storage/blobs/storage-quickstart-blobs-go?toc=%2Fazure%2Fdeveloper%2Fgo%2Ftoc.json&bc=%2Fazure%2Fdeveloper%2Fgo%2Fbreadcrumb%2Ftoc.json&tabs=roles-azure-portal#authenticate-to-azure-and-authorize-access-to-blob-data
 2024-01-09 22:21:39 -08:00
Ben McClellandandGitHub 6786a6385a Merge pull request #367 from versity/azure-sas-token 
Azure sas token authentication
 2024-01-09 22:06:57 -08:00
jonaustin09andBen McClelland e5fc12042b feat: Added sas token authentication for azure backend 2024-01-09 22:03:13 -08:00
Ben McClellandandGitHub 06ccd7496e Merge pull request #369 from versity/ben/az_cleanup 
chore: remove azure bug comment
 2024-01-09 08:29:42 -08:00
Ben McClellandandGitHub c86362b269 Merge pull request #370 from versity/dependabot/go_modules/dev-dependencies-925c4d3e9f 
chore(deps): bump the dev-dependencies group with 6 updates
 2024-01-09 08:28:59 -08:00