jonaustin09
23a40d86a2
fix: Removed the bucket ACL owner check for admin and root users
2024-07-17 09:39:00 -04:00
Ben McClelland
ed9a10a337
Merge pull request #679 from versity/fix/s3cmd-acl-grt-type
...
Type property support in bucket ACL
2024-07-16 16:03:12 -07:00
jonaustin09
828eb93bee
fix: Added 'Type' property support in bucket ACL Grantee schema
2024-07-16 18:17:16 -04:00
jonaustin09
ddd048495a
feat: Implemented server access logs with file for Admin APIs
2024-07-15 15:49:03 -04:00
jonaustin09
2843cdbd45
fix: Fixed ChangeBucketOwnership action implementation to update the bucket acl
2024-07-11 13:45:01 -04:00
jonaustin09
e773872c48
feat: Implemented response body streaming for GetObject action
2024-07-08 15:56:24 -04:00
jonaustin09
7545e6236c
feat: Implement bucket ownership controls
...
Bucket ACLs are now disabled by default the same as AWS.
By default the object ownership is BucketOwnerEnforced
which means that bucket ACLs are disabled. If one attempts
to set bucket ACL the following error is returned both in
the gateway and on AWS:
ErrAclNotSupported: {
Code: "AccessControlListNotSupported",
Description: "The bucket does not allow ACLs",
HTTPStatusCode: http.StatusBadRequest,
},
ACls can be enabled with PutBucketOwnershipControls
Changed bucket canned ACL translation
New backend interface methods:
PutBucketOwnershipControls
GetBucketOwnershipControls
DeleteBucketOwnershipControls
Added these to metrics
2024-06-28 21:03:09 -07:00
jonaustin09
1808335381
feat: Added admin api and CLI command for updating gateway users attributes
2024-06-20 08:13:10 -07:00
jonaustin09
985330237f
fix: Fixed admin api error response statuses
2024-06-17 16:50:05 -04:00
jonaustin09
8fa2b58f8e
fix: fixed RestoreObject action request body parsing
2024-06-11 16:37:56 -04:00
Ben McClelland
f0005a0047
fix: restore object request handler and scoutfs glacier enable
...
The restore object api request handler was incorrectly trying to
unmarshal the request body, but for the stadnard (all?) case the
request body is emtpy. We only need the bucket and opbject params
for now.
This also adds a fix to actually honor the enable glacier mode
in scoutfs.
2024-06-11 12:57:46 -07:00
jonaustin09
5d5381e688
feat: Parsing storage class and forwarding to backend as CopyObject input
2024-06-04 16:46:46 -04:00
Ben McClelland
97b5424e07
feat: move metrics actions and service to tags
2024-05-29 15:42:04 -07:00
jonaustin09
dbfd9e5171
fix: Removed required request body check for PutBucketAcl action
2024-05-29 14:13:38 -07:00
Ben McClelland
983da28a7e
feat: define action names in metrics module
2024-05-28 15:46:37 -07:00
jonaustin09
be6f9a86cd
feat: Integrated metric manager into the gateway
2024-05-28 12:50:50 -07:00
jonaustin09
9e8458a09f
feat: Added integration tests for bypass governance retention functionality
2024-05-28 15:17:25 -04:00
jonaustin09
fb27e2703e
feat: Implemented to logic to bypass governance retention
2024-05-24 13:50:41 -04:00
jonaustin09
6fb102056d
fix: Changed WORM protection implementation to prevent root/admin users to overwrite objects in governance mode or if legal hold is set up
2024-05-23 16:56:21 -04:00
jonaustin09
43f509d971
fix: Added missing properties support for CreateMultipartUpload action: ContentType, ObjectLock, Tagging, Metadata
2024-05-22 12:16:55 -07:00
jonaustin09
e38c63448d
fix: Changed GetObject by range success status code from 200 to 206
2024-05-20 14:48:02 -04:00
jonaustin09
4bde84eafd
fix: Added status property validation for PutObjectLegalHold action
2024-05-17 12:39:27 -04:00
jonaustin09
fbb7c4a888
fix: Fixed CopyObject action response body type
2024-05-07 11:57:36 -04:00
jonaustin09
2a2f9c827c
feat: Closes #484 . Added support to run the gateway on read only mode
2024-05-06 16:41:39 -04:00
jonaustin09
481c9246c6
feat: HeadObject ation multipart upload case
2024-05-03 18:10:32 -04:00
jonaustin09
b4cd35f60b
feat: error refactoring and enable object lock in backends
...
Added support to enable object lock on bucket creation in posix and azure
backends.
Implemented the logic to add object legal hold and retention on object creation
in azure and posix backends.
Added the functionality for HeadObject to return object lock related headers.
Added integration tests for these features.
2024-05-02 15:23:48 -07:00
jonaustin09
0c3771ae2d
feat: Added GetObjectAttributes actions implementation in posix, azure and s3 backends. Added integration tests for GetObjectAttributes action
2024-04-29 15:31:53 -04:00
jonaustin09
6f9c6fde37
feat: Added DeleteObjects event support in bucket event notifications
2024-04-25 16:18:02 -04:00
jonaustin09
89755ea5aa
feat: Changed object lock actions interface to put/get []byte
2024-04-22 13:19:09 -07:00
jonaustin09
fbaba0b944
feat: Added object WORM protection by object-lock feature from AWS with the following actions support: PutObjectLockConfiguration, GetObjectLockConfiguration, PutObjectRetention, GetObjectRetention, PutObjectLegalHold, GetObjectLegalHold
2024-04-22 13:13:40 -07:00
jonaustin09
84ce40fb54
fix: Fixes #487 , added response headers for HeadBucket action
2024-04-18 13:27:45 -04:00
Ben McClelland
17b1dbe025
fix: return non 0 exit status for cli admin error
...
Fixes #505 . This returns the body as an error when the http status
for the admin request is non-success.
2024-04-08 17:29:02 -07:00
Ben McClelland
4be4dc2971
feat: add more debug logging for api handler errors
...
There are a few cases where parsing, validations checks, etc
error details are getting lost with the more generic error
responses. This add some opt-in debug logging to log more
info for these various error cases.
2024-04-06 20:08:16 -07:00
jonaustin09
dbc0ad4325
feat: Closes #475 , Implemented filters for s3 bucket event notifications, created a utility CLI command to create config file
2024-04-04 13:25:01 -07:00
Ben McClelland
4d02ac21c5
Merge pull request #460 from versity/bucket-policies
...
Bucket Policy
2024-03-25 15:19:46 -07:00
jonaustin09
754c221c4d
feat: Added bucket policy access verifier function implementation. Changed the default behaviour of bucket ACLs. Fixed the supported actions list for bucket policy. Implemented Copy* actions access checker function
2024-03-25 16:00:35 -04:00
jonaustin09
af641e5368
feat: Added integration test cases for Put/Get/DeleteBucketPolicy actions. Made some bug fixes in these actions implementations
2024-03-20 17:31:52 -04:00
jonaustin09
d469a72213
feat: Implemented Put/Get/DeletBucketPolicy s3 actions in posix backend. Implemented policy document validation function
2024-03-15 15:47:10 -04:00
Ben McClelland
b801a700d5
Merge pull request #449 from versity/ben/input_tag_format
...
fix: remove namespace restrictions on tag xml input
2024-03-12 11:46:36 -07:00
Ben McClelland
08e5c568d5
fix: zero len put error when content length value not defined
...
Fixes #444 . For some clients using chunked uploads with a zero
length file, the content length value from the request headers
was coming back as an empty string. If this happens, just set
it to "0" so that we can successfully parse this to int value.
2024-03-11 21:15:34 -07:00
Ben McClelland
0d8a4f5791
fix: remove namespace restrictions on tag xml input
...
Fixes #447 . Previously we required XML namespace and got these
errors with this input:
DEBUG: <Tagging><TagSet><Tag><Key>mykey</Key><Value>myvalue</Value></Tag></TagSet></Tagging>
DEBUG: expected element <Tagging> in name space http://s3.amazonaws.com/doc/2006-03-01/ but have no name space
2024-03-11 21:01:40 -07:00
Ben McClelland
f7655dab9b
fix: delete object xml response should be DeleteResult instead of DeleteObjectsResult
2024-03-09 10:20:15 -08:00
jonaustin09
d4f17bf32f
feat: Added bucket policy actions implementation in FE
2024-03-06 13:56:29 -05:00
jonaustin09
e6852b3a99
feat: Closes 417, Added the following versioning related actions: PutBucketVersioning, GetBucketVersioning, ListObjectVersions. Added versionId support in FE for the following actions: GetObject, DeleteObject
2024-02-28 09:48:05 -05:00
jonaustin09
fa54dfeb9f
feat: Added userplus role in IAM, who has the same opportunities as the user, but may also create a bucket
2024-02-20 14:24:26 -05:00
Ben McClelland
0760467c3d
fix: correct xml response encoding for list-buckets and tagging
...
fixes #395
2024-02-12 16:20:07 -08:00
Jon Austin
0c056f935b
ListObjectsV2 start-after prop ( #388 )
...
* fix: Fixes #138 , Added StartAfter property in ListObjectsV2 action, added couple of integration tests for ListObjectsV2
2024-02-01 11:04:52 -08:00
jonaustin09
3cce3a5201
feat: Added unit and integration test cases for posix bucket tagging related actions
2024-01-31 10:09:48 -08:00
jonaustin09
d70ea61830
feat: Added the following actions support in posix backend: PutBucketTagging, GetBucketTagging, DeleteBucketTagging
2024-01-31 10:09:48 -08:00
jonaustin09
0d3a238ceb
feat: Implemented logic to add bucket ACL on bucket creation
2024-01-31 09:49:56 -08:00