jonaustin09
d4f17bf32f
feat: Added bucket policy actions implementation in FE
2024-03-06 13:56:29 -05:00
jonaustin09
e6852b3a99
feat: Closes 417, Added the following versioning related actions: PutBucketVersioning, GetBucketVersioning, ListObjectVersions. Added versionId support in FE for the following actions: GetObject, DeleteObject
2024-02-28 09:48:05 -05:00
Ben McClelland
0760467c3d
fix: correct xml response encoding for list-buckets and tagging
...
fixes #395
2024-02-12 16:20:07 -08:00
Jon Austin
0c056f935b
ListObjectsV2 start-after prop ( #388 )
...
* fix: Fixes #138 , Added StartAfter property in ListObjectsV2 action, added couple of integration tests for ListObjectsV2
2024-02-01 11:04:52 -08:00
jonaustin09
3cce3a5201
feat: Added unit and integration test cases for posix bucket tagging related actions
2024-01-31 10:09:48 -08:00
jonaustin09
d70ea61830
feat: Added the following actions support in posix backend: PutBucketTagging, GetBucketTagging, DeleteBucketTagging
2024-01-31 10:09:48 -08:00
jonaustin09
0d3a238ceb
feat: Implemented logic to add bucket ACL on bucket creation
2024-01-31 09:49:56 -08:00
Ben McClelland
6481e2aac5
fix: cleanup backend ACLs
...
This adds the default ACL to the CreateBucket backend method so
that the backend doesn't need to know how to construct and ACL.
This also moves the s3proxy ACLs to a tag key/value because the
gateway ACLs are not the same accounts as the backend s3 server.
TODO: we may need to mask this tag key/value if we add support
for the Get/PutBucketTagging API.
2024-01-10 09:36:00 -08:00
Ben McClelland
ba501e482d
feat: steaming requests for put object and put part
...
This builds on the previous work that sets up the body streaming
for the put object and put part requests. This adds the auth and
checksum readers to postpone the v4auth checks and the content
checksum until the end of the body stream.
This means that the backend with start reading the data from the
body stream before the request is fully validated and signatures
checked. So the backend must check the error returned from the
body reader for the final auth and content checks. The backend
is expected to discard the data upon error.
This should increase performance and reduce memory utilization
to no longer require caching the entire request body in memory
for put object and put part.
2023-12-14 19:19:46 -08:00
jonaustin09
27eb43d089
feat: Closes #290 , implemented request body stream reading for PutObject and UploadPart actions.
2023-12-14 18:27:51 -08:00
Ben McClelland
c6cbd82f8b
fix: Fixes 330, Fixes 334, Fixed copySrcModifSince bug in CopyObject action
...
commit 48d951edfejonaustin460@gmail.com >
Date: Wed Dec 13 09:06:44 2023 -0500
2023-12-13 15:35:46 -08:00
Jon Austin
e9f01c8cce
S3 proxy ListParts max parts issue ( #338 )
...
* feat: implemented the logic to run integration tests separately
* fix: Resolved tests closer bug
* fix: Fixes #329 , Fixed ListParts max-parts property issue
* fix: removed max-parts max int value check
2023-12-13 10:22:34 -08:00
jonaustin09
48818927bb
feat: Fixes #286 , Created a struct which handles s3 select event streaming and event message construction
2023-12-06 14:02:36 -08:00
Ben McClelland
cd8ad7d482
fix: breaking changes with aws sdk updates
2023-11-28 13:51:32 -08:00
jonaustin09
4f8e4714ee
fix: Fixes #286 , Fixed SelectObjectContent CLI bug, added Content-Length header in response
2023-10-13 13:23:19 -04:00
jonaustin09
52674ab0c5
feat: Closes #282 , created a new integration test group and test cases for posix specific behaviours testing
2023-10-11 08:17:10 -07:00
Ben McClelland
4661af11dd
feat: replace access/role context locals with full account info
2023-10-02 10:59:59 -07:00
Jon Austin
9cb357ecc5
CopyObject metadata ( #265 )
...
* fix: Object tag actions cleanup
* fix: Fixes #249 , Changed ListObjects default max-keys from -1 to 1000
* fix: Fixes #250 , Added support to provide a marker not from the objects list and list the objects after the provided marker in ListObjects(V2) actions
* feat: Closes #256 , Addded a check step, to compare object metadatas and allow the copying to itself, if the metadata has been changed
* fix: Simplified range assignment in CopyObject posix function
2023-09-26 18:09:09 -07:00
jonaustin09
099ac39f22
fix: Fixes #259 , Changed delete actions response statuses from 200 to 204
2023-09-23 21:21:47 -07:00
jonaustin09
4be5d64c8b
fix: Object tag actions cleanup
2023-09-23 21:00:45 -07:00
jonaustin09
e0c09ad4d9
fix: Fixes #247 , Changed DeleteObjectTagging action successful response status from 200 to 204
2023-09-20 12:07:52 -04:00
jonaustin09
e392ac940a
fix: VerifyACL function clenup: removed unused bucket argument from the function declaration
2023-09-19 16:36:42 -07:00
jonaustin09
a77954a307
fix: Fixes #246 , Added max length check for tag keys and values in PutObjectTagging and PutObject actions
2023-09-19 14:42:30 -04:00
Jon Austin
1874d3c329
fix: Fixes #244 , Added destincation bucket ACL check for CopyObject action ( #253 )
2023-09-18 11:49:37 -07:00
jonaustin09
8d2e2a4106
fix: Fixes #204 , Change ListBuckets action logic to return all the buckets for admin users and the buckets owned by a user for regular users. Added integration test cases for ListBuckets action
2023-09-07 14:49:47 -04:00
jonaustin09
cb2f6a87aa
fix: Fixes #207 , Fixes #198 : added lexicographical order by object key and uploadId for ListMultipartUploads response, Added FE support to pass the necessary arguments to BE for ListMultipartUploads
2023-09-01 15:33:58 -04:00
jonaustin09
e8b06a72f9
fix: Fixes #197 , Fixed PutBucketAcl action input validation
2023-08-25 00:40:17 +04:00
jonaustin09
dde13ddc9a
fix: Fixes #183 . Added a validation for max-keys for ListObjects/ListObjectsV2
2023-08-03 20:47:34 +04:00
jonaustin09
009ceee748
feat: Added FE support for SelectObjectContent action
2023-08-02 00:08:28 +04:00
Jon Austin
091375fa00
Issue 151 ( #174 )
...
* fix: Fixes #151 . Fixed DeleteObjects action bugs: Corrected request body serialization type, added return type
2023-07-31 21:36:33 -07:00
jonaustin09
838a7f9ef9
fix: Fixes #152 . Changed CompleteMultiPartUpload invalid payload error to MalformedXML
2023-07-28 18:19:15 +04:00
Jon Austin
77080328c1
Issue 156 ( #167 )
...
* fix: Fixes #156 , Added bucket name validation on bucket creation
2023-07-27 11:04:50 -07:00
Ben McClelland
884fd029c3
feat: add context to backend calls
...
This adds a context to the backend interface calls so that the backend
can enable request cancellation. This change isn't acutally implementing
any backend handling, but just putting the pieces into place to pass the
context to the backend.
2023-07-26 21:54:12 -07:00
jonaustin09
7fb2a7f9ba
feat: ACL refactoring, moved ace parsing from controllers to middleware
2023-07-26 20:54:50 +04:00
Ben McClelland
ee703479d0
Merge pull request #161 from versity/fix/issue-150
...
Issue 150
2023-07-25 10:02:57 -07:00
Ben McClelland
bedd353d72
Merge pull request #160 from versity/fix/issue-155
...
Issue 155
2023-07-25 10:02:16 -07:00
jonaustin09
4c451a4822
feat: Added support to add object tags on object creation
2023-07-25 20:42:58 +04:00
jonaustin09
287db7a7b6
fix: Fixed ListObjects marker bug, now it takes the correct query param as marker
2023-07-25 20:31:40 +04:00
jonaustin09
c598ee5416
fix: Added accept-range, Content-range and x-amz-tagging-count headers in GetObject action response, added test cases for these
2023-07-25 20:28:40 +04:00
Ben McClelland
2291c22eaa
fix: standardize Backend interface args for s3 types
2023-07-22 22:45:24 -07:00
jonaustin09
fe547a19e9
feat: bucket event notifications
...
Set up Bucket event notifications interface to send aws compatible format event messages to a configured event service.
First integrated service is kafka message broker as an option for bucket event notifications.
2023-07-20 11:37:14 -07:00
jonaustin09
87d61a1eb3
feat: Setup audit loggin with webhook url and root level access.log file. CLI enables either webhook or server access logs by providing the flags
2023-07-14 23:40:05 +04:00
jonaustin09
39803cb158
feat: Some cleanup in controller unit tests, removed backend unsupported unit tests, added test cases for admin controller functions
2023-07-03 20:35:40 +04:00
jonaustin09
f63545c9b7
feat: Added UploadPartCopy action in FE
2023-07-03 17:14:46 +04:00
jonaustin09
9db01362a0
feat: increased unit testing coverage in controllers, utility functions and server functions. Fixed bucket owner bug in putbucketacl. 2 more minor changes in controllers
2023-06-30 22:04:46 +04:00
Jon Austin
4bfb3d84d3
Acl integration test ( #115 )
...
* feat: Added test an integration test case for acl actions(get, put), fixed PutBucketAcl actions bugs, fixed iam bugs on getting and creating user accounts
* fix: Fixed acl unit tests
* fix: Fixed cli path in exec command in acl integration test
* fix: fixed account creation bug
2023-06-28 19:38:35 -07:00
Jon Austin
45e3c0922d
Tag actions FE ( #113 )
...
* feat: Added get-object-tagging, put-object-tagging, delete-object-tagging actions in fe
2023-06-26 12:29:56 -07:00
Ben McClelland
c4e0aa69a8
scoutfs: add support for glacier emulation mode
2023-06-21 10:27:14 -07:00
jonaustin09
c01d3ed542
feat: control over logging in debug mode and control logging for specific actions
2023-06-20 19:39:58 +04:00
jonaustin09
0209ca4bc0
fix: fixed merge conflicts
2023-06-19 23:20:33 +04:00
