jonaustin09
70818de594
fix: Fixes #168 . Changed PutObject existing object error from custom internal error to ErrExistingObjectIsDirectory
2023-07-31 18:17:29 +04:00
jonaustin09
898c3efaa0
fix: Fixes #153 . Fixed CompleteMultipartUpload invalid ETag error case, fixed UploadPart xattr.Set error
2023-07-28 18:20:07 +04:00
Jon Austin
bf33b9f5a2
Issue 154 ( #169 )
...
* fix: Fixes #154 , Changed GetObject range error to InvalidRange
2023-07-27 11:05:40 -07:00
Ben McClelland
884fd029c3
feat: add context to backend calls
...
This adds a context to the backend interface calls so that the backend
can enable request cancellation. This change isn't acutally implementing
any backend handling, but just putting the pieces into place to pass the
context to the backend.
2023-07-26 21:54:12 -07:00
Ben McClelland
5b31a7bafc
Merge pull request #162 from versity/fix/issue-136
...
Issue 136
2023-07-25 10:03:28 -07:00
Ben McClelland
bedd353d72
Merge pull request #160 from versity/fix/issue-155
...
Issue 155
2023-07-25 10:02:16 -07:00
jonaustin09
1649c5cafd
fix: Added KeyCount property in ListObjectsV2 action result, added a test case for one
2023-07-25 20:44:57 +04:00
jonaustin09
4c451a4822
feat: Added support to add object tags on object creation
2023-07-25 20:42:58 +04:00
jonaustin09
c598ee5416
fix: Added accept-range, Content-range and x-amz-tagging-count headers in GetObject action response, added test cases for these
2023-07-25 20:28:40 +04:00
Ben McClelland
2291c22eaa
fix: standardize Backend interface args for s3 types
2023-07-22 22:45:24 -07:00
jonaustin09
ef1de682a4
fix: Error handling for posix DeleteObject function to return an error when the object doesn't exist
2023-07-14 23:41:52 +04:00
Ben McClelland
47dea2db7c
feat: implement posix UploadCopyPart
2023-07-05 19:06:19 -07:00
jonaustin09
39803cb158
feat: Some cleanup in controller unit tests, removed backend unsupported unit tests, added test cases for admin controller functions
2023-07-03 20:35:40 +04:00
Ben McClelland
7e34078d6a
posix: cleanup extra debug output
2023-06-29 11:18:00 -07:00
Jon Austin
3c69c6922a
Integration test cases for HeadBucket, CopyObject, DeleteObject actions ( #117 )
...
* feat: Added integration test cases for HeadBucket, CopyObject, DeleteObjects
* feat: Added logger for debugging
2023-06-29 10:40:54 -07:00
Ben McClelland
6d99c69953
fix range gets with unspecified end range
...
The aws cli will send range gets of an object with ranges like
the following:
bytes=0-8388607
bytes=8388608-16777215
bytes=16777216-25165823
bytes=25165824-
The last one with the end offset unspecified just means the rest of
the object. So this fixes that case where there is only one offset
in the range.
2023-06-28 23:09:49 -07:00
Jon Austin
4bfb3d84d3
Acl integration test ( #115 )
...
* feat: Added test an integration test case for acl actions(get, put), fixed PutBucketAcl actions bugs, fixed iam bugs on getting and creating user accounts
* fix: Fixed acl unit tests
* fix: Fixed cli path in exec command in acl integration test
* fix: fixed account creation bug
2023-06-28 19:38:35 -07:00
jonaustin09
b770daa3b5
fix: fixed object directory key for scoutfs fileToObj function
2023-06-22 20:51:37 +04:00
jonaustin09
ed047f5046
fix: fixed directory object key prefix
2023-06-22 20:12:17 +04:00
Ben McClelland
c4e0aa69a8
scoutfs: add support for glacier emulation mode
2023-06-21 10:27:14 -07:00
Ben McClelland
5ce010b1fa
refactor walk to allow for more general obj translation
2023-06-20 13:51:47 -07:00
Ben McClelland
0f733ae0c8
refactor move auth to top level
2023-06-19 11:15:19 -07:00
Ben McClelland
33673de160
fix case where bucket directory is created without acl
2023-06-19 10:34:45 -07:00
Ben McClelland
d2eab5bce3
posix: move iam data store to file
...
Storing to a file will allow more than 64k of storage that the xattr
would be limited to. This attempts to resolve racing updates between
multiple gateways without an explicit coordination between gateways.
This wil also setup a default IAM file on init.
2023-06-19 10:21:53 -07:00
Ben McClelland
94808bb4a9
refactor iam service for blind backend store
2023-06-19 09:53:19 -07:00
Ben McClelland
2427c67171
refactor ACLs to separate out ACL logic from backend
2023-06-16 16:47:05 -07:00
Ben McClelland
09e8889e75
feat: scoutfs backend with move blocks multipart optimized
2023-06-16 10:25:52 -07:00
Ben McClelland
5c61604e82
fix list buckets response for single bucket entry
...
The xml encoding of the s3.ListBucketsOutput return type was not giving
correct results when there is only a single bucket. This revives the
old aws xsd schema and generated types that will give more accurate xml
encoding results.
2023-06-16 10:22:25 -07:00
jonaustin09
49af6f0049
feat: ACL set up finished: added VerifyACL function, added admin checker function on list buckets, fixed all the unit tests
2023-06-16 20:55:23 +04:00
jonaustin09
3d7ce4210a
fix: Fixed GetBucketAcl return type, fixed staticcheck uppercase error, fixed unit tests for PutActions
2023-06-15 20:39:20 +04:00
jonaustin09
114d9fdf63
fix: Branch up to date
2023-06-14 22:41:44 +04:00
jonaustin09
21f0fea5a7
feat: Implemented GetBucketACL, PutBucketACL posix functions, fixed authentication middleware signed headers bug
2023-06-14 22:39:27 +04:00
Ben McClelland
20638aee49
fix: linux otmp object and part uploads
...
We were missing the object and directory name in the O_TMPFILE uploads,
so were incorrectly trying to link these into the top level directory.
2023-06-14 08:42:39 -07:00
Jon Austin
1bcdf948ba
feat: Move IAM configuration file creation on backend running, set up… ( #89 )
...
* feat: Move IAM configuration file creation on backend running
2023-06-13 11:13:18 -07:00
Ben McClelland
dfd8709777
fix some spelling errors
2023-06-12 14:00:10 -07:00
Ben McClelland
7157280627
cleanup unused backend interface
2023-06-12 11:49:57 -07:00
jonaustin09
def500d464
fix: Merged main branch into admin-delete-api
2023-06-12 20:00:34 +04:00
jonaustin09
b98f48ce2c
feat: Added admin api and admin CLI aciton to delete a user
2023-06-12 19:58:28 +04:00
Ben McClelland
ef06d11d7c
fix: get simple multipart upload tests passing
2023-06-12 07:37:21 -07:00
Jon Austin
160a99cbbd
feat: Added admin CLI, created api endpoint for creating new user, cr… ( #68 )
...
* feat: Added admin CLI, created api endpoint for creating new user, created action for admin CLI to create a new user, changed the authentication middleware to verify the users from db
* feat: Added both single and multi user support, added caching layer for getting IAM users
* fix: Added all the files
2023-06-09 10:30:20 -07:00
Ben McClelland
f1ac6b808b
fix list objects for directory type objects
2023-06-08 22:04:08 -07:00
Ben McClelland
f4400edaa0
fix list objects
2023-06-07 22:57:00 -07:00
Ben McClelland
6b16dd76bd
fix: convert byte range to start and length
2023-06-07 08:19:13 -07:00
Jon Austin
8f27e88198
feat: GetObject range calculation moved to backend, created utility function for it in the backend ( #61 )
2023-06-06 11:13:45 -07:00
jonaustin09
7dc1c7f4c1
feat: added windows version of posix file
2023-06-02 22:14:25 +04:00
jonaustin09
f174308e3f
fix: Merge conflicts resolved
2023-05-31 22:41:52 +04:00
Ben McClelland
04ab589aeb
posix: fix put object etag
2023-05-30 21:46:21 -07:00
Ben McClelland
b8cb3f774d
posix: make temp dir if not already exists
2023-05-30 21:45:51 -07:00
Ben McClelland
981894aef2
posix: fix fallback tempfile naming
2023-05-31 04:09:47 +00:00
Ben McClelland
5cbcf0c900
add copyright headers to source files
2023-05-28 14:38:45 -07:00