Commit Graph

42 Commits

Author SHA1 Message Date
slasher
1d84f74acd chore(format): format all code with gofumpt
Signed-off-by: slasher <shenjie1@oppo.com>
2024-01-12 14:21:16 +08:00
yhjiango
4401624f96 feat(objectnode): s3 sts and signature auth
1. sts federation token
2. signature auth code refactor

Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2023-08-30 20:05:32 +08:00
tangdeyi
d11e9142a2 feat(objectnode): object lock
Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2023-08-30 20:05:32 +08:00
Patrick Wu
29e3110a93 S3 lifecycle
Signed-off-by: Patrick Wu <wuchunhuan@gmail.com>
2023-08-30 20:05:32 +08:00
yhjiango
2040ce00a9 fix(objectnode): fix bucket policy and location processing
1. Fix the problem of returning 500 internal errors in PutBucketPolicy.
2. Add related parameter verification in GetBucketLocation.

Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2023-07-20 10:58:50 +08:00
yhjiango
0affc88413 fix(objectnode): fully compatible with s3
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2023-05-18 10:48:57 +08:00
tangdeyi
831ea00d5d fix(objectnode): enhance s3 compatibility
1.CORS supports preflight request;
2.S3-compatible err reply;
3.Small parts upload bugfix;
4.Specific status code when panic;
5.UploadPartCopy;

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2023-05-18 10:48:57 +08:00
Patrick Wu
c8bf55ae69 S3 bugfix
Signed-off-by: Patrick Wu <wuchunhuan@oppo.com>
2023-03-04 16:13:35 +08:00
leonrayang
9a30b9f884 update: update to CubeFS
Signed-off-by: leonrayang <chl696@sina.com>
2022-08-22 18:16:09 +08:00
leonrayang
2970e2c3d1 update. go import path change from chubaofs to cubefs
Signed-off-by: leonrayang <chl696@sina.com>
2022-01-25 18:17:02 +08:00
wenjia322
ae3688cc2a feature: add 'corsMiddleware' and 'optionObject'
Signed-off-by: wenjia322 <buaa1214wwj@126.com>
2020-05-22 15:16:38 +08:00
wenjia322
6405da2709 feature: add api 'getBucketCors/deleteBucketCors/putBucketCors'
Signed-off-by: wenjia322 <buaa1214wwj@126.com>
2020-05-22 15:16:38 +08:00
Mofei Zhang
df4b7f9a42
Fix: parallel-safe issue in conn pool and metanode conn serve
1. Fix: parallel-safe issue in conn pool and metanode conn serve
2. Fix: nil pointer issue when list parts for non-exist uploadId
3. Enhancement: validate read size while read from connnect.
4. Enhancement: clean up useless data on failure while upload part.
5. Enhancement: generate ETag if do not exist when listing.
6. Enhancement: include error message when formatting packet to string.
7. Enhancement: improve compatile with old version SDK.
8. Enhancement:  success when retry add exist multipart part.

Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
Signed-off-by: 张墨飞 <zhangmofei@jd.com>
2020-05-21 12:28:18 +08:00
Mofei Zhang
a4ec2c88d5
Enhancement: improve tagging storage and add tests
1. Add tests for tagging operations.
2. Support setup tagging when put an object.
3. Fix routing issue on DeleteObjectTagging interface.
4. Improve tagging encoding for storage.

Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
2020-05-05 22:38:34 +08:00
Mofei Zhang
d619923016
Enhancement: presigned url fully support
All s3-compatible object storage interfaces already support
presigned url.

Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
2020-05-03 20:44:44 +08:00
Mofei Zhang
7a57837f74
Fix: third-party license information
Adjust the format of the license header information of the third-party
code used to make the format more compliant. The NOTICE file supplements
the third-party code NOTIC information and explains the use of the code.

Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
2020-04-14 19:29:39 +08:00
Mofei Zhang
4edef106d5
Enhancement: add routing for unimplemented APIs
In view of the particularity of the AWS S3 protocol rules, additional
routes are implemented for unimplemented APIs to prevent users from
incorrectly routing to other APIs when requesting unimplemented APIs.

Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
2020-04-08 11:21:25 +08:00
Mofei Zhang
c2f057069d
Merge branch 'master' into object-store
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
2020-03-20 01:11:58 +08:00
Mofei Zhang
61abd3b473
Fix: API route issue of upload part interface
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
2020-03-19 18:46:55 +08:00
Mofei Zhang
11d0a4ddf0
Refactor: reorganize permission and actions
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
2020-03-17 00:11:01 +08:00
Mofei Zhang
d99f147e6a
Refacrot: move actions to command proto package
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
2020-03-16 08:43:17 +08:00
Mervin
83b657724e
Fix: xml entity issue in PutXAttrRequest struct
Signed-off-by: Mervin <mofei2816@gmail.com>
2020-03-10 14:26:25 +08:00
Mervin
a78ce3ad84
Fix: log output of getObjectXAttrHandler
Signed-off-by: Mervin <mofei2816@gmail.com>
2020-03-09 10:35:34 +08:00
wenjia322
56b61426a4 fix: missing parameter in register oss api
Signed-off-by: wenjia322 <buaa1214wwj@126.com>
2020-03-02 14:21:40 +08:00
Mofei Zhang
aec409ffcf Refactor: using middleware for policy valication.
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
2020-02-27 20:36:28 +08:00
Mofei Zhang
4979d728b2 Add: configuration for signature ignore actions
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
2020-02-26 00:00:32 +08:00
wenjia322
b1970b29ae fix: null pointer and masterAddr
Signed-off-by: wenjia322 <buaa1214wwj@126.com>
2020-02-18 12:22:55 +08:00
wenjia322
705a1f6d49 feature: add master api 'deleteVolPolicy'; revise code about authnode
Signed-off-by: wenjia322 <buaa1214wwj@126.com>
2020-02-11 17:12:11 +08:00
Mofei Zhang
d1fe8624b1
Enhancement: unified object storage interface api action
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
2020-02-05 18:16:58 +08:00
Mofei Zhang
d5da6fa573
Add: object storage interface for bucket tagging put and get.
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
2020-02-05 17:47:15 +08:00
Mofei Zhang
a4cef6c836
Add: object storage interface for bucket tagging removal
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
2020-02-05 17:06:51 +08:00
Mofei Zhang
0009306a10
Enhancement: object storage api for object tagging operations
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
2020-02-04 21:11:32 +08:00
Mofei Zhang
6eba8cbeef
Synchronous changes from the master branch
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
2020-01-19 18:25:54 +08:00
Mofei Zhang
0a102eb8c8
Fix: issue when copy file across folder by using object storage interface
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
2020-01-17 17:26:52 +08:00
wenjia322
d108d93bf1 fix: add CreationDate in ListBucketsOutput
Signed-off-by: wenjia322 <buaa1214wwj@126.com>
2020-01-17 15:23:58 +08:00
wenjia322
7e8ce2f552 feature: add api DeleteBucket
Signed-off-by: wenjia322 <buaa1214wwj@126.com>
2020-01-14 11:03:44 +08:00
wenjia322
72e28bd4ed fix: remove policyCheck when create bucket
Signed-off-by: wenjia322 <buaa1214wwj@126.com>
2020-01-13 13:57:02 +08:00
wenjia322
af94502147 feature: add api CreateBucket
Signed-off-by: wenjia322 <buaa1214wwj@126.com>
2020-01-13 11:23:32 +08:00
zhuzhengyi1
0658b4f3fb fix acl router bug
Signed-off-by: zhuzhengyi1 <zhuzhengyi@jd.com>
2020-01-09 09:54:06 +08:00
wenjia322
0ea6447516 feature: cache authnode-info in objectnode and check user policy before calling handle function
Signed-off-by: wenjia322 <buaa1214wwj@126.com>
2020-01-08 18:36:04 +08:00
Mofei Zhang
6996fa18fc
fix api route register order issue
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
2019-12-23 19:18:12 +08:00
Mofei Zhang
d609fedb5c feature: object storage interface
Add ObjectNode provides S3-compatibile APIs.
Fusion Storage interface expose two interface (POSIX and S3-compatible) for file operation.

Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
2019-12-17 17:36:53 +08:00