Commit Graph

320 Commits

Author SHA1 Message Date
shuqiang-zheng
3f1e45a22a fix(security): slice memory allocation with excessive size value.
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2024-08-12 14:03:06 +08:00
W9068822
d25840b71f feat(metrics): report version of client, metanode, datanode, authnode, lcnode, objectnode
Signed-off-by: W9068822 <v-lijianrong1@oppo.com>
2024-07-22 17:10:59 +08:00
Victor1319
4df91ebc6e refactor(all): reslove merge conflicts between 3.3.x and 3.4.0.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-07-18 16:57:38 +08:00
yhjiango
3797f6b0e8 fix(object): fix request parts check in complete multipart
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2024-07-18 16:57:38 +08:00
yhjiango
e487250c51 fix(object): adjust STS auth process
Signed-off-by: yhjiango <jiangyunhua@oppo.com>

(cherry picked from commit 1f23b3f620)
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2024-07-18 16:57:38 +08:00
yhjiango
46246c4768 feat(objectnode): s3 sts and signature auth
1. sts federation token
2. signature auth code refactor

Signed-off-by: yhjiango <jiangyunhua@oppo.com>

(cherry picked from commit 4401624f96)
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2024-07-18 16:57:38 +08:00
chihe
84223360b4 fix(client): trash support back-end audit 2024-07-18 16:57:38 +08:00
chihe
80c6e6417f enhance(client): ingnore exist error when rebuild parent dir
Signed-off-by: chihe <chi.he@oppo.com>
2024-07-18 16:57:38 +08:00
slasher
5c7898354f style(all): format all codes with golangci tools
closes #3371

@formatter:off

Signed-off-by: slasher <shenjie1@oppo.com>
2024-05-14 09:54:13 +08:00
tangdeyi
6ad04f6365 fix(object): listobjectv2 IsTruncated required
Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2024-03-22 11:02:51 +08:00
yhjiango
f7e7235694 fix(object): fix request parts check in complete multipart
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2024-03-13 15:54:54 +08:00
yhjiango
611ef3263e fix(object): fix tagging valid verification
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2024-03-13 15:54:54 +08:00
yhjiango
234d30ec11 fix(object): partNumber must not be greater than 10000
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2024-03-06 15:42:27 +08:00
yhjiango
1f23b3f620 fix(object): adjust STS auth process
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2024-03-06 15:42:27 +08:00
slasher
1d84f74acd chore(format): format all code with gofumpt
Signed-off-by: slasher <shenjie1@oppo.com>
2024-01-12 14:21:16 +08:00
yhjiango
135da4ec9f refactor(object): add CubeFS's statement comment
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2024-01-10 14:58:30 +08:00
leonrayang
be0ed93edc enhance(httpserver):resolve Potential Slowloris attacks according to ostif security team
Signed-off-by: leonrayang <chl696@sina.com>
2023-12-11 10:09:36 +08:00
leonrayang
7a739d82cf fix(object): unmarshal may return nil althrough no error happend
Signed-off-by: leonrayang <chl696@sina.com>
2023-12-11 10:09:36 +08:00
zhaochenyang
4566e8810e feat(ci): add sast tools gosec and semgrep
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2023-12-06 17:05:54 +08:00
tangdeyi
9388fc02b3 feat(objectnode): disable createBucket by s3
Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2023-12-06 14:10:49 +08:00
tangdeyi
0d8662cc9a feat(objectnode): listbucket add authed volumes
Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2023-12-06 14:10:49 +08:00
lily-lee
a8620dc1e9 fix(code scan): fix code-scanning problems.
Signed-off-by: lily-lee <lilylee88756@gmail.com>
2023-11-28 12:32:15 +08:00
yhjiango
abdb0f2d9d enhance(object): add time-consuming tracking in object access
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2023-11-22 15:15:06 +08:00
yhjiango
f1cfca0be5 fix(object): partNumber of multipart must be greater than 0
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2023-11-15 15:18:47 +08:00
tangdeyi
af996a6299 fix(objectnode): s3api perm is compatible with fuse perm
Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2023-11-13 15:12:30 +08:00
yhjiango
4860f6de65 fix(object): fixed original errorcode being modified
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2023-11-09 11:34:08 +08:00
yhjiango
e669e7b42f fix(object): xml tagging data in post object
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2023-11-09 11:34:08 +08:00
yhjiango
2493347023 enhance(object): remove '\n' of error response body to avoid line wrap in auditlog
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2023-11-09 11:34:08 +08:00
yhjiango
5574a77cfb fix(object): file size is not checked when content-length-range is not specified in the policy
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2023-11-09 11:34:08 +08:00
yhjiango
c8e92fb0f0 feat(objectnode): support local and external audit log
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2023-11-01 14:46:14 +08:00
tangdeyi
b8e3732fa8 fix(object): fix create bucket err
Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2023-11-01 10:33:45 +08:00
tangdeyi
9b14adf492 fix(object): fix content length limit
Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2023-10-31 19:21:10 +08:00
yhjiango
5f3c8e3a25 fix(objectnode): fix error response with object lock in postobject
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2023-10-31 18:56:31 +08:00
yhjiango
9eb43bb51c feat(objectnode): support post object
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2023-10-31 15:25:28 +08:00
yhjiango
26f6923afd feat(objectnode): support post object
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2023-10-31 11:03:49 +08:00
tangdeyi
831d9103fb fix(objectnode): fix delete object 5xx error
Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2023-10-24 17:44:01 +08:00
tangdeyi
dd46c24873 fix(objectnode): fix read body entirely into memory and without an upper boundary
Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2023-10-20 17:06:26 +08:00
NaturalSelect
1903deed73 feat(object): support full path audit log
Signed-off-by: NaturalSelect <2145973003@qq.com>
2023-10-18 14:51:09 +08:00
tangdeyi
fcdeaebb69 fix(objectnode): lifecycle skip locked object
Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2023-10-13 15:30:37 +08:00
slasher
fdcc9d7a3a chore(object): request id is escaped before being put into the response
see: security/code-scanning/122

Directly writing user input (for example, an HTTP request parameter) to
an HTTP response without properly sanitizing the input first, allows for
a cross-site scripting vulnerability.

Signed-off-by: slasher <shenjie1@oppo.com>
2023-09-25 11:03:32 +08:00
tangdeyi
15703d2c09 refactor(objectnode): update ratelimit v1 lib
Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2023-09-18 14:08:33 +08:00
tangdeyi
a7199600c6 fix(objectnode): temporary data security check for concurrent completeMultipart request
Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2023-09-15 14:16:30 +08:00
tangdeyi
7507bbdc35 fix(objectnode): fix s3qos resource release
Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2023-09-06 16:20:37 +08:00
tangdeyi
1b72e88cc8 feat(objectnode): fix s3 put api qos not work
Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2023-09-05 18:56:32 +08:00
tangdeyi
f9c273ac4c feat(objectnode): add some s3qos log
Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2023-09-05 10:28:40 +08:00
tangdeyi
210de3e28c fix(objectnode): fix s3qos zero nodenum
Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2023-08-31 16:36:14 +08:00
tangdeyi
b24525a027 fix(objectnode): fix superfluous writeheader
Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2023-08-31 16:36:14 +08:00
tangdeyi
14f0f67c73 feat(objnode): s3 api qos
Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2023-08-31 16:36:14 +08:00
tangdeyi
abf607736d enhance(objectnode): metacache support background evict
Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2023-08-30 20:05:32 +08:00
tangdeyi
adb37a02ee fix(objectnode): fix listobjectv1 err with delimiter
Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2023-08-30 20:05:32 +08:00