Commit Graph

351 Commits

Author SHA1 Message Date
slasher
c713d78265 chore(style): fix up semgrep for ip v4 and v6
Signed-off-by: slasher <shenjie1@oppo.com>
2025-02-19 10:05:11 +08:00
morphes1995
4a96eeb26e fix(object): buffer optimization when calculate md5sum
Signed-off-by: morphes1995 <morphes1995@gmail.com>
2025-01-10 15:56:35 +08:00
Victor1319
8bb1131500 refactor(all): refactor go code with golint. #22906448
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
0c406f55d9 refactor(master): resolve conflicts when picking to master branch. #22906448
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
dac1a12d0a refactor(master): resolve conflicts when picking to master branch. #22906448
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
leonrayang
3396accd80 feat(projectstructure): reorganize the module directory in the root to a suitable subdirectory
close:#22458839

Signed-off-by: leonrayang <chl696@sina.com>
2024-12-26 09:24:22 +08:00
Victor1319
ba48924d95 refactor(master): remove useless code. #22890822
eliminate security vulnerabilities in the code.

Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
tangdeyi
b7cf39a0c3 fix(objectnode): optimize the logic of createBucket
with #22863348

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
f9c00bb5c8 fix(meta): adjust the call order of the RegistConsul func to prevent concurrent modify to clustername.
#22873788

Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
tangdeyi
3461b0873d fix(objectnode): close volume loadOSSMeta task when volume is deleted
with #22861848

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2024-12-26 09:24:22 +08:00
zhaochenyang
824098f801 refactor(lcnode): hybrid cloud lifecycle rule prefix check #22726594
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-26 09:24:22 +08:00
zhaochenyang
a4dd4dfa92 refactor(lcnode): hybrid cloud config lc start time and disable expiration #22653422
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
0a3f53cdfa fix(client): client data modification is prohibited if renewal failed
close:#22676203

Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
037df5f5f9 fix(sdkclient): client compatible with older version server modules
#22400600
	@formatter:off
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
zhaochenyang
56b4c27f7a fix(lcnode): hybrid cloud support start one task and stop one task
#22423763
	#22502668
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-26 09:24:22 +08:00
zhaochenyang
da6467830a fix(lcnode): hybrid cloud optimize conflict rule prefix #22311091
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-26 09:24:22 +08:00
NaturalSelect
3b9ef65dbe chore(all): format code
@formatter:off

Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
09259d999d fix(sdk): hybrid cloud set VolCacheDpStorageClass when invoking NewExtentClient
#22196488
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
d9c01f0af5 fix(client): hybrid cloud Fix some places where the original condition
should be changed to "vol storageClass is blobstore".
	Adds field volStorageClass to ExtentClient for this purpose.
	Remove field volumeType from ExtentClient by the way.

Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
zhaochenyang
4c73097a3d refactor(lcnode): hybrid cloud lifecycle transition
1. close extent client
2. use StorageClass_Replica_HDD and StorageClass_BlobStore
3. scanner init AllowedStorageClass
4. enhance lifecycle parameter check
5. add extent client for write

Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
eb2d65002b refactor(metanode): hybrid cloud 1.Simplify the logic of updating extent key after migration
2. reset inode reserved when excute marshall operation
	3. initial ebs client in mp
	4. remove cold vol or hot vol check in client and objectnode

Signed-off-by: chihe <chi.he@oppo.com>
2024-12-26 09:24:22 +08:00
zhaochenyang
d89812aaf0 feat(lcnode): hybrid cloud lifecycle transition
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
284ca0d211 feat(metanodeclient): hybrid cloud support hybridcloud data migration
Signed-off-by: chihe <chi.he@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
443199e0b0 fix(client): hybrid cloud only clear dp when volume storage class is blobstore
Signed-off-by: chihe <chi.he@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
347208f189 refactor(clientmetanode): hybrid cloud check inode/vol storage class when checking vol type
Signed-off-by: chihe <chi.he@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
029d1b359e feat(clientmetanode): hybrid cloud support change inode storageclass when updating ek
Signed-off-by: chihe <chi.he@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
7a915e87e0 feat(client): hybrid cloud supports the option to choose SSD or HDD data partition
Signed-off-by: chihe <chi.he@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
e1442f7de1 feat(clientmetanode): hybrid cloud support renewal inode forbidden migration
Signed-off-by: chihe <chi.he@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
7211b09cd6 feat(meta): hybrid cloud inode supprot hybrid-clound
2.client read/write support hybrid-clound

Signed-off-by: chihe <chi.he@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
be565f6609 refactor(server): refactor http connect pool when comminute with master.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
tangdeyi
7ae6457821 fix(objectnode): separate read and write buffers
with

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2024-12-26 09:24:22 +08:00
shuqiang-zheng
3f1e45a22a fix(security): slice memory allocation with excessive size value.
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2024-08-12 14:03:06 +08:00
W9068822
d25840b71f feat(metrics): report version of client, metanode, datanode, authnode, lcnode, objectnode
Signed-off-by: W9068822 <v-lijianrong1@oppo.com>
2024-07-22 17:10:59 +08:00
Victor1319
4df91ebc6e refactor(all): reslove merge conflicts between 3.3.x and 3.4.0.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-07-18 16:57:38 +08:00
yhjiango
3797f6b0e8 fix(object): fix request parts check in complete multipart
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2024-07-18 16:57:38 +08:00
yhjiango
e487250c51 fix(object): adjust STS auth process
Signed-off-by: yhjiango <jiangyunhua@oppo.com>

(cherry picked from commit 1f23b3f620)
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2024-07-18 16:57:38 +08:00
yhjiango
46246c4768 feat(objectnode): s3 sts and signature auth
1. sts federation token
2. signature auth code refactor

Signed-off-by: yhjiango <jiangyunhua@oppo.com>

(cherry picked from commit 4401624f96)
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2024-07-18 16:57:38 +08:00
chihe
84223360b4 fix(client): trash support back-end audit 2024-07-18 16:57:38 +08:00
chihe
80c6e6417f enhance(client): ingnore exist error when rebuild parent dir
Signed-off-by: chihe <chi.he@oppo.com>
2024-07-18 16:57:38 +08:00
slasher
5c7898354f style(all): format all codes with golangci tools
closes #3371

@formatter:off

Signed-off-by: slasher <shenjie1@oppo.com>
2024-05-14 09:54:13 +08:00
tangdeyi
6ad04f6365 fix(object): listobjectv2 IsTruncated required
Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2024-03-22 11:02:51 +08:00
yhjiango
f7e7235694 fix(object): fix request parts check in complete multipart
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2024-03-13 15:54:54 +08:00
yhjiango
611ef3263e fix(object): fix tagging valid verification
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2024-03-13 15:54:54 +08:00
yhjiango
234d30ec11 fix(object): partNumber must not be greater than 10000
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2024-03-06 15:42:27 +08:00
yhjiango
1f23b3f620 fix(object): adjust STS auth process
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2024-03-06 15:42:27 +08:00
slasher
1d84f74acd chore(format): format all code with gofumpt
Signed-off-by: slasher <shenjie1@oppo.com>
2024-01-12 14:21:16 +08:00
yhjiango
135da4ec9f refactor(object): add CubeFS's statement comment
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2024-01-10 14:58:30 +08:00
leonrayang
be0ed93edc enhance(httpserver):resolve Potential Slowloris attacks according to ostif security team
Signed-off-by: leonrayang <chl696@sina.com>
2023-12-11 10:09:36 +08:00
leonrayang
7a739d82cf fix(object): unmarshal may return nil althrough no error happend
Signed-off-by: leonrayang <chl696@sina.com>
2023-12-11 10:09:36 +08:00
zhaochenyang
4566e8810e feat(ci): add sast tools gosec and semgrep
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2023-12-06 17:05:54 +08:00