Commit Graph

368 Commits

Author SHA1 Message Date
chihe
7a618a44ad fix(client): use sync flush if open file as directIO
close:#1000464581

Signed-off-by: chihe <chihe@oppo.com>
(cherry picked from commit 34fb8cdeb2)
2025-12-24 17:01:31 +08:00
Victor1319
fc05b1d503 refactor(all): remove cache rule and cache threshold. #1000142823
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-08-08 14:59:31 +08:00
zhumingze
b74b3fa74e fix(objectnode): fix incorrect statusCode when creating volume in objectnode. #1000146602
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-08 14:59:30 +08:00
Victor1319
c3ccdfc7e2 refactor(sdk): remove dp cache code from sdk, client, cli. #1000063488
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-08-08 14:59:27 +08:00
clinx
326f7611ca fix(objectnode): create reader or writer with corrected volume's type #23077454
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-08 14:39:32 +08:00
clinx
e50f6a23f4 fix(objectnode): create reader or writer with corrected volume's type #23077454
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-08 14:39:05 +08:00
clinx
7de202b317 fix(objectnode): create ebs reader by sv#23077454
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-07 16:00:26 +08:00
clinx
0152d00450 fix(objectnode): create reader or writer with corrected volume's type #23077454
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-07 16:00:26 +08:00
chihe
9a5d48ca84 fix(client): folder renamed or moved out of the cache directory will no longer be cached.
close:#23022505

Signed-off-by: chihe <chihe@oppo.com>
2025-08-07 16:00:25 +08:00
tangdeyi
77979034f5 fix(objectnode): add range get check
with #23042024

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2025-08-07 16:00:25 +08:00
clinx
0d875b0a33 fix(object): stop update volume meta info when vol is deleted #22861848
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-07 15:57:57 +08:00
clinx
82ffd69b6b fix(object): stop update volume meta info when vol is deleted #22861848
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-07 15:57:57 +08:00
chihe
c65d6c19df fix(lcnode): init ExtentConfig with metaWrapper
close:#23007284

Signed-off-by: chihe <chihe@oppo.com>
2025-08-07 15:57:56 +08:00
slasher
d4288318de feat(ci): add docker for go 1.18
@formatter:off

close: #3782

Signed-off-by: slasher <shenjie1@oppo.com>
2025-07-08 11:30:16 +08:00
FourSpaces
b7635952e0 fix(objectnode): When S3 deletes an object, the empty folder is not recursively deleted
Signed-off-by: FourSpaces <cheng1483x@gmail.com>
2025-04-10 11:16:02 +08:00
FourSpaces
9cc87735fe fix(objectnode): S3 Folder not recursively deleted
Signed-off-by: FourSpaces <cheng1483x@gmail.com>
2025-04-10 11:16:02 +08:00
slasher
7f1e02e668 chore(style): fix semgrep of ip v6 in document
Signed-off-by: slasher <shenjie1@oppo.com>
2025-03-03 11:07:46 +08:00
slasher
c713d78265 chore(style): fix up semgrep for ip v4 and v6
Signed-off-by: slasher <shenjie1@oppo.com>
2025-02-19 10:05:11 +08:00
morphes1995
4a96eeb26e fix(object): buffer optimization when calculate md5sum
Signed-off-by: morphes1995 <morphes1995@gmail.com>
2025-01-10 15:56:35 +08:00
Victor1319
8bb1131500 refactor(all): refactor go code with golint. #22906448
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
0c406f55d9 refactor(master): resolve conflicts when picking to master branch. #22906448
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
dac1a12d0a refactor(master): resolve conflicts when picking to master branch. #22906448
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
leonrayang
3396accd80 feat(projectstructure): reorganize the module directory in the root to a suitable subdirectory
close:#22458839

Signed-off-by: leonrayang <chl696@sina.com>
2024-12-26 09:24:22 +08:00
Victor1319
ba48924d95 refactor(master): remove useless code. #22890822
eliminate security vulnerabilities in the code.

Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
tangdeyi
b7cf39a0c3 fix(objectnode): optimize the logic of createBucket
with #22863348

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
f9c00bb5c8 fix(meta): adjust the call order of the RegistConsul func to prevent concurrent modify to clustername.
#22873788

Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
tangdeyi
3461b0873d fix(objectnode): close volume loadOSSMeta task when volume is deleted
with #22861848

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2024-12-26 09:24:22 +08:00
zhaochenyang
824098f801 refactor(lcnode): hybrid cloud lifecycle rule prefix check #22726594
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-26 09:24:22 +08:00
zhaochenyang
a4dd4dfa92 refactor(lcnode): hybrid cloud config lc start time and disable expiration #22653422
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
0a3f53cdfa fix(client): client data modification is prohibited if renewal failed
close:#22676203

Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
037df5f5f9 fix(sdkclient): client compatible with older version server modules
#22400600
	@formatter:off
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
zhaochenyang
56b4c27f7a fix(lcnode): hybrid cloud support start one task and stop one task
#22423763
	#22502668
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-26 09:24:22 +08:00
zhaochenyang
da6467830a fix(lcnode): hybrid cloud optimize conflict rule prefix #22311091
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-26 09:24:22 +08:00
NaturalSelect
3b9ef65dbe chore(all): format code
@formatter:off

Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
09259d999d fix(sdk): hybrid cloud set VolCacheDpStorageClass when invoking NewExtentClient
#22196488
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
d9c01f0af5 fix(client): hybrid cloud Fix some places where the original condition
should be changed to "vol storageClass is blobstore".
	Adds field volStorageClass to ExtentClient for this purpose.
	Remove field volumeType from ExtentClient by the way.

Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
zhaochenyang
4c73097a3d refactor(lcnode): hybrid cloud lifecycle transition
1. close extent client
2. use StorageClass_Replica_HDD and StorageClass_BlobStore
3. scanner init AllowedStorageClass
4. enhance lifecycle parameter check
5. add extent client for write

Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
eb2d65002b refactor(metanode): hybrid cloud 1.Simplify the logic of updating extent key after migration
2. reset inode reserved when excute marshall operation
	3. initial ebs client in mp
	4. remove cold vol or hot vol check in client and objectnode

Signed-off-by: chihe <chi.he@oppo.com>
2024-12-26 09:24:22 +08:00
zhaochenyang
d89812aaf0 feat(lcnode): hybrid cloud lifecycle transition
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
284ca0d211 feat(metanodeclient): hybrid cloud support hybridcloud data migration
Signed-off-by: chihe <chi.he@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
443199e0b0 fix(client): hybrid cloud only clear dp when volume storage class is blobstore
Signed-off-by: chihe <chi.he@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
347208f189 refactor(clientmetanode): hybrid cloud check inode/vol storage class when checking vol type
Signed-off-by: chihe <chi.he@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
029d1b359e feat(clientmetanode): hybrid cloud support change inode storageclass when updating ek
Signed-off-by: chihe <chi.he@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
7a915e87e0 feat(client): hybrid cloud supports the option to choose SSD or HDD data partition
Signed-off-by: chihe <chi.he@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
e1442f7de1 feat(clientmetanode): hybrid cloud support renewal inode forbidden migration
Signed-off-by: chihe <chi.he@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
7211b09cd6 feat(meta): hybrid cloud inode supprot hybrid-clound
2.client read/write support hybrid-clound

Signed-off-by: chihe <chi.he@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
be565f6609 refactor(server): refactor http connect pool when comminute with master.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
tangdeyi
7ae6457821 fix(objectnode): separate read and write buffers
with

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2024-12-26 09:24:22 +08:00
shuqiang-zheng
3f1e45a22a fix(security): slice memory allocation with excessive size value.
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2024-08-12 14:03:06 +08:00
W9068822
d25840b71f feat(metrics): report version of client, metanode, datanode, authnode, lcnode, objectnode
Signed-off-by: W9068822 <v-lijianrong1@oppo.com>
2024-07-22 17:10:59 +08:00