Commit Graph

127 Commits

Author SHA1 Message Date
shuqiang-zheng
c2120b249a fix(master): reported bad disk not complete decommission timely metric.
close:#1000242504

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-11 17:21:20 +08:00
zhumingze
ea04e20415 fix(data): Determine the disk lost based on master and locally loaded Dp information
. #1000244723

Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-11 17:21:20 +08:00
shuqiang-zheng
e39e185356 fix(master): show dp of missing tiny extent when cli performs data partition checking.
close:#1000059418

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-11 17:21:18 +08:00
shuqiang-zheng
999f2989ac fix(master): fix panic caused in build heartbeat response after loading broken disk.
close:#1000191783

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-11 17:21:16 +08:00
shuqiang-zheng
b258e285f2 fix(master): fix the problem of disk not found when using cli to query disk information.
close:#1000188189

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-11 17:21:16 +08:00
zhumingze
d624108ddc fix(data): fix panic while create datapartition. #1000173883
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-11 17:21:15 +08:00
zhumingze
4034350ab6 fix(data): selectDisk skip lost disk. #1000173883
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-11 17:21:15 +08:00
shuqiang-zheng
94ff433984 fix(master): set the repairingStatus of dp via raft.
close:#1000158166 #1000158134

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-08 14:59:31 +08:00
zhumingze
1cf0bafea2 fix(data): fix null pointer panic When CreateDataPartition. #1000131492
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-08 14:59:30 +08:00
shuqiang-zheng
3cbb46bd80 fix(master): fix some issues found during decommission testing.
close:#1000059418

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-08 14:59:28 +08:00
Wu Huocheng
df6a12c5d6 chore(datanode): change checking interval from hour to minute.#1000005968
Signed-off-by: Wu Huocheng <wuhuocheng@oppo.com>
2025-08-08 14:59:27 +08:00
Victor1319
631baaf14d feat(master): add switch to control whether ignore tiny extent recover. #1000094081
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-08-08 14:59:27 +08:00
Victor1319
62b28d0626 refactor(fmt): use gofumpt to format code. #1000063488
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-08-08 14:59:27 +08:00
Wu Huocheng
30b29217a1 feat(datanode): evict the extent cache by ttl.#1000005968
Signed-off-by: Wu Huocheng <wuhuocheng@oppo.com>
2025-08-08 14:59:26 +08:00
zhumingze
d7182d70bd feat(datameta): Record the read-only reason for dp&mp replicas. #1000060034
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-08 14:59:26 +08:00
zhumingze
24cb92350d feat(data): Mark the disks that encounter disk errors during startup as bad disks. #1000004886
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-08 14:59:26 +08:00
zhumingze
bfe93e050c feat(datamaster): Supplement test cases related to lost and bad disks. #1000004886
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-08 14:59:25 +08:00
zhumingze
1964c60240 feat(datamaster): Optimize the check disk lost logic. #1000004886
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-08 14:59:25 +08:00
zhumingze
f1ad286a21 feat(data): Adjust some parameters and initialize. #1000004886
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-08 14:59:25 +08:00
zhumingze
bf6d4f062f feat(masterdatacli): Add alerts for the completion of disk repair and improve cli display.
. #1000004886

Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-08 14:59:25 +08:00
zhumingze
e0a1ff8c0f feat(data): Regularly check dp availability. #1000004886
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-08 14:59:25 +08:00
zhumingze
1c794069a1 feat(masterdatacli): lost disks detection and reporting. #1000004886
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-08 14:59:25 +08:00
zhumingze
3c91dcbf84 fix(data): Add dp information to cache in advance to avoid start raft error. #23113653
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-07 16:00:28 +08:00
morphes1995
b23df49eca feat(datanode): support multi datanode process using different port on single node
Signed-off-by: morphes1995 <morphes1995@gmail.com>
2024-12-31 17:36:32 +08:00
Victor1319
8bb1131500 refactor(all): refactor go code with golint. #22906448
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
dac1a12d0a refactor(master): resolve conflicts when picking to master branch. #22906448
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
ced8ca0978 feat(masterdata): add config to control whether vol read direct disk. #22818122
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
fba5a5d6f3 refactor(master): check vol forbidden write type when add vol storage class. #22814514
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Reliey
5f3c6e2d4a feat(cli): support reporting and viewing of cluster and vol dimension disk data #22257509
Signed-off-by: Reliey <zhumingze@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
2bced8d337 refactor(datameta): hybrid cloud optimize some logs related to upgrade compatibility
close:#22716686
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
9f7ffeb194 feat(masterdatameta): support volume to forbidden write operate codes of lower packet protocol version
close#22531837

Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
a43f96d403 feat(dataclientmaster): support configuring datanode and metanode to forbidden
write operate codes of lower packet protocol version.
       	 close#22531837
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
leonrayang
111f9e9903 feat(dataemeta): cluster switch on snapshot take effect on module handle protocal process
Signed-off-by: leonrayang <chl696@sina.com>
2024-12-26 09:24:22 +08:00
chihe
cd73e762e4 fix(datanode): iterating through the cache of dps and disks when stopping space manager
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
c52f8b35eb fix(master): release token before resetting decommission dst
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
leonrayang
78bbb209f2 feat(datanode): enhance the preformace of the stat for disk opertion
Signed-off-by: leonrayang <chl696@sina.com>
2024-12-26 09:24:22 +08:00
W9068822
6e51516a8c feat(stat): datanode disk and dp operation log
Signed-off-by: W9068822 <v-lijianrong1@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
323133a9f9 fix(datanode): return error if receive OpDeleteDataPartition when disks are not loaded
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
61e0ab3aa6 fix(master): fix deadlock for getDataPartitionsView
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
da33bc2068 feat(cli): support raftForce for datanode decommission by cfs-cli
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
46157d2c06 refactor(all): resolve conflict when pick commit from 3.3.2 to 3.4.0.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
68d6b4d09d fix(master): get disk path for replica when getting info for datanode
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
2fb56e7282 feat(master): auto delete backup directories
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
a348b6acb3 feat(master): api for removing backup directories on disk
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
8d68de0acc fix(datanode): reduce the locking time when building heart beat
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
c3a2fb153c fix(datanode): to accelerate the traversal of dp by goroutines
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
7d05d431e6 fix(datanode): optimize the process of constructing heartbeat packets.
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
NaturalSelect
6aa160552c feat(master): persist datanode bad disk
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
145e53d2f6 fix(datanode): rename root dir of dp to dir with backup prefix.
when execute decommisison with raftForce

Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
2911125677 fix(datanode): check disk path for replica with master when executing attachPartition
Signed-off-by: chihe <chihe@oppo.com>
2024-07-22 17:10:59 +08:00