gian/cubefs
1
0
Fork 0
mirror of https://github.com/cubefs/cubefs.git synced 2026-08-02 02:00:56 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
6,190 Commits 48 Branches 52 Tags 378 MiB
master
Commit Graph

109 Commits

Author SHA1 Message Date
shuqiang-zheng
c2120b249a fix(master): reported bad disk not complete decommission timely metric. 
close:#1000242504

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2025-08-11 17:21:20 +08:00
zhumingze
ea04e20415 fix(data): Determine the disk lost based on master and locally loaded Dp information 
. #1000244723

Signed-off-by: zhumingze <zhumingze@oppo.com>
 2025-08-11 17:21:20 +08:00
zhumingze
12895d975f feat(meta): Add readDir iops limiter. #1000187434 
Signed-off-by: zhumingze <zhumingze@oppo.com>
 2025-08-11 17:21:16 +08:00
zhumingze
9e9eb0e753 fix(data): bad disk judgment logic fix. #1000184384 
Signed-off-by: zhumingze <zhumingze@oppo.com>
 2025-08-11 17:21:15 +08:00
zhumingze
33c6e2d96d fix(data): limitIO ​​logic fix. #1000158099 
Signed-off-by: zhumingze <zhumingze@oppo.com>
 2025-08-11 17:21:15 +08:00
zhumingze
71dee686ef feat(data): limitIO strategy for separating repair io from business io. #1000095860 
Signed-off-by: zhumingze <zhumingze@oppo.com>
 2025-08-08 14:59:30 +08:00
Victor1319
0ebe0b874f refactor(data): remove dp cache code from datanode. #1000062928 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2025-08-08 14:59:27 +08:00
zhumingze
bfe93e050c feat(datamaster): Supplement test cases related to lost and bad disks. #1000004886 
Signed-off-by: zhumingze <zhumingze@oppo.com>
 2025-08-08 14:59:25 +08:00
zhumingze
1964c60240 feat(datamaster): Optimize the check disk lost logic. #1000004886 
Signed-off-by: zhumingze <zhumingze@oppo.com>
 2025-08-08 14:59:25 +08:00
zhumingze
f1ad286a21 feat(data): Adjust some parameters and initialize. #1000004886 
Signed-off-by: zhumingze <zhumingze@oppo.com>
 2025-08-08 14:59:25 +08:00
zhumingze
bf6d4f062f feat(masterdatacli): Add alerts for the completion of disk repair and improve cli display. 
. #1000004886

Signed-off-by: zhumingze <zhumingze@oppo.com>
 2025-08-08 14:59:25 +08:00
zhumingze
1c794069a1 feat(masterdatacli): lost disks detection and reporting. #1000004886 
Signed-off-by: zhumingze <zhumingze@oppo.com>
 2025-08-08 14:59:25 +08:00
chihe
be79605ea0 fix(flashnode): read data source one by one 
close:#23095482

Signed-off-by: chihe <chihe@oppo.com>
 2025-08-07 16:00:30 +08:00
leonrayang
2e8bf80543 fix(testcase): comment the test case has high ratio of failure out #23059813 
Signed-off-by: leonrayang <chl696@sina.com>
 2025-08-07 16:00:26 +08:00
leonrayang
88ca620bf8 fix(datanode): Optimize io limiter exit process. #23059813 
Signed-off-by: leonrayang <chl696@sina.com>
 2025-08-07 16:00:26 +08:00
Victor1319
8bb1131500 refactor(all): refactor go code with golint. #22906448 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
ab8217379e refactor(datanode): refactor data read and write performance. #22504692 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
852dafafd2 fix(datanode): if dpBackupTimeout is not set, then do not delete back up directories. 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
53107ee952 fix(datanode): modifying the regular expression for backup directory: 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
68d6b4d09d fix(master): get disk path for replica when getting info for datanode 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
2fb56e7282 feat(master): auto delete backup directories 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
a348b6acb3 feat(master): api for removing backup directories on disk 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
0ffe25c31d fix(datanode): reload dp by parallelism during recovering bad disk 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
292f2abd45 feat(master): add api for recovering bad disk 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
NaturalSelect
6aa160552c feat(master): persist datanode bad disk 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
e9804d0043 feature(datanode): do not remove root dir for dp deleted by raftForce with auto decommmission mode 
Signed-off-by: chihe <chihe@oppo.com>
 2024-07-22 17:10:59 +08:00
chihe
7b9efc560f fix(datanode): remove expired root of dp during loading dp 
Signed-off-by: chihe <chihe@oppo.com>
 2024-07-22 17:10:59 +08:00
Victor1319
4df91ebc6e refactor(all): reslove merge conflicts between 3.3.x and 3.4.0. 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-07-18 16:57:38 +08:00
NaturalSelect
b7eeda10b4 refactor(data): revert data node dp delay load 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-18 16:57:38 +08:00
NaturalSelect
978254d5a5 fix(data): avoid write extent after store closed 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-18 16:57:38 +08:00
NaturalSelect
91c65e17ab feat(data): speed data node restart 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-18 16:57:38 +08:00
NaturalSelect
a0fcae90e6 feat(data): flush extent cache in timer 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-18 16:57:38 +08:00
Victor1319
b3f3278e5a feat(data): Support asynchronous deletion of expired partition lists. 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-07-18 16:57:38 +08:00
S9054862
297fd4627c feat(data): load extent info on demand 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-18 16:57:38 +08:00
S9054862
e812d1c37a fix(data): speed up initBaseFileID 
Signed-off-by: S9054862 <huangzhibin1@oppo.com>
 2024-07-18 16:57:38 +08:00
S9054862
00ecb62b94 feat(data): limit io current on a disk when load/stop dp 
Signed-off-by: S9054862 <huangzhibin1@oppo.com>
 2024-07-18 16:57:38 +08:00
chihe
c34141c911 fix(datanode): remove root dir for disk error dp not loaded 
Signed-off-by: chihe <chihe@oppo.com>
 2024-07-18 16:57:38 +08:00
chihe
7a6febec4b feat(cli): add decommissioned disks info for datanode node info display 
Signed-off-by: chihe <chihe@oppo.com>
 2024-07-05 17:05:43 +08:00
chihe
65ee50a40a fix(cli): cli can display dps encountering IO errors during loading 
Signed-off-by: chihe <chihe@oppo.com>
 2024-07-05 17:05:43 +08:00
NaturalSelect
25fd340c39 fix(data): avoid panic when remove dp 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-02 16:35:56 +08:00
NaturalSelect
610e6bd457 feat(master): support auto decommission disk and config 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-02 16:35:56 +08:00
slasher
5c7898354f style(all): format all codes with golangci tools 
closes #3371

@formatter:off

Signed-off-by: slasher <shenjie1@oppo.com>
 2024-05-14 09:54:13 +08:00
chihe
78d380a60a enhance(datanode): remove mutex for extent repair read 
close:#21999366

Signed-off-by: chihe <chihe@oppo.com>
 2024-03-27 14:24:50 +08:00
chihe
b518b4c53a feat(datnode): 1.support read enableExtentRepairReadLimit from conf 2.query dp holded token 
Signed-off-by: chihe <chihe@oppo.com>
 2024-03-27 14:24:50 +08:00
chihe
f66c732104 feat(datanode): Support the functionality of allowing only one extent data read at a time per disk 
Signed-off-by: chihe <chihe@oppo.com>
 2024-03-27 14:24:50 +08:00
slasher
1d84f74acd chore(format): format all code with gofumpt 
Signed-off-by: slasher <shenjie1@oppo.com>
 2024-01-12 14:21:16 +08:00
true1064
cae5f00182 feat(data): if IO errors make disk status change to unavailable, not set all datapartitions of the disk as unavailable except the datapartition related to the if IO errors. 
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-01-10 11:25:22 +08:00
NaturalSelect
0cc253a8d6 fix(master,data): master sync decommission disk status with datanode in heartbeat 
close: #2777
Signed-off-by: NaturalSelect <2145973003@qq.com>
 2023-12-15 15:04:55 +08:00
slasher
a07b5cae3a feat(datanode): limit disk flow and io concurrency 
yun #20494841

Signed-off-by: slasher <shenjie1@oppo.com>
 2023-11-29 18:40:43 +08:00
true1064
bdf5dbf60c feat(data): add an API to manually set a disk of dataNode as error. this operation will set disk status as unavailable and stop raft of all data partitions on the disk. 
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2023-11-09 19:41:10 +08:00