Commit Graph

5318 Commits

Author SHA1 Message Date
zhumingze
d6ad6681dd refactor(fsck): avoid panic when vol not exists #22911241
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-07 16:00:30 +08:00
zhaochenyang
3e3204cabe refactor(lcnode): lcnode response ack to master after save data #22941195
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2025-08-07 16:00:30 +08:00
Victor1319
df827a9909 fix(meta): Resolve the issue where log level settings for the EC are ineffective #22921293
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-08-07 16:00:30 +08:00
Victor1319
7c8d9b0c9a refactor(master): add vol used stats for monitor metrics. #22930922
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-08-07 16:00:30 +08:00
Victor1319
dec11132ba refactor(master): support report monitor stats for cluster different media datanode. #22929430
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-08-07 16:00:30 +08:00
Victor1319
76b8d7a946 refactor(all): refactor code for code scan warn info. #22929123
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-08-07 16:00:30 +08:00
clinx
a6939d0981 fix(flashnode): close cached files concurrently#23092015
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-07 16:00:30 +08:00
clinx
a1a2add9d9 fix(flashnode): confirm the default value is no #23079599
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-07 16:00:30 +08:00
clinx
c3b9145631 fix(flashnode): code check#23131609
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-07 16:00:30 +08:00
clinx
19e4fdc075 fix(flashnode): record disk dimension to file read and write operations #23131609
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-07 16:00:30 +08:00
clinx
cfa8134cc7 feat(flashnode): add read and write latency metrics for cache #1000002444
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-07 16:00:30 +08:00
chihe
91965b0b44 fix(flashnode): use limitRead for read cache
close:#23123752

Signed-off-by: chihe <chihe@oppo.com>
2025-08-07 16:00:30 +08:00
chihe
9a1adf8212 fix(flashnode): use limitWrite for flashnode instead of disk
close:#23123752

Signed-off-by: chihe <chihe@oppo.com>
2025-08-07 16:00:30 +08:00
chihe
be79605ea0 fix(flashnode): read data source one by one
close:#23095482

Signed-off-by: chihe <chihe@oppo.com>
2025-08-07 16:00:30 +08:00
clinx
c27769e9f0 fix(flashnode): wait group for woker goroutine #23092015
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-07 16:00:29 +08:00
clinx
1e5dd165c6 fix(flashnode): simplify the logic for deleting a directory #23092015
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-07 16:00:29 +08:00
clinx
28d975ce10 feat(flashnode): init load files using a separate coroutine for handling #23092015
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-07 16:00:29 +08:00
Wu Huocheng
1801c729a3 chore(master): fix the mistake of unit test codes.#22834621
Signed-off-by: Wu Huocheng <wuhuocheng@oppo.com>
2025-08-07 16:00:29 +08:00
Victor1319
d031b8f62c refactor(meta): not return error when lease time not expire. #23131784
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-08-07 16:00:29 +08:00
Victor1319
eae24a92f9 fix(meta): check whether sortEks empty when fsmUpdateExtentKeyAfterMigration. #23126054
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-08-07 16:00:29 +08:00
zhumingze
11e446b191 feat(master): Discard partition does not print the log of missing Replica. #23132815
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-07 16:00:29 +08:00
Wu Huocheng
5af9e23abf fix(master): Calculate the mp memory size by used value.#22834621
Signed-off-by: Wu Huocheng <wuhuocheng@oppo.com>
2025-08-07 16:00:29 +08:00
Wu Huocheng
2074d059c3 fix(master): Checking the whole pc memory usage.#22834621
Signed-off-by: Wu Huocheng <wuhuocheng@oppo.com>
2025-08-07 16:00:29 +08:00
shuqiang-zheng
4b9f564cdf feat(flashnode): enhancement of flashGroup information display.
close:#23070174

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-07 16:00:29 +08:00
shuqiang-zheng
808b831224 feat(flashnode): support for gradually creation and deletion of flashGroup.
close:#23070174

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-07 16:00:29 +08:00
zhumingze
e0b861423d fix(util): Avoid label conflicts during the version metric pushing process. #23104396
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-07 16:00:29 +08:00
clinx
a12abc9dcc fix(flashndoe): add user confirmation when the user attempts to remove flash group by id#23079599
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-07 16:00:29 +08:00
clinx
afadcde635 fix(flashndoe): add user confirmation when the user attempts to delete a flashnode. #23079599
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-07 16:00:29 +08:00
leonrayang
27ff3d3280 fix(master): Leader mismatch during volume cache synchoronize #23117176
Signed-off-by: leonrayang <chl696@sina.com>
2025-08-07 16:00:29 +08:00
leonrayang
8d897d1289 feat(datanode): Enable crc check for BaseExtentID information #23118077
Signed-off-by: leonrayang <chl696@sina.com>
2025-08-07 16:00:29 +08:00
leonrayang
7d9c971da5 fix(master): The limit fields in Quota should be stored to rocksdb if it is updated #23117980
Signed-off-by: leonrayang <chl696@sina.com>
2025-08-07 16:00:29 +08:00
leonrayang
549128cf1a fix(datanode): Stop the tiny extent markdelete process while store stopped #23115007
Signed-off-by: leonrayang <chl696@sina.com>
2025-08-07 16:00:29 +08:00
leonrayang
8d3fe7499c fix(datanode): Temporarily disable the crc read due to the wrong extentid in meta EXTENT_META
close: #23118077

Signed-off-by: leonrayang <chl696@sina.com>
2025-08-07 16:00:29 +08:00
zhumingze
175e6f4ee7 fix(datamaster): Adjust some error logs. #23101965
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-07 16:00:29 +08:00
zhumingze
bea1253769 fix(master): Optimize the display of checkDiskError logs. #23115792
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-07 16:00:29 +08:00
clinx
8b4b6ca311 fix(flashndoe): Evict cache by each disk using a separate coroutine for each disk #23091754
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-07 16:00:29 +08:00
shuqiang-zheng
c61e0a0896 feat(flashnode): fix the problem that lru is not eliminated in time due to insufficient disk space.
close:#23105469

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-07 16:00:28 +08:00
shuqiang-zheng
6c5f62ba89 feat(flashnode): load each disk's cacheBlock concurrently
close:#23103621

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-07 16:00:28 +08:00
shuqiang-zheng
4253b68c83 fix(flashnode): fix a possible no space left problem during concurrent cacheBlock creation.
close:#23105469

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-07 16:00:28 +08:00
shuqiang-zheng
e3f33db578 feat(flashnode): add bad disk alerts for flashnode on master.
close:#23057658

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-07 16:00:28 +08:00
shuqiang-zheng
24d656446f fix(flashnode): fix eof issues that could be caused by concurrent creation of cacheBlock.
close:#23100234

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-07 16:00:28 +08:00
shuqiang-zheng
b36e228468 feat(flashnode): after all cacheBlock loads completed, print the load completion information.
close:#23103621

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-07 16:00:28 +08:00
shuqiang-zheng
b2a4b1a478 fix(flashnode): determine disk actual leftspace before creating a cacheBlock to open the file.
close:#23105469

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-07 16:00:28 +08:00
clinx
99b6c2142d fix(flashnode): print audit log when read data from remote source#23112585
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-07 16:00:28 +08:00
clinx
41ad2fdc7d fix(flashnode): avoid unnecessary audit log printing #23112585
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-07 16:00:28 +08:00
zhumingze
e9b9b9250c fix(fsck): Improve the printing information of fsck. #23109752
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-07 16:00:28 +08:00
zhumingze
ef9ceeb8e3 fix(master): Decommission interface returns specific error information. #23117907
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-07 16:00:28 +08:00
zhumingze
fe8906f897 fix(master): No longer allow single replica dp raftForce deletion. #23115830
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-07 16:00:28 +08:00
zhumingze
3c91dcbf84 fix(data): Add dp information to cache in advance to avoid start raft error. #23113653
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-07 16:00:28 +08:00
Wu Huocheng
54c4f04c52 chore(raft): Add debug logs to track the raft peers changing.#22834621
Signed-off-by: Wu Huocheng <wuhuocheng@oppo.com>
2025-08-07 16:00:28 +08:00