Commit Graph

5279 Commits

Author SHA1 Message Date
shuqiang-zheng
e3f33db578 feat(flashnode): add bad disk alerts for flashnode on master.
close:#23057658

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-07 16:00:28 +08:00
shuqiang-zheng
24d656446f fix(flashnode): fix eof issues that could be caused by concurrent creation of cacheBlock.
close:#23100234

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-07 16:00:28 +08:00
shuqiang-zheng
b36e228468 feat(flashnode): after all cacheBlock loads completed, print the load completion information.
close:#23103621

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-07 16:00:28 +08:00
shuqiang-zheng
b2a4b1a478 fix(flashnode): determine disk actual leftspace before creating a cacheBlock to open the file.
close:#23105469

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-07 16:00:28 +08:00
clinx
99b6c2142d fix(flashnode): print audit log when read data from remote source#23112585
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-07 16:00:28 +08:00
clinx
41ad2fdc7d fix(flashnode): avoid unnecessary audit log printing #23112585
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-07 16:00:28 +08:00
zhumingze
e9b9b9250c fix(fsck): Improve the printing information of fsck. #23109752
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-07 16:00:28 +08:00
zhumingze
ef9ceeb8e3 fix(master): Decommission interface returns specific error information. #23117907
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-07 16:00:28 +08:00
zhumingze
fe8906f897 fix(master): No longer allow single replica dp raftForce deletion. #23115830
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-07 16:00:28 +08:00
zhumingze
3c91dcbf84 fix(data): Add dp information to cache in advance to avoid start raft error. #23113653
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-07 16:00:28 +08:00
Wu Huocheng
54c4f04c52 chore(raft): Add debug logs to track the raft peers changing.#22834621
Signed-off-by: Wu Huocheng <wuhuocheng@oppo.com>
2025-08-07 16:00:28 +08:00
clinx
03b21f5bd6 fix(flashnode): rename the field remoteCacheFollowerRead to remoteCacheMultiRead #23065717
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-07 16:00:28 +08:00
chihe
e32d901fb6 fix(flashnode): delete expired file for block cache before unlock
close:#23062373

Signed-off-by: chihe <chihe@oppo.com>
2025-08-07 16:00:28 +08:00
chihe
1e8032b24e fix(client): add gen for extent cache when doing overwrite
close:#23025850

Signed-off-by: chihe <chihe@oppo.com>
2025-08-07 16:00:28 +08:00
chihe
d7c377e5d3 fix(client): support 3.5.0 java sdk #23068759
Signed-off-by: chihe <chihe@oppo.com>
2025-08-07 16:00:27 +08:00
wu huocheng
c41f9f2041 chore(master): clean the meta partition from smallest inode.#22834621
The smallest inode meta partition is exhausted. So remove such mp.

Signed-off-by: wu huocheng <wuhuocheng@oppo.com>
2025-08-07 16:00:27 +08:00
wu huocheng
8d0c652b85 fix(master): unlock the mutex before return.#22834621
Rewrite the freeze function.

Signed-off-by: wu huocheng <wuhuocheng@oppo.com>
2025-08-07 16:00:27 +08:00
wu huocheng
10d378fb19 chore(master): skip useless logs.#22834621
Signed-off-by: wu huocheng <wuhuocheng@oppo.com>
2025-08-07 16:00:27 +08:00
Wu Huocheng
a2f6f97dfc feat(master): configure memory ratio percent and control mp migrate.#22834621
Signed-off-by: Wu Huocheng <wuhuocheng@oppo.com>
2025-08-07 16:00:27 +08:00
Wu Huocheng
266c9a7ba4 fix(cli): report error when no migrate plan created.#22834621
Signed-off-by: Wu Huocheng <wuhuocheng@oppo.com>
2025-08-07 16:00:27 +08:00
Wu Huocheng
ce8f310bb4 feat(master): Auto clear task that status is done.#22834621
Signed-off-by: Wu Huocheng <wuhuocheng@oppo.com>
2025-08-07 16:00:27 +08:00
wu huocheng
6372209d12 fix(master): skip the meta partition that is recover or has no leader.#22834621
Signed-off-by: Wu Huocheng <wuhuocheng@oppo.com>
2025-08-07 16:00:27 +08:00
Wu Huocheng
e27923fa1c chore(master): rerange the codes.#22834621
Signed-off-by: Wu Huocheng <wuhuocheng@oppo.com>
2025-08-07 16:00:27 +08:00
Wu Huocheng
f13cc3a1b6 feat(master): Add migrate request meta partition apis.#22834621
Signed-off-by: Wu Huocheng <wuhuocheng@oppo.com>
2025-08-07 16:00:27 +08:00
zhumingze
55e0a1cade feat(master): Keep discard dp information in master and avoid panic when dp is nil. #23036742
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-07 16:00:27 +08:00
shuqiang-zheng
72358a9bc0 feat(flashnode): Add a configurable item to control the number of cache loading goroutines.
close:#22831482

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-07 16:00:27 +08:00
shuqiang-zheng
3cdea7d89f feat(flashnode): modify the upper limit of cachePercent and the defaultMaxUseRatio of lru.
close:#23080181

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-07 16:00:27 +08:00
shuqiang-zheng
f2d2a663a6 fix(flashnode): fix the problem of not being able to select readWrite disks.
close:#23078913

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-07 16:00:27 +08:00
shuqiang-zheng
1ebe5b6dfd feat(flashnode): if the disk is umounted, the cacheblock can be detected and stopped timely.
close:#23021760

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-07 16:00:27 +08:00
shuqiang-zheng
c3a505fb1e fix(flashnode): avoid the cache not being cleaned up when the flashnode is removed.
close:#23003554

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-07 16:00:27 +08:00
shuqiang-zheng
96f8c21399 fix(flashnode): fix empty volume directories not cleaned up when cacheBlock is deleted.
close:#23057658

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-07 16:00:27 +08:00
shuqiang-zheng
815fb21cde feat(flashnode): add error cacheBlock number count during restart loading process.
close:#23021760

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-07 16:00:27 +08:00
chihe
630b48ed2f fix(flashnode): add cacheItem into lru after file is inited
close:#23062373

Signed-off-by: chihe <chihe@oppo.com>
2025-08-07 16:00:27 +08:00
chihe
1d5213c43b fix(master): add default value for ttl and readTimeout for remoete cache
close:#23081308

Signed-off-by: chihe <chihe@oppo.com>
2025-08-07 16:00:26 +08:00
chihe
bc66f9ae66 fix(client): add some debug log
close:#23062373

Signed-off-by: chihe <chihe@oppo.com>
2025-08-07 16:00:26 +08:00
chihe
f212b4b113 fix(client): only read operation execute sendReadToDP
close:#23069988

Signed-off-by: chihe <chihe@oppo.com>
2025-08-07 16:00:26 +08:00
clinx
7de202b317 fix(objectnode): create ebs reader by sv#23077454
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-07 16:00:26 +08:00
leonrayang
72bf18cdff fix(data): Temporily modifying the test case has a high ratio of failure out #23059813
Signed-off-by: leonrayang <chl696@sina.com>
2025-08-07 16:00:26 +08:00
leonrayang
2e8bf80543 fix(testcase): comment the test case has high ratio of failure out #23059813
Signed-off-by: leonrayang <chl696@sina.com>
2025-08-07 16:00:26 +08:00
leonrayang
88ca620bf8 fix(datanode): Optimize io limiter exit process. #23059813
Signed-off-by: leonrayang <chl696@sina.com>
2025-08-07 16:00:26 +08:00
leonrayang
e0b6ed4060 feat(client): Reducing the log output of flow limiter #23059813
Signed-off-by: leonrayang <chl696@sina.com>
2025-08-07 16:00:26 +08:00
clinx
9df10b2063 fix(flashnode): reset test limiter#23061931
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-07 16:00:26 +08:00
clinx
f3b98b69b1 fix(flashnode): open readlimiter for OpFlashNodeCachePrepare. #23061931
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-07 16:00:26 +08:00
baihailong
58e68d9ef3 fix(flashnode): OpFlashNodeCachePrepare operation with flow control.#23061931
Signed-off-by: baihailong <baihailong@oppo.com>
2025-08-07 16:00:26 +08:00
clinx
0152d00450 fix(objectnode): create reader or writer with corrected volume's type #23077454
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-07 16:00:26 +08:00
clinx
ed5c20840b fix(master): prevent reentrant locking #22935828
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-07 16:00:26 +08:00
clinx
9c29ebadac fix(client): add default value #23062821
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-07 16:00:26 +08:00
chihe
279817ca50 fix(client): modify default value for remoteCacheReadTimeoutSec
close:#23047275

Signed-off-by: chihe <chihe@oppo.com>
2025-08-07 16:00:26 +08:00
clinx
2de99277d2 fix(client): show client remote cache flag when call master client info #23062821
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-07 16:00:26 +08:00
zhumingze
c4f524a52f feat(master): Add state transition for fail status when deleting excess copie. #23036843
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-07 16:00:26 +08:00