Commit Graph

4299 Commits

Author SHA1 Message Date
leonrayang
3dfdcf354e feat(master): improve the exit process in multiple goroutines to ensure proper resource cleanup and graceful shutdown.
Signed-off-by: leonrayang <chl696@sina.com>
2024-12-26 09:24:22 +08:00
chihe
a831f1e5a7 fix(mater): delete decommission disk record form rocksdb
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
65ce9f8b7c fix(master): deadlock for datanode and nodeset
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
8a76004126 fix(master): exiting the decommmission goroutine when leader is changed
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
baihailong
1a003718ee fix(client): check whether the mountpoint has been mounted when mounting.
Signed-off-by: baihailong <baihailong@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
36076b8cd8 fix(master): fix deadlock for deleteMissingDp
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
2645319183 fix(data): donot persist applyId by raftForce
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
96dd26f01a fix(master): the dp's zone selection logic supports decommission operations.
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
716044fd94 fix(master): when setting a RestoreReplica operation to fail
check if another replica is currently undergoing the offline process.

Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
b8742d469a fix(master): use lock to set dp markDecommission
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
leonrayang
78bbb209f2 feat(datanode): enhance the preformace of the stat for disk opertion
Signed-off-by: leonrayang <chl696@sina.com>
2024-12-26 09:24:22 +08:00
W9068822
6e51516a8c feat(stat): datanode disk and dp operation log
Signed-off-by: W9068822 <v-lijianrong1@oppo.com>
2024-12-26 09:24:22 +08:00
leonrayang
82666bb21a feat(clientmaster): enable clients to report their version and flow information to the master
Signed-off-by: leonrayang <chl696@sina.com>
2024-12-26 09:24:22 +08:00
chihe
eb5787a7b3 fix(master): traverse all nodesets to check if dp is decommissioning
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
64afe661cb fix(master): do not check size of datanode when retrying to decommission special replica
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
ef8183b648 fix(cli): remove unnecessary commands for cli
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
baihailong
f0e631799e fix(sdk): client update extents from meta and drop extents in cache leadto ek conflict.
Signed-off-by: baihailong <baihailong@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
c3131b01f9 fix(datanode): use dp leader real size as to be repaired size.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
323133a9f9 fix(datanode): return error if receive OpDeleteDataPartition when disks are not loaded
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
39c07de007 fix(sdk): return err if getting extents failed in function ExtentClient
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
leonrayang
4428c3b64c feat(master): enhance the effectiveness of log output
Signed-off-by: leonrayang <chl696@sina.com>
2024-12-26 09:24:22 +08:00
leonrayang
043b559ba4 fix(master): use the largest volume ID in load vols process
Signed-off-by: leonrayang <chl696@sina.com>
2024-12-26 09:24:22 +08:00
chihe
53107ee952 fix(datanode): modifying the regular expression for backup directory:
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
61e0ab3aa6 fix(master): fix deadlock for getDataPartitionsView
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
da33bc2068 feat(cli): support raftForce for datanode decommission by cfs-cli
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
46157d2c06 refactor(all): resolve conflict when pick commit from 3.3.2 to 3.4.0.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
79579bacd2 fix(data): check response reqId to avoid data painc.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
493795f8db fix(master): reset bad dp report info after dp recover.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
27c66007c5 refactor(master): report datanode count which can alloc dp.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
a792521c86 refactor(master): add replica num label when report dp no leader metrics.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
2ba73be6be feat(master): add vol total count metric info.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
7b979b17e6 fix(data): fix delete gc data failed bug.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
d3fa6c9244 fix(metanode): fix tx bug in concurrent use case.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
79ce6ff6cf refactor(master): reduce dp&mp detail report info
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
5ef3f6c59b refactor(master): reduce prometheus metrics count for master.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
69ca9cd0f4 fix(metanode): only sync at among replicas when inode is not nil
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
3a4a54f3bc fix(cli): use macro value instead of hard code
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
f5484d9d98 fix(master): fix the bug that reset transaction info when update vol info.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
b1b5d5bd2b fix(meta): fix panic bug when delete empty dentry info.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
b5252646d0 refactor(cli): refactor cli hint message when update transaction info.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
716e489036 fix(master): return no leader for request before master change leader success.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
c869155d09 fix(master): fix http pool test case fail bug.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
a305b32b9c feat(master): cli support setting for persistting accessTime
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
136ee9704e fix(master): persist accesstimeInterval and EnablePersistAccessTime
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
6970b4570d feat(master): support set trashInterval with cli
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
be565f6609 refactor(server): refactor http connect pool when comminute with master.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
leonrayang
f721730cfb feat(client): reduce the massive getVol request from Quota routine
Signed-off-by: leonrayang <chl696@sina.com>
2024-12-26 09:24:22 +08:00
chihe
a487a828b4 feat(master): api for enable/disbale persist for accesstime
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
0f64f5010e feat(master): api for setting accesstime vaild interval by vol
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
58194e8f36 feat(metanode): add sdk for querying accesstime of inode
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00