Commit Graph

4101 Commits

Author SHA1 Message Date
slasher
b34dfb8de0 chore(util): add default of switch, update err judgment
@formatter:off

Signed-off-by: slasher <shenjie1@oppo.com>
Signed-off-by: JasonHu520 <huzongchao@oppo.com>
2024-07-29 15:13:21 +08:00
slasher
753475c481 fix(access): return not exist volume in access cached
. #22420678

Signed-off-by: slasher <shenjie1@oppo.com>
2024-07-29 15:13:21 +08:00
slasher
4aca6e2127 fix(rpc): return 598 http status code if fail to decode from response
. #22420678

Signed-off-by: slasher <shenjie1@oppo.com>
2024-07-29 15:13:21 +08:00
tangdeyi
9d392be776 fix(clustermgr): fix pendingkey memory release when add disk to dropped node
with #22402652

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2024-07-29 15:13:21 +08:00
JasonHu520
9622635308 fix(scheduler): update volume unit failed, first get latest volume info to comfirm whether updated
. #22366648

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
2024-07-29 15:13:21 +08:00
xiejian
5e5351780b fix(clustermgr): AllocVolumeUnit return error when inconsistent request vuid and cm vuid
. #22366648

Signed-off-by: xiejian <xiejian3@oppo.com>
2024-07-29 15:13:21 +08:00
leonrayang
88f826557b feat(doc): Update the release documentation and add docker image info
Signed-off-by: leonrayang <chl696@sina.com>
2024-07-29 10:16:08 +08:00
chihe
2911125677 fix(datanode): check disk path for replica with master when executing attachPartition
Signed-off-by: chihe <chihe@oppo.com>
2024-07-22 17:10:59 +08:00
chihe
9dd4c9cf1b fix(master): decommission concel ignore decommission running
Signed-off-by: chihe <chihe@oppo.com>
2024-07-22 17:10:59 +08:00
NaturalSelect
6b82499eb7 feat(meta): async inode del file recycle
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-07-22 17:10:59 +08:00
NaturalSelect
807581fe83 feat(meta): adjust delete INODE_DEL file water mark
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-07-22 17:10:59 +08:00
NaturalSelect
33d820c27f fix(meta): fix INODE_DEL recycle
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-07-22 17:10:59 +08:00
NaturalSelect
c2e20b6e2e fix(meta): limit the count of metanode inode audit log
Signed-off-by: NaturalSelect <2145973003@qq.com>
2024-07-22 17:10:59 +08:00
true1064
035fafbf52 fix(data): When loading the disk, strengthen the checking before removing the duplicated data partition directories.
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-07-22 17:10:59 +08:00
leonrayang
981b298ca3 refactor(master): refactor the code of zone moudule
Signed-off-by: leonrayang <chl696@sina.com>
2024-07-22 17:10:59 +08:00
chihe
47a7a6dfa4 feat(master):recover replica deleted by raftForce
Signed-off-by: chihe <chihe@oppo.com>
2024-07-22 17:10:59 +08:00
chihe
e9f4b5ab7e fix(master): remove the status of DecommissionNeedManualFix
Signed-off-by: chihe <chihe@oppo.com>
2024-07-22 17:10:59 +08:00
chihe
3325185e75 fix(master): fix deadlock for progress of WarnMissingDp
Signed-off-by: chihe <chihe@oppo.com>
2024-07-22 17:10:59 +08:00
chihe
e9804d0043 feature(datanode): do not remove root dir for dp deleted by raftForce with auto decommmission mode
Signed-off-by: chihe <chihe@oppo.com>
2024-07-22 17:10:59 +08:00
Victor1319
601c736226 refactor(master): add log when over datanode dp cnt limit.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-07-22 17:10:59 +08:00
Victor1319
2c16aa9c47 fix(meta): add gen log when append extent key.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-07-22 17:10:59 +08:00
shuqiang-zheng
fb82f1bb4a feat(client): cleaning up the log that may be printed to standard output during write process.
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2024-07-22 17:10:59 +08:00
Victor1319
3bc66f6c7d fix(data): fix reload datapartition error.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-07-22 17:10:59 +08:00
NaturalSelect
e858b4d740 fix(meta): fix INODE_DEL recycle
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-07-22 17:10:59 +08:00
shuqiang-zheng
28d1561188 fix(master): Fix the problem of loading volDelayDeleteTimeHour from rocksdb without determining whether the value is greater than 0 or not.
@formatter:off

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2024-07-22 17:10:59 +08:00
Victor1319
5d7464f05f refactor(master): reload data from rocksdb once leader changed.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-07-22 17:10:59 +08:00
NaturalSelect
f9e319ff4f fix(master): avoid warningMetrics deadlock
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-07-22 17:10:59 +08:00
leonrayang
5c82a084f1 fix(datanode): The contents on which the CRC check depends are inconsistent with each other
Update the crc check output from error to warn, the inconsistent may be false report and require
more output and make a jugement.

The applyId and crc cann't be atomic under the architecture and are not necessary for performance.

Signed-off-by: leonrayang <chl696@sina.com>
2024-07-22 17:10:59 +08:00
leonrayang
c9611557a2 fix(datanode):Refactor the paramter of storage write at datanode
Signed-off-by: leonrayang <chl696@sina.com>
2024-07-22 17:10:59 +08:00
baihailong
39dc1dfaa8 fix(sdk): add gosdk.
Signed-off-by: baihailong <baihailong@oppo.com>
2024-07-22 17:10:59 +08:00
NaturalSelect
85445548b2 fix(data): avoid flush extent when it is not dirty
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-07-22 17:10:59 +08:00
chihe
3a8a2633be fix(datanode): donot raise panic when ApplyMemberChange trigger disk error
Signed-off-by: chihe <chihe@oppo.com>
2024-07-22 17:10:59 +08:00
chihe
c641056a38 fix(master): reset decommission type when dp decommission fail
Signed-off-by: chihe <chihe@oppo.com>
2024-07-22 17:10:59 +08:00
chihe
0c89a008cf fix(master): remove excessive peer during checkReplicaMeta
Signed-off-by: chihe <chihe@oppo.com>
2024-07-22 17:10:59 +08:00
chihe
7176a68346 fix(datanode): remove expired peers with expired nodeID
Signed-off-by: chihe <chihe@oppo.com>
2024-07-22 17:10:59 +08:00
chihe
7b9efc560f fix(datanode): remove expired root of dp during loading dp
Signed-off-by: chihe <chihe@oppo.com>
2024-07-22 17:10:59 +08:00
chihe
55f8ce3b67 fix(master):if dp has emtpy replicas when execute decommission,return error
Signed-off-by: chihe <chihe@oppo.com>
2024-07-22 17:10:59 +08:00
chihe
83b51e236c fix(master): if raft is already started when repair for dp is finished, return error directly
Signed-off-by: chihe <chihe@oppo.com>
2024-07-22 17:10:59 +08:00
chihe
01e1ed9c3b fix(master): add lock for accessing missingMpAddrSet
Signed-off-by: chihe <chihe@oppo.com>
2024-07-22 17:10:59 +08:00
chihe
9f81498736 fix(master): change error msg for multiple replica are executing decommissioning
Signed-off-by: chihe <chihe@oppo.com>
2024-07-22 17:10:59 +08:00
NaturalSelect
605371c336 fix(util): refactor audit log remove
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-07-22 17:10:59 +08:00
NaturalSelect
bc5dd77fbd feat(master): support set dp heartbeat timeout
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-07-22 17:10:59 +08:00
shuqiang-zheng
bf2753766e feat(log): Add support for standard output in the log module.
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2024-07-22 17:10:59 +08:00
baihailong
f08ff32bff fix(sdk): add cfs_IsDir,cfs_IsRegular for libsdk.
Signed-off-by: baihailong <baihailong@oppo.com>
2024-07-22 17:10:59 +08:00
NaturalSelect
6aca325797 feat(master): feat support vol level dp meta repair
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-07-22 17:10:59 +08:00
NaturalSelect
41d2a78dd7 fix(data): ensure that truncate index is less than applied index
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-07-22 17:10:59 +08:00
NaturalSelect
414229e0b5 fix(master): update dp cache after create vol
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-07-22 17:10:59 +08:00
NaturalSelect
f88206c3a2 fix(data): adjust extent flush period to 5min
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-07-22 17:10:59 +08:00
baihailong
51b093afac fix(sdk): add statistical metrics for libsdk.
Signed-off-by: baihailong <baihailong@oppo.com>
2024-07-22 17:10:59 +08:00
NaturalSelect
9767a884b4 fix(meta): avoid leak EXTENT_DEL fd
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-07-22 17:10:59 +08:00