gian/cubefs
1
0
Fork 0
mirror of https://github.com/cubefs/cubefs.git synced 2026-08-02 10:06:14 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
4,983 Commits 48 Branches 52 Tags 378 MiB
ea3d9f9d38
Commit Graph

4983 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
xiejian
ea3d9f9d38 fix(shardnode): excludes failed vid when AllocSlice 
with #22916378

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:15 +08:00
mawei029
5b39560fa8 fix(bssdk): transform the error message in more detail, when list blob 
with: #22905178

Signed-off-by: mawei029 <mawei2@oppo.com>
 2025-07-08 11:30:15 +08:00
mawei029
f97631d8eb fix(bssdk): sum body hashes and return it when put blob, modify print log 
with: #22901344

Signed-off-by: mawei029 <mawei2@oppo.com>
 2025-07-08 11:30:15 +08:00
mawei029
9d84c73c17 fix(bssdk): fix panic, modify get the disk punished status from cache 
with: #22893213

Signed-off-by: mawei029 <mawei2@oppo.com>
 2025-07-08 11:30:15 +08:00
xiejian
1eef24a5dd refactor(kvstorev2): optimize SeekForPrev of kvstorev2 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:15 +08:00
xiejian
4c99c2a735 fix(shardnode): handle situations of failedSlice is empty of AllocSlice api 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:15 +08:00
JasonHu520
aef6b4efc7 feat(blobnode): request new leader to update source unit 
with #22812331

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
 2025-07-08 11:30:15 +08:00
xiejian
c20c28b17f fix(shardnode): prevent shard delete get leader which is itself cause dead lock 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:15 +08:00
JasonHu520
fcd249e20a feat(blobnode): update source shard unit to learner 
with #22812331

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
 2025-07-08 11:30:15 +08:00
xiejian
71d680d91c fix(shardnode): 1.load disk shard concurrency 
2.remove trash shard
3.update listShard api
4.optimize lock nesting to avoid lock conflicts, stats api return node host
5.kvstorev2 add optimized default config
6.support about recover shard cli
7.optimize trace log time cost record

with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:15 +08:00
xiejian
35df8a3f09 fix(raft): 1.remove entry cache put verify, fix get and get from 
2.fix duplicated heartbeat request and MsgAppResp response
3.remove snapshot meta when storage close
4.fix outgoingSnapshot repeat close
5.add some log and fix log level and format

with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:15 +08:00
Cloudstriff
7fbc45344b perf(raft): optimized raft storage Entries and Term interface performance 
with #22792157

Signed-off-by: Cloudstriff <chenjiongwendao@qq.com>
 2025-07-08 11:30:14 +08:00
xiejian
bb272a12a5 feat(shardnode): add time cost detail of blob api in span 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
xiejian
26086a3208 feat(shardnode): add padding when encode space key to avoid out of order 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
xiejian
9d8d1c1996 fix(raft): 1.do not return error when process proposal msg failed because of not leader 
2.storage keep both snapshot meta and hard state
3.fix applyUpdateRaw panic when found not value but do close
4.fix apply snapshot in statemachine while appy commited entries concurrently

with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
xiejian
fbb8d2ca1d feat(shardnode): support tcmalloc and rocksdb stats api 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
xiejian
6546e56e54 feat(shardnode): support tcmalloc 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
xiejian
38f382d808 fix(shardnode): with member ctx when createRaftGroup to fix suid is 0 after apply snapshot 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
xiejian
2d8a920fd1 feat(shardnode): support addShard cli tool 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
xiejian
4b73769f5d fix(shardnode): fix restart panic after apply snapshot and tickElection 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
xiejian
24edbfdbb1 fix(shardnode): encode kv storage data key with shardID 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
xiejian
173a1cd157 fix(shardnode): fix panic problem when restart service with apply snapshot 
supplement kvstore interface

with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
xiejian
d0e5f634e1 fix(shardnode): fix fatal when shard is deleting but apply member change 
flush when delete shard info, read/write check when do snapshot, do checkpoint

with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
JasonHu520
0d4321d8c1 fix(scheduler): fix cancel shard task failed 
with #22812331

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
 2025-07-08 11:30:14 +08:00
tangdeyi
89d49fbe1d fix(clustermgr): put refresh into loadData cause of snapshot 
with #22842525

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
 2025-07-08 11:30:14 +08:00
tangdeyi
da172ccb9d fix(clustermgr): validate arg when chunk is reported 
with #22815976

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
 2025-07-08 11:30:14 +08:00
mawei029
92668d0b96 fix(access): need get twice shard stats from shardnode 
with: #22751713 of #22751546

Signed-off-by: mawei029 <mawei2@oppo.com>
 2025-07-08 11:30:14 +08:00
mawei029
c2b33079e6 fix(access): need update shard route when connection refused, catalog skip leader disk 0 
with: #22751713 of #22751546

Signed-off-by: mawei029 <mawei2@oppo.com>
 2025-07-08 11:30:14 +08:00
mawei029
6034ad9e03 feat(bssdk): tool sdk cli support perf tools to put,get,delete 
with: #22751704 of #22751546

Signed-off-by: mawei029 <mawei2@oppo.com>
 2025-07-08 11:30:14 +08:00
mawei029
7dbdcb859a refactor(bssdk): sdk cli convert blobname byte to string, suid readable 
with: #22751573 of #22751546

Signed-off-by: mawei029 <mawei2@oppo.com>
 2025-07-08 11:30:14 +08:00
mawei029
26a9fd2ac7 refactor(tools): drop disk stat, open rocksdb read only without depend on LOCK 
remove duplicate disk path

@formatter:off

Signed-off-by: mawei029 <mawei2@oppo.com>
 2025-07-08 11:30:14 +08:00
slasher
9dad1ee7cf feat(access): punish volume disk and service with own value 
. #22762717

Signed-off-by: slasher <shenjie1@oppo.com>
 2025-07-08 11:30:14 +08:00
slasher
bed91e7765 feat(access): report metric of read and write 
. #22762725

Signed-off-by: slasher <shenjie1@oppo.com>
 2025-07-08 11:30:14 +08:00
tangdeyi
f7859160de fix(clustermgr): remove shardUnitInfo in shardItem 
. #22711921

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
 2025-07-08 11:30:14 +08:00
tangdeyi
ddbc6f37ac feat(clustermgr): persistent raft members when applying snapshot 
. #22711921

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
 2025-07-08 11:30:14 +08:00
mawei029
7e016da2a3 fix(bssdk): get blob fill crc, shard keys fix panic, shard not 
leader update, get next end shard, cli readable

with: #22639120

Signed-off-by: mawei029 <mawei2@oppo.com>
 2025-07-08 11:30:14 +08:00
mawei029
6357ce9b75 feat(bssdk): blobstore cli support sdk cmd 
with: #22639120

Signed-off-by: mawei029 <mawei2@oppo.com>
 2025-07-08 11:30:14 +08:00
slasher
c6b2152692 feat(rpc2): unmarshal none if response length is zero 
@formatter:off

Signed-off-by: slasher <shenjie1@oppo.com>
Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
xiejian
30789df40d fix(shardnode): fix the bugs found with sdk test, and add unit test 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
slasher
e26e3ab749 fix(access): force flush proxy volume if context canceled 
@formatter:off

Signed-off-by: slasher <shenjie1@oppo.com>
 2025-07-08 11:30:14 +08:00
JasonHu520
d7abb27eac refactor(scheduler): update log level for kafka message 
@formatter:off

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
 2025-07-08 11:30:14 +08:00
Cloudstriff
d6c6a775e0 feat(raft): fix query log term by index in raft storage 
with #22656329

Signed-off-by: Cloudstriff <chenjiongwendao@qq.com>
 2025-07-08 11:30:14 +08:00
Cloudstriff
6a3d90ca93 fix(kvstorev2): fix kv list without handleError function 
with #22656329

Signed-off-by: Cloudstriff <chenjiongwendao@qq.com>
 2025-07-08 11:30:14 +08:00
mawei029
84d6df46af feat(access): sdk put blob, delete blob from shard node 
with: #22549147 of #22357707

Signed-off-by: mawei029 <mawei2@oppo.com>
 2025-07-08 11:30:14 +08:00
xiejian
7706c4b4b3 fix(shardnode): calculate crc when persist Location, update AllocSlice api 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
xiejian
ae3626ac38 fix(shardnode): return err if repeat create blob, fix alloc slice check 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
tangdeyi
26fffe9b21 feat(clustermgr): optimize the judgment of shard init done 
. #22672295

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
 2025-07-08 11:30:14 +08:00
slasher
2a98715983 feat(rpc2): bad request if parse parameter failed 
. #22617142

Signed-off-by: slasher <shenjie1@oppo.com>
 2025-07-08 11:30:14 +08:00
xiejian
3f0f1d2b31 refactor(raft): remove raft config resolver, only keep transport resolver 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
xiejian
5a93938026 refactor(access): move location crc calculate func to common package 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00