gian/cubefs
1
0
Fork 0
mirror of https://github.com/cubefs/cubefs.git synced 2026-08-02 02:00:56 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
4,963 Commits 48 Branches 52 Tags 378 MiB
24edbfdbb1
Commit Graph

4963 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
xiejian
24edbfdbb1 fix(shardnode): encode kv storage data key with shardID 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
xiejian
173a1cd157 fix(shardnode): fix panic problem when restart service with apply snapshot 
supplement kvstore interface

with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
xiejian
d0e5f634e1 fix(shardnode): fix fatal when shard is deleting but apply member change 
flush when delete shard info, read/write check when do snapshot, do checkpoint

with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
JasonHu520
0d4321d8c1 fix(scheduler): fix cancel shard task failed 
with #22812331

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
 2025-07-08 11:30:14 +08:00
tangdeyi
89d49fbe1d fix(clustermgr): put refresh into loadData cause of snapshot 
with #22842525

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
 2025-07-08 11:30:14 +08:00
tangdeyi
da172ccb9d fix(clustermgr): validate arg when chunk is reported 
with #22815976

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
 2025-07-08 11:30:14 +08:00
mawei029
92668d0b96 fix(access): need get twice shard stats from shardnode 
with: #22751713 of #22751546

Signed-off-by: mawei029 <mawei2@oppo.com>
 2025-07-08 11:30:14 +08:00
mawei029
c2b33079e6 fix(access): need update shard route when connection refused, catalog skip leader disk 0 
with: #22751713 of #22751546

Signed-off-by: mawei029 <mawei2@oppo.com>
 2025-07-08 11:30:14 +08:00
mawei029
6034ad9e03 feat(bssdk): tool sdk cli support perf tools to put,get,delete 
with: #22751704 of #22751546

Signed-off-by: mawei029 <mawei2@oppo.com>
 2025-07-08 11:30:14 +08:00
mawei029
7dbdcb859a refactor(bssdk): sdk cli convert blobname byte to string, suid readable 
with: #22751573 of #22751546

Signed-off-by: mawei029 <mawei2@oppo.com>
 2025-07-08 11:30:14 +08:00
mawei029
26a9fd2ac7 refactor(tools): drop disk stat, open rocksdb read only without depend on LOCK 
remove duplicate disk path

@formatter:off

Signed-off-by: mawei029 <mawei2@oppo.com>
 2025-07-08 11:30:14 +08:00
slasher
9dad1ee7cf feat(access): punish volume disk and service with own value 
. #22762717

Signed-off-by: slasher <shenjie1@oppo.com>
 2025-07-08 11:30:14 +08:00
slasher
bed91e7765 feat(access): report metric of read and write 
. #22762725

Signed-off-by: slasher <shenjie1@oppo.com>
 2025-07-08 11:30:14 +08:00
tangdeyi
f7859160de fix(clustermgr): remove shardUnitInfo in shardItem 
. #22711921

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
 2025-07-08 11:30:14 +08:00
tangdeyi
ddbc6f37ac feat(clustermgr): persistent raft members when applying snapshot 
. #22711921

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
 2025-07-08 11:30:14 +08:00
mawei029
7e016da2a3 fix(bssdk): get blob fill crc, shard keys fix panic, shard not 
leader update, get next end shard, cli readable

with: #22639120

Signed-off-by: mawei029 <mawei2@oppo.com>
 2025-07-08 11:30:14 +08:00
mawei029
6357ce9b75 feat(bssdk): blobstore cli support sdk cmd 
with: #22639120

Signed-off-by: mawei029 <mawei2@oppo.com>
 2025-07-08 11:30:14 +08:00
slasher
c6b2152692 feat(rpc2): unmarshal none if response length is zero 
@formatter:off

Signed-off-by: slasher <shenjie1@oppo.com>
Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
xiejian
30789df40d fix(shardnode): fix the bugs found with sdk test, and add unit test 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
slasher
e26e3ab749 fix(access): force flush proxy volume if context canceled 
@formatter:off

Signed-off-by: slasher <shenjie1@oppo.com>
 2025-07-08 11:30:14 +08:00
JasonHu520
d7abb27eac refactor(scheduler): update log level for kafka message 
@formatter:off

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
 2025-07-08 11:30:14 +08:00
Cloudstriff
d6c6a775e0 feat(raft): fix query log term by index in raft storage 
with #22656329

Signed-off-by: Cloudstriff <chenjiongwendao@qq.com>
 2025-07-08 11:30:14 +08:00
Cloudstriff
6a3d90ca93 fix(kvstorev2): fix kv list without handleError function 
with #22656329

Signed-off-by: Cloudstriff <chenjiongwendao@qq.com>
 2025-07-08 11:30:14 +08:00
mawei029
84d6df46af feat(access): sdk put blob, delete blob from shard node 
with: #22549147 of #22357707

Signed-off-by: mawei029 <mawei2@oppo.com>
 2025-07-08 11:30:14 +08:00
xiejian
7706c4b4b3 fix(shardnode): calculate crc when persist Location, update AllocSlice api 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
xiejian
ae3626ac38 fix(shardnode): return err if repeat create blob, fix alloc slice check 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
tangdeyi
26fffe9b21 feat(clustermgr): optimize the judgment of shard init done 
. #22672295

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
 2025-07-08 11:30:14 +08:00
slasher
2a98715983 feat(rpc2): bad request if parse parameter failed 
. #22617142

Signed-off-by: slasher <shenjie1@oppo.com>
 2025-07-08 11:30:14 +08:00
xiejian
3f0f1d2b31 refactor(raft): remove raft config resolver, only keep transport resolver 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
xiejian
5a93938026 refactor(access): move location crc calculate func to common package 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
xiejian
5a07148126 refactor(raft): fix ut, and some ticker config 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
Cloudstriff
c724be4931 feat(shardnode): add snapshot header support on apply snapshot progress 
with #22656329

Signed-off-by: Cloudstriff <chenjiongwendao@qq.com>
 2025-07-08 11:30:14 +08:00
xiejian
9f9cb91540 refactor(raft): simplify SealBlob api args 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
JasonHu520
596e12a83c refactor(blobnode): some changes for code style 
with: #22481824 #22481829

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
 2025-07-08 11:30:14 +08:00
Cloudstriff
6bfdb3547c fix(blobnode): fix transfer leader without update shard member type 
with #22615053

Signed-off-by: Cloudstriff <chenjiongwendao@qq.com>
 2025-07-08 11:30:14 +08:00
JasonHu520
56bfb25102 feat(blobnode): access the client of clustermgr and shardnode 
with: #22481824 #22481829

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
 2025-07-08 11:30:14 +08:00
JasonHu520
d5e206e18f feat(blobnode): add shard task for worker 
1. add some ut shard disk repair task

with: #22481824 #22481829

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
 2025-07-08 11:30:14 +08:00
JasonHu520
67277bdf0e feat(scheduler): add shard disk repair manager 
1. finish shard task process and shard disk repair

with: #22452167

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
 2025-07-08 11:30:14 +08:00
JasonHu520
19e3ec09e4 feat(scheduler): add shard node task 
1. Update the scheduler and worker interaction protocols to support new
task types

with: #22417838

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
 2025-07-08 11:30:14 +08:00
JasonHu520
afaef8a55c fix(scheduler): fix task update volume failed and task retry duplicated in finish stage 
with: #22481824 #22481829

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
 2025-07-08 11:30:14 +08:00
xiejian
6b1a33c26a fix(raft): fix raft transport panic when disk not finish load 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
xiejian
6a0842c17c fix(shardnode): fix base transport singleflight key conflict 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
xiejian
d2facf68d9 fix(raft): fix raft manager interface convert problem 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
xiejian
2a57182e15 feat(shardnode): add shardnode related cli tools 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
xiejian
ea7e25f25f feat(shardnode): support AllocSlice api, update SealBlob api args 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
xiejian
4e563e095e refactor(shardnode): replace shardnode.Blob with commom.Blob 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
xiejian
0e5d3eb8a1 fix(shardnode): fix the problem of incorrect assignment of unit learner 
field in addShard process
fix rpc auditlog missing traceID problem, add shardnode log
fix update shard without suid
fix shard task routeVersion check

with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
xiejian
899fb14003 fix(clustermgr): fix cm AllocChunks failure causes concurrency issues 
with #22565373

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:14 +08:00
slasher
e270e33102 chore(rpc2): add test server and client 
tcp, transport, rpc, rpc2

@formatter:off

Signed-off-by: slasher <shenjie1@oppo.com>
 2025-07-08 11:30:14 +08:00
slasher
d5e816db40 feat(rpc2): client retry on codec parameter 
. #22637531

Signed-off-by: slasher <shenjie1@oppo.com>
 2025-07-08 11:30:14 +08:00