Commit Graph

4951 Commits

Author SHA1 Message Date
slasher
bed91e7765 feat(access): report metric of read and write
. #22762725

Signed-off-by: slasher <shenjie1@oppo.com>
2025-07-08 11:30:14 +08:00
tangdeyi
f7859160de fix(clustermgr): remove shardUnitInfo in shardItem
. #22711921

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2025-07-08 11:30:14 +08:00
tangdeyi
ddbc6f37ac feat(clustermgr): persistent raft members when applying snapshot
. #22711921

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2025-07-08 11:30:14 +08:00
mawei029
7e016da2a3 fix(bssdk): get blob fill crc, shard keys fix panic, shard not
leader update, get next end shard, cli readable

with: #22639120

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-07-08 11:30:14 +08:00
mawei029
6357ce9b75 feat(bssdk): blobstore cli support sdk cmd
with: #22639120

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-07-08 11:30:14 +08:00
slasher
c6b2152692 feat(rpc2): unmarshal none if response length is zero
@formatter:off

Signed-off-by: slasher <shenjie1@oppo.com>
Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:14 +08:00
xiejian
30789df40d fix(shardnode): fix the bugs found with sdk test, and add unit test
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:14 +08:00
slasher
e26e3ab749 fix(access): force flush proxy volume if context canceled
@formatter:off

Signed-off-by: slasher <shenjie1@oppo.com>
2025-07-08 11:30:14 +08:00
JasonHu520
d7abb27eac refactor(scheduler): update log level for kafka message
@formatter:off

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
2025-07-08 11:30:14 +08:00
Cloudstriff
d6c6a775e0 feat(raft): fix query log term by index in raft storage
with #22656329

Signed-off-by: Cloudstriff <chenjiongwendao@qq.com>
2025-07-08 11:30:14 +08:00
Cloudstriff
6a3d90ca93 fix(kvstorev2): fix kv list without handleError function
with #22656329

Signed-off-by: Cloudstriff <chenjiongwendao@qq.com>
2025-07-08 11:30:14 +08:00
mawei029
84d6df46af feat(access): sdk put blob, delete blob from shard node
with: #22549147 of #22357707

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-07-08 11:30:14 +08:00
xiejian
7706c4b4b3 fix(shardnode): calculate crc when persist Location, update AllocSlice api
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:14 +08:00
xiejian
ae3626ac38 fix(shardnode): return err if repeat create blob, fix alloc slice check
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:14 +08:00
tangdeyi
26fffe9b21 feat(clustermgr): optimize the judgment of shard init done
. #22672295

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2025-07-08 11:30:14 +08:00
slasher
2a98715983 feat(rpc2): bad request if parse parameter failed
. #22617142

Signed-off-by: slasher <shenjie1@oppo.com>
2025-07-08 11:30:14 +08:00
xiejian
3f0f1d2b31 refactor(raft): remove raft config resolver, only keep transport resolver
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:14 +08:00
xiejian
5a93938026 refactor(access): move location crc calculate func to common package
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:14 +08:00
xiejian
5a07148126 refactor(raft): fix ut, and some ticker config
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:14 +08:00
Cloudstriff
c724be4931 feat(shardnode): add snapshot header support on apply snapshot progress
with #22656329

Signed-off-by: Cloudstriff <chenjiongwendao@qq.com>
2025-07-08 11:30:14 +08:00
xiejian
9f9cb91540 refactor(raft): simplify SealBlob api args
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:14 +08:00
JasonHu520
596e12a83c refactor(blobnode): some changes for code style
with: #22481824 #22481829

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
2025-07-08 11:30:14 +08:00
Cloudstriff
6bfdb3547c fix(blobnode): fix transfer leader without update shard member type
with #22615053

Signed-off-by: Cloudstriff <chenjiongwendao@qq.com>
2025-07-08 11:30:14 +08:00
JasonHu520
56bfb25102 feat(blobnode): access the client of clustermgr and shardnode
with: #22481824 #22481829

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
2025-07-08 11:30:14 +08:00
JasonHu520
d5e206e18f feat(blobnode): add shard task for worker
1. add some ut shard disk repair task

with: #22481824 #22481829

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
2025-07-08 11:30:14 +08:00
JasonHu520
67277bdf0e feat(scheduler): add shard disk repair manager
1. finish shard task process and shard disk repair

with: #22452167

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
2025-07-08 11:30:14 +08:00
JasonHu520
19e3ec09e4 feat(scheduler): add shard node task
1. Update the scheduler and worker interaction protocols to support new
task types

with: #22417838

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
2025-07-08 11:30:14 +08:00
JasonHu520
afaef8a55c fix(scheduler): fix task update volume failed and task retry duplicated in finish stage
with: #22481824 #22481829

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
2025-07-08 11:30:14 +08:00
xiejian
6b1a33c26a fix(raft): fix raft transport panic when disk not finish load
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:14 +08:00
xiejian
6a0842c17c fix(shardnode): fix base transport singleflight key conflict
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:14 +08:00
xiejian
d2facf68d9 fix(raft): fix raft manager interface convert problem
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:14 +08:00
xiejian
2a57182e15 feat(shardnode): add shardnode related cli tools
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:14 +08:00
xiejian
ea7e25f25f feat(shardnode): support AllocSlice api, update SealBlob api args
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:14 +08:00
xiejian
4e563e095e refactor(shardnode): replace shardnode.Blob with commom.Blob
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:14 +08:00
xiejian
0e5d3eb8a1 fix(shardnode): fix the problem of incorrect assignment of unit learner
field in addShard process
fix rpc auditlog missing traceID problem, add shardnode log
fix update shard without suid
fix shard task routeVersion check

with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:14 +08:00
xiejian
899fb14003 fix(clustermgr): fix cm AllocChunks failure causes concurrency issues
with #22565373

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:14 +08:00
slasher
e270e33102 chore(rpc2): add test server and client
tcp, transport, rpc, rpc2

@formatter:off

Signed-off-by: slasher <shenjie1@oppo.com>
2025-07-08 11:30:14 +08:00
slasher
d5e816db40 feat(rpc2): client retry on codec parameter
. #22637531

Signed-off-by: slasher <shenjie1@oppo.com>
2025-07-08 11:30:14 +08:00
slasher
fc32992b0b feat(rpc2): audit log on error handler
. #22617142

Signed-off-by: slasher <shenjie1@oppo.com>
2025-07-08 11:30:14 +08:00
tangdeyi
0612bfc8ff feat(clustermgr): blobstore cli add catalog cmd
. #22631156

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2025-07-08 11:30:14 +08:00
tangdeyi
aa952305d5 fix(clustermgr): remove shard compatibile mode code and record version
. #22416534

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2025-07-08 11:30:13 +08:00
xiejian
b5b77a1c97 fix(shardnode): fix test founded problems
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:13 +08:00
slasher
20176fe835 fix(access): report punished service with threshold
@formatter:off

Signed-off-by: slasher <shenjie1@oppo.com>
2025-07-08 11:30:13 +08:00
slasher
f79491f781 feat(rpc2): add any codec for any value
. #22573386

Signed-off-by: slasher <shenjie1@oppo.com>
2025-07-08 11:30:13 +08:00
xiejian
ce3acc2279 fix(common): rename Location and Slice's json tag
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:13 +08:00
xiejian
c6c97d78b6 fix(shardnode): fix kvstorev2 problems
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:13 +08:00
xiejian
c697fc85dd fix(shardnode): fix raft related problems
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:13 +08:00
xiejian
241781a646 test(shardnode): complete unit test
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:13 +08:00
tangdeyi
c96e84040c feat(clustermgr): add space management
. #22416534

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2025-07-08 11:30:13 +08:00
tangdeyi
85e6c02538 feat(clustermgr): add route management
. #22477961

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2025-07-08 11:30:13 +08:00