Commit Graph

5003 Commits

Author SHA1 Message Date
JasonHu520
7295732597 fix(raft): in the data synchronization process, persist the data first and then respond
@formatter:off

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
2025-07-08 11:30:15 +08:00
mawei029
6c5d75abde fix(bssdk): fix put blob all fail, seal slices is zero, put blob ok but seal fail
with: #22933065

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-07-08 11:30:15 +08:00
mawei029
a743a2a74b fix(bssdk): fix update shard when put fail at restart shardnode
with: #22941519

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-07-08 11:30:15 +08:00
slasher
5c385715ff fix(cli): add log level setting for cli
@formatter:off

Signed-off-by: slasher <shenjie1@oppo.com>
2025-07-08 11:30:15 +08:00
JasonHu520
0e0474bb64 feat(raft): handle raft group panic error
@formatter:off

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
2025-07-08 11:30:15 +08:00
JasonHu520
db3df98398 feat(scheduler): use err code replace detail
@formatter:off

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
2025-07-08 11:30:15 +08:00
xiejian
28c197a0e2 feat(shardnode): transfer leader when handleEIO
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:15 +08:00
JasonHu520
759217aeab fix(raft): leader can not be leaner, need leader transfer
@formatter:off

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
2025-07-08 11:30:15 +08:00
mawei029
b1c8321beb fix(bssdk): add print log, wait shard node return no leader
default shard node retry time

with: #22918200

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-07-08 11:30:15 +08:00
xiejian
ecd4101463 fix(shardnode): prevent alloc slice for sealed Blob
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:15 +08:00
xiejian
ce75c10929 refactor(rpc): Solving serious problems in code scanning
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:15 +08:00
xiejian
0de3986825 refactor(shardnode): Solving serious problems in code scanning
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:15 +08:00
xiejian
82b7c61fbd refactor(raft): Solving serious problems in code scanning
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:15 +08:00
slasher
587b825bc0 feat(cli): encode and decode json bytes in cli
@formatter:off

Signed-off-by: slasher <shenjie1@oppo.com>
2025-07-08 11:30:15 +08:00
mawei029
7b57e9d894 fix(bssdk): convert error code 5xx key not found
with: #22912998

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-07-08 11:30:15 +08:00
mawei029
94e068fa65 fix(bssdk): private createBlob and sealBlob
with: #22918200

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-07-08 11:30:15 +08:00
mawei029
e20adade26 fix(bssdk): fix get leader shardnode with new diskID when connect refuse
with: #22918200

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-07-08 11:30:15 +08:00
xiejian
eb0499a6c9 fix(shardnode): convert kvstore key not found err to err with code
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:15 +08:00
xiejian
ba801c5c77 fix(shardnode): check request blob name length
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:15 +08:00
slasher
80e0ac3b81 fix(rpc2): parse codec args in multi frames
. #22922602

Signed-off-by: slasher <shenjie1@oppo.com>
2025-07-08 11:30:15 +08:00
xiejian
ea3d9f9d38 fix(shardnode): excludes failed vid when AllocSlice
with #22916378

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:15 +08:00
mawei029
5b39560fa8 fix(bssdk): transform the error message in more detail, when list blob
with: #22905178

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-07-08 11:30:15 +08:00
mawei029
f97631d8eb fix(bssdk): sum body hashes and return it when put blob, modify print log
with: #22901344

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-07-08 11:30:15 +08:00
mawei029
9d84c73c17 fix(bssdk): fix panic, modify get the disk punished status from cache
with: #22893213

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-07-08 11:30:15 +08:00
xiejian
1eef24a5dd refactor(kvstorev2): optimize SeekForPrev of kvstorev2
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:15 +08:00
xiejian
4c99c2a735 fix(shardnode): handle situations of failedSlice is empty of AllocSlice api
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:15 +08:00
JasonHu520
aef6b4efc7 feat(blobnode): request new leader to update source unit
with #22812331

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
2025-07-08 11:30:15 +08:00
xiejian
c20c28b17f fix(shardnode): prevent shard delete get leader which is itself cause dead lock
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:15 +08:00
JasonHu520
fcd249e20a feat(blobnode): update source shard unit to learner
with #22812331

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
2025-07-08 11:30:15 +08:00
xiejian
71d680d91c fix(shardnode): 1.load disk shard concurrency
2.remove trash shard
3.update listShard api
4.optimize lock nesting to avoid lock conflicts, stats api return node host
5.kvstorev2 add optimized default config
6.support about recover shard cli
7.optimize trace log time cost record

with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:15 +08:00
xiejian
35df8a3f09 fix(raft): 1.remove entry cache put verify, fix get and get from
2.fix duplicated heartbeat request and MsgAppResp response
3.remove snapshot meta when storage close
4.fix outgoingSnapshot repeat close
5.add some log and fix log level and format

with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:15 +08:00
Cloudstriff
7fbc45344b perf(raft): optimized raft storage Entries and Term interface performance
with #22792157

Signed-off-by: Cloudstriff <chenjiongwendao@qq.com>
2025-07-08 11:30:14 +08:00
xiejian
bb272a12a5 feat(shardnode): add time cost detail of blob api in span
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:14 +08:00
xiejian
26086a3208 feat(shardnode): add padding when encode space key to avoid out of order
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:14 +08:00
xiejian
9d8d1c1996 fix(raft): 1.do not return error when process proposal msg failed because of not leader
2.storage keep both snapshot meta and hard state
3.fix applyUpdateRaw panic when found not value but do close
4.fix apply snapshot in statemachine while appy commited entries concurrently

with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:14 +08:00
xiejian
fbb8d2ca1d feat(shardnode): support tcmalloc and rocksdb stats api
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:14 +08:00
xiejian
6546e56e54 feat(shardnode): support tcmalloc
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:14 +08:00
xiejian
38f382d808 fix(shardnode): with member ctx when createRaftGroup to fix suid is 0 after apply snapshot
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:14 +08:00
xiejian
2d8a920fd1 feat(shardnode): support addShard cli tool
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:14 +08:00
xiejian
4b73769f5d fix(shardnode): fix restart panic after apply snapshot and tickElection
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:14 +08:00
xiejian
24edbfdbb1 fix(shardnode): encode kv storage data key with shardID
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:14 +08:00
xiejian
173a1cd157 fix(shardnode): fix panic problem when restart service with apply snapshot
supplement kvstore interface

with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:14 +08:00
xiejian
d0e5f634e1 fix(shardnode): fix fatal when shard is deleting but apply member change
flush when delete shard info, read/write check when do snapshot, do checkpoint

with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:14 +08:00
JasonHu520
0d4321d8c1 fix(scheduler): fix cancel shard task failed
with #22812331

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
2025-07-08 11:30:14 +08:00
tangdeyi
89d49fbe1d fix(clustermgr): put refresh into loadData cause of snapshot
with #22842525

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2025-07-08 11:30:14 +08:00
tangdeyi
da172ccb9d fix(clustermgr): validate arg when chunk is reported
with #22815976

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2025-07-08 11:30:14 +08:00
mawei029
92668d0b96 fix(access): need get twice shard stats from shardnode
with: #22751713 of #22751546

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-07-08 11:30:14 +08:00
mawei029
c2b33079e6 fix(access): need update shard route when connection refused, catalog skip leader disk 0
with: #22751713 of #22751546

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-07-08 11:30:14 +08:00
mawei029
6034ad9e03 feat(bssdk): tool sdk cli support perf tools to put,get,delete
with: #22751704 of #22751546

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-07-08 11:30:14 +08:00
mawei029
7dbdcb859a refactor(bssdk): sdk cli convert blobname byte to string, suid readable
with: #22751573 of #22751546

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-07-08 11:30:14 +08:00