Commit Graph

42 Commits

Author SHA1 Message Date
xiejian
0cbe1e276b feat(shardnode): support http rpc service
with: #1000324330

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-10-13 15:29:35 +08:00
JasonHu520
2f0b2b163b feat(blobnode): chunk data support batch read
with: #1000135108

Signed-off-by: slasher <shenjie1@oppo.com>
Signed-off-by: JasonHu520 <huzongchao@oppo.com>
2025-10-13 15:29:34 +08:00
mawei029
80b069d508 refactor(blobnode): optimize io context cancel, and it has become simpler
with: #1000146037

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-10-13 15:29:34 +08:00
tangdeyi
3cebf9fdbf feat(clustermgr): lock unlock volume support epoch
with #1000102800

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2025-10-13 15:29:33 +08:00
mawei029
7a18c4c20d fix(blobnode): need check write n at datafile, may be ctx is cancel
with: #1000309518

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-09-01 10:17:05 +08:00
xiejian
76b2a6e6e3 fix(shardnode): record Slice.ValidSize when alloc or seal
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:15 +08:00
xiejian
70f6955e1e fix(shardnode): 1. reject insert item with empty ID 2.fix ListItem
with #22989681 #22989410

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:15 +08:00
xiejian
19f006b1f4 fix(shardnode): 1.transfer leader return err with code 2.add update shard args check
with #22982347 #22982342 #22980415

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:15 +08:00
xiejian
986bb6c830 fix(shardnode): 1.prevent create blob with empty name
2.fix some error msg
3.fix seal and delete blob return nil when get space failed

with #22977114 #22981300 #22982188

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:15 +08:00
xiejian
ecd4101463 fix(shardnode): prevent alloc slice for sealed Blob
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:15 +08:00
mawei029
7b57e9d894 fix(bssdk): convert error code 5xx key not found
with: #22912998

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-07-08 11:30:15 +08:00
xiejian
eb0499a6c9 fix(shardnode): convert kvstore key not found err to err with code
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:15 +08:00
xiejian
ba801c5c77 fix(shardnode): check request blob name length
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:15 +08:00
xiejian
24edbfdbb1 fix(shardnode): encode kv storage data key with shardID
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:14 +08:00
xiejian
30789df40d fix(shardnode): fix the bugs found with sdk test, and add unit test
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:14 +08:00
mawei029
84d6df46af feat(access): sdk put blob, delete blob from shard node
with: #22549147 of #22357707

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-07-08 11:30:14 +08:00
xiejian
ae3626ac38 fix(shardnode): return err if repeat create blob, fix alloc slice check
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:14 +08:00
xiejian
ea7e25f25f feat(shardnode): support AllocSlice api, update SealBlob api args
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:14 +08:00
xiejian
0e5d3eb8a1 fix(shardnode): fix the problem of incorrect assignment of unit learner
field in addShard process
fix rpc auditlog missing traceID problem, add shardnode log
fix update shard without suid
fix shard task routeVersion check

with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:14 +08:00
tangdeyi
533caf5fcd feat(clustermgr): add shard management and catalog module
. #22477946

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2025-07-08 11:30:13 +08:00
mawei029
4cfbf9e6d7 feat(access): sdk get blob, punish shard node
with: #22433440 of #22357707

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-07-08 11:30:13 +08:00
tangdeyi
552cb2fd9f feat(clustermgr): optimize drop node process
1. dropping node triggers dropping disk
2. node is set to dropped as all disks are either dropped or repaired
3. add disk is banned if node is dropping

with #22358259

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2025-07-08 11:30:13 +08:00
Cloudstriff
f3a83ecb47 style(shardnode): code static check and style refactor
with #22357426

Signed-off-by: Cloudstriff <chenjiongwendao@qq.com>
Signed-off-by: xiejian <xiejian3@oppo.com>
2025-07-08 11:30:12 +08:00
Cloudstriff
c06fdb8b3c feat(shardnode): update shard and remove shard implements
with #22357426

Signed-off-by: Cloudstriff <chenjiongwendao@qq.com>
2025-07-08 11:30:12 +08:00
Cloudstriff
a4562e5b8d feat(shardnode): initial shardnode module code framework
with #22357426

Signed-off-by: Cloudstriff <chenjiongwendao@qq.com>
2025-07-08 11:30:12 +08:00
yanghonggang
d821466a1f fix(blobstore): rename CodeNoAvaliableVolume to CodeNoCodemodeVolume
The previous error code 'CodeNoAvaliableVolume' (801) contained a typo
and was semantically ambiguous. To avoid confusion with the similarly
named 'CodeNoAvailableVolume' (917) from Clustermgr, it has been renamed
to 'CodeNoCodemodeVolume'.

Fixes: #3790

Signed-off-by: yanghonggang <yanghonggang_yewu@cmss.chinamobile.com>
2025-05-13 14:50:05 +08:00
JasonHu520
2d90e0f96e perf(scheduler): update volume cache failed error replace with error code
@formatter:off

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
2024-11-12 11:01:05 +08:00
slasher
b8211ebe58 refactor(access): change access request limited to 4xx
. #22358245

Signed-off-by: slasher <shenjie1@oppo.com>
2024-07-15 16:38:24 +08:00
tangdeyi
dc91b64e02 fix(clustermgr): add error msg
with #22283083

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2024-07-15 11:03:57 +08:00
xiejian
266f000adc fix(clustermgr): complete the error code message
with: #22204241 #22201875
Signed-off-by: xiejian <xiejian3@oppo.com>
2024-07-15 11:03:57 +08:00
tangdeyi
c1c66d0111 feat(clustermgr): clustermgr support copyset
1. add nodeAdd and nodeDrop api
2. add topoMgr struct
3. do refactor for copy set change

with #22171901 #22040204

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2024-07-15 11:03:57 +08:00
xiejian
84567b8d67 feat(blobnode): put shard time out return error code 675
with: #22201875 of #22040231
Signed-off-by: xiejian <xiejian3@oppo.com>
2024-07-15 11:03:57 +08:00
xiejian
690c26fe43 feat(clustermgr): cm background worker return unsupported replica mode error
with: #22201875 of #22040231
Signed-off-by: xiejian <xiejian3@oppo.com>
2024-07-15 11:03:57 +08:00
setcy
5654e32621 chore(blobstore): support showing migrating process
close: #1900

Signed-off-by: setcy <asetcy@gmail.com>
2023-05-04 15:17:25 +08:00
JasonHu520
14c559e1eb refactor(blobstore): update error code
Signed-off-by: JasonHu520 <huzongchao@oppo.com>
2023-03-30 10:29:38 +08:00
wangzhihao
f733520e1f opt(blobnode): modify qos limiter and optimize code style
Signed-off-by: wangzhihao <wangzhihao@oppo.com>
2023-03-21 10:30:28 +08:00
pengtianyue
4c789e9c1e feat(scheduler): support disk-level concurrency for disk drop task
Closes #1495

Signed-off-by: pengtianyue <pengtianyue@oppo.com>
2023-03-21 10:30:28 +08:00
tangzhixiang
4961b84378 refactor(clustermgr): merge configMgr into kvMgr
Signed-off-by: tangzhixiang <tangzhixiang@oppo.com>
2023-03-21 10:30:28 +08:00
slasher
42594ec61b style(api,access): body retry with original http request
Signed-off-by: slasher <mcq.sejust@gmail.com>
2022-10-12 10:21:39 +08:00
cresc
6bb95b4854 opt(blobnode): optimize return code and add UT
Signed-off-by: cresc <wzh07@hotmail.com>
2022-10-12 10:21:39 +08:00
pengtianyue025
5ff82367c1 feat(scheduler): persist migrate tasks via clustermgr instead of mongodb
Signed-off-by: pengtianyue025 <pengtianyue025@gmail.com>
2022-10-12 10:21:39 +08:00
pengtianyue025
631cf74d7e build(scheduler): add blobstore module scheduler
Signed-off-by: pengtianyue025 <pengtianyue025@gmail.com>
2022-10-12 10:21:39 +08:00