gian/cubefs
1
0
Fork 0
mirror of https://github.com/cubefs/cubefs.git synced 2026-08-02 10:06:14 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
6,258 Commits 48 Branches 52 Tags 378 MiB
blobstore-develop
Commit Graph

429 Commits

Author SHA1 Message Date
Victor1319
d66cd51bec refactor(meta): remove dp cache code from metanode. #1000063486 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2025-08-08 14:59:27 +08:00
zhumingze
ff102a00da feat(cli): Add display of repair start time in datapartition check. #1000081755 
Signed-off-by: zhumingze <zhumingze@oppo.com>
 2025-08-08 14:59:27 +08:00
zhumingze
75af3848b0 feat(cli): Add parameters to datapartition check to simplify display. #1000068067 
Signed-off-by: zhumingze <zhumingze@oppo.com>
 2025-08-08 14:59:26 +08:00
zhumingze
47e9e94f1d feat(cli): Cli tool data partition check optimization. #1000057001 
Signed-off-by: zhumingze <zhumingze@oppo.com>
 2025-08-08 14:59:26 +08:00
zhumingze
d7182d70bd feat(datameta): Record the read-only reason for dp&mp replicas. #1000060034 
Signed-off-by: zhumingze <zhumingze@oppo.com>
 2025-08-08 14:59:26 +08:00
zhumingze
c8d253aa39 feat(master): mp&dp replica missing check time can be adjusted. #1000044373 
Signed-off-by: zhumingze <zhumingze@oppo.com>
 2025-08-08 14:59:25 +08:00
zhumingze
bf6d4f062f feat(masterdatacli): Add alerts for the completion of disk repair and improve cli display. 
. #1000004886

Signed-off-by: zhumingze <zhumingze@oppo.com>
 2025-08-08 14:59:25 +08:00
zhumingze
1c794069a1 feat(masterdatacli): lost disks detection and reporting. #1000004886 
Signed-off-by: zhumingze <zhumingze@oppo.com>
 2025-08-08 14:59:25 +08:00
clinx
d178a1fe51 fix(cli): show handle and read timeout unit#1000100585 
Signed-off-by: clinx <chenlin1@oppo.com>
 2025-08-08 14:59:25 +08:00
clinx
3b9696b8d6 fix(cli): set handle and read timeout by cli #1000100585 
Signed-off-by: clinx <chenlin1@oppo.com>
 2025-08-08 14:59:25 +08:00
clinx
6af47faed0 fix(datanode): change warn message log level #1000091570 
Signed-off-by: clinx <chenlin1@oppo.com>
 2025-08-08 14:59:24 +08:00
clinx
c20fb87a05 fix(cli): show remove all inactive nodes with node address #1000100585 
Signed-off-by: clinx <chenlin1@oppo.com>
 2025-08-08 14:59:24 +08:00
clinx
c296c6ff54 fix(client): distinguish between regions or zones based on the time issued by the master #1000075110 
Signed-off-by: clinx <chenlin1@oppo.com>
 2025-08-08 14:52:12 +08:00
baihailong
35a97d6de8 fix(master): Assign default values to remoteCache parameters when upgrade master.#1000077514 
Signed-off-by: baihailong <baihailong@oppo.com>
 2025-08-08 14:52:12 +08:00
baihailong
967338d137 feat(master): Optimize the client to remove flashnode logic when flashnode returns timeout 
. #1000074429

Signed-off-by: baihailong <baihailong@oppo.com>
 2025-08-08 14:52:03 +08:00
clinx
812388b33a fix(cli): print error msg to console #1000060043 
Signed-off-by: clinx <chenlin1@oppo.com>
 2025-08-08 14:52:02 +08:00
clinx
be196f9b6f fix(flashnode): show empty stat #1000021930 
Signed-off-by: clinx <chenlin1@oppo.com>
 2025-08-08 14:52:02 +08:00
baihailong
97612b6b20 feat(flashnode): enable statistic slot hit rate.#1000037792 
Signed-off-by: baihailong <baihailong@oppo.com>
 2025-08-08 14:52:02 +08:00
clinx
b677abc848 feat(cli): idle not show group stats#1000021930 
Signed-off-by: clinx <chenlin1@oppo.com>
 2025-08-08 14:52:02 +08:00
clinx
2176a61e7e feat(cli): print group status for flashnode #1000021930 
Signed-off-by: clinx <chenlin1@oppo.com>
 2025-08-08 14:52:02 +08:00
chihe
6a89226dc5 feat(flashnode): supports return to client directly if data is not cached 
close:#1000014246

Signed-off-by: chihe <chihe@oppo.com>
 2025-08-08 14:52:01 +08:00
baihailong
c1ee0a0053 fix(sdkmaster): volume remoteCacheReadTimeout parameter changed from seconds to milliseconds. 
. #1000024513

Signed-off-by: baihailong <baihailong@oppo.com>
 2025-08-08 14:51:45 +08:00
clinx
3c67ab500b fix(flashnode): valid args for fla flashnode list#1000020535 
Signed-off-by: clinx <chenlin1@oppo.com>
 2025-08-08 14:51:45 +08:00
clinx
5584dfe034 fix(flashnode): valid args for fla flashnode list#1000020535 
Signed-off-by: clinx <chenlin1@oppo.com>
 2025-08-08 14:51:45 +08:00
clinx
0c5da8ea36 fix(flashnode): check the deletion operation of the flashnode #1000020535 
Signed-off-by: clinx <chenlin1@oppo.com>
 2025-08-08 14:51:45 +08:00
shuqiang-zheng
501dc61922 feat(meta): Support for dynamic adjustment of gogc. 
close:#1000011090

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2025-08-08 14:42:25 +08:00
clinx
a1a2add9d9 fix(flashnode): confirm the default value is no #23079599 
Signed-off-by: clinx <chenlin1@oppo.com>
 2025-08-07 16:00:30 +08:00
shuqiang-zheng
4b9f564cdf feat(flashnode): enhancement of flashGroup information display. 
close:#23070174

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2025-08-07 16:00:29 +08:00
shuqiang-zheng
808b831224 feat(flashnode): support for gradually creation and deletion of flashGroup. 
close:#23070174

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2025-08-07 16:00:29 +08:00
clinx
a12abc9dcc fix(flashndoe): add user confirmation when the user attempts to remove flash group by id#23079599 
Signed-off-by: clinx <chenlin1@oppo.com>
 2025-08-07 16:00:29 +08:00
clinx
afadcde635 fix(flashndoe): add user confirmation when the user attempts to delete a flashnode. #23079599 
Signed-off-by: clinx <chenlin1@oppo.com>
 2025-08-07 16:00:29 +08:00
clinx
03b21f5bd6 fix(flashnode): rename the field remoteCacheFollowerRead to remoteCacheMultiRead #23065717 
Signed-off-by: clinx <chenlin1@oppo.com>
 2025-08-07 16:00:28 +08:00
Wu Huocheng
e27923fa1c chore(master): rerange the codes.#22834621 
Signed-off-by: Wu Huocheng <wuhuocheng@oppo.com>
 2025-08-07 16:00:27 +08:00
zhumingze
55e0a1cade feat(master): Keep discard dp information in master and avoid panic when dp is nil. #23036742 
Signed-off-by: zhumingze <zhumingze@oppo.com>
 2025-08-07 16:00:27 +08:00
chihe
1d5213c43b fix(master): add default value for ttl and readTimeout for remoete cache 
close:#23081308

Signed-off-by: chihe <chihe@oppo.com>
 2025-08-07 16:00:26 +08:00
chihe
279817ca50 fix(client): modify default value for remoteCacheReadTimeoutSec 
close:#23047275

Signed-off-by: chihe <chihe@oppo.com>
 2025-08-07 16:00:26 +08:00
shuqiang-zheng
b4a9c85ae6 feat(flashnode): add interfaces for manual inactive disk. 
@formatter:off

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2025-08-07 16:00:25 +08:00
shuqiang-zheng
fc3cddfc20 feat(flashnode): modify the name of the disk statistics in heartbeat reporting. 
@formatter:off

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2025-08-07 16:00:25 +08:00
shuqiang-zheng
e0880fa4d0 feat(flashnode): clears the cache on flashNode when removing it. 
close:#23003554

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2025-08-07 16:00:25 +08:00
shuqiang-zheng
08639d8b52 feat(flashnode): add multi disk support. 
close:#23021760

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2025-08-07 16:00:25 +08:00
baihailong
fa1ce7515c fix(cli): if parameter remoteCacheMaxFileSizeGB not changed when update volume, stay the same. 
. #23047778

Signed-off-by: baihailong <baihailong@oppo.com>
 2025-08-07 16:00:25 +08:00
baihailong
45b7ffdf60 feat(flashnode): Querying flashnode status prints the expiration time of the key value.#23040431 
Signed-off-by: baihailong <baihailong@oppo.com>
 2025-08-07 16:00:25 +08:00
baihailong
4d7e0c1997 fix(cli): when create or update volume, remoteCacheMaxFileSizeGB must greater than 0.#23034629 
Signed-off-by: baihailong <baihailong@oppo.com>
 2025-08-07 16:00:25 +08:00
baihailong
6d04ae146c fix(cli): fix remotecache params when create volume.#23030205 
Signed-off-by: baihailong <baihailong@oppo.com>
 2025-08-07 16:00:25 +08:00
baihailong
e19232f374 feat(mastersdkcli): enable config remoteCache parameter by volume. 
. #23020464

Signed-off-by: baihailong <baihailong@oppo.com>
 2025-08-07 16:00:11 +08:00
baihailong
8d81c6d2f0 fix(cli): Restrict cli only execute httpStat and httpEvict on the flashnode of the cluster.#22983845 
Signed-off-by: baihailong <baihailong@oppo.com>
 2025-08-07 15:57:56 +08:00
zhumingze
5e57eb1ecd feat(master): Add maximally-read config in master for better management. #22931456 
Signed-off-by: zhumingze <zhumingze@oppo.com>
 2025-08-07 15:57:56 +08:00
baihailong
3d7c4917c2 fix(flashnode): optimize flashnode list cost time.#22989953 
Signed-off-by: baihailong <baihailong@oppo.com>
 2025-08-07 15:57:56 +08:00
baihailong
969df96cb7 fix(cli): fix flashgroup info too many blank line and limit max weight of flashgroup.#22981269 
Signed-off-by: baihailong <baihailong@oppo.com>
 2025-08-07 15:57:56 +08:00
shuqiang-zheng
ca2eb33605 fix(flashnode): modify the name of the cache size and ratio configuration item. 
close:#22963423

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2025-08-07 15:57:56 +08:00
baihailong
090e94bab8 feat(flashcache): Support to specify the weight parameter when creating flashgroup.#22931494 
Signed-off-by: baihailong <baihailong@oppo.com>
 2025-08-07 15:45:37 +08:00
zhumingze
410e4545e1 feat(master): Support setting dp and mp cnt limit for different machines #22883514 
Signed-off-by: zhumingze <zhumingze@oppo.com>
 2025-08-07 15:45:37 +08:00
baihailong
057d9605da fix(cli): Restrict the valid and default values of the volume's remoteCache parameter.#22897624 
Signed-off-by: baihailong <baihailong@oppo.com>
 2025-08-07 15:45:26 +08:00
baihailong
4a373f4b23 fix(flashcache): format some code and remove unsued code.#22692038 
Signed-off-by: baihailong <baihailong@oppo.com>
 2025-08-07 15:45:25 +08:00
baihailong
90798863ca fix(flashcache): format some code of flashcache.#22692038 
Signed-off-by: baihailong <baihailong@oppo.com>
 2025-08-07 15:45:09 +08:00
baihailong
4a6527d101 fix(master): The remotecache parameter is supported when creating a volume.#22575809 
Signed-off-by: baihailong <baihailong@oppo.com>
 2025-08-07 15:19:27 +08:00
leonrayang
30659caa84 enhance(client): enhance the check of slots for flashGroup create 
Signed-off-by: leonrayang <chl696@sina.com>
 2025-08-07 15:19:15 +08:00
slasher
bf26b4bc3d feat(sdk): add common headers in sdk http client 
. #22115371

Signed-off-by: slasher <mcq.sejust@gmail.com>
 2025-08-07 15:19:13 +08:00
slasher
c98e438814 feat(flash): enable volume config in master 
. #22200580

Signed-off-by: slasher <mcq.sejust@gmail.com>
 2025-08-07 15:19:11 +08:00
slasher
d8396639d5 chore(cli): return errors to root of cmd 
. #22200600

Signed-off-by: slasher <mcq.sejust@gmail.com>
 2025-08-07 15:19:08 +08:00
slasher
2742e1ddb7 feat(master): add http args parser in master 
. #22200600

Signed-off-by: slasher <mcq.sejust@gmail.com>
 2025-08-07 15:19:06 +08:00
slasher
1877c03de8 feat(flashnode): turn on off client cache in master 
. #22115371

Signed-off-by: slasher <mcq.sejust@gmail.com>
 2025-08-07 15:19:05 +08:00
slasher
015776b952 test(master): add test case of flash cache 
. #22115371 of 21940685

Signed-off-by: slasher <mcq.sejust@gmail.com>
 2025-08-07 15:19:02 +08:00
slasher
44e56bb610 feat(flashnode): make slot with user defined 
. #22200518

Signed-off-by: slasher <mcq.sejust@gmail.com>
 2025-08-07 15:19:01 +08:00
slasher
4a11077864 feat(flashnode): add cli of flashnode and flashgroup 
. #22200531 #22200571 #22200580

Signed-off-by: slasher <mcq.sejust@gmail.com>
 2025-08-07 15:18:58 +08:00
chihe
625289c6cd fix(cli): do not enable trash when excuting operation for quota 
close:#22922055

Signed-off-by: chihe <chihe@oppo.com>
 2025-08-07 15:17:53 +08:00
NaturalSelect
627118cd8b feat(cli): support change master leader by cmd 
Signed-off-by: NaturalSelect <huangzhibin@xiaomi.com>
 2025-06-27 14:49:32 +08:00
liubingxing
3d51f7b6ba fix(cli): migrate metanode cmd cannot work with default limit mp count 
Signed-off-by: liubingxing <liubbingxing@gmail.com>
 2025-04-15 17:12:55 +08:00
liubingxing
e0ca16e6ad fix(cli): migrate metanode cmd cannot work with default limit mp count 
Signed-off-by: liubingxing <liubbingxing@gmail.com>
 2025-04-15 17:12:55 +08:00
morphes1995
ab398d669d fix(master): RaftPartitionCanUsingDifferentPort make effective after and all dn/mn upgraded 
Signed-off-by: morphes1995 <morphes1995@gmail.com>
 2024-12-31 17:36:32 +08:00
morphes1995
00a3ee193f fix(master): fix port inconsistent when create dp/mp during upgrading process 
Signed-off-by: morphes1995 <morphes1995@gmail.com>
 2024-12-31 17:36:32 +08:00
morphes1995
f4c7755316 feat(metanode): support multi metanode process using different port on single node 
Signed-off-by: morphes1995 <morphes1995@gmail.com>
 2024-12-31 17:36:32 +08:00
morphes1995
b23df49eca feat(datanode): support multi datanode process using different port on single node 
Signed-off-by: morphes1995 <morphes1995@gmail.com>
 2024-12-31 17:36:32 +08:00
Victor1319
8bb1131500 refactor(all): refactor go code with golint. #22906448 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
0c406f55d9 refactor(master): resolve conflicts when picking to master branch. #22906448 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
dac1a12d0a refactor(master): resolve conflicts when picking to master branch. #22906448 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
67d5dab1db fix(master): ignore abnormal dp when addVolStorageClass. #22908260 
enable to skip check mp & dp forbidden status.

Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
zhumingze
edaf7b6f93 feat(cli): support cli to view inode detail information by inode id. #22867405 
Signed-off-by: zhumingze <zhumingze@oppo.com>
 2024-12-26 09:24:22 +08:00
zhumingze
eec42fcec6 feat(cli): support cli to display vol used size based on dp media type #22853006 
Signed-off-by: zhumingze <zhumingze@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
3a8f5eb3f8 feat(master): support query all client ip from master. #22834669 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
ced8ca0978 feat(masterdata): add config to control whether vol read direct disk. #22818122 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
644508479e feat(metasdkmaster): support read quoram when mp no leader. #22782472 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
447fcc1d61 fix(master): support meta follower read. #22782680 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
Reliey
ddfc4c29b8 feat(master): add http interface getOpLog for data processing #22257509 
Signed-off-by: Reliey <zhumingze@oppo.com>
 2024-12-26 09:24:22 +08:00
Reliey
5f3c6e2d4a feat(cli): support reporting and viewing of cluster and vol dimension disk data #22257509 
Signed-off-by: Reliey <zhumingze@oppo.com>
 2024-12-26 09:24:22 +08:00
Reliey
3986329ed7 feat(mastercli): support datanode report dpOpLog and diskOpLog infomation. #22257509 
Signed-off-by: Reliey <zhumingze@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
bcf36ab04f fix(metanode): modify log level for fsmInternalBatchFreeMigrationExtentKey 
close:#22757889

Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
0eecc1fd85 fix(cli): fix some tiny issues. #22727537 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
abc2ab5912 refactor(master): support double check master media cfg type. #22727537 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
9f5fbba63b refactor(master): refactor variable name from cap to quota. #22731703 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
ce3439d199 feat(master): support replica storage quota limit.#22731703 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
168fa0418c feat(mastermeta): add LegacyDataMediaType in master cluster values, and metaNode fetch it from master. 
close:#22716686
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
d59f4e0b84 fix(cli): if create replica volume and replica-num is assigned 1 or 2, set follower-read as true 
close:#22701504
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
883b15189d feat(metamastercli): hybrid cloud migration data usage statistics. 
close:#22658297
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
f25aa0734d feat(master): not allow a volume supports both replica storageClass and blobstore 
close:#22395995
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
9f7ffeb194 feat(masterdatameta): support volume to forbidden write operate codes of lower packet protocol version 
close#22531837

Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
a43f96d403 feat(dataclientmaster): support configuring datanode and metanode to forbidden 
write operate codes of lower packet protocol version.
       	 close#22531837
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
037df5f5f9 fix(sdkclient): client compatible with older version server modules 
#22400600
	@formatter:off
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
daf4dd9d51 fix(lcNode): hybrid cloud set followerRead as false when create ExtentClient 
#22481972
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
57c8f26829 refactor(cli): hybrid cloud add storageClass tips in help messages 
#22395995
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00