gian/cubefs
1
0
Fork 0
mirror of https://github.com/cubefs/cubefs.git synced 2026-08-02 02:00:56 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
6,190 Commits 48 Branches 52 Tags 378 MiB
master
Commit Graph

429 Commits

Author SHA1 Message Date
baihailong
090e94bab8 feat(flashcache): Support to specify the weight parameter when creating flashgroup.#22931494 
Signed-off-by: baihailong <baihailong@oppo.com>
 2025-08-07 15:45:37 +08:00
zhumingze
410e4545e1 feat(master): Support setting dp and mp cnt limit for different machines #22883514 
Signed-off-by: zhumingze <zhumingze@oppo.com>
 2025-08-07 15:45:37 +08:00
baihailong
057d9605da fix(cli): Restrict the valid and default values of the volume's remoteCache parameter.#22897624 
Signed-off-by: baihailong <baihailong@oppo.com>
 2025-08-07 15:45:26 +08:00
baihailong
4a373f4b23 fix(flashcache): format some code and remove unsued code.#22692038 
Signed-off-by: baihailong <baihailong@oppo.com>
 2025-08-07 15:45:25 +08:00
baihailong
90798863ca fix(flashcache): format some code of flashcache.#22692038 
Signed-off-by: baihailong <baihailong@oppo.com>
 2025-08-07 15:45:09 +08:00
baihailong
4a6527d101 fix(master): The remotecache parameter is supported when creating a volume.#22575809 
Signed-off-by: baihailong <baihailong@oppo.com>
 2025-08-07 15:19:27 +08:00
leonrayang
30659caa84 enhance(client): enhance the check of slots for flashGroup create 
Signed-off-by: leonrayang <chl696@sina.com>
 2025-08-07 15:19:15 +08:00
slasher
bf26b4bc3d feat(sdk): add common headers in sdk http client 
. #22115371

Signed-off-by: slasher <mcq.sejust@gmail.com>
 2025-08-07 15:19:13 +08:00
slasher
c98e438814 feat(flash): enable volume config in master 
. #22200580

Signed-off-by: slasher <mcq.sejust@gmail.com>
 2025-08-07 15:19:11 +08:00
slasher
d8396639d5 chore(cli): return errors to root of cmd 
. #22200600

Signed-off-by: slasher <mcq.sejust@gmail.com>
 2025-08-07 15:19:08 +08:00
slasher
2742e1ddb7 feat(master): add http args parser in master 
. #22200600

Signed-off-by: slasher <mcq.sejust@gmail.com>
 2025-08-07 15:19:06 +08:00
slasher
1877c03de8 feat(flashnode): turn on off client cache in master 
. #22115371

Signed-off-by: slasher <mcq.sejust@gmail.com>
 2025-08-07 15:19:05 +08:00
slasher
015776b952 test(master): add test case of flash cache 
. #22115371 of 21940685

Signed-off-by: slasher <mcq.sejust@gmail.com>
 2025-08-07 15:19:02 +08:00
slasher
44e56bb610 feat(flashnode): make slot with user defined 
. #22200518

Signed-off-by: slasher <mcq.sejust@gmail.com>
 2025-08-07 15:19:01 +08:00
slasher
4a11077864 feat(flashnode): add cli of flashnode and flashgroup 
. #22200531 #22200571 #22200580

Signed-off-by: slasher <mcq.sejust@gmail.com>
 2025-08-07 15:18:58 +08:00
chihe
625289c6cd fix(cli): do not enable trash when excuting operation for quota 
close:#22922055

Signed-off-by: chihe <chihe@oppo.com>
 2025-08-07 15:17:53 +08:00
NaturalSelect
627118cd8b feat(cli): support change master leader by cmd 
Signed-off-by: NaturalSelect <huangzhibin@xiaomi.com>
 2025-06-27 14:49:32 +08:00
liubingxing
3d51f7b6ba fix(cli): migrate metanode cmd cannot work with default limit mp count 
Signed-off-by: liubingxing <liubbingxing@gmail.com>
 2025-04-15 17:12:55 +08:00
liubingxing
e0ca16e6ad fix(cli): migrate metanode cmd cannot work with default limit mp count 
Signed-off-by: liubingxing <liubbingxing@gmail.com>
 2025-04-15 17:12:55 +08:00
morphes1995
ab398d669d fix(master): RaftPartitionCanUsingDifferentPort make effective after and all dn/mn upgraded 
Signed-off-by: morphes1995 <morphes1995@gmail.com>
 2024-12-31 17:36:32 +08:00
morphes1995
00a3ee193f fix(master): fix port inconsistent when create dp/mp during upgrading process 
Signed-off-by: morphes1995 <morphes1995@gmail.com>
 2024-12-31 17:36:32 +08:00
morphes1995
f4c7755316 feat(metanode): support multi metanode process using different port on single node 
Signed-off-by: morphes1995 <morphes1995@gmail.com>
 2024-12-31 17:36:32 +08:00
morphes1995
b23df49eca feat(datanode): support multi datanode process using different port on single node 
Signed-off-by: morphes1995 <morphes1995@gmail.com>
 2024-12-31 17:36:32 +08:00
Victor1319
8bb1131500 refactor(all): refactor go code with golint. #22906448 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
0c406f55d9 refactor(master): resolve conflicts when picking to master branch. #22906448 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
dac1a12d0a refactor(master): resolve conflicts when picking to master branch. #22906448 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
67d5dab1db fix(master): ignore abnormal dp when addVolStorageClass. #22908260 
enable to skip check mp & dp forbidden status.

Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
zhumingze
edaf7b6f93 feat(cli): support cli to view inode detail information by inode id. #22867405 
Signed-off-by: zhumingze <zhumingze@oppo.com>
 2024-12-26 09:24:22 +08:00
zhumingze
eec42fcec6 feat(cli): support cli to display vol used size based on dp media type #22853006 
Signed-off-by: zhumingze <zhumingze@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
3a8f5eb3f8 feat(master): support query all client ip from master. #22834669 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
ced8ca0978 feat(masterdata): add config to control whether vol read direct disk. #22818122 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
644508479e feat(metasdkmaster): support read quoram when mp no leader. #22782472 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
447fcc1d61 fix(master): support meta follower read. #22782680 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
Reliey
ddfc4c29b8 feat(master): add http interface getOpLog for data processing #22257509 
Signed-off-by: Reliey <zhumingze@oppo.com>
 2024-12-26 09:24:22 +08:00
Reliey
5f3c6e2d4a feat(cli): support reporting and viewing of cluster and vol dimension disk data #22257509 
Signed-off-by: Reliey <zhumingze@oppo.com>
 2024-12-26 09:24:22 +08:00
Reliey
3986329ed7 feat(mastercli): support datanode report dpOpLog and diskOpLog infomation. #22257509 
Signed-off-by: Reliey <zhumingze@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
bcf36ab04f fix(metanode): modify log level for fsmInternalBatchFreeMigrationExtentKey 
close:#22757889

Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
0eecc1fd85 fix(cli): fix some tiny issues. #22727537 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
abc2ab5912 refactor(master): support double check master media cfg type. #22727537 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
9f5fbba63b refactor(master): refactor variable name from cap to quota. #22731703 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
ce3439d199 feat(master): support replica storage quota limit.#22731703 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
168fa0418c feat(mastermeta): add LegacyDataMediaType in master cluster values, and metaNode fetch it from master. 
close:#22716686
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
d59f4e0b84 fix(cli): if create replica volume and replica-num is assigned 1 or 2, set follower-read as true 
close:#22701504
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
883b15189d feat(metamastercli): hybrid cloud migration data usage statistics. 
close:#22658297
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
f25aa0734d feat(master): not allow a volume supports both replica storageClass and blobstore 
close:#22395995
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
9f7ffeb194 feat(masterdatameta): support volume to forbidden write operate codes of lower packet protocol version 
close#22531837

Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
a43f96d403 feat(dataclientmaster): support configuring datanode and metanode to forbidden 
write operate codes of lower packet protocol version.
       	 close#22531837
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
037df5f5f9 fix(sdkclient): client compatible with older version server modules 
#22400600
	@formatter:off
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
daf4dd9d51 fix(lcNode): hybrid cloud set followerRead as false when create ExtentClient 
#22481972
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
57c8f26829 refactor(cli): hybrid cloud add storageClass tips in help messages 
#22395995
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
af298477f3 fix(master): check if volume's zoneName list has the resource when add allowed storageClass 
#22395995
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
e2e9943f47 feat(cli): while creating volume, auto set crossZone as true if assigned more than one zone. 
#22376966

Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
be1e6ba732 feat(master): hybrid cloud support assigning mediaType when manually create datapartiton. 
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
NaturalSelect
7a63703de6 feat(master): hybrid cloud support query cluster storage class info 
close: #22310366
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-12-26 09:24:22 +08:00
NaturalSelect
f029d45f6a feat(cli): hybrid cloud support query vol hybrid storage info 
close: #22304812 #22304800
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
0ec2d1c2b6 fix(cli): hybrid cloud show if the node is set as read-only when get node information 
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
0173aa7e48 fix(master): hybrid cloud fix test cases of creating datapartitions 
#22196488
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
3561f231ba fix(cli): fix the display of the 'metapartition check' command of the cfs-cli tool 
clsoe:#22152841

Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
309d89f1a3 fix(meta): hybrid cloud check err when invoking (*Inode).UnmarshalInodeValue 
close:#22112817
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
698311248a fix(master): hybrid cloud set ebsblockSize when add blobStore to volume's allowedStorageClass 
Signed-off-by: true1064 <true1063@163.com>
 2024-12-26 09:24:22 +08:00
true1064
4173cc9f4d fix(master): hybrid cloud When updating a volume, ebsBlockSize can be modified if allowedStorageClass contains blobstore. 
Signed-off-by: true1064 <true1063@163.com>
 2024-12-26 09:24:22 +08:00
true1064
3de7e847a9 feat(master): handle compatibility of master when older version upgrade to hybrid cloud: 
(1) auto set mediaType of datanode, zone, datapartiton by config legacy "legacyDataMediaType" and persist;
	(2) auto set storageClass of volume by config legacy "legacyDataMediaType" and persist;
	(3) if need to rollback master to older version, need to do nothing, just replace to old master and restart. because hybrid cloud master only add new fields to meta by not changed old fields.

Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
35ed550795 feat(master): hybrid cloud forbidden AdminCreateVersion API because hybrid cloud not support snapshot version yet 
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
9d2bf3b483 feat(mastercli): add API to add storageClass to volume's allowedStorageClass list 
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
5936cdfe8d fix(master): amend some logs 
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
443199e0b0 fix(client): hybrid cloud only clear dp when volume storage class is blobstore 
Signed-off-by: chihe <chi.he@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
f04993070b fix(master): some fix about datapartition creation 
(1) while creating dp in vol creation, check dp count by mediaType to judge if success.
	(2) when background periodical check if need to create dp, skip volumes whose createTime is too recently, to avoid background create dp while volume is creating.
	(3) display mediaType of dp in cfs-cli cmd "volume info -d"

Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
51554785e3 fix(master): hybrid cloud not set zoneName as default value if not assigned in the create vol request. 
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
7a7b663b6c feat(mastercli): hybrid cloud vol.volStorageClass can be changed by "cfs-cli volume update" 
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
1f9dab0eda feat(masterclientpreload): add property CacheDpStorageClass to volume. 
CacheDpStorageClass is used to inform SDK which storageClass to use when access cache dp.

Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
14d7e0e19c feat(masterclientcli): hybrid cloud add property mediaType to datapartition 
(1)master: when creating vol, master creates dps of each mediaType according to vol.allowedStorageClass
	(2)client: when select dp to do append write, choose dp with spcific mediaType according to inode's storageClass

Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
6cafecdb7d feat(masterclientcli): add property volStorageClass and allowedStorageClass to volume 
now volType is not uesed while creating volume, but is maintained for compability

Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
3081a30168 feat(master): hybrid cloud add mediaType property to zone 
(1) zone mediaType is set as the first add-in datanode's mediaType
	(2) once zone mediaType is set, all datanodes in the zone must be the same mediaType.
	(3) the cmd 'cfs-cli zone info' shows zone mediaType.

Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
f70b3cfe38 feat(masterdatacli): hybrid cloud add datanode's mediaType 
for module master and datanode; the cmd 'cfs-cli datanode info' can show datanode's mediaType

Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
leonrayang
0647717f79 fix(client): enable Client with version 3.4.0 compatible with 3.3.2 
Signed-off-by: leonrayang <chl696@sina.com>
 2024-12-26 09:24:22 +08:00
chihe
852dafafd2 fix(datanode): if dpBackupTimeout is not set, then do not delete back up directories. 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
a3fb3d301b fix(master): if the decommission fails and requires retry, set the status to 'mark' only at the end of the decommission function 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
64afe661cb fix(master): do not check size of datanode when retrying to decommission special replica 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
ef8183b648 fix(cli): remove unnecessary commands for cli 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
323133a9f9 fix(datanode): return error if receive OpDeleteDataPartition when disks are not loaded 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
da33bc2068 feat(cli): support raftForce for datanode decommission by cfs-cli 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
46157d2c06 refactor(all): resolve conflict when pick commit from 3.3.2 to 3.4.0. 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
69ca9cd0f4 fix(metanode): only sync at among replicas when inode is not nil 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
3a4a54f3bc fix(cli): use macro value instead of hard code 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
b5252646d0 refactor(cli): refactor cli hint message when update transaction info. 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
a305b32b9c feat(master): cli support setting for persistting accessTime 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
6970b4570d feat(master): support set trashInterval with cli 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
a487a828b4 feat(master): api for enable/disbale persist for accesstime 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
0f64f5010e feat(master): api for setting accesstime vaild interval by vol 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
shuqiang-zheng
aefb1b2bd9 refactor(cli): update instructions for freezing clusters 
@formatter:off
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
f70f1ee08c fix(master): fix dead lock by getting copy of dp map 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
2fb56e7282 feat(master): auto delete backup directories 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
leonrayang
d6e066f899 fix(util): improve the code style according to warnings from code check 2024-12-26 09:24:22 +08:00
NaturalSelect
5365949f7c feat(master): support config decommission settings 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
04ac20e2cb fix(master): calculating the decommission progress of the disk includes ignoring dps. 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
shuqiang-zheng
f8c677a041 fix(security): slice memory allocation with excessive size value. 
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2024-08-09 19:04:31 +08:00
chihe
47a7a6dfa4 feat(master):recover replica deleted by raftForce 
Signed-off-by: chihe <chihe@oppo.com>
 2024-07-22 17:10:59 +08:00
chihe
e9804d0043 feature(datanode): do not remove root dir for dp deleted by raftForce with auto decommmission mode 
Signed-off-by: chihe <chihe@oppo.com>
 2024-07-22 17:10:59 +08:00
NaturalSelect
bc5dd77fbd feat(master): support set dp heartbeat timeout 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-22 17:10:59 +08:00
NaturalSelect
6aca325797 feat(master): feat support vol level dp meta repair 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-22 17:10:59 +08:00
NaturalSelect
414229e0b5 fix(master): update dp cache after create vol 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-22 17:10:59 +08:00
chihe
e287f3a9ce fix(master): redundant replica not participate when decommissioning mutiple replicas of dp 
Signed-off-by: chihe <chihe@oppo.com>
 2024-07-22 17:10:59 +08:00
NaturalSelect
48506bbd18 fix(data): avaliable space calculate consider decommissioned disks 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-22 17:10:59 +08:00
NaturalSelect
7a1c60eeea feat(master): support enable or disable auto dp meta repair 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-22 17:10:59 +08:00
NaturalSelect
d68b68a2a2 fix(master): support config dp repiar timeout 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-22 17:10:59 +08:00
NaturalSelect
cf772279a7 feat(master): nodeset info return can alloc metanode/datanode cnt 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-22 17:10:59 +08:00
W9068822
24618be53c fix(cli): fix DataNodeMigrate, @formatter:off 
Signed-off-by: W9068822 <v-lijianrong1@oppo.com>
 2024-07-18 16:57:38 +08:00
W9068822
bf336dc34d feat(master): add getAllDataNodes and getAllMetaNodes apis 
Signed-off-by: W9068822 <v-lijianrong1@oppo.com>
 2024-07-18 16:57:38 +08:00
NaturalSelect
c19b690d1d feat(master): support reset dp restore status 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-18 16:57:38 +08:00
NaturalSelect
4acdeca1fd feat(master): return can alloc partition when query node info 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-18 16:57:38 +08:00
Victor1319
4df91ebc6e refactor(all): reslove merge conflicts between 3.3.x and 3.4.0. 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-07-18 16:57:38 +08:00
leonrayang
a9b3d54028 feat(master): Volume update enable crossZone 
Signed-off-by: leonrayang <changliang@oppo.com>
 2024-07-18 16:57:38 +08:00
NaturalSelect
ec188331f0 feat(cli): support set trash interval 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-18 16:57:38 +08:00
NaturalSelect
53b269d7e5 fix(master): update decommission limit when load nodeset 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-18 16:57:38 +08:00
Victor1319
d95f005df9 fix(master): Avoid concurrent access exceptions when responding to HTTP requests with a map. 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-07-18 16:57:38 +08:00
Victor1319
c7aba207cc refactor(cli): Optimize the print output results of fileInCore. 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-07-18 16:57:38 +08:00
Victor1319
c976358bbe refactor(cli): remove pasue flag in transaction flag hint. 
Signed-off-by: Victor1319 <834863182@qq.com>
 2024-07-18 16:57:38 +08:00
Victor1319
ee9aba1f3a fix(master&client&cli): Add a new variable EnableTransactionV1 to avoid compatibility issues 
Signed-off-by: Victor1319 <834863182@qq.com>
 2024-07-18 16:57:38 +08:00
NaturalSelect
7c08fedcd8 feat(master): add forbid vol feature 
Signed-off-by: NaturalSelect <2145973003@qq.com>
 2024-07-18 16:57:38 +08:00
NaturalSelect
625a7a3d62 feat(master): enable audit log by default 
NOTE: Please be careful when cherry-picking this commit.

Signed-off-by: NaturalSelect <2145973003@qq.com>
 2024-07-18 16:57:38 +08:00
shuqiang-zheng
68cf97ab68 fix(master):fix the problem of TestCreateColdVol 
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2024-07-18 16:57:38 +08:00
NaturalSelect
3b2a91bdf6 fix(cli): fix ui error occured by cherry-pick 
Signed-off-by: NaturalSelect <2145973003@qq.com>
 2024-07-18 16:57:38 +08:00
NaturalSelect
d201f99c04 feat(master): support set decommission disk limit 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-18 16:57:38 +08:00
shuqiang-zheng
eed62c913f enhance(log): Modify the threshold triggering log to logLeftSpaceLimitRatio of the total disk space 
@formatter:off

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2024-07-18 16:57:38 +08:00
chihe
7a6febec4b feat(cli): add decommissioned disks info for datanode node info display 
Signed-off-by: chihe <chihe@oppo.com>
 2024-07-05 17:05:43 +08:00
chihe
65ee50a40a fix(cli): cli can display dps encountering IO errors during loading 
Signed-off-by: chihe <chihe@oppo.com>
 2024-07-05 17:05:43 +08:00
NaturalSelect
fdec047ee4 feat(master): support abort disk decommission 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-05 17:05:43 +08:00
NaturalSelect
0a158c3e96 feat(master): support query decommission failed disks 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-05 17:05:43 +08:00
NaturalSelect
3b03341425 feat(master): support max mp cnt limit 
@formatter:off

Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-05 17:05:43 +08:00
NaturalSelect
14ce5dc2cd test(master): fix unit tests 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-05 17:05:43 +08:00
W9068822
470967aae4 feat(ci): fix format failed. 
Signed-off-by: W9068822 <v-lijianrong1@oppo.com>
 2024-07-05 17:05:43 +08:00
chihe
f704f3fdac feat(cli): add report for disk error dp replica for cli 
Signed-off-by: chihe <chihe@oppo.com>
 2024-07-05 17:05:43 +08:00
NaturalSelect
96ed7fd818 fix(master): persist decommission error message 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-02 16:35:56 +08:00
NaturalSelect
7329d1f1e8 feat(master): check datapartition status when set dp discard 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-02 16:35:56 +08:00
NaturalSelect
9ca77ba7aa feat(master): if dp is discard, decommission will success directly 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-02 16:35:56 +08:00
NaturalSelect
18e83cd45d fix(cli): foramt decommission dp info 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-02 16:35:56 +08:00
NaturalSelect
610e6bd457 feat(master): support auto decommission disk and config 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-02 16:35:56 +08:00
NaturalSelect
38bd1924e0 fix(cli): datapartition query-progress 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-02 16:35:56 +08:00
S9054862
8ad316ecfc feat(data): repair block size support master config 
Signed-off-by: S9054862 <huangzhibin1@oppo.com>
 2024-07-01 15:09:55 +08:00
leonrayang
4ee2208263 feat(master): Optimize logic of uid calculate for better performance 
1.use channel to instead of lock and isolate with main heartbeat routine
2.calculate in an aysnchoronus way periodically instead of real time
3.move heartbeat outside the goroutine, the startup of goroutine may delay the response time

Signed-off-by: leonrayang <changliang@oppo.com>
 2024-07-01 15:09:55 +08:00
slasher
5c7898354f style(all): format all codes with golangci tools 
closes #3371

@formatter:off

Signed-off-by: slasher <shenjie1@oppo.com>
 2024-05-14 09:54:13 +08:00
morphes1995
b8c26ba20f feat(cli): cfs-cli add functionality to show disk info 
Signed-off-by: morphes1995 <morphes1995@gmail.com>
 2024-04-19 14:06:35 +08:00
slasher
bdffd66650 feat(cli): auto format struct and table 
with #21965811

Signed-off-by: slasher <shenjie1@oppo.com>
 2024-03-29 14:22:29 +08:00
shuqiang-zheng
e59f07a084 feat(reconstruct): gofmt by gofumpt. 
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2024-03-28 11:43:55 +08:00
shuqiang-zheng
af739c6a3f fix(master): Fix the problem of updating a cold volume when cachecap and replicaNum is all 0. 
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2024-03-28 11:43:55 +08:00
shuqiang-zheng
42fa6628f4 enhance(cli): Modifying Volume Deletion Related Error Messages. 
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2024-03-28 11:43:55 +08:00
shuqiang-zheng
6d0de0df25 fix(master): Fixed the problem that delayed deleted volumes do not support migration. 
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2024-03-28 11:43:55 +08:00
shuqiang-zheng
452d2a3239 enhance(cli): Dynamically configure volDeletionDelayTime through the interface. 
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2024-03-28 11:43:55 +08:00
shuqiang-zheng
325694a4f7 enhance(cli): Add query interface to show the current delayed deletion time of the volume. 
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2024-03-28 11:43:55 +08:00
shuqiang-zheng
9c5185e9be feat(master): Freeze the volume when performing volume deletion. 
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2024-03-28 11:43:55 +08:00