Commit Graph

310 Commits

Author SHA1 Message Date
morphes1995
ab398d669d fix(master): RaftPartitionCanUsingDifferentPort make effective after and all dn/mn upgraded
Signed-off-by: morphes1995 <morphes1995@gmail.com>
2024-12-31 17:36:32 +08:00
morphes1995
00a3ee193f fix(master): fix port inconsistent when create dp/mp during upgrading process
Signed-off-by: morphes1995 <morphes1995@gmail.com>
2024-12-31 17:36:32 +08:00
morphes1995
f4c7755316 feat(metanode): support multi metanode process using different port on single node
Signed-off-by: morphes1995 <morphes1995@gmail.com>
2024-12-31 17:36:32 +08:00
morphes1995
b23df49eca feat(datanode): support multi datanode process using different port on single node
Signed-off-by: morphes1995 <morphes1995@gmail.com>
2024-12-31 17:36:32 +08:00
Victor1319
8bb1131500 refactor(all): refactor go code with golint. #22906448
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
0c406f55d9 refactor(master): resolve conflicts when picking to master branch. #22906448
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
dac1a12d0a refactor(master): resolve conflicts when picking to master branch. #22906448
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
67d5dab1db fix(master): ignore abnormal dp when addVolStorageClass. #22908260
enable to skip check mp & dp forbidden status.

Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
zhumingze
edaf7b6f93 feat(cli): support cli to view inode detail information by inode id. #22867405
Signed-off-by: zhumingze <zhumingze@oppo.com>
2024-12-26 09:24:22 +08:00
zhumingze
eec42fcec6 feat(cli): support cli to display vol used size based on dp media type #22853006
Signed-off-by: zhumingze <zhumingze@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
3a8f5eb3f8 feat(master): support query all client ip from master. #22834669
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
ced8ca0978 feat(masterdata): add config to control whether vol read direct disk. #22818122
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
644508479e feat(metasdkmaster): support read quoram when mp no leader. #22782472
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
447fcc1d61 fix(master): support meta follower read. #22782680
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Reliey
ddfc4c29b8 feat(master): add http interface getOpLog for data processing #22257509
Signed-off-by: Reliey <zhumingze@oppo.com>
2024-12-26 09:24:22 +08:00
Reliey
5f3c6e2d4a feat(cli): support reporting and viewing of cluster and vol dimension disk data #22257509
Signed-off-by: Reliey <zhumingze@oppo.com>
2024-12-26 09:24:22 +08:00
Reliey
3986329ed7 feat(mastercli): support datanode report dpOpLog and diskOpLog infomation. #22257509
Signed-off-by: Reliey <zhumingze@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
bcf36ab04f fix(metanode): modify log level for fsmInternalBatchFreeMigrationExtentKey
close:#22757889

Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
0eecc1fd85 fix(cli): fix some tiny issues. #22727537
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
abc2ab5912 refactor(master): support double check master media cfg type. #22727537
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
9f5fbba63b refactor(master): refactor variable name from cap to quota. #22731703
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
ce3439d199 feat(master): support replica storage quota limit.#22731703
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
168fa0418c feat(mastermeta): add LegacyDataMediaType in master cluster values, and metaNode fetch it from master.
close:#22716686
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
d59f4e0b84 fix(cli): if create replica volume and replica-num is assigned 1 or 2, set follower-read as true
close:#22701504
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
883b15189d feat(metamastercli): hybrid cloud migration data usage statistics.
close:#22658297
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
f25aa0734d feat(master): not allow a volume supports both replica storageClass and blobstore
close:#22395995
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
9f7ffeb194 feat(masterdatameta): support volume to forbidden write operate codes of lower packet protocol version
close#22531837

Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
a43f96d403 feat(dataclientmaster): support configuring datanode and metanode to forbidden
write operate codes of lower packet protocol version.
       	 close#22531837
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
037df5f5f9 fix(sdkclient): client compatible with older version server modules
#22400600
	@formatter:off
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
daf4dd9d51 fix(lcNode): hybrid cloud set followerRead as false when create ExtentClient
#22481972
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
57c8f26829 refactor(cli): hybrid cloud add storageClass tips in help messages
#22395995
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
af298477f3 fix(master): check if volume's zoneName list has the resource when add allowed storageClass
#22395995
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
e2e9943f47 feat(cli): while creating volume, auto set crossZone as true if assigned more than one zone.
#22376966

Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
be1e6ba732 feat(master): hybrid cloud support assigning mediaType when manually create datapartiton.
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
NaturalSelect
7a63703de6 feat(master): hybrid cloud support query cluster storage class info
close: #22310366
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-12-26 09:24:22 +08:00
NaturalSelect
f029d45f6a feat(cli): hybrid cloud support query vol hybrid storage info
close: #22304812 #22304800
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
0ec2d1c2b6 fix(cli): hybrid cloud show if the node is set as read-only when get node information
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
0173aa7e48 fix(master): hybrid cloud fix test cases of creating datapartitions
#22196488
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
3561f231ba fix(cli): fix the display of the 'metapartition check' command of the cfs-cli tool
clsoe:#22152841

Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
309d89f1a3 fix(meta): hybrid cloud check err when invoking (*Inode).UnmarshalInodeValue
close:#22112817
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
698311248a fix(master): hybrid cloud set ebsblockSize when add blobStore to volume's allowedStorageClass
Signed-off-by: true1064 <true1063@163.com>
2024-12-26 09:24:22 +08:00
true1064
4173cc9f4d fix(master): hybrid cloud When updating a volume, ebsBlockSize can be modified if allowedStorageClass contains blobstore.
Signed-off-by: true1064 <true1063@163.com>
2024-12-26 09:24:22 +08:00
true1064
3de7e847a9 feat(master): handle compatibility of master when older version upgrade to hybrid cloud:
(1) auto set mediaType of datanode, zone, datapartiton by config legacy "legacyDataMediaType" and persist;
	(2) auto set storageClass of volume by config legacy "legacyDataMediaType" and persist;
	(3) if need to rollback master to older version, need to do nothing, just replace to old master and restart. because hybrid cloud master only add new fields to meta by not changed old fields.

Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
35ed550795 feat(master): hybrid cloud forbidden AdminCreateVersion API because hybrid cloud not support snapshot version yet
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
9d2bf3b483 feat(mastercli): add API to add storageClass to volume's allowedStorageClass list
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
5936cdfe8d fix(master): amend some logs
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
443199e0b0 fix(client): hybrid cloud only clear dp when volume storage class is blobstore
Signed-off-by: chihe <chi.he@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
f04993070b fix(master): some fix about datapartition creation
(1) while creating dp in vol creation, check dp count by mediaType to judge if success.
	(2) when background periodical check if need to create dp, skip volumes whose createTime is too recently, to avoid background create dp while volume is creating.
	(3) display mediaType of dp in cfs-cli cmd "volume info -d"

Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
51554785e3 fix(master): hybrid cloud not set zoneName as default value if not assigned in the create vol request.
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
7a7b663b6c feat(mastercli): hybrid cloud vol.volStorageClass can be changed by "cfs-cli volume update"
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00