gian/cubefs
1
0
Fork 0
mirror of https://github.com/cubefs/cubefs.git synced 2026-08-02 02:00:56 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
4,362 Commits 48 Branches 52 Tags 378 MiB
4815a61444
Commit Graph

4362 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
chihe
4815a61444 fix(client): hybrid cloud fix bug about checking media type of dp 
Signed-off-by: chihe <chi.he@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
3373c73b4f fix(master): ybrid cloud not use var pointer dataNode if not got it from cluster, to avoid panic 
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
7a7b663b6c feat(mastercli): hybrid cloud vol.volStorageClass can be changed by "cfs-cli volume update" 
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
347208f189 refactor(clientmetanode): hybrid cloud check inode/vol storage class when checking vol type 
Signed-off-by: chihe <chi.he@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
1f9dab0eda feat(masterclientpreload): add property CacheDpStorageClass to volume. 
CacheDpStorageClass is used to inform SDK which storageClass to use when access cache dp.

Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
92d1d54832 feat(master): volume supports multi mediaType based on the refactored codes from v3.4.0 
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
14d7e0e19c feat(masterclientcli): hybrid cloud add property mediaType to datapartition 
(1)master: when creating vol, master creates dps of each mediaType according to vol.allowedStorageClass
	(2)client: when select dp to do append write, choose dp with spcific mediaType according to inode's storageClass

Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
6cafecdb7d feat(masterclientcli): add property volStorageClass and allowedStorageClass to volume 
now volType is not uesed while creating volume, but is maintained for compability

Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
3081a30168 feat(master): hybrid cloud add mediaType property to zone 
(1) zone mediaType is set as the first add-in datanode's mediaType
	(2) once zone mediaType is set, all datanodes in the zone must be the same mediaType.
	(3) the cmd 'cfs-cli zone info' shows zone mediaType.

Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
029d1b359e feat(clientmetanode): hybrid cloud support change inode storageclass when updating ek 
Signed-off-by: chihe <chi.he@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
7a915e87e0 feat(client): hybrid cloud supports the option to choose SSD or HDD data partition 
Signed-off-by: chihe <chi.he@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
e1442f7de1 feat(clientmetanode): hybrid cloud support renewal inode forbidden migration 
Signed-off-by: chihe <chi.he@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
7211b09cd6 feat(meta): hybrid cloud inode supprot hybrid-clound 
2.client read/write support hybrid-clound

Signed-off-by: chihe <chi.he@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
f70b3cfe38 feat(masterdatacli): hybrid cloud add datanode's mediaType 
for module master and datanode; the cmd 'cfs-cli datanode info' can show datanode's mediaType

Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
fd428b4706 refactor(master): fix confilcts when pick 3.4.0. #22906448 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
dee812aded fix(master): canAllocDp compatible with 3.4.0 before 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
bff1bbca48 fix(metanode): inodeOnce marshall compatible with meta 3.3.2 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
baihailong
1d196732dc fix(client): enableBcache is invalid even if it was specified. 
Signed-off-by: baihailong <baihailong@oppo.com>
 2024-12-26 09:24:22 +08:00
leonrayang
9c6438e631 feat(metanode): optimize quota infomation storage to reduce usage of memory 
Signed-off-by: leonrayang <chl696@sina.com>
 2024-12-26 09:24:22 +08:00
leonrayang
65cb8077e4 feat(metanode): optimize memory usage of metanode for multi snapshit 
Signed-off-by: leonrayang <chl696@sina.com>
 2024-12-26 09:24:22 +08:00
chihe
68a27c700d fix(client): goroutine for trash to build parent dir would not quit 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
1e8ffbeb73 refactor(client): if subdir is empty from cfg file, use cfg from option. 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
b57d898709 fix(doc): fix path for cfs-arch-ec.png 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
60dbc1ac30 feat(docs): update Governance related documentation 
1. Clarify the responsibilities of the TSC, maintainers, and committers.
	2. Fix the issue in security reporting as incorrect email address for reporting vulnerabilities.
	3. Clarify the governace of SIGs
	4. Add a link to the governance section in README.md for emphasis.

Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
cf07bf261d fix(master): check quotaManager for vol when executing ListQuota 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
e4ebd42ae0 fix(metanode): delete extent_del file when reach end of the file. 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
1113795e49 fix(meta): reset reserved flag when marshal inode. 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
8faf83077f fix(meta): consider snapshot ver when unmarshal extents 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
8f9035c3a1 fix(meta): inode unmarshal logic is compatible with subsequent versions. 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
bae8527daa fix(meta): check error when unmarshal inode value. 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
d858cc505b fix(metanode): do not update Accesstime when excuting getInodeTopLayer 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
c43dd5eda2 fix(metanod): if clusterEnableSnapshot is not enbale, do not apply VersionOp 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
d3912d2042 fix(datanode): check initPartitionSize when calculating progress 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
46930ab462 refactor(raft): use decimal format to print number in raft log. 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
1d79c40a29 refactor(raft): use decimal format to print number in raft log. 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
cuishuang
a9c6e74bbf fix(util): fix slice init length 
Signed-off-by: cuishuang <imcusg@gmail.com>
 2024-12-26 09:24:22 +08:00
leonrayang
7558f203ec feat(metanode): enable metanode with version 3.4.0 compatible with master 3.3.2 
Signed-off-by: leonrayang <chl696@sina.com>
 2024-12-26 09:24:22 +08:00
leonrayang
fc71116a51 fix(client): enable Datanode with version 3.3.2 compatible with client 3.4.0 
Signed-off-by: leonrayang <chl696@sina.com>
 2024-12-26 09:24:22 +08:00
leonrayang
0647717f79 fix(client): enable Client with version 3.4.0 compatible with 3.3.2 
Signed-off-by: leonrayang <chl696@sina.com>
 2024-12-26 09:24:22 +08:00
chihe
5dbd5ba05e fix(master): compatible with 3.3.2 metanode(used for memory) 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
26a1a160b4 fix(master): only check offline with old version datanode 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
852dafafd2 fix(datanode): if dpBackupTimeout is not set, then do not delete back up directories. 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
leonrayang
111f9e9903 feat(dataemeta): cluster switch on snapshot take effect on module handle protocal process 
Signed-off-by: leonrayang <chl696@sina.com>
 2024-12-26 09:24:22 +08:00
leonrayang
d4d64fb931 feat(metanode): enable rollback from 3.4.0 to 3.3.2 
1) Add protocal opFSMSentToChanWithVer, enable compatible during update version because []proto.ExtentKey has no version info
	2) Update inode marshal and unmarshal process, do not persist version 3 flag if not eable snapshot

Signed-off-by: leonrayang <chl696@sina.com>
 2024-12-26 09:24:22 +08:00
baihailong
003aa07305 fix(client): failure to mount other directories when the mount point is abnormal. 
Signed-off-by: baihailong <baihailong@oppo.com>
 2024-12-26 09:24:22 +08:00
baihailong
a3a05ee4bd fix(client): alarm the mount point has been mounted incorrectly. 
Signed-off-by: baihailong <baihailong@oppo.com>
 2024-12-26 09:24:22 +08:00
leonrayang
f761097bde fix(master): set the cluster's stop channel to nil upon receiving the signal to prevent it from running again 
Signed-off-by: leonrayang <chl696@sina.com>
 2024-12-26 09:24:22 +08:00
chihe
cd73e762e4 fix(datanode): iterating through the cache of dps and disks when stopping space manager 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
leonrayang
0be1a11ad7 fix(master): some goroutines are stateless and do not require waiting for their transfer to a stopped state 
Signed-off-by: leonrayang <chl696@sina.com>
 2024-12-26 09:24:22 +08:00
leonrayang
fc5ac71931 fix(master): enable master exit process more ellgantly 
Signed-off-by: leonrayang <chl696@sina.com>
 2024-12-26 09:24:22 +08:00