Commit Graph

268 Commits

Author SHA1 Message Date
Victor1319
fa2e7a4cdf feat(master): support report whether enable bcache for client. #22845037
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
2030e66068 fix(meta): ignore get dp partitions error when create mp. #22832968
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
baihailong
2015d02b78 fix(client): optimize bcache switch names and debug logs.#22814877
Signed-off-by: baihailong <baihailong@oppo.com>
2024-12-26 09:24:22 +08:00
baihailong
4ab0642da0 fix(sdk): enable config bcache only for clod data.#22770439
Signed-off-by: baihailong <baihailong@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
0a3f53cdfa fix(client): client data modification is prohibited if renewal failed
close:#22676203

Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
baihailong
f56ef231a1 fix(sdk): classifiy statistic file size and count for refresher tool.#22490031
Signed-off-by: baihailong <baihailong@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
9f7ffeb194 feat(masterdatameta): support volume to forbidden write operate codes of lower packet protocol version
close#22531837

Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
0d12d07d03 fix(client): to access the right storageClass when inode has migrated to blobstore
close:#22506168
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
037df5f5f9 fix(sdkclient): client compatible with older version server modules
#22400600
	@formatter:off
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
5c20dc2109 feat(client): hybrid cloud only create blobStore client when volume's storageClass is blobStore.
close #22338879
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
NaturalSelect
3b9ef65dbe chore(all): format code
@formatter:off

Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
440058e0e5 fix(client): hybrid cloud assign open flags when opening file
close:#21969712

Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
80ca15784b fix(client): hybrid cloud fix migrate check condition
close:#21969712

Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
cf4dadf5bd fix(client): hybrid cloud create ebs reader or writer when storage class is changed
close:#21969712

Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
3b5ab67dba feat(client): hybrid cloud if storage class has been changed, do not raise err when reading file
close:#21969712

Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
c642f0a29d fix(client): hybrid cloud if file is stored in ebs, do not fetch extentkey list from metanode in lookup operation
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
b6443f3b2b fix(clientmetanode): hybrid cloud remove duplicated logs for deleteMarkedInodes
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
9e688d76ae fix(metanodeclient): hybrid cloud if encountering storage class mismatch error, do not retry
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
7c185c7cf5 fix(client): hybrid cloud update file node cache if storage class had been changed
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
4173cc9f4d fix(master): hybrid cloud When updating a volume, ebsBlockSize can be modified if allowedStorageClass contains blobstore.
Signed-off-by: true1064 <true1063@163.com>
2024-12-26 09:24:22 +08:00
true1064
d9c01f0af5 fix(client): hybrid cloud Fix some places where the original condition
should be changed to "vol storageClass is blobstore".
	Adds field volStorageClass to ExtentClient for this purpose.
	Remove field volumeType from ExtentClient by the way.

Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
eb2d65002b refactor(metanode): hybrid cloud 1.Simplify the logic of updating extent key after migration
2. reset inode reserved when excute marshall operation
	3. initial ebs client in mp
	4. remove cold vol or hot vol check in client and objectnode

Signed-off-by: chihe <chi.he@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
284ca0d211 feat(metanodeclient): hybrid cloud support hybridcloud data migration
Signed-off-by: chihe <chi.he@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
443199e0b0 fix(client): hybrid cloud only clear dp when volume storage class is blobstore
Signed-off-by: chihe <chi.he@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
347208f189 refactor(clientmetanode): hybrid cloud check inode/vol storage class when checking vol type
Signed-off-by: chihe <chi.he@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
1f9dab0eda feat(masterclientpreload): add property CacheDpStorageClass to volume.
CacheDpStorageClass is used to inform SDK which storageClass to use when access cache dp.

Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
6cafecdb7d feat(masterclientcli): add property volStorageClass and allowedStorageClass to volume
now volType is not uesed while creating volume, but is maintained for compability

Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
7a915e87e0 feat(client): hybrid cloud supports the option to choose SSD or HDD data partition
Signed-off-by: chihe <chi.he@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
e1442f7de1 feat(clientmetanode): hybrid cloud support renewal inode forbidden migration
Signed-off-by: chihe <chi.he@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
7211b09cd6 feat(meta): hybrid cloud inode supprot hybrid-clound
2.client read/write support hybrid-clound

Signed-off-by: chihe <chi.he@oppo.com>
2024-12-26 09:24:22 +08:00
baihailong
1d196732dc fix(client): enableBcache is invalid even if it was specified.
Signed-off-by: baihailong <baihailong@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
1e8ffbeb73 refactor(client): if subdir is empty from cfg file, use cfg from option.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
baihailong
003aa07305 fix(client): failure to mount other directories when the mount point is abnormal.
Signed-off-by: baihailong <baihailong@oppo.com>
2024-12-26 09:24:22 +08:00
baihailong
a3a05ee4bd fix(client): alarm the mount point has been mounted incorrectly.
Signed-off-by: baihailong <baihailong@oppo.com>
2024-12-26 09:24:22 +08:00
baihailong
1a003718ee fix(client): check whether the mountpoint has been mounted when mounting.
Signed-off-by: baihailong <baihailong@oppo.com>
2024-12-26 09:24:22 +08:00
baihailong
e07aeac619 fix(fuse): if vol name not match regexp when mount, return failed immediately.
Signed-off-by: baihailong <baihailong@oppo.com>
2024-12-26 09:24:22 +08:00
baihailong
8f48f3ac85 fix(client): if vol not exists, mount return failed immediately.
Signed-off-by: baihailong <baihailong@oppo.com>
2024-12-26 09:24:22 +08:00
baihailong
21463372eb fix(client): when volume is deleted, cfs-client need to exit.
Signed-off-by: baihailong <baihailong@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
3d2137e545 refactor(client): reduce buffer chan size to reduce memory when client idle.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
0e7ab29565 refactor(client): add config to control stream op max timeout.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
2911125677 fix(datanode): check disk path for replica with master when executing attachPartition
Signed-off-by: chihe <chihe@oppo.com>
2024-07-22 17:10:59 +08:00
baihailong
89d1a533f6 fix(client): remove the wrong code in function write.
Signed-off-by: baihailong <baihailong@oppo.com>
2024-07-22 17:10:59 +08:00
baihailong
e80bdd732f fix(fuse): print goroutine info when cfs-client exiting normally.
Signed-off-by: baihailong <baihailong@oppo.com>
2024-07-22 17:10:59 +08:00
W9068822
d25840b71f feat(metrics): report version of client, metanode, datanode, authnode, lcnode, objectnode
Signed-off-by: W9068822 <v-lijianrong1@oppo.com>
2024-07-22 17:10:59 +08:00
baihailong
8459b9372b fix(fuse): report error when read size not expected.
Signed-off-by: baihailong <baihailong@oppo.com>
2024-07-22 17:10:59 +08:00
NaturalSelect
374018d88d fix(client): fix appendExtentKey extent conflict
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-07-22 17:10:59 +08:00
baihailong
3316b7ccf4 fix(client): revert reports file's metadata and data inconsistencies.
Signed-off-by: baihailong <baihailong@oppo.com>
2024-07-18 16:57:38 +08:00
baihailong
81b5f56c3b fix(fuse): when client starting, reports last exit info.
Signed-off-by: baihailong <baihailong@oppo.com>
2024-07-18 16:57:38 +08:00
Victor1319
4df91ebc6e refactor(all): reslove merge conflicts between 3.3.x and 3.4.0.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-07-18 16:57:38 +08:00
chihe
138ffa3004 fix(client): Don't remove non-empty directories when trash enable
Signed-off-by: chihe <chihe@oppo.com>
2024-07-18 16:57:38 +08:00