Commit Graph

53 Commits

Author SHA1 Message Date
zhumingze
12895d975f feat(meta): Add readDir iops limiter. #1000187434
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-11 17:21:16 +08:00
leonrayang
901614ae0b feat(metanode): Add interface of reloadMp to enable online reload metapartition #1000171136
Signed-off-by: leonrayang <changliang@oppo.com>
2025-08-11 17:21:14 +08:00
zhumingze
8986320af9 feat(mastermeta): support set fileStats thresholds. #1000047869
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-08 14:59:26 +08:00
zhumingze
4e54422a61 feat(meta): support volume file statistics. #1000047865
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-08 14:59:26 +08:00
shuqiang-zheng
57fefaa661 feat(meta): perform security checks when configuring gogc, set upper and lower limits.
close:#1000011090

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-08 14:42:25 +08:00
shuqiang-zheng
501dc61922 feat(meta): Support for dynamic adjustment of gogc.
close:#1000011090

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-08 14:42:25 +08:00
Wu Huocheng
45afc5aee0 fix(raft): use raftfsm.replicas instead of get peers.@formatter:off
Signed-off-by: Wu Huocheng <wuhuocheng@oppo.com>
2025-08-07 16:00:26 +08:00
Wu Huocheng
ed61daa568 feat(raft): display raft peers.@formatter:off
Signed-off-by: Wu Huocheng <wuhuocheng@oppo.com>
2025-08-07 16:00:26 +08:00
Victor1319
8bb1131500 refactor(all): refactor go code with golint. #22906448
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
ba48924d95 refactor(master): remove useless code. #22890822
eliminate security vulnerabilities in the code.

Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
0c09436c98 fix(metanode): remove invalid filed for repsonese of getInode
close:#22768285

Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
6e06157948 feat(metalcnode): meta API OpMetaUpdateExtentKeyAfterMigration replies err details to lcNode
lcNode will print it to audit log
	#22327519
	#22385058
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
NaturalSelect
3b9ef65dbe chore(all): format code
@formatter:off

Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
309d89f1a3 fix(meta): hybrid cloud check err when invoking (*Inode).UnmarshalInodeValue
close:#22112817
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
b701abdf6a fix(meta): if inode is dir, not allowed to set migrate extents in UpdateExtentKeyAfterMigration
close:#22076233
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
7af36c991a fix(meta): if the storageClass of inode is the same as requested storageClass then return err.
close:#22067659
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
5baafaef59 feat(meta): hybrid cloud provide an API to modify inode's ctime, for debug/test purpose.
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
505015cd17 refactor(metanode): hybrid cloud add api for get full inode infomation include eks
Signed-off-by: chihe <chi.he@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
fd428b4706 refactor(master): fix confilcts when pick 3.4.0. #22906448
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
46157d2c06 refactor(all): resolve conflict when pick commit from 3.3.2 to 3.4.0.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
a305b32b9c feat(master): cli support setting for persistting accessTime
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
a487a828b4 feat(master): api for enable/disbale persist for accesstime
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
e92c00b752 feat(metanode): persist accesstime by raft
Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
4df91ebc6e refactor(all): reslove merge conflicts between 3.3.x and 3.4.0.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-07-18 16:57:38 +08:00
slasher
59538d3a98 feat(common): apply http argument parser in nodes
. #22032841 of #22032813

Signed-off-by: slasher <shenjie1@oppo.com>
2024-05-24 10:43:02 +08:00
slasher
5c7898354f style(all): format all codes with golangci tools
closes #3371

@formatter:off

Signed-off-by: slasher <shenjie1@oppo.com>
2024-05-14 09:54:13 +08:00
slasher
1d84f74acd chore(format): format all code with gofumpt
Signed-off-by: slasher <shenjie1@oppo.com>
2024-01-12 14:21:16 +08:00
leonrayang
f58e5d1e45 fix(metanode): The deleted versions in the dentry list have not been cleaned up
reconstruct dentry snapshot deletion process for better readable

Signed-off-by: leonrayang <chl696@sina.com>
2023-12-15 10:56:58 +08:00
tangzhixiang
7fa0b29a61 feat(metanode): add func to get mp leader term
Signed-off-by: tangzhixiang <tangzhixiang@oppo.com>
2023-08-30 20:05:32 +08:00
leonrayang
2e3321ab4a enhance: check client version by reuse packect's field ExtentType and set MultiVersionFlag
Signed-off-by: leonrayang <chl696@sina.com>
2023-08-30 20:05:32 +08:00
leonrayang
8efae62da3 Update: enhance snapshot on tiny extent and split senarios. etc...
.write on exist extent normally happened and create a new extent to write. but for snapshot scenarios extent be split
and the last extent to append write directly may occur conflict because the position may have the splited extent and effective,
thus we need make a additional jugement for GetEndForAppendW, if split happend then not reuse the extent.
update: add space log for datanode

.Snapshot mod append on tiny extent should use replay extent that may be new

.origin design use the end of old tiny extent id while modAppend, but that process not use get and put ways,
and it's not safe if parrelle. still can be hanged if parrellel already use the tiny extent id

.update tiny modAppend process from modAppend to tinyAppendWrite
.tiny write directly need with follower addrs or else repair later but read may not get it
.inode ek be truncated considered as split 2) code optimizition on createLowerVersion

.extent key be splited and be dropped through extDelCh and freelist, multi ext key belong to one extent
the eks before the last one should just the make a hole on the extent,but the last one should delete the whole extent.

Signed-off-by: leonrayang <chl696@sina.com>
2023-08-30 20:05:32 +08:00
leonrayang
2f519ff21d enhance: protect verlist info metanode,decommission support snapshot,enhance 2phase version create
1)reconstruct and clean code
2)fix bugs....

Signed-off-by: leonrayang <chl696@sina.com>
2023-08-30 20:05:32 +08:00
leonrayang
4d81c6693c update: snapshot deletion and build test env
. inode 0 snapshot deletion and top layer deletion
. extentlist get inode don't need verion
. snapshot tools clean support 0 deletion
. update: build metanode basic test env

Signed-off-by: leonrayang <chl696@sina.com>
2023-08-30 20:05:32 +08:00
leonrayang
5ae500768b feature: support multi version snapshot
Signed-off-by: leonrayang <chl696@sina.com>
2023-08-30 20:05:32 +08:00
Victor1319
e57f941ee1 refactor(meta): refactor getTxInfo handler print msg
Signed-off-by: Victor1319 <834863182@qq.com>
2023-08-09 14:01:52 +08:00
Victor1319
273b40ab53 feat(master & client & meta): enhance ongoning tx monitor
1. support get tx, rbIno, rbDenry cnt for mp & vol
2. support lookup all tx info for mp

Signed-off-by: Victor1319 <834863182@qq.com>
2023-08-09 14:01:52 +08:00
leonrayang
6f24ccd4d8 feat(transaction): add get tx info handle to metanode
Signed-off-by: leonrayang <chl696@sina.com>
2023-07-20 10:58:50 +08:00
liubingxing
7f730944a2 enhance(fsck): add commands to obtain the inode's fullpath and summary information
Signed-off-by: liubingxing <liubbingxing@gmail.com>
2023-06-06 16:09:44 +08:00
tangzhixiang
ed5f52ad1a feat(metanode): add get leader meta partitions api
Signed-off-by: tangzhixiang <tangzhixiang@oppo.com>
2023-05-18 10:48:57 +08:00
liubingxing
853bcda665 Feature: add ClusterUUID for mn/dn to identify a cluster upon restart
Signed-off-by: liubingxing <liubbingxing@gmail.com>
2023-05-05 11:23:50 +08:00
Tao Li
9e50fbce05 Enhancement: Add more info for mp to facilitate trace
Signed-off-by: Tao Li <tomscut@apache.org>
2022-11-27 13:27:41 +08:00
leonrayang
9a30b9f884 update: update to CubeFS
Signed-off-by: leonrayang <chl696@sina.com>
2022-08-22 18:16:09 +08:00
Victor1319
b38c3f6b5d feature: support ebs index
1. support ebs index
2. obsolete index

Signed-off-by: Victor1319 <834863182@qq.com>
2022-04-13 15:57:55 +08:00
leonrayang
2970e2c3d1 update. go import path change from chubaofs to cubefs
Signed-off-by: leonrayang <chl696@sina.com>
2022-01-25 18:17:02 +08:00
Victor1319
3b87e6998f enhance: add getRaftStatus for metanode
Signed-off-by: Victor1319 <834863182@qq.com>
2021-12-10 17:49:45 +08:00
jadewang198510
7c50ad9b66 feat: metaNode smux support
Signed-off-by: jadewang198510 <741773046@qq.com>
Signed-off-by: mingwei <gongwilliam@163.com>
2021-04-02 16:53:55 +08:00
awzhgw
cf7fbde1f5
Revert "Sync from release-20200720" 2020-11-11 14:23:59 +08:00
awzhgw
b230b7107d Sync changes from release-20200720 branch.
Signed-off-by: awzhgw <guowl18702995996@gmail.com>
Signed-off-by: xuxihao1 <xuxihao3@jd.com>
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
2020-11-09 16:03:42 +08:00
zhuzhengyi1
beeb27cc2d Enhancement: add metanode set/get deleteBatchCount http api
Signed-off-by: zhuzhengyi1 <zhuzhengyi@jd.com>
2020-06-03 12:26:53 +08:00
Mofei Zhang
d609fedb5c feature: object storage interface
Add ObjectNode provides S3-compatibile APIs.
Fusion Storage interface expose two interface (POSIX and S3-compatible) for file operation.

Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
2019-12-17 17:36:53 +08:00