gian/cubefs
1
0
Fork 0
mirror of https://github.com/cubefs/cubefs.git synced 2026-08-02 02:00:56 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
3,492 Commits 48 Branches 52 Tags 378 MiB
1d84f74acd
Commit Graph

66 Commits

Author SHA1 Message Date
slasher
1d84f74acd chore(format): format all code with gofumpt 
Signed-off-by: slasher <shenjie1@oppo.com>
 2024-01-12 14:21:16 +08:00
jax
f8f7a70f69 fix [Feature]: Support delete volume only when dentry count is zero. 
if volForceDeletion param set to true, volume can be deleted directly.
otherwise, volumes can be deleted only if it's latest dentry count is less than or equal to the volDeletionDentryThreshold

Signed-off-by: jax <jax.jiang@openpie.com>
 2023-11-07 16:30:18 +08:00
xuruida
022da12d51 fix(master): close fsm.raftstore before closing rocksdb when master shutdown 
Signed-off-by: xuruida <xuruida@oppo.com>
 2023-10-23 20:02:44 +08:00
NaturalSelect
273e2ead2d fix(master): close rocksdb when master shutdown 
Signed-off-by: NaturalSelect <2145973003@qq.com>
 2023-09-15 14:56:03 +08:00
Patrick Wu
29e3110a93 S3 lifecycle 
Signed-off-by: Patrick Wu <wuchunhuan@gmail.com>
 2023-08-30 20:05:32 +08:00
setcy
d42621f7a7 feat: support the master to uniformly configure the push gateway address of the data reported by the client 
Signed-off-by: setcy <2670061551@qq.com>
 2023-08-30 20:05:32 +08:00
M1eyu2018
65ec21d1a6 [Enhancement] add authentication for master admin api 
Signed-off-by: M1eyu2018 <857037797@qq.com>
 2023-08-24 16:05:12 +08:00
Victor1319
7e03ff254a feat(master): add switch to control whether enable automatic create partition. 
Signed-off-by: Victor1319 <834863182@qq.com>

Closes #2411

Signed-off-by: Victor1319 <834863182@qq.com>
 2023-08-09 14:01:52 +08:00
Victor1319
67bba62544 refactor(master & authnode): split package rocksdb from raftstore to avoid import by other. 
Signed-off-by: Victor1319 <834863182@qq.com>
 2023-08-09 14:01:52 +08:00
true1064
fff2c7808f feat(master): meta partition no leader report use a separate configuration from data partition no leader 
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2023-06-16 17:42:02 +08:00
baijiaruo
e0375721cb enhance: 1.the number of quotas is configurable 
2.delete the quota using the path
         3.added listAll interface to query which volumes are configured with quotas

Signed-off-by: baijiaruo <huyao2@oppo.com>
 2023-05-26 11:17:10 +08:00
Patrick Wu
b82eba2e32 fix: master metrics bug fix 
Signed-off-by: Patrick Wu <wuchunhuan@oppo.com>
 2023-05-18 10:48:57 +08:00
baijiaruo
d6fdaa6ed6 bugfix: Fix the problem that metaPartitionInodeIdStep is 0 when read from cluster info after upgrading, and remove the process of reading configuration file at the same time 
Signed-off-by: baijiaruo <huyao2@oppo.com>
 2023-05-18 10:48:57 +08:00
baijiaruo
279ce7b7e8 Enhancement: add mp step size configuration and dynamic adjustment 
Signed-off-by: baijiaruo <baijiaruo@126.com>

Conflicts:
	master/api_service.go
	master/config.go
	proto/admin_proto.go
 2023-05-18 10:48:57 +08:00
NaturalSelect
9cdf533851 feat(master): support setting max cnt of dp 
close: #1897

Signed-off-by: NaturalSelect <2145973003@qq.com>
 2023-05-09 09:45:05 +08:00
Victor1319
e1ac90fba8 fix(master,meta,data): add switch to control whether use target ip when start service 
Closes #1826

Signed-off-by: Victor1319 <834863182@qq.com>
 2023-03-20 16:47:27 +08:00
Victor1319
bd43586347 tool: support start cubefs cluster by shell in one node 
Signed-off-by: Victor1319 <834863182@qq.com>
 2023-03-06 11:39:42 +08:00
Victor1319
abe516dbfc enhance: support to bind target ip when start start service 
Signed-off-by: Victor1319 <834863182@qq.com>
 2023-03-06 11:39:42 +08:00
Victor1319
09c4c1701f enhance: modify volume name illegal err info #1472 
Signed-off-by: Victor1319 <834863182@qq.com>
 2023-03-04 16:13:35 +08:00
Patrick Wu
e3f64d0cc5 fix: load api limiter config on start 
Signed-off-by: Patrick Wu <wuchunhuan@oppo.com>
 2023-03-04 16:13:35 +08:00
Patrick Wu
4565dcb6d6 enhance: add feature of setting api limiter on master, and add statistics for api invoking 
Signed-off-by: Patrick Wu <wuchunhuan@oppo.com>
 2023-03-04 16:13:35 +08:00
Patrick Wu
e8477b87c3 enhance: master metrics optimization 
Signed-off-by: Patrick Wu <wuchunhuan@oppo.com>
 2023-03-04 16:13:35 +08:00
baijiaruo
26e2aed3ff master: delete some unused variables 
Signed-off-by: baijiaruo <baijiaruo@126.com>
 2022-10-28 11:04:33 +08:00
true1064
e2b2241d31 enhance: Optimize raft health monitoring policies. 
Signed-off-by: true1064 <true1063@163.com>
 2022-10-10 14:33:16 +08:00
leonrayang
9a30b9f884 update: update to CubeFS 
Signed-off-by: leonrayang <chl696@sina.com>
 2022-08-22 18:16:09 +08:00
leonrayang
77509b3f77 update: go fmt 
Signed-off-by: leonrayang <chl696@sina.com>
 2022-08-19 15:05:33 +08:00
leonrayang
f93fbe3664 update: update config and code filed from ebsAddr to blobstore 
Signed-off-by: leonrayang <chl696@sina.com>
 2022-08-19 15:05:33 +08:00
Victor1319
88b2c38587 feature: limit dp cnt in one data node 
Signed-off-by: Victor1319 <834863182@qq.com>
 2022-07-14 15:38:34 +08:00
leonrayang
7ec2b73e96 add feature: support one replica of data storage 
notice:single replica cann't support write during migration but can support read

master
1) enable singal replica migration with method add new replica first and del later
2) add interface to cacel zombile decommission task
3) enable datapartition with single replica startup with inconsistent dp info with master caused by disk error or inormal

raft
1) add log. raft output log info details if recive reject from follower
2) fix. raft snapshot still running while peer remove happened which lead to the snapshot gorutine cann't end.
3) snapshot concurrent count has define limit 10, that's means much more snapshot will be hang if 10 exception happens
4) raft status must be include to cal data partition status

Signed-off-by: leonrayang <chl696@sina.com>
 2022-04-13 15:57:55 +08:00
Victor1319
e7317a01b2 feature: support mulit volume type 
1. low frequency access type volume support
 2. volume high and low frequency datapartition offline
 3. out scale of low frequncey volume
 4. recycle dataparition
 5. support different type dp in a volume

Signed-off-by: Victor1319 <834863182@qq.com>
 2022-04-13 15:57:55 +08:00
leonrayang
2970e2c3d1 update. go import path change from chubaofs to cubefs 
Signed-off-by: leonrayang <chl696@sina.com>
 2022-01-25 18:17:02 +08:00
leonrayang
ee298ee369 enhance.reduce flow from interface of "client/partiton" that follower support it and will not redirect to leader 
for some interface client need read from leader directly in some scenorio that info may not fresh as leader
    ignore dp info which not used from interface client/vol
    client need read client/partition from all masters randomly

Signed-off-by: leonrayang <chl696@sina.com>
 2021-11-26 19:36:23 +08:00
leonrayang
d6094fee2b 1) fix bug.cfgDomainBuildAsPossible use wrong key 2)reduce domain info output 
Signed-off-by: leonrayang <chl696@sina.com>
 2021-07-14 16:40:19 +08:00
leonrayang
142135fe44 1) add feature.add faultDomainBuildAsPossible. default not create domain with less than faultDomainGrpBatchCnt zones 
2) enhance.update undomain zones data use limit to to 0.90
3) enhance.change domain related interface
4) fix bug.zone allocate algorithm of undomain cross zone revert to old ways
5) fix bug.parition allocation should choose different host with domain use specific policy when zone unavaliable

Signed-off-by: leonrayang <chl696@sina.com>
 2021-07-14 16:40:19 +08:00
leonrayang
9f8ac01416 Add feature domain for cross zone 
Signed-off-by: leonrayang <chl696@sina.com>
 2021-07-14 16:40:19 +08:00
mingwei
29aec5c70f feat: the receive buffer channel size of raft support to be configurable 
Signed-off-by: mingwei <gongwilliam@163.com>
 2021-07-05 18:47:38 +08:00
awzhgw
cf7fbde1f5
Revert "Sync from release-20200720" 2020-11-11 14:23:59 +08:00
awzhgw
b230b7107d Sync changes from release-20200720 branch. 
Signed-off-by: awzhgw <guowl18702995996@gmail.com>
Signed-off-by: xuxihao1 <xuxihao3@jd.com>
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
 2020-11-09 16:03:42 +08:00
Victor1319
53a8447aeb use log to replace fmt.println 
Signed-off-by: Victor1319 <834863182@qq.com>
 2020-10-14 11:25:51 +08:00
Victor1319
d62e311f19 fix: set output from fmt to log for server run in daemon 
Signed-off-by: Victor1319 <834863182@qq.com>
 2020-10-14 11:25:51 +08:00
zhuzhengyi1
cd06ba922c Update: add exporter InitWithRouter for prometheus init with http router 
Signed-off-by: zhuzhengyi1 <zhuzhengyi@jd.com>
 2020-05-07 13:42:52 +08:00
wenjia322
4d2a20e5f9 feature: add master and cli api 'updateUser' 
Signed-off-by: wenjia322 <buaa1214wwj@126.com>
 2020-03-24 14:35:34 +08:00
wenjia322
721248d444 enhancement: create super admin automatically; can't delete super admin 
Signed-off-by: wenjia322 <buaa1214wwj@126.com>
 2020-03-13 12:23:50 +08:00
wenjia322
82851081de refactor: []string'AKAndActions' -> map'AKAndActions'; delete relations in volAKs when delete user 
Signed-off-by: wenjia322 <buaa1214wwj@126.com>
 2020-03-11 21:43:17 +08:00
Mervin
5db80feeee Refactor: http api route in master 
Signed-off-by: Mervin <mofei2816@gmail.com>
 2020-03-11 09:47:41 +08:00
wenjia322
d373da69f8 fix: remove create super admin automatically 
Signed-off-by: wenjia322 <buaa1214wwj@126.com>
 2020-03-10 23:01:49 +08:00
Mervin
40d01f0661
Enhancement: support dot character in volume name 
Signed-off-by: Mervin <mofei2816@gmail.com>
 2020-03-10 20:33:14 +08:00
wenjia322
23befdf313 feature: add filed 'UserType' in struct 'AKPolicy' 
Signed-off-by: wenjia322 <buaa1214wwj@126.com>
 2020-03-10 18:09:01 +08:00
Mervin
3a2df30f36
Merge branch 'master' into object-store 
Signed-off-by: Mervin <mofei2816@gmail.com>
 2020-03-09 13:19:05 +08:00
zhuhyc
b1846813f7 feature: Multi-Zone Replication 
Signed-off-by: zhuhyc <zzhniy.163.niy@163.com>
 2020-03-08 22:09:48 +08:00