Commit Graph

382 Commits

Author SHA1 Message Date
wuwenjia5
df6ff2a328 feature: add authorization to master api getVol
Signed-off-by: wuwenjia5 <wuwenjia5@jd.com>
2019-12-02 22:17:20 -08:00
awzhgw
c955e66b89 Fix:if the datanode config file resverdSpace > 30GB, the resverdSpace
parameter  does not work and gofmt project

Signed-off-by: awzhgw <guowl18702995996@gmail.com>
2019-11-18 14:32:20 +08:00
jzeng04
60a4977980 Add a general Authentication & Authorization framework for chubaofs.
Signed-off-by: jzeng4 <jzeng04@gmail.com>
2019-11-18 09:51:43 +08:00
zhuhyc
c4ee0aea94 refactor: refine labels of the disk error metric
Signed-off-by: zhuhyc <zzhniy.163.niy@163.com>
2019-11-12 17:27:14 +08:00
wuwenjia5
c8b46cc021 fix: return error from function LoadConfigFile to the caller
Signed-off-by: wuwenjia5 <wuwenjia5@jd.com>
2019-11-12 17:27:14 +08:00
zhuzhengyi1
dfca18fa1b fix: update export init for consul register
Signed-off-by: zhuzhengyi1 <zhuzhengyi@jd.com>
2019-09-05 18:22:54 +08:00
awzhgw
f732ade2bc Refactor: log checkroration checkTime change to 1 second
Signed-off-by: awzhgw <guowl18702995996@gmail.com>
2019-09-02 15:27:34 +08:00
awzhgw
9c1e104822 Feature: support log module change loglevel on line
Signed-off-by: awzhgw <guowl18702995996@gmail.com>
2019-09-02 09:58:52 +08:00
zhuhyc
d69db16252 fix: the buf is not reset and the old data is repeatedly written to the ump warning log, resulting in the overall performance degradation of the cluster
Signed-off-by: zhuhyc <zzhniy.163.niy@163.com>
2019-08-30 12:51:34 +08:00
awzhgw
4dd740c435 Fix Datanode retain RaftLog:
1.Datanode add log on recovery
2.Datanode Change raft log retain log to 10
3.delete unused file datanode/partition_metrics.go

Signed-off-by: awzhgw <guowl18702995996@gmail.com>
2019-08-22 17:51:36 +08:00
awzhgw
6a9dbc369b Refactor: if not config warnLogDir,then donnot write umplog to disk
Signed-off-by: awzhgw <guowl18702995996@gmail.com>
2019-08-16 14:42:09 +08:00
awzhgw
669df1f3d7 Refactoring: exporter add ump
Signed-off-by: awzhgw <guowl18702995996@gmail.com>
2019-08-16 14:42:09 +08:00
awzhgw
9e2fce42a7 enhancement: add raft monitor
Signed-off-by: awzhgw <guowl18702995996@gmail.com>
2019-08-16 14:42:09 +08:00
Shuoran Liu
a485e82f69 enhancement: compatible with string when get bool config
Right now certain client mount options require bool type inputs,
which have no double quotation marks, i.e. true instead of "true".
However, this is a little bit confusing, and some customers might
have used string type by mistake.

This commit can deal with a string-typed bool config such as "true".

Signed-off-by: Shuoran Liu <shuoranliu@gmail.com>
2019-08-14 19:53:51 +08:00
awzhgw
f3a8f60c63 fix : when create dataPartition failed,then exclude the dp hosts
Signed-off-by: awzhgw <guowl18702995996@gmail.com>
2019-07-10 11:09:09 +08:00
awzhgw
7e0eed1b70 when create dp failed,then Check all dp host if the host is alive
Signed-off-by: awzhgw <guowl18702995996@gmail.com>
2019-07-10 11:09:09 +08:00
zhuhyc
1bbdc2bef5 warn log message unicode encoding is converted to utf8
Signed-off-by: zhuhyc <zzhniy.163.niy@163.com>
2019-07-04 20:51:46 +08:00
Shuoran Liu
96e0142fc0 util: increase request timeout to master
When the amount of partitions are very large, some requests to master
such as obtaining all partitions info may take several seconds to
complete. So increase timeout for now and will optimize master later.

Signed-off-by: Shuoran Liu <shuoranliu@gmail.com>
2019-07-03 17:04:28 +08:00
awzhgw
e841bb8e4b go fmt project
Signed-off-by: awzhgw <guowl18702995996@gmail.com>
2019-07-02 20:11:17 +08:00
awzhgw
f3eead28cb fix: warnMesg failed on warnLogDir
Signed-off-by: awzhgw <guowl18702995996@gmail.com>
2019-07-02 20:11:17 +08:00
zhuzhengyi1
8543c15380 normalize exporter cluster name
Signed-off-by: zhuzhengyi1 <zhuzhengyi@jd.com>
2019-06-26 17:14:38 +08:00
awzhgw
236e454c37 when warnLogDir not config,then warn
Signed-off-by: awzhgw <guowl18702995996@gmail.com>
2019-06-20 16:00:06 +08:00
awzhgw
03f79e7370 Specification code and metanode config file
Signed-off-by: awzhgw <guowl18702995996@gmail.com>
2019-06-20 09:29:56 +08:00
Shuoran Liu
369e157ddb Use UMP performance monitor if exporter is not enabled
Signed-off-by: Shuoran Liu <shuoranliu@gmail.com>
2019-06-11 12:53:17 +08:00
awzhgw
38164ada4b add when load datapartition failed,then warn
Signed-off-by: awzhgw <guowl18702995996@gmail.com>
2019-06-11 12:53:17 +08:00
awzhgw
76ac26b91e add when datanode disk error ,then ump warn,and change disk error to -1
Signed-off-by: awzhgw <guowl18702995996@gmail.com>
2019-06-11 12:53:17 +08:00
awzhgw
36d97f1034 master:
1.add ump warn packet
  2.partition has recover,but the status don't change
  3.remove redundancy calling loadMetaData method
  4.reload meta data when change leader

metanode:
   1. add totalMem in configFile
   2.change not raft leader to tryOtherAddr error

 datanode:
   1.when datapartition not exsit,tell client with proto.OptryAgain resultcode
   2.change disk retrain default space to 20gb
   3.heartbeat report add volname

 raft:
   1.use raft.ErrNotLeader replace ErrNotLeader
   2.raft became leader must apply from oldapplyid to commitid

 client:
   1.  create a dummy node instance if inode does not exist
   2. add ump alarm for read/write/fsync errors

log:
   1.   auto create subdir to logdir

 error:
   1.delete juju error packet
2019-04-30 09:31:58 +08:00
awzhgw
97f2a18f5c rename repo from cfs to chubaofs 2019-04-28 15:12:17 +08:00
awzhgw
3893283054 init LICENSE file and vendor,util packet 2019-03-14 14:04:21 +08:00
Haifeng Liu
545ba87a86
Merge pull request #2 from ZhuZhengyi/exporter
init exporter
2019-03-07 09:26:59 +08:00
znlstar
800719baa1 add log module 2019-03-05 17:32:02 +08:00
zhuzhengyi1
41ba0307e8 init exporter 2019-03-05 15:43:06 +08:00