Commit Graph

15 Commits

Author SHA1 Message Date
leonrayang
3396accd80 feat(projectstructure): reorganize the module directory in the root to a suitable subdirectory
close:#22458839

Signed-off-by: leonrayang <chl696@sina.com>
2024-12-26 09:24:22 +08:00
leonrayang
d58736436e fix(update|client): snapshot. Refactor some codes to solve the synchronization update problem of client streamer's seq and datanode
Signed-off-by: leonrayang <chl696@sina.com>
2024-01-22 15:22:12 +08:00
slasher
1d84f74acd chore(format): format all code with gofumpt
Signed-off-by: slasher <shenjie1@oppo.com>
2024-01-12 14:21:16 +08:00
leonrayang
3dfbf48255 enhance(metanode|client): Optimizing the Logic for Synchronizing Verseq between Nodes
The synchronization process now includes synchronizing the "verlist". If there is a difference in version numbers,
the client and metanode will mutually push the latest "verlist" to each other.
Client writes will have increased retries to carry the "verlist".
The purpose of all this is to ensure that the metanode obtains the latest and most comprehensive data,
reducing the possibility of missing data during individual Verseq pushes.

To make it simple, packet of randomWriteVer from client always contains verlist
VerList in dataNode not persist

This update also optimized the message synchronization logic in the process, adopting an asynchronous approach using channels to handle it.

Signed-off-by: leonrayang <chl696@sina.com>
2023-09-19 14:05:49 +08:00
leonrayang
c2bae50bf2 enhance: still reply to client if datanode recive package but failed at prepare stage
close:#2237

Signed-off-by: leonrayang <chl696@sina.com>
2023-07-20 10:58:50 +08:00
leonrayang
9a30b9f884 update: update to CubeFS
Signed-off-by: leonrayang <chl696@sina.com>
2022-08-22 18:16:09 +08:00
leonrayang
2970e2c3d1 update. go import path change from chubaofs to cubefs
Signed-off-by: leonrayang <chl696@sina.com>
2022-01-25 18:17:02 +08:00
Shuoran Liu
b02c9f283c feat: intruduce metrics degrade level to datanode
This commit introduces metrics degrade level config to suppress monitor
metrics collection as needed.

Metrics Degrade Level
- minus value: turn off metrics collection.
- 0 or 1: full metrics.
- 2: 1/2 of the metrics will be collected.
- 3: 1/3 of the metrics will be collected.
- ...

Signed-off-by: Shuoran Liu <shuoranliu@gmail.com>
2022-01-20 11:45:54 +08:00
Shuoran Liu
ee0f623d0d Revert "feature.config exporter output ratio to reduce cost"
This reverts commit 01dfc6dfb4.

Signed-off-by: Shuoran Liu <shuoranliu@gmail.com>
2022-01-20 11:45:54 +08:00
leonrayang
01dfc6dfb4 feature.config exporter output ratio to reduce cost
Signed-off-by: leonrayang <chl696@sina.com>
2022-01-17 17:00:54 +08:00
awzhgw
f3a8f60c63 fix : when create dataPartition failed,then exclude the dp hosts
Signed-off-by: awzhgw <guowl18702995996@gmail.com>
2019-07-10 11:09:09 +08:00
awzhgw
e37c7d7ee0 change packet attr func and ReadTinyDelete impl log
Signed-off-by: awzhgw <guowl18702995996@gmail.com>
2019-07-10 11:09:09 +08:00
awzhgw
36d97f1034 master:
1.add ump warn packet
  2.partition has recover,but the status don't change
  3.remove redundancy calling loadMetaData method
  4.reload meta data when change leader

metanode:
   1. add totalMem in configFile
   2.change not raft leader to tryOtherAddr error

 datanode:
   1.when datapartition not exsit,tell client with proto.OptryAgain resultcode
   2.change disk retrain default space to 20gb
   3.heartbeat report add volname

 raft:
   1.use raft.ErrNotLeader replace ErrNotLeader
   2.raft became leader must apply from oldapplyid to commitid

 client:
   1.  create a dummy node instance if inode does not exist
   2. add ump alarm for read/write/fsync errors

log:
   1.   auto create subdir to logdir

 error:
   1.delete juju error packet
2019-04-30 09:31:58 +08:00
awzhgw
97f2a18f5c rename repo from cfs to chubaofs 2019-04-28 15:12:17 +08:00
awzhgw
9e383a92ee init (repl procotol,datanode frame,replicate and storage engine 2019-03-14 22:16:06 +08:00