Commit Graph

2677 Commits

Author SHA1 Message Date
leonrayang
d5bb45ea49 docs. update to cubefs
Signed-off-by: leonrayang <chl696@sina.com>
2023-05-26 11:17:10 +08:00
baijiaruo
9a6c4d25ce fix:1.In the txcreate operation, the quota is exceeded, and the error code is incorrect
2.NewMetaWrapper decides whether to start the coroutine according to whether the config has an updateQuota parameter
    3.extend copy add lock

Signed-off-by: baijiaruo <huyao2@oppo.com>
2023-05-26 11:17:10 +08:00
pheianox
2de771c319 Add PITS Global Data Recovery Services to the list of adopters
This pull request adds new entry in the adopters list

Signed-off-by: pheianox <pheianox@gmail.com>
2023-05-25 09:05:15 +08:00
JasonHu520
0612df4747 fix(deploy): fix one-click deployment script for blobstore
Signed-off-by: JasonHu520 <huzongchao@oppo.com>
2023-05-24 14:11:38 +08:00
yuxiaobo
ce51ad618b fix: build blobstore error in github ci
Signed-off-by: yuxiaobo <yuxiaobo@oppo.com>
2023-05-24 11:12:06 +08:00
slasher
5361602c10 build: cubefs using local module of blobstore
close: #1527

Signed-off-by: slasher <shenjie1@oppo.com>
2023-05-23 19:09:11 +08:00
yuxiaobo
54d3f6f323 fix: add blobstore proxy build
Signed-off-by: yuxiaobo <yuxiaobo@oppo.com>
2023-05-23 18:11:14 +08:00
htlin65535
6bcc022d31 docs: update blobstore/scheduler.md
Signed-off-by: htlin65535 <htlin65535@gmail.com>
2023-05-23 16:00:04 +08:00
yuxiaobo
82bb6aa714 build: delete useless Dockfile and scripts
Signed-off-by: yuxiaobo <yuxiaobo@oppo.com>
2023-05-23 15:24:53 +08:00
yuxiaobo
c9366451e9 fix: add the version to compilation information
Signed-off-by: yuxiaobo <yuxiaobo@oppo.com>
2023-05-23 15:24:53 +08:00
yuxiaobo
ac75137295 build: the build script of blobstore is merged into cubefs
1. rocksdb upgrade to 6.3.6
2. optimize the build scripts
3. fix build errors
4. add env variable for blobstore unit test
5. update git ignore file to ignore build and test result
6. modify open files limit for unit test

Signed-off-by: yuxiaobo <yuxiaobo@oppo.com>
Signed-off-by: slasher <shenjie1@oppo.com>
Signed-off-by: Victor1319 <834863182@qq.com>
2023-05-23 15:24:53 +08:00
pengtianyue
303e3276f7 chore(docs): change v3.2.2 to v3.3.0
Signed-off-by: pengtianyue <pengtianyue@oppo.com>
2023-05-22 09:55:17 +08:00
Horsing
7badf3f64d feat(blobstore-cli): supports setting background task switch
close: #1898

Signed-off-by: Horsing <wittcnezh@foxmail.com>
2023-05-18 15:25:34 +08:00
tangdeyi
434fb5bcf9 fix(objectnode): s3 test fix
Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2023-05-18 10:48:57 +08:00
tangdeyi
9fcbc52cd4 fix(objectnode): policy check fix
Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2023-05-18 10:48:57 +08:00
yhjiango
d30cdd4dea fix(objectnode): ignore the non-existence error of dir acl
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2023-05-18 10:48:57 +08:00
tangdeyi
7df19f730a fix(objectnode): volume view cache
Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2023-05-18 10:48:57 +08:00
Patrick Wu
0b45ac165e fix: 1.delay freeing inode when inode is in transaction. 2.fix accessing nil err
Signed-off-by: Patrick Wu <wuchunhuan@oppo.com>
2023-05-18 10:48:57 +08:00
Patrick Wu
b0eacf6c10 fix: parent inode rollback item is not added when dealing with dentry create and deletion
Signed-off-by: Patrick Wu <wuchunhuan@oppo.com>
2023-05-18 10:48:57 +08:00
true1064
448a180ed7 feat(master,cli): cfs-cli metapartition check add: (1)display unavailable mp, (2)display excess replica num mp, (3) mp no leader consider heartbeat report time
Signed-off-by: true1064 <tangjingyu@oppo.com>
2023-05-18 10:48:57 +08:00
leonrayang
461306d92e enhance(master): dp's "no leader" report need after a NoLeaderReportInterval in case of wrong report
Signed-off-by: leonrayang <chl696@sina.com>
2023-05-18 10:48:57 +08:00
leonrayang
3baea5927b test(master): tempory forbit master unit test
Signed-off-by: leonrayang <chl696@sina.com>
2023-05-18 10:48:57 +08:00
baijiaruo
5d106aff19 fix: update quota Persistence problem
Signed-off-by: baijiaruo <huyao2@oppo.com>
2023-05-18 10:48:57 +08:00
true1064
82a10e751c enhance: 'cfs-cli datapartition check' adds display of datapartitions with excessive replica num
Signed-off-by: true1064 <tangjingyu@oppo.com>
2023-05-18 10:48:57 +08:00
true1064
ec2aa61ab9 enhance: add isDiscard flag to datapartion; master provides setup isDiscard flag API accordingly; when client try to read an discard dp it will fast fail and avoid retry
Signed-off-by: true1064 <tangjingyu@oppo.com>
2023-05-18 10:48:57 +08:00
baijiaruo
bec4880637 fix create/delete quota concurrently, request to send metanode failure problem
Signed-off-by: baijiaruo <huyao2@oppo.com>
2023-05-18 10:48:57 +08:00
baijiaruo
7e34c2b4ec fix: update quota default maxBytes update is incorrect
Signed-off-by: baijiaruo <huyao2@oppo.com>
2023-05-18 10:48:57 +08:00
baijiaruo
41146a226e enhance:1.Limit the quota of a volume to a maximum of 100
2.loadExtend must be executed after loadInode
        3.Delete unnecessary error logs

Signed-off-by: baijiaruo <huyao2@oppo.com>
2023-05-18 10:48:57 +08:00
baijiaruo
3e14be1f6e enhance:1.set and update without inodeId
2.When renaming the upper-level or higher-level directory of the quota directory, the full path information of the quota is also modified accordingly.
        3.quota update operation, if only one parameter value is changed, other parameter values remain unchanged
        4.Change the display time to no longer a timestamp
Signed-off-by: baijiaruo <huyao2@oppo.com>
2023-05-18 10:48:57 +08:00
leonrayang
e8d0649a4a fix. mps rwlock and mp rwlock use need be caution in master
1)getMetaPartitionsView hold mps read lock need mp lock
2)splitMetaPartition need mps lock but find the read lock on,then hang wait the read return,but trigger a lock waitting status
3)checkEnd hold mp lock and need mps read lock but the mps reads lock be hang by 2)'s lock preparition

according to the step upon, the deallock happened

Signed-off-by: leonrayang <chl696@sina.com>
2023-05-18 10:48:57 +08:00
yhjiango
6c730a752e fix(objectnode): remove etag update in object meta get
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2023-05-18 10:48:57 +08:00
tangdeyi
b27a7c4ba0 fix(objectnode): listobject bugfix
Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2023-05-18 10:48:57 +08:00
yhjiango
f83ec30d71 style(objectnode): add status code and error message log in the end of traceMiddleware
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2023-05-18 10:48:57 +08:00
tangdeyi
b26b714746 fix(metanode): part puttime fix
Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2023-05-18 10:48:57 +08:00
yhjiango
1434374d51 fix(metanode): The same partInode must not be overwritten
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2023-05-18 10:48:57 +08:00
yhjiango
2b6b00126a fix(objectnode): error adjustment in complete multipart
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2023-05-18 10:48:57 +08:00
yhjiango
c5b008ebc8 fix(objectnode): fix the md5 mismatch between the put and get of the multipart object
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2023-05-18 10:48:57 +08:00
yhjiango
0a4830dd93 fix(objectnode): fix the list multipart uploads and dir object inaccessible
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2023-05-18 10:48:57 +08:00
tangdeyi
06df15564a fix(objectnode): read buffer reuse
Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2023-05-18 10:48:57 +08:00
yhjiango
3bc3e84947 fix(objectnode/sdk): fix no data write in WriteFromReader of writer
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2023-05-18 10:48:57 +08:00
yhjiango
1536889f35 fix(objectnode): fix too much data read by reader
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2023-05-18 10:48:57 +08:00
tangdeyi
ac93148820 fix(objectnode): policy & acl check err handle
Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2023-05-18 10:48:57 +08:00
yhjiango
a56250817d fix(objectnode): fix the volume load call and error return
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2023-05-18 10:48:57 +08:00
tangdeyi
862fde677a fix(objectnode):
1. MultipartUpload with nonexistent uploadId return NoSuchUploadID
2. NoSuchBucket err handle

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2023-05-18 10:48:57 +08:00
tangdeyi
ee5577115b fix(objectnode): uploadpart overwrites the existing part
Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2023-05-18 10:48:57 +08:00
tangdeyi
3eddf3e623 fix(objectnode): Options CORS
Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2023-05-18 10:48:57 +08:00
yhjiango
e2112e892a fix(objectnode): fix the copy object
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2023-05-18 10:48:57 +08:00
tangdeyi
ad2f245e76 fix(objectnode): Options CORS
Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2023-05-18 10:48:57 +08:00
yhjiango
e5989dec41 fix(objectnode): fix md5 check failure when uploading keys with all empty characters
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2023-05-18 10:48:57 +08:00
yhjiango
2011f3d4b1 fix(objectnode): fix the delete objects
Signed-off-by: yhjiango <jiangyunhua@oppo.com>
2023-05-18 10:48:57 +08:00