1. rocksdb upgrade to 6.3.6
2. optimize the build scripts
3. fix build errors
4. add env variable for blobstore unit test
5. update git ignore file to ignore build and test result
6. modify open files limit for unit test
Signed-off-by: yuxiaobo <yuxiaobo@oppo.com>
Signed-off-by: slasher <shenjie1@oppo.com>
Signed-off-by: Victor1319 <834863182@qq.com>
We found a bug when multi bucket were operated.
The s3-tests case now only support single bucket tests.
So I add a bucket named 's3test'.
Signed-off-by: wanglei469 <wanglei469@ke.com>
As of Go 1.16, os.ReadDir is a more efficient and correct choice than
ioutil.ReadDir, so we are making the updates.
Signed-off-by: Shuoran Liu <shuoranliu@gmail.com>
1. Fix: parallel-safe issue in conn pool and metanode conn serve
2. Fix: nil pointer issue when list parts for non-exist uploadId
3. Enhancement: validate read size while read from connnect.
4. Enhancement: clean up useless data on failure while upload part.
5. Enhancement: generate ETag if do not exist when listing.
6. Enhancement: include error message when formatting packet to string.
7. Enhancement: improve compatile with old version SDK.
8. Enhancement: success when retry add exist multipart part.
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
Signed-off-by: 张墨飞 <zhangmofei@jd.com>
When creating a volume, it returns to success when both the meta
partition and data partition are successfully created.
When adding a data partition to the volume, the data partition is
successfully created and then returns to success.
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
Http's Expect header is a special header. When nginx is used as the
reverse proxy in the front end of ObjectNode, nginx will process the
Expect header information in advance, send the http status code 100 to
the client, and will not forward this header information to ObjectNode.
At this time, if the client request uses the Expect header when signing,
it will cause the ObjectNode to verify the signature.
A workaround is used here to solve this problem. Add the following
configuration in Nginx:
proxy_set_header X-Forwarded-Expect $ http_Expect
In this way, nginx will not only automatically handle the Expect
handshake, but also send the original value of Expect to the ObjectNode
through X-Forwared-Expect. ObjectNode only needs to use the value of
X-Forwared-Expect.
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
Auto create user while create volume if the owner user is not exists.
Add a option for force transfer volume to target user.
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
Enhancement: validate user policy when mount volume.
Enhancement: when an object node loads a volume, different volumes do not block each other.
Enhancement: when checking policies, check user permissions before checking volume policies to reduce the overhead of loading volumes.
Enhancement: release connection pool when releasing meta wrapper resources.
Enhancement: the object node automatically releases the deleted volume.
Fix: response when deleting non-existing files using Object Storage
Interface.
Fix: url parameter parsing issue of signature algorithm V2.
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
Refactor: using cli instead of curl in CI scripts
Add: CLI command for CLI for adding more data partition to volume
Enhancement: optimize CLI output format
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
