Commit Graph

17 Commits

Author SHA1 Message Date
Yuval Lifshitz
60a7f72bb1 rgw/logging: rollover objects when conf changes
and return the name of the flushed object to the client

Fixes: https://tracker.ceph.com/issues/72940

Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>
2025-09-10 15:12:24 +00:00
Yuval Lifshitz
fb2b037355 rgw/logging: send flushed object name in API reply
Fixes: https://tracker.ceph.com/issues/71219

Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>
2025-06-09 17:37:59 +00:00
Casey Bodley
b05a9580f8 examples/rgw: register boto extension for BucketIndex on CreateBucket
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2025-02-25 11:15:57 -05:00
Yuval Lifshitz
2c6d3ec3d8 rgw/notification/logging: add bucket as context param
when URI has the form: "/{Bucket}?<action>"
the "Bucket" parameter has to be added as context parameter for
botocore based clients to send the operation as a bucket
operation

Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>
2025-02-10 17:07:21 +00:00
Casey Bodley
d81d15839a examples/rgw: add type to HeadBucketOutput for old boto
0f55c1759d added an override for
the "HeadBucketOutput" shape, but that didn't exist until botocore
1.33.2. s3-tests is pinned to botocore <1.28.0

Fixes: https://tracker.ceph.com/issues/69582

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2025-01-24 11:20:36 -05:00
Casey Bodley
0f55c1759d examples/rgw: register boto extension for HeadBucket stats
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-12-17 15:28:52 -05:00
Ali Masarwa
a508216657
Merge pull request #60942 from AliMasarweh/wip-alimasa-bucket-logging-filter
RGW/logging: add filtering for bucket logging 

Reviewed-by: yuvalif<ylifshit@redhat.com>
2024-12-17 20:06:51 +02:00
Ali Masarwa
e03f5ca25f RGW\logging: convert s3_filter to key_filter
Signed-off-by: Ali Masarwa <amasarwa@redhat.com>
2024-12-17 13:06:11 +02:00
Ali Masarwa
ca9e0f4061 RGW/logging: add filtering for bucket logging
Signed-off-by: Ali Masarwa <amasarwa@redhat.com>
2024-12-17 13:06:04 +02:00
Ali Masarwa
9a9e14db35 RGW/logging: add rest API to flush logging bucket
Signed-off-by: Ali Masarwa <amasarwa@redhat.com>
2024-12-17 12:55:39 +02:00
Yuval Lifshitz
790c38eacc rgw/logging: add support for GetBucketLogging and PutBucketLogging
this is based on AWS server access logs:
- https://docs.aws.amazon.com/AmazonS3/latest/userguide/enable-server-access-logging.html
- https://docs.aws.amazon.com/AmazonS3/latest/userguide/ServerLogs.html
- https://docs.aws.amazon.com/AmazonS3/latest/API/API_PutBucketLogging.html
- https://docs.aws.amazon.com/AmazonS3/latest/API/API_GetBucketLogging.html

however, a new mode was added called "journal" where:
- logs of PUT, COPY and MPU are guaranteed
- we have logs of DELETE and multi-DELETE operations (not guaranteed)
- log records hold only minimal amount of information

Fixes: https://tracker.ceph.com/issues/984

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2024-12-08 16:20:50 +00:00
rkhudov
508bba9b0d examples/rgw/boto3/README.md: update documentation for boto3 extension installation. Fixes: https://tracker.ceph.com/issues/67768
Signed-off-by: rkhudov <rhudov@gmail.com>
2024-08-29 14:17:13 +01:00
Soumya Koduri
bbf0393168 Add new sync-policy related params to boto3 extension
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2024-05-13 22:15:53 +05:30
Josh Soref
ed70d843df rgw: fix spelling errors
* access
* acquire
* across
* algorithm
* alternatively
* ambiguous
* attributes
* authenticated
* automatically
* based
* between
* beware
* bootstrap
* bucket
* cache
* character
* check
* cleanup
* combinations
* committed
* comparison
* compatibility
* concurrent
* conditions
* conjunction
* connections
* considered
* contains
* correct
* creates
* crypto
* dependencies
* dequeued
* dequeuing
* derivative
* described
* determine
* deterministic
* detritus
* discrepancy
* display
* either way
* elements
* entirely
* entries
* error
* everything
* expected
* explicitly
* extend
* false
* fclose
* feature
* following
* foreign
* format
* forward
* functionality
* functions
* generated
* getting
* gracefully
* happened
* hashicorp
* healthcheck
* hierarchy
* however
* http
* identify
* idleness
* ignored
* incremental
* information
* initialization
* length
* locally
* macros
* malformed
* means
* mechanism
* multipart
* multiple
* must
* namespace
* necessary
* nonexistent
* notifications
* occurred
* official
* outputs
* outputted
* overridden
* ownership
* parallelism
* partition
* passthrough
* pause
* penguin
* perform
* permission
* populated
* position
* preferably
* prefixes
* presumably
* previous
* print
* quadruple
* reference
* regardless
* registry
* renewed
* request
* requires
* reshard
* resource
* result to
* satisfy
* secret
* separate
* separator
* setting
* shouldn't
* skipping
* some
* somehow
* something
* specific
* struct
* succeeded
* success
* successful
* successfully
* syntax
* testing
* truncated
* unambiguously
* unittest
* unmodified
* unnecessary
* valid_action
* verifying
* versioning
* visible
* whatever
* whenever

Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
2023-11-27 10:27:32 -05:00
Konstantin Monakhov
608c7111aa examples: fixed errors with the if-match header in the examples of rgw-cache nginx configs
Signed-off-by: Konstantin Monakhov <stangerkm@gmail.com>
2023-09-10 22:08:50 +06:00
Justin Caratzas
47b954f1a8 examples: replace example go modules with instructions to run
Signed-off-by: Justin Caratzas <jcaratza@ibm.com>
2023-05-10 08:44:46 -04:00
Casey Bodley
36747b08ff examples: move rgw examples under subdirectory
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-02-13 17:20:26 -05:00