Commit Graph

161531 Commits

Author SHA1 Message Date
Shraddha Agrawal
81bb19f67c debian: enable crimson packages
This commit enables ceph-osd-crimson and ceph-osd-crimson-dbg
packages for debian builds which have gcc version 13 or above.
This is done as a first step to add noble to supported distors
for crimson.

Signed-off-by: Shraddha Agrawal <shraddha.agrawal000@gmail.com>
2026-06-08 12:38:37 +05:30
Guillaume Abrioux
12c63f2ab5
Merge pull request #69143 from guits/fix-cv-vg-lv-batch
ceph-volume: retry lvs after empty result and "devices file is missing" stderr
2026-06-01 09:57:17 +02:00
Vallari Agrawal
6790982813
Merge pull request #69135 from VallariAg/wip-nvmeof-teuthology-mon-conf
qa/suites/nvmeof: set beacon grace and connect panic
2026-05-31 21:30:05 +05:30
Ali Masarwa
6c76810aa9
Merge pull request #66500 from AliMasarweh/wip-alimasa-global-cors
RGW: add support for global CORS rule

Reviewed-by: Naman Munet <naman.munet@ibm.com>, Casey Bodley <cbodley@redhat.com>
2026-05-31 13:30:56 +03:00
Kefu Chai
9f7da28fb4
Merge pull request #69185 from sunyuechi/wip-with-system-spdk
cmake,blk/spdk: support WITH_SYSTEM_SPDK

Reviewed-by: Kefu Chai <k.chai@proxmox.com>
2026-05-31 18:26:14 +08:00
Hezko
03bb4f71f7
Merge pull request #68745 from Hezko/bugfix-13279
mgr/dashboard: fix listener add errors
2026-05-31 11:04:07 +03:00
Matan Breizman
c973f7a82c
Merge pull request #69044 from xxhdx1985126/wip-seastore-rewrite-fix
crimson/os/seastore: force rewrite transactions to conflict with others if it involve insertions on the lba tree

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2026-05-31 10:20:36 +03:00
Sun Yuechi
6af1a85946 cmake: add WITH_SYSTEM_SPDK to link a system-installed SPDK
By default ceph builds the bundled src/spdk fork via BuildSPDK. Add a
WITH_SYSTEM_SPDK option that instead locates a distro-provided SPDK
through a new Findspdk.cmake (pkg-config based, modelled on
Finddpdk.cmake), exposing the same spdk::spdk target.

Signed-off-by: Sun Yuechi <sunyuechi@iscas.ac.cn>
2026-05-31 08:33:11 +08:00
Sun Yuechi
d18ffa868f blk/spdk: support both old and new spdk_env_opts member names
SPDK 21.01 renamed two struct spdk_env_opts members: pci_whitelist ->
pci_allowed and master_core -> main_core. Guard the assignments in
NVMEDevice with SPDK_VERSION.

pci_whitelist -> pci_allowed:  https://github.com/spdk/spdk/commit/4a6a2824119b
master_core -> main_core:      https://github.com/spdk/spdk/commit/fe137c8970bf

Signed-off-by: Sun Yuechi <sunyuechi@iscas.ac.cn>
2026-05-31 08:33:08 +08:00
Casey Bodley
0ee19106cf
Merge pull request #68934 from cbodley/wip-76578
rgw/beast: add ssl_ciphersuites option for tls 1.3

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2026-05-29 13:52:00 -04:00
Ilya Dryomov
762c11da5f
Merge pull request #68899 from batrick/i76586
qa: ignore POOL_FULL for rbd tests exercising full pools

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2026-05-29 18:02:02 +02:00
Patrick Donnelly
2fa91d6db0
Merge PR #67683 into main
* refs/pull/67683/head:
	qa/tasks/cbt: construct venv just for cbt
	qa/distros: use consistent naming
	qa/tasks/nvme_loop: fix nvme loop task for ubuntu noble
	qa/distros: add ubuntu_24.04 as supported container host
	qa/distros: bump ubuntu_latest.yaml to 24.04
	qa/distros: add all/ubuntu_24.04.yaml
	qa/suites/rados/encoder: use random supported distro
	qa/ceph-ansible: symlink supported-random-distro$
	qa/fs/fscrypt: symlink supported-random-distro$
	qa/cephmetrics: symlink supported-random-distro$

Reviewed-by: Redouane Kachach <rkachach@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
2026-05-29 11:08:23 -04:00
Patrick Donnelly
7699baa9c6
Merge PR #69163 into main
* refs/pull/69163/head:
	qa/tasks: capture CommandCrashedError when running nvme list cmd

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
2026-05-29 11:07:03 -04:00
Igor Fedotov
1ed8efb9bb
Merge pull request #66439 from aclamk/aclamk-bs-simpler-flush
bluestore/bluefs: FileWriter simpler flush

Reviewed-by: Igor Fedotov <igor.fedotov@croit.io>
2026-05-29 18:04:47 +03:00
Igor Fedotov
00d84cb15a
Merge pull request #68607 from dheart-joe/wip-bluestore-unshare-blob
os/bluestore: optimize shared blob unsharing during snapshot removal

Reviewed-by: Igor Fedotov <igor.fedotov@croit.io>
2026-05-29 18:03:05 +03:00
Casey Bodley
24b9cca840
Merge pull request #69166 from sunyuechi/wip-rgw-swift-error-handler-out-of-line
rgw: move SWIFT error_handler out-of-line to fix link failure

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2026-05-29 11:01:51 -04:00
Igor Fedotov
315c4c4770
Merge pull request #68898 from gardran/wip-gardran-show-esb-in-metadata
os/bluestore: dump effective elastic shared blobs mode in OSD metadata report

Reviewed-by: Adam Kupczyk <akupczyk@ibm.com>
2026-05-29 18:01:44 +03:00
Gil Bregman
4b5d6933fe
Merge pull request #69144 from gbregman/main
nvmeof: Change the NVMEOF image version to 1.8
2026-05-29 17:39:57 +03:00
Ilya Dryomov
f18652255a
Merge pull request #68095 from lumir-sliva/fix-deprecated-egrep-fgrep
qa,src: replace deprecated egrep/fgrep with grep -E/grep -F

Reviewed-by: Kefu Chai <k.chai@proxmox.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2026-05-29 15:52:14 +02:00
Sun Yuechi
868fdd8120 rgw: move SWIFT error_handler out-of-line to fix link failure
The two error_handler overrides are defined inline in rgw_rest_swift.h
and delegate to RGWSwiftWebsiteHandler::error_handler, a non-virtual
function defined in rgw_rest_swift.cc (librgw_a.a). Because the header
is included by rgw_rest.cc, the inline bodies are emitted in
librgw_common.a, which then ODR-uses that symbol across archives.

The link line lists librgw_a.a before librgw_common.a, and GNU ld only
pulls archive members on demand: when librgw_a.a is scanned nothing yet
references RGWSwiftWebsiteHandler::error_handler, so rgw_rest_swift.cc.o
is dropped and the symbol is later unresolved. This shows up as a link
failure with gcc 16 -O2.

Move the two bodies into rgw_rest_swift.cc next to the function they
call, so the ODR-use stays within the same object and the build no
longer depends on archive scan order. No functional change.

Signed-off-by: Sun Yuechi <sunyuechi@iscas.ac.cn>
2026-05-29 18:51:31 +08:00
Vallari Agrawal
7f8bcdc7d1
qa/suites/nvmeof: ignore "have only 1 nvmeof gateway"
Add "have only 1 nvmeof gateway" to ignorelist.
NVMEOF_SINGLE_GATEWAY is already part of ignorelist
but tests sometimes fail on "have only 1 nvmeof gateway".

Thrasher or scalability tests can trigger this but there
are enough asserts to ensure all expected gateways are
up, we can safely ignore this healthcheck warning.

Fixes: https://tracker.ceph.com/issues/75913

Signed-off-by: Vallari Agrawal <vallari.agrawal@ibm.com>
2026-05-29 15:08:23 +05:30
Redouane Kachach
0bf55d6a8b
qa/tasks: capture CommandCrashedError when running nvme list cmd
The safe_while retry loop does not catch exceptions, so a
CommandCrashedError from `nvme list` bypasses it entirely. Catch
CommandCrashedError and continue the retry loop instead.

Fixes: https://tracker.ceph.com/issues/76984

Signed-off-by: Redouane Kachach <rkachach@ibm.com>
2026-05-29 11:22:01 +02:00
Ronen Friedman
ce220cc902
Merge pull request #69110 from ronen-fr/wip-rf-hours
osd/scrub: 'repairing' scrubs allowed at all times

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2026-05-29 07:00:00 +03:00
Patrick Donnelly
44fa2a5d85
Merge PR #68936 into main
* refs/pull/68936/head:
	osd: Fix bug when calculating min_peer_features

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
Reviewed-by: Alex Ainscow <aainscow@uk.ibm.com>
2026-05-28 19:48:15 -04:00
David Galloway
e93ef6b62d
Merge pull request #69073 from ShwetaBhosale1/fix_nfs_version_issue
Use GANESHA_REPO_BASEURL for NFS-Ganesha on all distros
2026-05-28 17:25:06 -04:00
Patrick Donnelly
5ac8b6fecd
Merge PR #69055 into main
* refs/pull/69055/head:
	qa/suites/upgrade: ignore osd in unknown state

Reviewed-by: Laura Flores <lflores@redhat.com>
2026-05-28 13:57:54 -04:00
John Mulligan
6e443c5a5a
Merge pull request #69128 from xhernandez/fix-unbound-var
mgr/smb: fix incorrect referenced variable

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Shwetha Acharya <sacharya@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
2026-05-28 13:53:15 -04:00
Ronen Friedman
787f2b0d0a osd/scrub: removed a misleading comment about 'overdue' scrubs
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2026-05-28 14:55:41 +00:00
Gil Bregman
86b52ecfef nvmeof: Change the NVMEOF image version to 1.8
Fixes: https://tracker.ceph.com/issues/76958

Signed-off-by: Gil Bregman <gbregman@il.ibm.com>
2026-05-28 15:41:26 +03:00
Guillaume Abrioux
d91d320a7f ceph-volume: retry lvs after empty result and "devices file is missing" stderr
When LVM's devices file is out of sync with the runtime device view (common
in teuthology/container namespaces with multipath), `lvs` can exit 0 with
empty stdout and only stderr warnings about missing mapper entries.
It can leave get_lvs() empty and cause Device() to fall through to lsblk on a
vg/lv path which can produce a misleading "not a block device" error.

With this fix, ceph-volume retries once with 'use_devicesfile=0' when it
detects this specific pattern.

Fixes: https://tracker.ceph.com/issues/76959

Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
2026-05-28 13:39:55 +02:00
Xuehan Xu
8023e9f5df
Merge pull request #69095 from xxhdx1985126/wip-seastore-onode-cpu-overhead-output
crimson/os/seastore/onode_manager: avoid debug related info from occupying too much cpu time

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2026-05-28 10:03:09 +08:00
Casey Bodley
54a58396ff
Merge pull request #67246 from mheler/wip-rgw-sse-gcm
rgw: Add AES-256-GCM support for RGW server-side encryption

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2026-05-27 17:22:10 -04:00
Tomer Haskalovitch
eb3cf546ff mgr/dashboard: dont treat errno.EREMOTE as an error to avoid errors from listerner add command
fixes: https://tracker.ceph.com/issues/76418
Signed-off-by: Tomer Haskalovitch <tomer.haska@ibm.com>
2026-05-28 00:03:31 +03:00
John Mulligan
da2731f8da
Merge pull request #68851 from stzuraski898/wip-sz-76513-unittest-analysis-script
scripts: add Jenkins unit test analysis tool

Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
2026-05-27 15:11:47 -04:00
Casey Bodley
0b0fc316f1
Merge pull request #69111 from cbodley/wip-doc-71265
doc/rgw: document s3control apis for PublicAccessBlock

Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>
2026-05-27 14:35:40 -04:00
Gil Bregman
59c06692a3
Merge pull request #69126 from gbregman/main
mgr/dashboard: Add EC pools support to NVMEoF CLI
2026-05-27 21:22:28 +03:00
Casey Bodley
142e167a4f doc/rgw: document s3control apis for PublicAccessBlock
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2026-05-27 14:22:11 -04:00
Casey Bodley
a22627be1e
Merge pull request #68972 from bluikko/wip-common-options-rgw-separator-note
common/options: improve rgw_dns_name and clarify separator

Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2026-05-27 13:23:56 -04:00
Matan Breizman
63ba680afb
Merge pull request #68964 from fultheim/fix-cleaner-gc-autotune
crimson/os/seastore: auto-tune cleaner gc segment pick under random-write

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2026-05-27 19:54:10 +03:00
Xavi Hernandez
c03af0ba8d mgr/smb: fix incorrect referenced variable
An unassigned variable was used in a log message. Replace it by the
relevant one.

Fixes: https://tracker.ceph.com/issues/76947
Signed-off-by: Xavi Hernandez <xhernandez@gmail.com>
2026-05-27 18:10:42 +02:00
NitzanMordhai
981cdf3901
Merge pull request #69125 from NitzanMordhai/wip-nitzan-perf-count-high-cpu
mgr/ThreadMonitor: monitor interval running in seconds and not nanose…

Reviewed-by: Sridhar Seshasayee <sridhar.seshasayee@ibm.com>
2026-05-27 18:44:48 +03:00
Laura Flores
a502b26a8f
Merge pull request #68727 from aainscow/wip_75962
osd: Correct missing list on divergent merge of partial writes

Reviewed-by: Bill Scales <bill_scales@uk.ibm.com>
2026-05-27 10:26:43 -05:00
Matan Breizman
9a08ea7903
Merge pull request #69122 from tchaikov/wip-crimson-silence-unused-warning
crimson/seastore: segment_manager: fix -Wunused warnings

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2026-05-27 17:08:45 +03:00
Casey Bodley
143cb00ba1 doc/rgw: document support for bucket-level PublicAccessBlock
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2026-05-27 10:02:47 -04:00
Matan Breizman
81f1fcbeb4
Merge pull request #69019 from tchaikov/wip-crimson-wake-in-loaded
crimson/osd: wake pgs_creating waiters in PGMap::pg_loaded()

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2026-05-27 16:23:16 +03:00
Gil Bregman
53a697880e mgr/dashboard: Add EC pools support to NVMEoF CLI
Fixes: https://tracker.ceph.com/issues/76937

Signed-off-by: Gil Bregman <gbregman@il.ibm.com>
2026-05-27 16:14:36 +03:00
Casey Bodley
61cd7517b5
Merge pull request #64293 from cbodley/wip-71265
rgw: add s3control apis for account-wide PublicAccessBlock

Reviewed-by: Adam Emerson <aemerson@redhat.com>
2026-05-27 09:08:45 -04:00
Patrick Donnelly
614993a066
qa/tasks/cbt: construct venv just for cbt
So we no longer need to install system-wide.

Avoids errors like on Ubuntu 24.04:

    2026-05-24T13:48:19.681 DEBUG:teuthology.orchestra.run.trial043:> python3 -m pip install -r /home/ubuntu/cephtest/cbt/requirements.txt
    2026-05-24T13:48:19.861 INFO:teuthology.orchestra.run.trial043.stderr:error: externally-managed-environment
    2026-05-24T13:48:19.861 INFO:teuthology.orchestra.run.trial043.stderr:
    2026-05-24T13:48:19.861 INFO:teuthology.orchestra.run.trial043.stderr:× This environment is externally managed
    2026-05-24T13:48:19.861 INFO:teuthology.orchestra.run.trial043.stderr:╰─> To install Python packages system-wide, try apt install
    2026-05-24T13:48:19.862 INFO:teuthology.orchestra.run.trial043.stderr:    python3-xyz, where xyz is the package you are trying to
    2026-05-24T13:48:19.862 INFO:teuthology.orchestra.run.trial043.stderr:    install.
    2026-05-24T13:48:19.862 INFO:teuthology.orchestra.run.trial043.stderr:
    2026-05-24T13:48:19.862 INFO:teuthology.orchestra.run.trial043.stderr:    If you wish to install a non-Debian-packaged Python package,
    2026-05-24T13:48:19.862 INFO:teuthology.orchestra.run.trial043.stderr:    create a virtual environment using python3 -m venv path/to/venv.
    2026-05-24T13:48:19.862 INFO:teuthology.orchestra.run.trial043.stderr:    Then use path/to/venv/bin/python and path/to/venv/bin/pip. Make
    2026-05-24T13:48:19.862 INFO:teuthology.orchestra.run.trial043.stderr:    sure you have python3-full installed.
    2026-05-24T13:48:19.862 INFO:teuthology.orchestra.run.trial043.stderr:
    2026-05-24T13:48:19.862 INFO:teuthology.orchestra.run.trial043.stderr:    If you wish to install a non-Debian packaged Python application,
    2026-05-24T13:48:19.862 INFO:teuthology.orchestra.run.trial043.stderr:    it may be easiest to use pipx install xyz, which will manage a
    2026-05-24T13:48:19.862 INFO:teuthology.orchestra.run.trial043.stderr:    virtual environment for you. Make sure you have pipx installed.
    2026-05-24T13:48:19.863 INFO:teuthology.orchestra.run.trial043.stderr:
    2026-05-24T13:48:19.863 INFO:teuthology.orchestra.run.trial043.stderr:    See /usr/share/doc/python3.12/README.venv for more information.
    2026-05-24T13:48:19.863 INFO:teuthology.orchestra.run.trial043.stderr:
    2026-05-24T13:48:19.863 INFO:teuthology.orchestra.run.trial043.stderr:note: If you believe this is a mistake, please contact your Python installation or OS distribution provider. You can override this, at the risk of breaking your Python installation or OS, by passing --break-system-packages.
    2026-05-24T13:48:19.863 INFO:teuthology.orchestra.run.trial043.stderr:hint: See PEP 668 for the detailed specification.
    2026-05-24T13:48:19.883 DEBUG:teuthology.orchestra.run:got remote process result: 1
    2026-05-24T13:48:19.883 ERROR:teuthology.run_tasks:Saw exception from tasks.
    Traceback (most recent call last):
      File "/home/teuthworker/src/git.ceph.com_teuthology_3686f8793d626abcf5a0018da0a50786e41fed9d/teuthology/run_tasks.py", line 112, in run_tasks
        manager.__enter__()
      File "/home/teuthworker/src/git.ceph.com_teuthology_3686f8793d626abcf5a0018da0a50786e41fed9d/teuthology/task/__init__.py", line 122, in __enter__
        self.setup()
      File "/home/teuthworker/src/github.com_ceph_ceph-c_1bc3c25246d3a6fbc360dc78d9b4b51200743391/qa/tasks/cbt.py", line 173, in setup
        self.install_dependencies()
      File "/home/teuthworker/src/github.com_ceph_ceph-c_1bc3c25246d3a6fbc360dc78d9b4b51200743391/qa/tasks/cbt.py", line 112, in install_dependencies
        self.first_mon.run(args=pip_install_cmd)
      File "/home/teuthworker/src/git.ceph.com_teuthology_3686f8793d626abcf5a0018da0a50786e41fed9d/teuthology/orchestra/remote.py", line 596, in run
        r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
      File "/home/teuthworker/src/git.ceph.com_teuthology_3686f8793d626abcf5a0018da0a50786e41fed9d/teuthology/orchestra/run.py", line 461, in run
        r.wait()
      File "/home/teuthworker/src/git.ceph.com_teuthology_3686f8793d626abcf5a0018da0a50786e41fed9d/teuthology/orchestra/run.py", line 161, in wait
        self._raise_for_status()
      File "/home/teuthworker/src/git.ceph.com_teuthology_3686f8793d626abcf5a0018da0a50786e41fed9d/teuthology/orchestra/run.py", line 181, in _raise_for_status
        raise CommandFailedError(
    teuthology.exceptions.CommandFailedError: Command failed on trial043 with status 1: 'python3 -m pip install -r /home/ubuntu/cephtest/cbt/requirements.txt'

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>
2026-05-27 08:45:53 -04:00
Patrick Donnelly
e9ef70baca
qa/distros: use consistent naming
Put the release name in the yaml name so it's easy to read from the job
description. "ubuntu_latest" means different things depending on the
Ceph release.

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>
2026-05-27 08:45:53 -04:00
Adam King
17cc03da91
qa/tasks/nvme_loop: fix nvme loop task for ubuntu noble
Compared to older distros, this one complains if
you include `-q hostnqn` in the nvme connect command,
saying "Failed to write to /dev/nvme-fabrics: Invalid argument".
Removing that argument gets passed that error and
doesn't seem to have any downsides

Signed-off-by: Adam King <adking@redhat.com>
2026-05-27 08:45:53 -04:00