ceph-mirror/src
Igor Fedotov 1b443af34c os/bluesore,kv/rocksdbstore: dump KV txc ops when slow
Depending on bluestore_log_op_verbose parameter one can see either
short:
2026-05-20T19:45:05.792+0300 7f60980006c0  0
bluestore(/home/if/ceph.2/build/dev/osd0) log_latency_fn slow operation
observed for _txc_committed_kv, latency = 0.004759922s, txc =
0x55c357bde900, txc bytes = 2756989, txc ios = 43, txc cost = 31566989,
txc onodes = 1, DB ops = ' p:P, p:P, p:O, p:O, p:O, p:O, p:O, p:O, p:O,
p:O, p:O, p:L, m:b, m:b, m:b, m:b, m:b, m:b, m:b, m:b, m:b, m:b, m:b,
m:b', DB updates = 24, DB bytes = 8937, cost max = 95489052 on
2026-05-20T18:38:20.749901+0300, txc max = 100 on
2026-05-20T18:38:21.215016+0300

or verbose:
2026-05-20T18:42:01.551+0300 7f60980006c0  0
bluestore(/home/if/ceph.2/build/dev/osd0) log_latency_fn slow operation
observed for _txc_committe
d_kv, latency = 0.003735413s, txc = 0x55c356a35500, txc bytes = 2757061,
txc ios = 44, txc cost = 32237061, txc onodes = 1, DB ops = '
PutCF( prefix = P key =
0x0000000000000499'.0000000032.00000000000000000005' value size = 185)
PutCF( prefix = P key = 0x0000000000000499'._fastinfo' value size = 194)
PutCF( prefix = O key =
0x7F8000000000000002DB7D25F2'!c!='0xFFFFFFFFFFFFFFFEFFFFFFFFFFFFFFFF6F0000000078
value size = 453)
PutCF( prefix = O key =
0x7F8000000000000002DB7D25F2'!c!='0xFFFFFFFFFFFFFFFEFFFFFFFFFFFFFFFF6F0006000078
value size = 455)
PutCF( prefix = O key =
0x7F8000000000000002DB7D25F2'!c!='0xFFFFFFFFFFFFFFFEFFFFFFFFFFFFFFFF6F000C000078
value size = 455)
PutCF( prefix = O key =
0x7F8000000000000002DB7D25F2'!c!='0xFFFFFFFFFFFFFFFEFFFFFFFFFFFFFFFF6F0012000078
value size = 455)
PutCF( prefix = O key =
0x7F8000000000000002DB7D25F2'!c!='0xFFFFFFFFFFFFFFFEFFFFFFFFFFFFFFFF6F0018000078
value size = 455)
PutCF( prefix = O key =
0x7F8000000000000002DB7D25F2'!c!='0xFFFFFFFFFFFFFFFEFFFFFFFFFFFFFFFF6F001E000078
value size = 455)
PutCF( prefix = O key =
0x7F8000000000000002DB7D25F2'!c!='0xFFFFFFFFFFFFFFFEFFFFFFFFFFFFFFFF6F0024000078
value size = 455)
PutCF( prefix = O key =
0x7F8000000000000002DB7D25F2'!c!='0xFFFFFFFFFFFFFFFEFFFFFFFFFFFFFFFF6F002A000078
value size = 21)
PutCF( prefix = O key =
0x7F8000000000000002DB7D25F2'!c!='0xFFFFFFFFFFFFFFFEFFFFFFFFFFFFFFFF6F
value size = 388)
MergeCF( prefix = b key = 0x0000000019080000 value size = 16)
MergeCF( prefix = b key = 0x0000000019100000 value size = 16)
MergeCF( prefix = b key = 0x0000000019180000 value size = 16)
MergeCF( prefix = b key = 0x0000000019200000 value size = 16)
MergeCF( prefix = b key = 0x0000000019280000 value size = 16)
MergeCF( prefix = b key = 0x0000000019300000 value size = 16)
MergeCF( prefix = T key = 0x0000000000000002 value size = 40)', DB
updates = 18, DB bytes = 4668, cost max = 95489052 on
2026-05-20T18:38:20.74
9901+0300, txc max = 100 on 2026-05-20T18:38:21.215016+0300

operations list when BlueStore observes slow op on KV commit.

Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
2026-07-01 16:19:11 +03:00
..
arch Merge pull request #68098 from sunyuechi/riscv-isa-l-support 2026-06-02 11:47:35 +08:00
arrow@272715f6df rgw: bump Apache Arrow submodule from 17.0.0 to 19.0.1 2026-05-24 18:57:04 +08:00
auth auth/cephx/CephxKeyServer: un-inline methods to reduce header dependencies 2026-03-09 21:29:41 +01:00
bash_completion
BLAKE3@92e4cd71be
blk Merge pull request #66344 from JoshuaGabriel/68797-bdev-expand-admin 2026-06-30 15:13:45 +03:00
blkin@f24ceec055
breakpad@41b6533e5f
c-ares@fd6124c74d
ceph-node-proxy node-proxy: expose FCM stats 2026-06-24 04:17:52 +02:00
ceph-volume ceph-volume: skip internal raid mirror LVs in inventory 2026-06-19 08:27:04 +02:00
cephadm Merge pull request #69808 from rkachach/fix_issue_bump_python_version 2026-06-30 14:09:48 +02:00
client client: fix Dentry UAF by holding DentryRef across unlink 2026-07-01 11:04:38 +05:30
cls Merge pull request #68912 from adamemerson/wip-cls-timeindex-build 2026-06-26 17:52:44 -04:00
common os/bluesore,kv/rocksdbstore: dump KV txc ops when slow 2026-07-01 16:19:11 +03:00
compressor Merge pull request #69188 from sunyuechi/zstd-system-include 2026-06-08 21:34:54 +08:00
crimson Merge pull request #69711 from ronen-fr/wip-rf-mold3 2026-06-30 14:49:36 +03:00
crush Merge pull request #68662 from kamoltat/wip-ksirivad-stretch-crush-experiment 2026-06-16 09:53:01 +05:30
crypto rgw: restore constant-time GCM tag comparison in ISA-L path 2026-06-23 07:02:05 -05:00
dmclock dmclock: Integrate fully into Ceph project 2026-01-14 23:54:02 -05:00
doc Added blank line after header block 2025-10-02 17:35:10 -04:00
dokan
erasure-code erasure-code/consistency: Extend get shard/osd to specify namespace. 2026-05-28 15:15:50 +01:00
exporter
extblkdev extblkdev/fcm: Replace errors with health warning 2026-04-22 14:22:18 +00:00
fmt@123913715a
global Merge pull request #63390 from taodd/fix-ms_async_op_threads 2025-11-20 08:54:19 +05:30
googletest@6910c9d916
include Add FoundationDB client library "libfdb". 2026-06-30 09:06:20 -07:00
isa-l@c196241ae8 isa-l: Update isa-l submodule from 2.30.0 to 2.32.0 2026-03-11 22:21:22 +00:00
jaegertracing
java java/native/libcephfs_jni: add missing include 2026-03-18 11:51:00 +01:00
journal journal/ObjectPlayer: don't acquire locks in destructor 2026-06-18 19:42:49 +08:00
json_spirit Merge pull request #64966 from edwinzrodriguez/ceph-wip-72474 2025-12-10 14:55:14 -08:00
kv os/bluesore,kv/rocksdbstore: dump KV txc ops when slow 2026-07-01 16:19:11 +03:00
libcephfs_proxy libcephfs_proxy: remove unused field in protocol 2026-04-09 13:38:55 +02:00
libkmip@c05329f82a
librados build: add Mold linker compatibility 2026-06-28 14:53:54 +00:00
libradosstriper Merge pull request #65742 from edwinzrodriguez/ceph-clang-format-cc 2025-10-08 16:17:02 -07:00
librbd librbd: fix use-after-free in trash purge on image open error 2026-07-01 00:13:42 +08:00
log test/osd: Improve test logging with OSD identification 2026-06-08 13:06:01 +01:00
lss@ed31caa60f
mds mds: add MDS code to allow snap metadata mutations 2026-06-18 11:57:45 +05:30
messages Merge pull request #64618 from sseshasa/wip-fix-mclock-slow-ops-during-recovery 2026-06-12 18:37:50 +05:30
mgr Merge pull request #69755 from tchaikov/wip-mgr-remote-pyunicode-leak 2026-06-29 16:29:57 +08:00
mon Merge pull request #69675 from NitzanMordhai/wip-nitzan-config-trim-key-trail-lead-spaces 2026-06-29 11:02:24 +03:00
mount Update indent settings cc 2025-10-02 17:32:57 -04:00
msg crimson/osd: reject Seastore PG merges across shards 2026-06-11 10:25:49 +05:30
neorados cmake: link legacy-option-headers from targets that use legacy options 2026-06-01 19:41:15 +08:00
nvmeof Merge pull request #68792 from MaxKellermann/nvmeof__missing_includes 2026-06-27 14:13:23 +08:00
objclass librados: enforce compile-time read/write semantics for class methods 2026-04-13 10:38:24 +01:00
objsync
ocf
os os/bluesore,kv/rocksdbstore: dump KV txc ops when slow 2026-07-01 16:19:11 +03:00
osd Merge pull request #69537 from tchaikov/wip-crimson-compile-time-fmt-check 2026-06-30 08:18:18 +08:00
osdc Merge pull request #69253 from cbodley/wip-76725 2026-06-09 08:24:19 -04:00
perfglue cmake: link legacy-option-headers from targets that use legacy options 2026-06-01 19:41:15 +08:00
powerdns
pybind Merge pull request #68180 from rhcs-dashboard/bug-13712 2026-07-01 16:21:00 +05:30
python-common Merge pull request #69736 from gbregman/main 2026-06-26 10:18:04 +03:00
qatlib@142e305970
qatzip@fdee557b5b
rbd_fuse
rbd_replay rbd: make enums statically castable 2026-01-09 19:14:55 +01:00
rgw Add FoundationDB client library "libfdb". 2026-06-30 09:06:20 -07:00
rocksdb@c7a7c6340c rocksdb: update submodule to fix FTBFS due to missing <cstdint> 2026-06-19 19:22:44 +08:00
s3select@0a0f6d4394
script Merge pull request #69440 from jdurgin/wip-release-notes-script 2026-06-30 15:36:42 -07:00
seastar@15b1ca1bec seastar: bump up seastar submodule 2026-03-02 11:24:01 +00:00
spdk@82fcb24851
telemetry
test Add FoundationDB client library "libfdb". 2026-06-30 09:06:20 -07:00
tools tools: add missing includes 2026-06-25 21:42:29 +02:00
tracing
utf8proc@d7bf128df7 rgw: bump up versions of Apache Arrow and utf8proc submodules 2025-10-06 14:12:33 -04:00
xxHash@bbb27a5efb
zstd@794ea1b0af zstd: update submodule to v1.5.6 2025-10-31 12:24:01 -04:00
.gitignore
ceph_common.sh qa,src: replace deprecated egrep/fgrep with grep -E/grep -F 2026-03-29 14:39:07 +02:00
ceph_fuse.cc Add missing blank line after comment block 2025-10-02 17:32:57 -04:00
ceph_mds.cc Add missing blank line after comment block 2025-10-02 17:32:57 -04:00
ceph_mgr.cc Add missing blank line after comment block 2025-10-02 17:32:57 -04:00
ceph_mon.cc mon: add monitor RocksDB backup and restore 2026-06-17 19:24:52 -05:00
ceph_nvmeof_monitor_client.cc Add missing blank line after comment block 2025-10-02 17:32:57 -04:00
ceph_osd.cc os/bluestore: Add config bluestore_use_ebd 2026-03-25 09:35:04 +00:00
ceph_release ceph_release: update to umbrella 2026-03-25 16:53:03 +00:00
ceph_release.h.in.cmake
ceph_syn.cc Add missing blank line after comment block 2025-10-02 17:32:57 -04:00
ceph_ver.c
ceph_ver.h.in.cmake
ceph-clsinfo
ceph-coverage.in
ceph-crash.in ceph-crash: reduce log noise from auth fallback in post_crash() 2026-04-09 21:00:26 +08:00
ceph-create-keys
ceph-debugpack.in
ceph-osd-prestart.sh
ceph-post-file.in
ceph-rbdnamer
ceph-run
ceph.conf.twoosds
ceph.in ceph.in: load asan/lsan suppressions on WITH_ASAN builds 2026-06-23 23:02:05 +08:00
cephfs.pc.in
ckill.sh
CMakeLists.txt Merge pull request #69537 from tchaikov/wip-crimson-compile-time-fmt-check 2026-06-30 08:18:18 +08:00
cmonctl
cstart.sh
etc-rbdmap
init-ceph.in qa,src: replace deprecated egrep/fgrep with grep -E/grep -F 2026-03-29 14:39:07 +02:00
init-radosgw
krbd.cc
libcephfs.cc Merge PR #69324 into main 2026-06-30 19:09:27 +05:30
libcephsqlite.cc libcephsqlite: ensure atexit handlers are registered after openssl 2026-04-07 16:44:39 -04:00
librados-config.cc Add missing blank line after comment block 2025-10-02 17:32:57 -04:00
loadclass.sh
logrotate.conf logrotate: send SIGHUP to ceph-exporter on log rotation 2026-05-21 11:40:08 +08:00
mount.fuse.ceph
mrgw.sh
mrun
mstart.sh
mstop.sh
multi-dump.sh
mypy-constrains.txt
mypy.ini Merge pull request #69510 from tchaikov/wip-cryptotools-sans-pyopenssl 2026-06-26 14:29:38 +08:00
nasm-wrapper
perf_histogram.h Add blank line after header block 2025-10-02 17:33:40 -04:00
ps-ceph.pl
push_to_qemu.pl
rbd-replay-many
rbdmap
README
sample.ceph.conf
SimpleRADOSStriper.cc Update indent settings cc 2025-10-02 17:32:57 -04:00
SimpleRADOSStriper.h Update indent settings h 2025-10-02 17:33:40 -04:00
stop.sh
TODO
vnewosd.sh
vstart.sh vstart: load lsan/asan suppressions on WITH_ASAN builds 2026-06-22 13:41:04 +08:00

Sage Weil <sage@newdream.net>
Ceph - scalable distributed storage system