Your message dated Mon, 17 Oct 2022 10:38:49 +0000
with message-id <[email protected]>
and subject line Bug#1003890: fixed in ceph 16.2.10+ds-3
has caused the Debian Bug report #1003890,
regarding ceph-mgr won't start when backported to Bullseye
to be marked as done.
This means that you claim that the problem has been dealt with.
If this is not the case it is now your responsibility to reopen the
Bug report if necessary, and/or fix the problem forthwith.
(NB: If you are a system administrator and have no idea what this
message is talking about, this may indicate a serious mail system
misconfiguration somewhere. Please contact [email protected]
immediately.)
--
1003890: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1003890
Debian Bug Tracking System
Contact [email protected] with problems
--- Begin Message ---
Package: ceph-mgr
Version: 16.2.7+ds-4
Severity: wishlist
Hi,
I downloaded ceph sources from unsable, and compiled sucessfully on
Bullseye. However once installed/upgraded over from bullseye version of
the packages I can not start ceph-mgr on any node.
At first I was getting an error about the pg_autoscaler module:
Jan 17 12:10:45 pyre systemd[1]: Started Ceph cluster manager daemon.
Jan 17 12:10:47 pyre ceph-mgr[63427]: context.c:56: warning: mpd_setminalloc:
ignoring request to set MPD_MINALLOC a second time
Jan 17 12:10:47 pyre ceph-mgr[63427]: context.c:56: warning: mpd_setminalloc:
ignoring request to set MPD_MINALLOC a second time
Jan 17 12:10:47 pyre ceph-mgr[63427]: context.c:56: warning: mpd_setminalloc:
ignoring request to set MPD_MINALLOC a second time
Jan 17 12:10:48 pyre ceph-mgr[63427]: context.c:56: warning: mpd_setminalloc:
ignoring request to set MPD_MINALLOC a second time
Jan 17 12:10:54 pyre ceph-mgr[63427]: 2022-01-17T12:10:54.556-0500 7fa9217fa700
-1 log_channel(cluster) log [ERR] : Unhandled exception from module
'pg_autoscaler' while running on mgr.pyre: (-18,)
Jan 17 12:10:54 pyre ceph-mgr[63427]: 2022-01-17T12:10:54.556-0500 7fa9217fa700
-1 pg_autoscaler.serve:
Jan 17 12:10:54 pyre ceph-mgr[63427]: 2022-01-17T12:10:54.556-0500 7fa9217fa700
-1 Traceback (most recent call last):
Jan 17 12:10:54 pyre ceph-mgr[63427]: File
"/usr/share/ceph/mgr/pg_autoscaler/module.py", line 272, in serve
Jan 17 12:10:54 pyre ceph-mgr[63427]: self._maybe_adjust()
Jan 17 12:10:54 pyre ceph-mgr[63427]: File
"/usr/share/ceph/mgr/pg_autoscaler/module.py", line 608, in _maybe_adjust
Jan 17 12:10:54 pyre ceph-mgr[63427]: ps, root_map =
self._get_pool_status(osdmap, pools, profile)
Jan 17 12:10:54 pyre ceph-mgr[63427]: File
"/usr/share/ceph/mgr/pg_autoscaler/module.py", line 565, in _get_pool_status
Jan 17 12:10:54 pyre ceph-mgr[63427]: root_map, overlapped_roots =
self.get_subtree_resource_status(osdmap, crush_map)
Jan 17 12:10:54 pyre ceph-mgr[63427]: File
"/usr/share/ceph/mgr/pg_autoscaler/module.py", line 341, in
get_subtree_resource_status
Jan 17 12:10:54 pyre ceph-mgr[63427]: roots, overlapped_roots =
self.identify_subtrees_and_overlaps(osdmap,
Jan 17 12:10:54 pyre ceph-mgr[63427]: File
"/usr/share/ceph/mgr/pg_autoscaler/module.py", line 296, in
identify_subtrees_and_overlaps
Jan 17 12:10:54 pyre ceph-mgr[63427]: osds =
set(crush.get_osds_under(root_id))
Jan 17 12:10:54 pyre ceph-mgr[63427]: File
"/usr/share/ceph/mgr/mgr_module.py", line 292, in get_osds_under
Jan 17 12:10:54 pyre ceph-mgr[63427]: accumulate(buckets[root_id])
Jan 17 12:10:54 pyre ceph-mgr[63427]: KeyError: -18
However still not having any luck after disabling that module. Now I
get this:
Jan 17 12:24:45 pyre ceph-mgr[67556]: ceph version 16.2.7
(dd0603118f56ab514f133c8d2e3adfc983942503) pacific (stable)
Jan 17 12:24:45 pyre ceph-mgr[67556]: 1: (ceph::__ceph_assert_fail(char
const*, char const*, int, char const*)+0x124) [0x7efebab0d120]
Jan 17 12:24:45 pyre ceph-mgr[67556]: 2:
/usr/lib/x86_64-linux-gnu/ceph/libceph-common.so.2(+0x24a2ab) [0x7efebab0d2ab]
Jan 17 12:24:45 pyre ceph-mgr[67556]: 3:
(CrushWrapper::_get_take_weight_osd_map(int, std::map<int, float,
std::less<int>, std::allocator<std::pair<int const, float> > >*) const+0x201)
[0x7efebb097b11]
Jan 17 12:24:45 pyre ceph-mgr[67556]: 4:
(CrushWrapper::get_rule_weight_osd_map(unsigned int, std::map<int, float,
std::less<int>, std::allocator<std::pair<int const, float> > >*) const+0x15b)
[0x7efebb097d3b]
Jan 17 12:24:45 pyre ceph-mgr[67556]: 5: (PGMap::get_rule_avail(OSDMap const&,
int) const+0x66) [0x555fc9c84166]
Jan 17 12:24:45 pyre ceph-mgr[67556]: 6: (PGMap::get_rules_avail(OSDMap
const&, std::map<int, long, std::less<int>, std::allocator<std::pair<int const,
long> > >*) const+0x1cd) [0x555fc9c8461d]
Jan 17 12:24:45 pyre ceph-mgr[67556]: 7: (PGMap::encode_digest(OSDMap const&,
ceph::buffer::v15_2_0::list&, unsigned long)+0x20) [0x555fc9c84730]
Jan 17 12:24:45 pyre ceph-mgr[67556]: 8: (DaemonServer::send_report()+0x616)
[0x555fc9d2f656]
Jan 17 12:24:45 pyre ceph-mgr[67556]: 9:
(DaemonServer::maybe_ready(int)+0x633) [0x555fc9d308e3]
Jan 17 12:24:45 pyre ceph-mgr[67556]: 10:
(DaemonServer::ms_dispatch2(boost::intrusive_ptr<Message> const&)+0xef)
[0x555fc9d4165f]
Jan 17 12:24:45 pyre ceph-mgr[67556]: 11:
(Messenger::ms_deliver_dispatch(boost::intrusive_ptr<Message> const&)+0x468)
[0x7efebad2f518]
Jan 17 12:24:45 pyre ceph-mgr[67556]: 12: (DispatchQueue::entry()+0x5ef)
[0x7efebad2cc3f]
Jan 17 12:24:45 pyre ceph-mgr[67556]: 13:
(DispatchQueue::DispatchThread::entry()+0xd) [0x7efebadec21d]
Jan 17 12:24:45 pyre ceph-mgr[67556]: 14:
/lib/x86_64-linux-gnu/libpthread.so.0(+0x8ea7) [0x7efeba4feea7]
Jan 17 12:24:45 pyre ceph-mgr[67556]: 15: clone()
Jan 17 12:24:45 pyre ceph-mgr[67556]: 0> 2022-01-17T12:24:45.814-0500
7efe8b1ee700 -1 *** Caught signal (Aborted) **
Jan 17 12:24:45 pyre ceph-mgr[67556]: in thread 7efe8b1ee700
thread_name:ms_dispatch
Jan 17 12:24:45 pyre ceph-mgr[67556]: ceph version 16.2.7
(dd0603118f56ab514f133c8d2e3adfc983942503) pacific (stable)
Jan 17 12:24:45 pyre ceph-mgr[67556]: 1:
/lib/x86_64-linux-gnu/libpthread.so.0(+0x14140) [0x7efeba50a140]
Jan 17 12:24:45 pyre ceph-mgr[67556]: 2: gsignal()
Jan 17 12:24:45 pyre ceph-mgr[67556]: 3: abort()
Jan 17 12:24:45 pyre ceph-mgr[67556]: 4: (ceph::__ceph_assert_fail(char
const*, char const*, int, char const*)+0x16e) [0x7efebab0d16a]
Jan 17 12:24:45 pyre ceph-mgr[67556]: 5:
/usr/lib/x86_64-linux-gnu/ceph/libceph-common.so.2(+0x24a2ab) [0x7efebab0d2ab]
Jan 17 12:24:45 pyre ceph-mgr[67556]: 6:
(CrushWrapper::_get_take_weight_osd_map(int, std::map<int, float,
std::less<int>, std::allocator<std::pair<int const, float> > >*) const+0x201)
[0x7efebb097b11]
Jan 17 12:24:45 pyre ceph-mgr[67556]: 7:
(CrushWrapper::get_rule_weight_osd_map(unsigned int, std::map<int, float,
std::less<int>, std::allocator<std::pair<int const, float> > >*) const+0x15b)
[0x7efebb097d3b]
Jan 17 12:24:45 pyre ceph-mgr[67556]: 8: (PGMap::get_rule_avail(OSDMap const&,
int) const+0x66) [0x555fc9c84166]
Jan 17 12:24:45 pyre ceph-mgr[67556]: 9: (PGMap::get_rules_avail(OSDMap
const&, std::map<int, long, std::less<int>, std::allocator<std::pair<int const,
long> > >*) const+0x1cd) [0x555fc9c8461d]
Jan 17 12:24:45 pyre ceph-mgr[67556]: 10: (PGMap::encode_digest(OSDMap const&,
ceph::buffer::v15_2_0::list&, unsigned long)+0x20) [0x555fc9c84730]
Jan 17 12:24:45 pyre ceph-mgr[67556]: 11: (DaemonServer::send_report()+0x616)
[0x555fc9d2f656]
Jan 17 12:24:45 pyre ceph-mgr[67556]: 12:
(DaemonServer::maybe_ready(int)+0x633) [0x555fc9d308e3]
Jan 17 12:24:45 pyre ceph-mgr[67556]: 13:
(DaemonServer::ms_dispatch2(boost::intrusive_ptr<Message> const&)+0xef)
[0x555fc9d4165f]
Jan 17 12:24:45 pyre ceph-mgr[67556]: 14:
(Messenger::ms_deliver_dispatch(boost::intrusive_ptr<Message> const&)+0x468)
[0x7efebad2f518]
Jan 17 12:24:45 pyre ceph-mgr[67556]: 15: (DispatchQueue::entry()+0x5ef)
[0x7efebad2cc3f]
Jan 17 12:24:45 pyre ceph-mgr[67556]: 16:
(DispatchQueue::DispatchThread::entry()+0xd) [0x7efebadec21d]
Jan 17 12:24:45 pyre ceph-mgr[67556]: 17:
/lib/x86_64-linux-gnu/libpthread.so.0(+0x8ea7) [0x7efeba4feea7]
Jan 17 12:24:45 pyre ceph-mgr[67556]: 18: clone()
Jan 17 12:24:45 pyre ceph-mgr[67556]: NOTE: a copy of the executable, or
`objdump -rdS <executable>` is needed to interpret this.
Jan 17 12:24:45 pyre ceph-mgr[67556]: -383> 2022-01-17T12:24:45.262-0500
7efe1cff9700 -1 client.0 error registering admin socket command: (17) File
exists
Jan 17 12:24:45 pyre ceph-mgr[67556]: -381> 2022-01-17T12:24:45.262-0500
7efe1f7fe700 -1 client.0 error registering admin socket command: (17) File
exists
Jan 17 12:24:45 pyre ceph-mgr[67556]: -379> 2022-01-17T12:24:45.262-0500
7efe1cff9700 -1 client.0 error registering admin socket command: (17) File
exists
Jan 17 12:24:45 pyre ceph-mgr[67556]: -377> 2022-01-17T12:24:45.262-0500
7efe1cff9700 -1 client.0 error registering admin socket command: (17) File
exists
Jan 17 12:24:45 pyre ceph-mgr[67556]: -375> 2022-01-17T12:24:45.262-0500
7efe1cff9700 -1 client.0 error registering admin socket command: (17) File
exists
Jan 17 12:24:45 pyre ceph-mgr[67556]: -373> 2022-01-17T12:24:45.262-0500
7efe1cff9700 -1 client.0 error registering admin socket command: (17) File
exists
Jan 17 12:24:45 pyre ceph-mgr[67556]: -370> 2022-01-17T12:24:45.262-0500
7efe1f7fe700 -1 client.0 error registering admin socket command: (17) File
exists
Jan 17 12:24:45 pyre ceph-mgr[67556]: -365> 2022-01-17T12:24:45.262-0500
7efe1f7fe700 -1 client.0 error registering admin socket command: (17) File
exists
Jan 17 12:24:45 pyre ceph-mgr[67556]: -361> 2022-01-17T12:24:45.262-0500
7efe1f7fe700 -1 client.0 error registering admin socket command: (17) File
exists
Jan 17 12:24:45 pyre ceph-mgr[67556]: -357> 2022-01-17T12:24:45.262-0500
7efe1f7fe700 -1 client.0 error registering admin socket command: (17) File
exists
Jan 17 12:24:45 pyre ceph-mgr[67556]: -1> 2022-01-17T12:24:45.814-0500
7efe8b1ee700 -1 ./src/crush/CrushWrapper.cc: In function 'float
CrushWrapper::_get_take_weight_osd_map(int, std::map<int, float>*) const'
thread 7efe8b1ee700 time 2022-01-17T12:24:45.817338-0500
Jan 17 12:24:45 pyre ceph-mgr[67556]: ./src/crush/CrushWrapper.cc: 2393: FAILED
ceph_assert(b)
Thought I'd check to see if you have any ideas. I have no idea what
FAILED ceph_assert(b) is. I assume this doesn't happen on unstable?
-- System Information:
Debian Release: 11.2
APT prefers stable-updates
APT policy: (905, 'stable-updates'), (905, 'stable'), (400, 'testing')
Architecture: amd64 (x86_64)
Foreign Architectures: i386
Kernel: Linux 5.10.0-10-amd64 (SMP w/12 CPU threads)
Kernel taint flags: TAINT_PROPRIETARY_MODULE, TAINT_OOT_MODULE,
TAINT_UNSIGNED_MODULE
Locale: LANG=en_CA.UTF-8, LC_CTYPE=en_CA.UTF-8 (charmap=UTF-8), LANGUAGE not set
Shell: /bin/sh linked to /bin/dash
Init: systemd (via /run/systemd/system)
LSM: AppArmor: enabled
Versions of packages ceph-mgr depends on:
ii ceph-base 16.2.7+ds-4
ii ceph-mgr-modules-core 16.2.7+ds-4
ii libboost-python1.74.0 [libboost-python1.74.0-py39] 1.74.0-9
ii libc6 2.31-13+deb11u2
ii libfmt7 7.1.3+ds1-5
ii libgcc-s1 10.2.1-6
ii libpython3.9 3.9.2-1
ii librados2 16.2.7+ds-4
ii libstdc++6 10.2.1-6
ii python3-bcrypt 3.1.7-4
ii python3-cherrypy3 8.9.1-8
ii python3-jwt 1.7.1-2
ii python3-openssl 20.0.1-1
ii python3-pecan 1.3.3-3
ii python3-requests 2.25.1+dfsg-2
ii python3-werkzeug 1.0.1+dfsg1-2
ceph-mgr recommends no packages.
Versions of packages ceph-mgr suggests:
ii ceph-mgr-dashboard 16.2.7+ds-4
pn ceph-mgr-diskprediction-local <none>
pn ceph-mgr-rook <none>
-- no debconf information
--- End Message ---
--- Begin Message ---
Source: ceph
Source-Version: 16.2.10+ds-3
Done: Thomas Goirand <[email protected]>
We believe that the bug you reported is fixed in the latest version of
ceph, which is due to be installed in the Debian FTP archive.
A summary of the changes between this version and the previous one is
attached.
Thank you for reporting the bug, which will now be closed. If you
have further comments please address them to [email protected],
and the maintainer will reopen the bug report if appropriate.
Debian distribution maintenance software
pp.
Thomas Goirand <[email protected]> (supplier of updated ceph package)
(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing [email protected])
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256
Format: 1.8
Date: Thu, 22 Sep 2022 15:35:37 +0200
Source: ceph
Architecture: source
Version: 16.2.10+ds-3
Distribution: unstable
Urgency: medium
Maintainer: Ceph Packaging Team <[email protected]>
Changed-By: Thomas Goirand <[email protected]>
Closes: 1003890 1012489 1018837 1020489
Changes:
ceph (16.2.10+ds-3) unstable; urgency=medium
.
* Fix mgr modules fail to run due to "PY_SSIZE_T_CLEAN macro must be defined
for '#'": add mgr-Define-PY_SSIZE_T_CLEAN-ahead-of-every-Python.h.patch
backported from upstream (Closes: #1020489, #1003890).
* Fix debian/cephfs-shell.install (it was doing FTBFS with file not found).
* Add fix-CheckCxxAtomic-riscv64.patch (Closes: #1018837).
* Remove arch-qualifier for libboost-context-dev and libboost-coroutine-dev
as Ceph FTBFS without these libs anyways (Closes: #1012489).
Checksums-Sha1:
78d5ba6c6c124faf69dae6096e2b0b9273d89d36 8082 ceph_16.2.10+ds-3.dsc
f4f51bd88e40b3857588e63d473e99b1442a07fe 119308 ceph_16.2.10+ds-3.debian.tar.xz
bae668f83f43b164be44831672a2ae622191e33d 41438
ceph_16.2.10+ds-3_amd64.buildinfo
Checksums-Sha256:
111795d71108d07642f313bae2861694f47968542195cd93aa5e235c8e591a23 8082
ceph_16.2.10+ds-3.dsc
7193792a5febad8ab5b0b372f202bc8be1df1f290c1146409c6935b4be122896 119308
ceph_16.2.10+ds-3.debian.tar.xz
c45cf4e882008846026370d25a0047726e4525bcd0f60d9122a8d96dae1a3136 41438
ceph_16.2.10+ds-3_amd64.buildinfo
Files:
94e8affc2c5563514410d70af45c6492 8082 admin optional ceph_16.2.10+ds-3.dsc
39c5d4010fa3d159d99c85443892716c 119308 admin optional
ceph_16.2.10+ds-3.debian.tar.xz
5476cc97bfb8d52bee3f94ec1e5c9a9d 41438 admin optional
ceph_16.2.10+ds-3_amd64.buildinfo
-----BEGIN PGP SIGNATURE-----
iQIzBAEBCAAdFiEEoLGp81CJVhMOekJc1BatFaxrQ/4FAmNNK0YACgkQ1BatFaxr
Q/4nig/+Pj6rgLepIOfsSJ0FTnIBWQIw6kjmhC33ko5FNwT1yTshpNunl7djZ1/J
kmOxvRl7Fe7ZY1diAs05AMNCV+4H/kY0iPsSQWiCw9LDPefAq4Wf34EtEsfd3Vnt
TtXvJ6Hx0UpQ/SFU1OWchbL9dDzJK0LI51hj+QqDUDRskhISSr50M+BknI2VVhRy
eKFoPccWQ2h1skvRLS4dGe5PdHbmyo3eVU5LxT0hYxsQJMtBphr+8boMzVfFmW4u
Q3lnyFPZ4toYky2tx2zTMXIwGlVF1udNE0LsKaBb1N3XhNe22wOTxWQZK0VzklCc
inv96fu6dbIzKgXzXROjX0jhvr+vbvAezvM54qU09QETC7U9KGqTyEGbNzOFDIVB
b+RNan8ySVY8yYQu16H9UMQ6w2ydOkE7iZZm2B7umwGw5T1qRvYsrkU+kUa15fOT
UFx5TsS55LO/b0AMbPN0DB/EQF7US/fBYyEwzzwHyRvLhggGVCCF60CWMqKEV2N2
OV3pTlsQQLoZLKhKZwHhc+sVh6N3gUucBPAbfseLt39IpCRr2hf4JIDMD81hLyuV
qnG3Dekuzhti26JDlSHQAynXgGnvOwTeP9D7rOdhxD0X5l002J6jyaOunK7GZU6r
xSja5Q/OgIm5rvpRppD8I8kN6t528tw2mv8cTSdRf1XVjLvG0DU=
=PpNK
-----END PGP SIGNATURE-----
--- End Message ---
