[Bug 1452312] Re: glance-registry process spins if rsyslog restarted with syslog logging enabled
This bug was fixed in the package python-eventlet - 0.13.0-1ubuntu2.2 --- python-eventlet (0.13.0-1ubuntu2.2) trusty; urgency=medium * d/p/handle-ENOTCONN.patch: Ensure that ENOTCONN socket errors are raised correctly, resolving issues with disconnected syslog sockets in OpenStack Glance (LP: #1452312). -- James Page Tue, 26 May 2015 17:22:24 +0100 ** Changed in: python-eventlet (Ubuntu Trusty) Status: Fix Committed => Fix Released -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1452312 Title: glance-registry process spins if rsyslog restarted with syslog logging enabled To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/python-eventlet/+bug/1452312/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1452312] Re: glance-registry process spins if rsyslog restarted with syslog logging enabled
This bug was fixed in the package python-eventlet - 0.16.1-0ubuntu1.1 --- python-eventlet (0.16.1-0ubuntu1.1) vivid; urgency=medium * d/p/handle-ENOTCONN.patch: Ensure that ENOTCONN socket errors are raised correctly, resolving issues with disconnected syslog sockets in OpenStack Glance (LP: #1452312). -- James Page Tue, 26 May 2015 17:28:40 +0100 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1452312 Title: glance-registry process spins if rsyslog restarted with syslog logging enabled To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/python-eventlet/+bug/1452312/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1452312] Re: glance-registry process spins if rsyslog restarted with syslog logging enabled
This bug was fixed in the package python-eventlet - 0.13.0-1ubuntu3.3 --- python-eventlet (0.13.0-1ubuntu3.3) utopic; urgency=medium * d/p/handle-ENOTCONN.patch: Ensure that ENOTCONN socket errors are raised correctly, resolving issues with disconnected syslog sockets in OpenStack Glance (LP: #1452312). -- James Page Tue, 26 May 2015 17:20:06 +0100 ** Changed in: python-eventlet (Ubuntu Utopic) Status: Fix Committed => Fix Released ** Changed in: python-eventlet (Ubuntu Vivid) Status: Fix Committed => Fix Released -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1452312 Title: glance-registry process spins if rsyslog restarted with syslog logging enabled To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/python-eventlet/+bug/1452312/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1452312] Re: glance-registry process spins if rsyslog restarted with syslog logging enabled
@hopem, We've running on this (proposed) code for few weeks already, works fine. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1452312 Title: glance-registry process spins if rsyslog restarted with syslog logging enabled To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/python-eventlet/+bug/1452312/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1452312] Re: glance-registry process spins if rsyslog restarted with syslog logging enabled
0. set up keystone, glance 1. stop rsyslogd while glance-api, registry is running 2. run comamnd "glance image-list" 3. CPU usage is getting high trusty ii python-eventlet 0.13.0-1ubuntu2.2all concurrent networking library for Python utopic ii python-eventlet 0.13.0-1ubuntu3.3all concurrent networking library for Python vivid ii python-eventlet 0.16.1-0ubuntu1.1all concurrent networking library - Python 2.x ** Tags removed: verification-needed ** Tags added: verification-done -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1452312 Title: glance-registry process spins if rsyslog restarted with syslog logging enabled To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/python-eventlet/+bug/1452312/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1452312] Re: glance-registry process spins if rsyslog restarted with syslog logging enabled
@george-shuklin the package will remain in trusty-proposed until it has been verified. If you want to help test this package please enable the proposed pocket in your /etc/apt/sources.list, run apt-get update and install the package. Thanks! -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1452312 Title: glance-registry process spins if rsyslog restarted with syslog logging enabled To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/python-eventlet/+bug/1452312/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1452312] Re: glance-registry process spins if rsyslog restarted with syslog logging enabled
Hello. I can't see update nor in trusty-updates nor in trusty- updates/juno/main. It still contains 0.13.0-1ubuntu3.2~cloud0 instead of 0.13.0-1ubuntu3.3 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1452312 Title: glance-registry process spins if rsyslog restarted with syslog logging enabled To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/python-eventlet/+bug/1452312/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1452312] Re: glance-registry process spins if rsyslog restarted with syslog logging enabled
This bug was fixed in the package python-eventlet - 0.17.3-2ubuntu2 --- python-eventlet (0.17.3-2ubuntu2) wily; urgency=medium * d/p/handle-ENOTCONN.patch: Ensure that ENOTCONN socket errors are raised correctly, resolving issues with disconnected syslog sockets in OpenStack Glance (LP: #1452312). -- James Page Tue, 26 May 2015 16:45:17 +0100 ** Changed in: python-eventlet (Ubuntu Wily) Status: Confirmed => Fix Released -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1452312 Title: glance-registry process spins if rsyslog restarted with syslog logging enabled To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/python-eventlet/+bug/1452312/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1452312] Re: glance-registry process spins if rsyslog restarted with syslog logging enabled
Note that this behaviour was originally reported here: https://bugs.launchpad.net/oslo.log/+bug/1076466 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1452312 Title: glance-registry process spins if rsyslog restarted with syslog logging enabled To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/python-eventlet/+bug/1452312/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1452312] Re: glance-registry process spins if rsyslog restarted with syslog logging enabled
** Branch linked: lp:ubuntu/wily-proposed/python-eventlet ** Branch linked: lp:ubuntu/vivid-proposed/python-eventlet ** Branch linked: lp:ubuntu/trusty-proposed/python-eventlet ** Branch linked: lp:ubuntu/utopic-proposed/python-eventlet -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1452312 Title: glance-registry process spins if rsyslog restarted with syslog logging enabled To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/python-eventlet/+bug/1452312/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1452312] Re: glance-registry process spins if rsyslog restarted with syslog logging enabled
Hello James, or anyone else affected, Accepted python-eventlet into trusty-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/python- eventlet/0.13.0-1ubuntu2.2 in a few hours, and then in the -proposed repository. Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users. If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-needed to verification-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed. In either case, details of your testing will help us make a better decision. Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance! ** Changed in: python-eventlet (Ubuntu Trusty) Status: Confirmed => Fix Committed ** Tags added: verification-needed ** Changed in: python-eventlet (Ubuntu Utopic) Status: Confirmed => Fix Committed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1452312 Title: glance-registry process spins if rsyslog restarted with syslog logging enabled To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/python-eventlet/+bug/1452312/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1452312] Re: glance-registry process spins if rsyslog restarted with syslog logging enabled
** Description changed:
- When configured to log to syslog, if the rsyslog process is restarted,
- then the glance-registry process goes into a spin, consuming 100% of CPU
- - strace:
+ [Impact]
+ Glance, when configured to log to syslog, will spin consuming 100% cpu if
syslog is restarted, locking all function.
+
+ [Test Case]
+ Install OpenStack Glance as part of a OpenStack Cloud
+ Configure to log to syslog
+ Restart syslog (sudo service rsyslog restart)
+
+ [Regression Potential]
+ Minimal - disconnected sockets are added to the list of types to re-raise
exceptions for.
+
+ [Original Bug Report]
+ When configured to log to syslog, if the rsyslog process is restarted, then
the glance-registry process goes into a spin, consuming 100% of CPU - strace:
poll([{fd=3, events=POLLOUT|POLLERR|POLLHUP}, {fd=5,
events=POLLIN|POLLPRI|POLLERR|POLLHUP}], 2, 6) = 1 ([{fd=3,
revents=POLLOUT}])
sendto(3, "<14>2015-05-06 14:58:16.186 2579"..., 112, 0, NULL, 0) = -1
ENOTCONN (Transport endpoint is not connected)
gettimeofday({1430924440, 430244}, NULL) = 0
poll([{fd=3, events=POLLOUT|POLLERR|POLLHUP}, {fd=5,
events=POLLIN|POLLPRI|POLLERR|POLLHUP}], 2, 6) = 1 ([{fd=3,
revents=POLLOUT}])
sendto(3, "<14>2015-05-06 14:58:16.186 2579"..., 112, 0, NULL, 0) = -1
ENOTCONN (Transport endpoint is not connected)
This maybe related to bug 1081022 but that should have only impacted
12.04 deployments.
ProblemType: Bug
DistroRelease: Ubuntu 14.04
Package: glance-registry 1:2014.1.4-0ubuntu2
ProcVersionSignature: User Name 3.13.0-51.84-generic 3.13.11-ckt18
Uname: Linux 3.13.0-51-generic x86_64
ApportVersion: 2.14.1-0ubuntu3.10
Architecture: amd64
Date: Wed May 6 15:00:00 2015
Ec2AMI: ami-0350
Ec2AMIManifest: FIXME
Ec2AvailabilityZone: nova
Ec2InstanceType: m1.small.osci
Ec2Kernel: aki-0002
Ec2Ramdisk: ari-0002
PackageArchitecture: all
SourcePackage: glance
UpgradeStatus: No upgrade log present (probably fresh install)
modified.conffile..etc.glance.glance.registry.conf: [deleted]
modified.conffile..etc.glance.glance.registry.paste.ini: [deleted]
--
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1452312
Title:
glance-registry process spins if rsyslog restarted with syslog logging
enabled
To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/python-eventlet/+bug/1452312/+subscriptions
--
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1452312] Re: glance-registry process spins if rsyslog restarted with syslog logging enabled
** Changed in: python-eventlet (Ubuntu Utopic) Status: New => Confirmed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1452312 Title: glance-registry process spins if rsyslog restarted with syslog logging enabled To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/python-eventlet/+bug/1452312/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1452312] Re: glance-registry process spins if rsyslog restarted with syslog logging enabled
Potential fix: https://github.com/eventlet/eventlet/commit/ed0655333007fe97624b745e92deb407d192022c -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1452312 Title: glance-registry process spins if rsyslog restarted with syslog logging enabled To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/python-eventlet/+bug/1452312/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1452312] Re: glance-registry process spins if rsyslog restarted with syslog logging enabled
https://github.com/eventlet/eventlet/issues/192 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1452312 Title: glance-registry process spins if rsyslog restarted with syslog logging enabled To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/python-eventlet/+bug/1452312/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1452312] Re: glance-registry process spins if rsyslog restarted with syslog logging enabled
Also confirmed with kilo - using eventlet 0.16.0 ** Changed in: python-eventlet (Ubuntu Vivid) Status: New => Confirmed ** Changed in: python-eventlet (Ubuntu Wily) Status: New => Confirmed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1452312 Title: glance-registry process spins if rsyslog restarted with syslog logging enabled To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/python-eventlet/+bug/1452312/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1452312] Re: glance-registry process spins if rsyslog restarted with syslog logging enabled
I'm reticent to pull in the patch detail in #3 as this is not upstream - the codebase in the master branch is fundamentally the same as that found in eventlet in 14.04. ** Changed in: python-eventlet (Ubuntu) Importance: Undecided => High ** Changed in: glance (Ubuntu) Importance: Undecided => High ** Also affects: python-eventlet (Ubuntu Wily) Importance: High Status: Confirmed ** Also affects: glance (Ubuntu Wily) Importance: High Status: Confirmed ** Also affects: python-eventlet (Ubuntu Utopic) Importance: Undecided Status: New ** Also affects: glance (Ubuntu Utopic) Importance: Undecided Status: New ** Also affects: python-eventlet (Ubuntu Trusty) Importance: Undecided Status: New ** Also affects: glance (Ubuntu Trusty) Importance: Undecided Status: New ** Also affects: python-eventlet (Ubuntu Vivid) Importance: Undecided Status: New ** Also affects: glance (Ubuntu Vivid) Importance: Undecided Status: New ** No longer affects: glance (Ubuntu) ** Changed in: glance (Ubuntu Trusty) Status: New => Invalid ** Changed in: glance (Ubuntu Utopic) Status: New => Invalid ** Changed in: glance (Ubuntu Vivid) Status: New => Invalid ** Changed in: glance (Ubuntu Wily) Status: Confirmed => Invalid ** Changed in: python-eventlet (Ubuntu Trusty) Status: New => Confirmed ** Changed in: python-eventlet (Ubuntu Trusty) Importance: Undecided => High ** Changed in: python-eventlet (Ubuntu Wily) Status: Confirmed => New ** Changed in: python-eventlet (Ubuntu Vivid) Importance: Undecided => High ** Changed in: python-eventlet (Ubuntu Utopic) Importance: Undecided => High ** Changed in: glance (Ubuntu Wily) Importance: High => Undecided -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1452312 Title: glance-registry process spins if rsyslog restarted with syslog logging enabled To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/python-eventlet/+bug/1452312/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1452312] Re: glance-registry process spins if rsyslog restarted with syslog logging enabled
Status changed to 'Confirmed' because the bug affects multiple users. ** Changed in: python-eventlet (Ubuntu) Status: New => Confirmed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1452312 Title: glance-registry process spins if rsyslog restarted with syslog logging enabled To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/python-eventlet/+bug/1452312/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1452312] Re: glance-registry process spins if rsyslog restarted with syslog logging enabled
Status changed to 'Confirmed' because the bug affects multiple users. ** Changed in: glance (Ubuntu) Status: New => Confirmed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1452312 Title: glance-registry process spins if rsyslog restarted with syslog logging enabled To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/python-eventlet/+bug/1452312/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1452312] Re: glance-registry process spins if rsyslog restarted with syslog logging enabled
Raising a task for eventlet as this appears to be related to https://gist.github.com/temoto/8259860 ** Also affects: python-eventlet (Ubuntu) Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1452312 Title: glance-registry process spins if rsyslog restarted with syslog logging enabled To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/python-eventlet/+bug/1452312/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1452312] Re: glance-registry process spins if rsyslog restarted with syslog logging enabled
Using the reproducer on bug 1081022 would indicate that this is something different, as the installation does not exhibit quite the same issue. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1452312 Title: glance-registry process spins if rsyslog restarted with syslog logging enabled To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/glance/+bug/1452312/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
