[Bug 1459046] Re: nova-* services do not start if rsyslog is not yet started
** Patch added: trusty-icehouse.debdiff https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1459046/+attachment/4425932/+files/trusty-icehouse.debdiff ** Summary changed: - nova-* services do not start if rsyslog is not yet started + [SRU] nova-* services do not start if rsyslog is not yet started -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1459046 Title: [SRU] nova-* services do not start if rsyslog is not yet started To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1459046/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1459046] Re: nova-* services do not start if rsyslog is not yet started
Reviewed: https://review.openstack.org/193633 Committed: https://git.openstack.org/cgit/openstack/oslo.log/commit/?id=9a6c22663b57b7f2d9071767dadf28e59075a75e Submitter: Jenkins Branch:stable/kilo commit 9a6c22663b57b7f2d9071767dadf28e59075a75e Author: Julien Danjou jul...@danjou.info Date: Mon Nov 24 18:35:36 2014 +0100 Replace RFCSysLogHandler by a syslog() based one Rather than using the Python provided logging module that reimplents the whole syslog protocol and pointing it to /dev/log (which is not portable), we use the system calls from the syslog module, which are portable and default to the behaviour we actually want. Closes-Bug: 1385295 Closes-Bug: 1391428 Partial-Bug: 1459046 (cherry picked from commit 33f5c6f94d94d5464fea38229d880f177b05aff7) Conflicts: oslo_log/log.py requirements.txt Change-Id: I2e47c896841cbd43d1f5504f2b8b897fc432cd0b ** Tags added: in-stable-kilo -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1459046 Title: nova-* services do not start if rsyslog is not yet started To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1459046/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1459046] Re: nova-* services do not start if rsyslog is not yet started
Kilo master status: Master works without any problem. oslo.log 1.2.0 will start writing to syslog as soon as rsyslogd is brought up. Kilo uses oslo.log 1.1.0 which just ignores use_syslog setting when rsyslogd is not running or not started before nova-* services. I have proposed the backport (https://review.openstack.org/#/c/193633/) to oslo.log stable/kilo from oslo.log master, and will get to the maintainer do a 1.0.1 release once merged. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1459046 Title: nova-* services do not start if rsyslog is not yet started To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1459046/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1459046] Re: nova-* services do not start if rsyslog is not yet started
The patch you have provided here for SRU (that is also now part of the SRU submission in bug 1348244) does not appear to have been submitted upstream. So, does this affect openstack versions greater than Icehouse? It looks like Nova logging was switched to use oslo.log as of Kilo so presumably Juno is also affected by this? Assuming that Kilo+ is not affected and since this code has been moved out of tree anyway I think we should apply this to both I and J and make sure that patch commit message references this bug so that we have a context reference. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1459046 Title: nova-* services do not start if rsyslog is not yet started To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1459046/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1459046] Re: nova-* services do not start if rsyslog is not yet started
** Also affects: nova Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1459046 Title: nova-* services do not start if rsyslog is not yet started To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1459046/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1459046] Re: nova-* services do not start if rsyslog is not yet started
stable/icehouse patch uploaded to https://review.openstack.org/#/c/193105/ ** Changed in: nova (Ubuntu) Status: Invalid = In Progress -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1459046 Title: nova-* services do not start if rsyslog is not yet started To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1459046/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1459046] Re: nova-* services do not start if rsyslog is not yet started
stable/juno patch uploaded to https://review.openstack.org/#/c/193110/ -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1459046 Title: nova-* services do not start if rsyslog is not yet started To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1459046/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1459046] Re: nova-* services do not start if rsyslog is not yet started
** Changed in: nova Status: New = In Progress ** Changed in: nova Assignee: (unassigned) = Edward Hope-Morley (hopem) -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1459046 Title: nova-* services do not start if rsyslog is not yet started To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1459046/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1459046] Re: nova-* services do not start if rsyslog is not yet started
** Also affects: oslo.log Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1459046 Title: nova-* services do not start if rsyslog is not yet started To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1459046/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1459046] Re: nova-* services do not start if rsyslog is not yet started
** Patch removed: nova-2014.1.4-0ubuntu3-lp1459046.patch https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1459046/+attachment/4407056/+files/nova-2014.1.4-0ubuntu3-lp1459046.patch -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1459046 Title: nova-* services do not start if rsyslog is not yet started To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1459046/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1459046] Re: nova-* services do not start if rsyslog is not yet started
Hi James, Sorry, I got messed up with quilt. I have resubmit the SRU at https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1348244, as it has the major fix that I backported in this SRU. And along with the backport, I also implemented the retry logic as you suggested. Thank you. I will mark this bug as invalid and continue the SRU in the original bug. Thanks, Liang ** Changed in: nova (Ubuntu) Status: In Progress = Invalid -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1459046 Title: nova-* services do not start if rsyslog is not yet started To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1459046/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1459046] Re: nova-* services do not start if rsyslog is not yet started
Hi Liang Two comment; firstly your cherry pick is not quite clean - it retains the existing syslog config code after the try/except wrapper introduced upstream. Secondly I'm not sure that this really resolves the issue - if syslog is not started prior to a nova service, nova will just not use syslog for logging - which feels wrong to me. I think a better fix might be to retry configuring syslog a few times - that way we don't have to update all upstart configurations, as the common code in the nova codebase will deal with the race. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1459046 Title: nova-* services do not start if rsyslog is not yet started To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1459046/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1459046] Re: nova-* services do not start if rsyslog is not yet started
Removing sponsors for now - lets get the fix right and then go for sponsorship. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1459046 Title: nova-* services do not start if rsyslog is not yet started To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1459046/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1459046] Re: nova-* services do not start if rsyslog is not yet started
Hi Martin, Yeah. This an SRU fix for trusty. It doesn't affect later releases, as newer releases use openstack juno/kilo which doesn't have this problem. That reminded me to try a backport instead of working on a upstart job patch. And it's indeed simpler and smaller. Thanks! Thanks, Liang ** Patch removed: nova-2014.1.4-0ubuntu3-lp1459046.patch https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1459046/+attachment/4406273/+files/nova-2014.1.4-0ubuntu3-lp1459046.patch -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1459046 Title: nova-* services do not start if rsyslog is not yet started To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1459046/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1459046] Re: nova-* services do not start if rsyslog is not yet started
** Patch added: nova-2014.1.4-0ubuntu3-lp1459046.patch https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1459046/+attachment/4407056/+files/nova-2014.1.4-0ubuntu3-lp1459046.patch -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1459046 Title: nova-* services do not start if rsyslog is not yet started To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1459046/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1459046] Re: nova-* services do not start if rsyslog is not yet started
This is apparently an SRU fix for trusty. Does that also affect later releases? In particular, does it affect vivid/wily, as we don't use upstart there but systemd? In particular, these would need an After=syslog.service, is that the case? If not, this needs to be fixed as well, and as per the SRU rules a bug has to be fixed in the development series first. Thanks! ** Also affects: nova (Ubuntu Trusty) Importance: Undecided Status: New ** Changed in: nova (Ubuntu Trusty) Status: New = In Progress -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1459046 Title: nova-* services do not start if rsyslog is not yet started To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1459046/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1459046] Re: nova-* services do not start if rsyslog is not yet started
** Changed in: nova (Ubuntu Trusty) Assignee: (unassigned) = Liang Chen (cbjchen) -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1459046 Title: nova-* services do not start if rsyslog is not yet started To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1459046/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1459046] Re: nova-* services do not start if rsyslog is not yet started
** Patch removed: nova-2014.1.4-0ubuntu3-lp1459046.patch https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1459046/+attachment/4405077/+files/nova-2014.1.4-0ubuntu3-lp1459046.patch ** Patch added: nova-2014.1.4-0ubuntu3-lp1459046.patch https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1459046/+attachment/4406273/+files/nova-2014.1.4-0ubuntu3-lp1459046.patch -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1459046 Title: nova-* services do not start if rsyslog is not yet started To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1459046/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1459046] Re: nova-* services do not start if rsyslog is not yet started
Michael, Yeah, they do. Thanks a lot for pointing it out! I am going to have a thorough testing, and will update the patch soon. Thanks, Liang -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1459046 Title: nova-* services do not start if rsyslog is not yet started To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1459046/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1459046] Re: nova-* services do not start if rsyslog is not yet started
Don't each of these start lines need a different WAITER value? -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1459046 Title: nova-* services do not start if rsyslog is not yet started To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1459046/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1459046] Re: nova-* services do not start if rsyslog is not yet started
** Attachment added: patch https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1459046/+attachment/4405056/+files/patch ** Description changed: - When nova services running on nova-cloud-controller log to syslog, we - should make sure the dependency on the upstart jobs is set prior to the - nova-* services start. + When nova services log to syslog, we should make sure the dependency on + the upstart jobs is set prior to the nova-* services start. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1459046 Title: nova-* services do not start if rsyslog is not yet started To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1459046/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1459046] Re: nova-* services do not start if rsyslog is not yet started
** Attachment removed: patch https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1459046/+attachment/4405056/+files/patch ** Patch added: nova-2014.1.4-0ubuntu3-lp1459046.patch https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1459046/+attachment/4405077/+files/nova-2014.1.4-0ubuntu3-lp1459046.patch ** Description changed: - When nova services log to syslog, we should make sure the dependency on - the upstart jobs is set prior to the nova-* services start. + [Impact] + + * Nova services fail to start because they cannot connect to rsyslog + + [Test Case] + + * Set user_syslog to True in nova.conf, stop rsyslog service and + restart nova services. + + [Regression Potential] + + * None + + + When nova services log to syslog, we should make sure the dependency on the upstart jobs is set prior to the nova-* services start. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1459046 Title: nova-* services do not start if rsyslog is not yet started To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1459046/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1459046] Re: nova-* services do not start if rsyslog is not yet started
The attachment nova-2014.1.4-0ubuntu3-lp1459046.patch seems to be a debdiff. The ubuntu-sponsors team has been subscribed to the bug report so that they can review and hopefully sponsor the debdiff. If the attachment isn't a patch, please remove the patch flag from the attachment, remove the patch tag, and if you are member of the ~ubuntu-sponsors, unsubscribe the team. [This is an automated message performed by a Launchpad user owned by ~brian-murray, for any issue please contact him.] ** Tags added: patch -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1459046 Title: nova-* services do not start if rsyslog is not yet started To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1459046/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1459046] Re: nova-* services do not start if rsyslog is not yet started
** Description changed: - When nova services log to syslog, we should make sure the dependency on - the upstart jobs is set prior to the nova-* services start. + When nova services running on nova-cloud-controller log to syslog, we + should make sure the dependency on the upstart jobs is set prior to the + nova-* services start. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1459046 Title: nova-* services do not start if rsyslog is not yet started To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1459046/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs