Re: [Bug 1727358] Re: cloud-init is slow to complete init on minimized images

2017-10-26 Thread Steve Langasek
On Thu, Oct 26, 2017 at 06:07:57PM -, Mathieu Trudel-Lapierre wrote:
> You can easily reproduce this by running the following image in virt-
> manager with a default setup (and optionally add a RNG device if
> necessary):

The defaults in both virt-manager and libvirt change over time.  For
reproducibility, it's helpful to have either a libvirt xml, or for maximum
reproducibility, a full qemu commandline from a running instance.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1727358

Title:
  cloud-init is slow to complete init on minimized images

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-init/+bug/1727358/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

Re: [Bug 1727358] Re: cloud-init is slow to complete init on minimized images

2017-10-26 Thread Steve Langasek
On Thu, Oct 26, 2017 at 03:56:24PM -, Scott Moser wrote:
> You can grep through, the onlyi real function taht  uses it is
> 'rand_str'. and i'm not sure really why that would be called at the
> point that you're seeing the slow down.

> I think it more valuable for you to figure out why your environment is
> causing this issue and fixing that rather than fixing cloud-init (and
> subsequently all users of entropy).

We know that Ubuntu Cloud images must function in entropy-poor environments;
that's why we ship pollinate by default.  If this particular delay is due to
cloud-init (or something it invoked) consuming entropy in early boot and
blocking, that is a problem, even if we do resolve the lack of an in-kernel
entropy source for this particular image and use case.

> Also, information about how you've come across this bug would be good.

I don't think I have ever seen the boot delay Mathieu is reporting, even
using the same image.  So we're dependent on him to provide a reproducer.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1727358

Title:
  cloud-init is slow to complete init on minimized images

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-init/+bug/1727358/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

Re: [Bug 1727358] Re: cloud-init is slow to complete init on minimized images

2017-10-26 Thread Scott Moser
You can grep through, the onlyi real function taht  uses it is 'rand_str'.
and i'm not sure really why that would be called at the point that you're
seeing the slow down.

I think it more valuable for you to figure out why your environment is
causing this issue and fixing that rather than fixing cloud-init (and
subsequently all users of entropy).

Also, information about how you've come across this bug would be good.

On Thu, Oct 26, 2017 at 11:24 AM, Steve Langasek <
steve.langa...@canonical.com> wrote:

> On Thu, Oct 26, 2017 at 10:37:37AM -, Scott Moser wrote:
> > Only via 'import random' and light usage.
>
> Even "light" usage is going to block at this point in the boot; can you
> give
> me a pointer into where this is in the code, so I can try to assess if this
> should be avoided?
>
> --
> You received this bug notification because you are a member of Canonical
> Cloudware, which is subscribed to cloud-init.
> Matching subscriptions: cloud-init bugs
> https://bugs.launchpad.net/bugs/1727358
>
> Title:
>   cloud-init is slow to complete init on minimized images
>
> Status in cloud-init:
>   Incomplete
> Status in cloud-init package in Ubuntu:
>   Incomplete
>
> Bug description:
>   http://paste.ubuntu.com/25816789/ for the full logs.
>
>   cloud-init is very slow to complete its initialization steps.
>   Specifically, the 'init' takes over 150 seconds.
>
>   Cloud-init v. 17.1 running 'init-local' at Wed, 25 Oct 2017 13:22:07
> +. Up 2.39 seconds.
>   2017-10-25 13:22:07,157 - util.py[WARNING]: did not find either path
> /sys/class/dmi/id or dmidecode command
>   Cloud-init v. 17.1 running 'init' at Wed, 25 Oct 2017 13:22:16 +. Up
> 11.37 seconds.
>   ci-info: Net device
> info+
>   ci-info: ++---+-+---+---+
> ---+
>   ci-info: | Device |   Up  | Address |  Mask | Scope |
>  Hw-Address|
>   ci-info: ++---+-+---+---+
> ---+
>   ci-info: | ens3:  |  True | 192.168.100.161 | 255.255.255.0 |   .   |
> 52:54:00:bb:ad:fb |
>   ci-info: | ens3:  |  True |.|   .   |   d   |
> 52:54:00:bb:ad:fb |
>   ci-info: |  lo:   |  True |127.0.0.1|   255.0.0.0   |   .   |
>  . |
>   ci-info: |  lo:   |  True |.|   .   |   d   |
>  . |
>   ci-info: | sit0:  | False |.|   .   |   .   |
>  . |
>   ci-info: ++---+-+---+---+
> ---+
>   ci-info: Route IPv4
> info
>   ci-info: +---+---+---+-+-
> --+---+
>   ci-info: | Route |  Destination  |Gateway| Genmask |
> Interface | Flags |
>   ci-info: +---+---+---+-+-
> --+---+
>   ci-info: |   0   |0.0.0.0| 192.168.100.1 | 0.0.0.0 |
> ens3   |   UG  |
>   ci-info: |   1   | 192.168.100.0 |0.0.0.0|  255.255.255.0  |
> ens3   |   U   |
>   ci-info: |   2   | 192.168.100.1 |0.0.0.0| 255.255.255.255 |
> ens3   |   UH  |
>   ci-info: +---+---+---+-+-
> --+---+
>   2017-10-25 13:24:38,187 - util.py[WARNING]: Failed to resize filesystem
> (cmd=('resize2fs', '/dev/root'))
>   2017-10-25 13:24:38,193 - util.py[WARNING]: Running module resizefs
> ( packages/cloudinit/config/cc_resizefs.py'>) failed
>   Generating public/private rsa key pair.
>   Your identification has been saved in /etc/ssh/ssh_host_rsa_key.
>   Your public key has been saved in /etc/ssh/ssh_host_rsa_key.pub.
>   The key fingerprint is:
>   SHA256:LKNlCqqOgPB8KBKGfPhFO5Rs6fDMnAvVet/W9i4vLxY root@cloudimg
>   The key's randomart image is:
>   +---[RSA 2048]+
>   | |
>   |. +  |
>   |   . O . |
>   |o . % +. |
>   |++.o %=.S|
>   |+=ooo=+o. . .E   |
>   |* +.+.   . o o.  |
>   |=. .  . .=.  |
>   |+.  . B= |
>   +[SHA256]-+
>   Generating public/private dsa key pair.
>   Your identification has been saved in /etc/ssh/ssh_host_dsa_key.
>   Your public key has been saved in /etc/ssh/ssh_host_dsa_key.pub.
>   The key fingerprint is:
>   SHA256:dNWNyBHqTUCl820/vL0dEhOVDFYJzqr1WeuqV1PAmjk root@cloudimg
>   The key's randomart image is:
>   +---[DSA 1024]+
>   | .oo=X==o|
>   |   =* *+.|
>   |. = .B . |
>   |   . o =E.. .|
>   |S .oo+o..|
>   |  o ..*+.|
>   | .   +.=o|
>   | .o *|
>   |   .o..++|
>   +[SHA256]-+
>   Generating public/private ecdsa key pair.
>   Your identification has been saved in /etc/ssh/ssh_host_ecdsa_key.
>   Your public key has been saved in /etc/ssh/ssh_host_ecdsa_key.pub.
>   The key fingerpri

Re: [Bug 1727358] Re: cloud-init is slow to complete init on minimized images

2017-10-26 Thread Steve Langasek
On Thu, Oct 26, 2017 at 10:37:37AM -, Scott Moser wrote:
> Only via 'import random' and light usage.

Even "light" usage is going to block at this point in the boot; can you give
me a pointer into where this is in the code, so I can try to assess if this
should be avoided?

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1727358

Title:
  cloud-init is slow to complete init on minimized images

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-init/+bug/1727358/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

Re: [Bug 1727358] Re: cloud-init is slow to complete init on minimized images

2017-10-26 Thread Scott Moser
Only via 'import random' and light usage.

On Oct 25, 2017 11:21 PM, "Steve Langasek" 
wrote:

> On Thu, Oct 26, 2017 at 01:43:12AM -, Scott Moser wrote:
> > possibly related, but was fixed:
> >  https://bugs.python.org/issue25420
>
> Does cloud-init itself consume entropy when it runs?
>
> --
> You received this bug notification because you are a member of Canonical
> Cloudware, which is subscribed to cloud-init.
> Matching subscriptions: cloud-init bugs
> https://bugs.launchpad.net/bugs/1727358
>
> Title:
>   cloud-init is slow to complete init on minimized images
>
> Status in cloud-init:
>   Incomplete
> Status in cloud-init package in Ubuntu:
>   Incomplete
>
> Bug description:
>   http://paste.ubuntu.com/25816789/ for the full logs.
>
>   cloud-init is very slow to complete its initialization steps.
>   Specifically, the 'init' takes over 150 seconds.
>
>   Cloud-init v. 17.1 running 'init-local' at Wed, 25 Oct 2017 13:22:07
> +. Up 2.39 seconds.
>   2017-10-25 13:22:07,157 - util.py[WARNING]: did not find either path
> /sys/class/dmi/id or dmidecode command
>   Cloud-init v. 17.1 running 'init' at Wed, 25 Oct 2017 13:22:16 +. Up
> 11.37 seconds.
>   ci-info: Net device
> info+
>   ci-info: ++---+-+---+---+
> ---+
>   ci-info: | Device |   Up  | Address |  Mask | Scope |
>  Hw-Address|
>   ci-info: ++---+-+---+---+
> ---+
>   ci-info: | ens3:  |  True | 192.168.100.161 | 255.255.255.0 |   .   |
> 52:54:00:bb:ad:fb |
>   ci-info: | ens3:  |  True |.|   .   |   d   |
> 52:54:00:bb:ad:fb |
>   ci-info: |  lo:   |  True |127.0.0.1|   255.0.0.0   |   .   |
>  . |
>   ci-info: |  lo:   |  True |.|   .   |   d   |
>  . |
>   ci-info: | sit0:  | False |.|   .   |   .   |
>  . |
>   ci-info: ++---+-+---+---+
> ---+
>   ci-info: Route IPv4
> info
>   ci-info: +---+---+---+-+-
> --+---+
>   ci-info: | Route |  Destination  |Gateway| Genmask |
> Interface | Flags |
>   ci-info: +---+---+---+-+-
> --+---+
>   ci-info: |   0   |0.0.0.0| 192.168.100.1 | 0.0.0.0 |
> ens3   |   UG  |
>   ci-info: |   1   | 192.168.100.0 |0.0.0.0|  255.255.255.0  |
> ens3   |   U   |
>   ci-info: |   2   | 192.168.100.1 |0.0.0.0| 255.255.255.255 |
> ens3   |   UH  |
>   ci-info: +---+---+---+-+-
> --+---+
>   2017-10-25 13:24:38,187 - util.py[WARNING]: Failed to resize filesystem
> (cmd=('resize2fs', '/dev/root'))
>   2017-10-25 13:24:38,193 - util.py[WARNING]: Running module resizefs
> ( packages/cloudinit/config/cc_resizefs.py'>) failed
>   Generating public/private rsa key pair.
>   Your identification has been saved in /etc/ssh/ssh_host_rsa_key.
>   Your public key has been saved in /etc/ssh/ssh_host_rsa_key.pub.
>   The key fingerprint is:
>   SHA256:LKNlCqqOgPB8KBKGfPhFO5Rs6fDMnAvVet/W9i4vLxY root@cloudimg
>   The key's randomart image is:
>   +---[RSA 2048]+
>   | |
>   |. +  |
>   |   . O . |
>   |o . % +. |
>   |++.o %=.S|
>   |+=ooo=+o. . .E   |
>   |* +.+.   . o o.  |
>   |=. .  . .=.  |
>   |+.  . B= |
>   +[SHA256]-+
>   Generating public/private dsa key pair.
>   Your identification has been saved in /etc/ssh/ssh_host_dsa_key.
>   Your public key has been saved in /etc/ssh/ssh_host_dsa_key.pub.
>   The key fingerprint is:
>   SHA256:dNWNyBHqTUCl820/vL0dEhOVDFYJzqr1WeuqV1PAmjk root@cloudimg
>   The key's randomart image is:
>   +---[DSA 1024]+
>   | .oo=X==o|
>   |   =* *+.|
>   |. = .B . |
>   |   . o =E.. .|
>   |S .oo+o..|
>   |  o ..*+.|
>   | .   +.=o|
>   | .o *|
>   |   .o..++|
>   +[SHA256]-+
>   Generating public/private ecdsa key pair.
>   Your identification has been saved in /etc/ssh/ssh_host_ecdsa_key.
>   Your public key has been saved in /etc/ssh/ssh_host_ecdsa_key.pub.
>   The key fingerprint is:
>   SHA256:N3RTlPa7KU5ryq6kJAO8Tiq90ub4P1DGSofn6jFkM3k root@cloudimg
>   The key's randomart image is:
>   +---[ECDSA 256]---+
>   | .o. |
>   | .o  |
>   |   o  . o. . |
>   |  +.*. . .  .|
>   | .*XE   S o .|
>   | oo++. .   . |
>   | oo= o . .   .  o|
>   |o.Oo. + o . .o.o |
>   |oB=+.. . .o++o.  |
>   +[SHA256]-+
>   Generating public/private ed25519 key pair.
>   Your identification has been saved in /etc/ssh/ssh_host_ed25519_key.
>   Your public

Re: [Bug 1727358] Re: cloud-init is slow to complete init on minimized images

2017-10-25 Thread Steve Langasek
On Thu, Oct 26, 2017 at 01:43:12AM -, Scott Moser wrote:
> possibly related, but was fixed:
>  https://bugs.python.org/issue25420

Does cloud-init itself consume entropy when it runs?

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1727358

Title:
  cloud-init is slow to complete init on minimized images

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-init/+bug/1727358/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs