On Fri, Jul 4, 2014 at 5:23 AM, Tim Penhey <tim.pen...@canonical.com> wrote:

> I do just want to make the point that we are not just an ubuntu only
> system any more, nor even linux only.
>
> I'd prefer if we kept away from terms like "apt-get" as it doesn't make
> sense for windows nor centos.  While we could certainly treat those
> values differently on the other platforms, it definitely gives the
> feeling that we are *mainly* ubuntu and (hand wavey) some others.
>
> Any ideas for better names?
>

"upgrade-packages"? Still kinda Linuxy, so alternatively "upgrade-system".

In cloud-init, it's "package_upgrade", with "apt_upgrade" as an alias.


> Tim
>
>
> On 04/07/14 02:56, Matt Bruzek wrote:
> > +1 to making these options configurable and having sane defaults.
> >
> > Thanks!
> >
> >    - Matt Bruzek <matthew.bru...@canonical.com
> > <mailto:matthew.bru...@canonical.com>>
> >
> >
> > On Thu, Jul 3, 2014 at 9:50 AM, Antonio Rosales
> > <antonio.rosa...@canonical.com <mailto:antonio.rosa...@canonical.com>>
> > wrote:
> >
> >     On Tue, Jul 1, 2014 at 7:19 PM, Andrew Wilkins
> >     <andrew.wilk...@canonical.com <mailto:andrew.wilk...@canonical.com>>
> >     wrote:
> >     > On Wed, Jul 2, 2014 at 3:38 AM, Antonio Rosales
> >     > <antonio.rosa...@canonical.com
> >     <mailto:antonio.rosa...@canonical.com>> wrote:
> >     >>
> >     >> Suggest we make an environments.yaml key value of say
> >     "apt-get-update"
> >     >> set to a boolean with the default being "true". Existing charms
> are
> >     >> timing out[0] when apt-get update is turned off due to stale
> apt-get
> >     >> metadata. Users then can them make the choice, and we can make
> >     >> suggestions in the docs as to what this key value means and how
> >     it can
> >     >> improve performance especially in the developer scenario when the
> >     care
> >     >> more about fast iterative deploys.
> >     >>
> >     >> Thoughts?
> >     >
> >     >
> >     > I'm not suggesting we turn off update, just upgrade. We add repos
> >     > (cloud-tools, ppa), so we need to update for juju's dependencies
> >     anyway. I
> >     > don't think my proposal will affect charms.
> >
> >     Ah yes, sorry.  However, I would still suggest upgrade and update be
> >     config parameter with the default being past behavior. On that note
> it
> >     would also be nice to have a utility for Juju to pass on additional
> >     user defined cloud-init config options.
> >
> >     -thanks,
> >     Antonio
> >
> >     >
> >     >>
> >     >> [0] https://bugs.launchpad.net/juju-core/+bug/1336353
> >     >>
> >     >> -thanks,
> >     >> Antonio
> >     >>
> >     >> On Tue, Jul 1, 2014 at 4:43 AM, Andrew Wilkins
> >     >> <andrew.wilk...@canonical.com
> >     <mailto:andrew.wilk...@canonical.com>> wrote:
> >     >> > On Tue, Jul 1, 2014 at 5:45 PM, John Meinel
> >     <j...@arbash-meinel.com <mailto:j...@arbash-meinel.com>>
> >     >> > wrote:
> >     >> >>
> >     >> >> I would just caution that we'd really prefer behavior to be
> >     consistent
> >     >> >> across platforms and clouds, and if we can work with Microsoft
> >     to make
> >     >> >> 'apt-get update' faster in their cloud everyone wins who uses
> >     Ubuntu
> >     >> >> there,
> >     >> >> not just us.
> >     >> >
> >     >> >
> >     >> > I was meaning to disable it across all providers. It would be
> >     ideal to
> >     >> > improve upgrades for all Ubuntu users, but from what I can tell
> >     it's a
> >     >> > case
> >     >> > of Azure's OS disks being a tad slow. If you start going up the
> >     >> > instance-type scale, then you do get more IOPS. I haven't
> >     measured how
> >     >> > much
> >     >> > of a difference it makes.
> >     >> >
> >     >> >>
> >     >> >> Have we looked into why Upgrade is taking 3m+? Is it the time
> to
> >     >> >> download
> >     >> >> things, is it the time to install things? I've certainly heard
> >     things
> >     >> >> like
> >     >> >> "disk ops is a bit poor" on Azure (vs CPU is actually better
> than
> >     >> >> average).
> >     >> >> Given the variance of 6m+ to 3m20s with Eat my data, it would
> >     seem disk
> >     >> >> sync
> >     >> >> performance is at least a factor here.
> >     >> >
> >     >> >
> >     >> > I just looked, and it is mostly not network related (I assume
> >     mostly I/O
> >     >> > bound). On ec2 an upgrade fetches all the bits in 0s; on Azure
> it's
> >     >> > taking
> >     >> > 5s.
> >     >> >
> >     >> >> Given I believe apt-get update is also disabled for local (it
> >     is run on
> >     >> >> the initial template, and then not run for the other instances
> >     copied
> >     >> >> from
> >     >> >> that), there is certainly precedence. I think a big concern is
> >     that we
> >     >> >> would
> >     >> >> probably still want to do apt-get update for security related
> >     updates.
> >     >> >> Though perhaps that is all of the updates we are applying
> >     anyway...
> >     >> >>
> >     >> >> If I read the "aws.json" file correctly, I see only 8 releases
> >     of the
> >     >> >> 'precise' image. 6 of 'trusty' and 32 total dates of released
> >     items.
> >     >> >> And
> >     >> >> some of the trusty releases are 2014-01-22.1 which means it is
> >     likely
> >     >> >> to be
> >     >> >> beta releases.
> >     >> >>
> >     >> >> Anyway, that means that they are actually averaging an update
> only
> >     >> >> 1/month, which is a fairly big window of updates to apply by
> >     the end of
> >     >> >> month (I would imagine). And while that does mean it takes
> >     longer to
> >     >> >> boot,
> >     >> >> it also means you would be open to more security holes without
> it.
> >     >> >
> >     >> >
> >     >> > My contention is that if we don't *keep* it updated, we may as
> >     well just
> >     >> > leave it to the user. When you create an instance in ec2 or
> >     Azure or
> >     >> > whatever, it doesn't come fully up-to-date. You get the
> >     released image,
> >     >> > and
> >     >> > then you can update it if you want to.
> >     >> >
> >     >> >> John
> >     >> >> =:->
> >     >> >>
> >     >> >>
> >     >> >>
> >     >> >>
> >     >> >> On Mon, Jun 30, 2014 at 5:05 PM, Andrew Wilkins
> >     >> >> <andrew.wilk...@canonical.com
> >     <mailto:andrew.wilk...@canonical.com>> wrote:
> >     >> >>>
> >     >> >>> Hi folks,
> >     >> >>>
> >     >> >>> I've been debugging a bootstrap bug [0] that was caused by
> >     ssh timing
> >     >> >>> out
> >     >> >>> (and the client not noticing), which was caused by "apt-get
> >     upgrade"
> >     >> >>> taking
> >     >> >>> an awfully long time (6 minutes on Azure).
> >     >> >>>     [0] https://bugs.launchpad.net/juju-core/+bug/1316185
> >     >> >>>
> >     >> >>> I just filed
> >     https://bugs.launchpad.net/juju-core/+bug/1335822, and
> >     >> >>> did a
> >     >> >>> quick and dirty hack that brought the upgrade down to 3
> >     minutes on
> >     >> >>> Azure. I
> >     >> >>> don't know the variance, so I can't be sure that it's all due
> to
> >     >> >>> eatmydata,
> >     >> >>> but smoser's results are similar.
> >     >> >>>
> >     >> >>> Even with eatmydata, a full bootstrap on Azure just took me 10
> >     >> >>> minutes.
> >     >> >>> That's roughly broken down into:
> >     >> >>>  - apt-get update: 20s
> >     >> >>>  - apt-get upgrade: 3m20s
> >     >> >>>  - apt-get install <various>: 10s
> >     >> >>>  - Download tools (from shared Azure storage account): 5s
> >     >> >>>  - jujud bootstrap: 1m50s
> >     >> >>>
> >     >> >>> We could bring the 10m down to 6m40s. Still not brilliant, but
> >     >> >>> considerably better IMO.
> >     >> >>>
> >     >> >>> I propose that we remove the "apt-get upgrade" altogether.
> Cloud
> >     >> >>> images
> >     >> >>> are regularly updated and tested, and I think we should be
> >     able to
> >     >> >>> rely on
> >     >> >>> that alone. If users want something more up-to-date, they can
> >     use the
> >     >> >>> daily
> >     >> >>> images which are not tested as a whole, but are composed of
> SRUs,
> >     >> >>> which is
> >     >> >>> effectively what users get today.
> >     >> >>>
> >     >> >>> Cheers,
> >     >> >>> Andrew
> >     >> >>>
> >     >> >>> --
> >     >> >>> Juju-dev mailing list
> >     >> >>> Juju-dev@lists.ubuntu.com <mailto:Juju-dev@lists.ubuntu.com>
> >     >> >>> Modify settings or unsubscribe at:
> >     >> >>> https://lists.ubuntu.com/mailman/listinfo/juju-dev
> >     >> >>>
> >     >> >>
> >     >> >
> >     >> >
> >     >> > --
> >     >> > Juju-dev mailing list
> >     >> > Juju-dev@lists.ubuntu.com <mailto:Juju-dev@lists.ubuntu.com>
> >     >> > Modify settings or unsubscribe at:
> >     >> > https://lists.ubuntu.com/mailman/listinfo/juju-dev
> >     >> >
> >     >>
> >     >>
> >     >>
> >     >> --
> >     >> Antonio Rosales
> >     >> Juju Ecosystem
> >     >> Canonical
> >     >
> >     >
> >
> >
> >
> >     --
> >     Antonio Rosales
> >     Juju Ecosystem
> >     Canonical
> >
> >     --
> >     Juju-dev mailing list
> >     Juju-dev@lists.ubuntu.com <mailto:Juju-dev@lists.ubuntu.com>
> >     Modify settings or unsubscribe at:
> >     https://lists.ubuntu.com/mailman/listinfo/juju-dev
> >
> >
> >
> >
>
>
> --
> Juju-dev mailing list
> Juju-dev@lists.ubuntu.com
> Modify settings or unsubscribe at:
> https://lists.ubuntu.com/mailman/listinfo/juju-dev
>
-- 
Juju-dev mailing list
Juju-dev@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/juju-dev

Reply via email to