Hey all,
I like this plan as a kind of next steps for OpenStack-Infra. I have some
thoughts on how zuul might better improve it's logging story but will post
those on the other thread.
I do, however, share both of Clark's concerns.
At the moment zuul_swift_uploads makes a POST request for each
Excerpts from corvus's message of 2018-07-16 15:27:10 -0700:
> The Zuul dashboard makes finding the location of logs for jobs
> (especially post jobs) simpler. So we no longer need logs.o.o to find
> the storage location (files or swift) for post jobs -- a user can just
> follow the link from
Clark Boylan writes:
> Couple of thoughts about this and Ara specifically. Ara static
> generation easily produces tens of thousands of files. Copying many
> small files to the log server with rsync was often quite slow (on the
> order of 10 minutes for some jobs (that is my fuzzy memory
On Mon, Jul 16, 2018, at 3:27 PM, James E. Blair wrote:
> Hi,
>
> As you may know, all of the logs from Zuul builds are currently uploaded
> to a single static fileserver with about 14TB of storage available in
> one large filesystem. This was easy to set up, but scales poorly, and
> we live in
cor...@inaugust.com (James E. Blair) writes:
> To summarize: static generation combined with a new role to upload to
> swift using openstacksdk should allow us to migrate to swift fairly
> quickly. Once there, we can work on a number of enhancements which I
> will describe in a followup post to
