Re: Apache Beam Jenkins Machines Upgrade

[Ismaël Mejía]

This is fantastic. I saw the reduction of the build times in Jenkins today,
they reduced dramatically.
Excellent work guys congratulations!
On Fri, Apr 27, 2018 at 3:00 PM Etienne Chauchot 
wrote:

> Awesome ! Very good news ! Thanks for your work guys !

> Etienne

> Le vendredi 27 avril 2018 à 00:15 +, Eugene Kirpichov a écrit :

> This sounds awesome, thanks to everybody involved!

> On Thu, Apr 26, 2018 at 4:28 PM Yifan Zou  wrote:

> Greetings,

> Most of you already know about upgrades on Jenkins machines this week. I
still want to share some details you might interested in.

> In April 24th, we had 16 new GCE instances (beam9 - 24) setup under
gcloud project 'apache-beam-testing' for Beam Jenkins. The old machines are
currently disconnected and they will be removed in next week. Major updates
are as follows:

> -- Upgraded machine type from n1-standard-4 (4 vCPUs, 15GB RAM) to
n1-highmem-16 (16 vCPUs, 104GB Ram);
> -- Upgraded OS from Ubuntu 14.04 to 16.04;
> -- Increased quantity of instances to 16;
> -- Installed the latest version of packages and underlying tools;

> The overall build duration are dropping and the stability is improved
since the new powerful machines.  In addition, python tests are no longer
limited to some specific nodes. It significantly reduce the waiting time in
job queue. For example, before swapping, the average waiting time of 10
latest Python PreCommits was 22.2 minutes, and now it drops to 10 seconds!

> Special thanks to Alan Myrvold and Jason Kuster for helping on the smooth
swapping process.

> Regards.
> Yifan Zou

Re: Apache Beam Jenkins Machines Upgrade

[Etienne Chauchot]

Awesome ! Very good news ! Thanks for your work guys !
Etienne
Le vendredi 27 avril 2018 à 00:15 +, Eugene Kirpichov a écrit :
> This sounds awesome, thanks to everybody involved!
> 
> On Thu, Apr 26, 2018 at 4:28 PM Yifan Zou  wrote:
> > Greetings,
> > 
> > Most of you already know about upgrades on Jenkins machines this week. I 
> > still want to share some details you might
> > interested in.
> > 
> > In April 24th, we had 16 new GCE instances (beam9 - 24) setup under gcloud 
> > project 'apache-beam-testing' for Beam
> > Jenkins. The old machines are currently disconnected and they will be 
> > removed in next week. Major updates are as
> > follows:
> > 
> > -- Upgraded machine type from n1-standard-4 (4 vCPUs, 15GB RAM) to 
> > n1-highmem-16 (16 vCPUs, 104GB Ram);
> > -- Upgraded OS from Ubuntu 14.04 to 16.04;
> > -- Increased quantity of instances to 16;
> > -- Installed the latest version of packages and underlying tools;
> > 
> > The overall build duration are dropping and the stability is improved since 
> > the new powerful machines.  In addition,
> > python tests are no longer limited to some specific nodes. It significantly 
> > reduce the waiting time in job queue.
> > For example, before swapping, the average waiting time of 10 latest Python 
> > PreCommits was 22.2 minutes, and now it
> > drops to 10 seconds!
> > 
> > Special thanks to Alan Myrvold and Jason Kuster for helping on the smooth 
> > swapping process.
> > 
> > Regards.
> > Yifan Zou
> > 

Re: Apache Beam Jenkins Machines Upgrade

[Eugene Kirpichov]

This sounds awesome, thanks to everybody involved!

On Thu, Apr 26, 2018 at 4:28 PM Yifan Zou  wrote:

> Greetings,
>
> Most of you already know about upgrades on Jenkins machines this week. I
> still want to share some details you might interested in.
>
> In April 24th, we had 16 new GCE instances (beam9 - 24) setup under gcloud
> project 'apache-beam-testing' for Beam Jenkins. The old machines are
> currently disconnected and they will be removed in next week. Major updates
> are as follows:
>
> -- Upgraded machine type from n1-standard-4 (4 vCPUs, 15GB RAM) to
> n1-highmem-16 (16 vCPUs, 104GB Ram);
> -- Upgraded OS from Ubuntu 14.04 to 16.04;
> -- Increased quantity of instances to 16;
> -- Installed the latest version of packages and underlying tools;
>
> The overall build duration are dropping and the stability is improved
> since the new powerful machines.  In addition, python tests are no longer
> limited to some specific nodes. It significantly reduce the waiting time in
> job queue. For example, before swapping, the average waiting time of 10
> latest Python PreCommits was 22.2 minutes, and now it drops to 10 seconds!
>
> Special thanks to Alan Myrvold and Jason Kuster for helping on the smooth
> swapping process.
>
> Regards.
> Yifan Zou
>

Apache Beam Jenkins Machines Upgrade

[Yifan Zou]

Greetings,

Most of you already know about upgrades on Jenkins machines this week. I
still want to share some details you might interested in.

In April 24th, we had 16 new GCE instances (beam9 - 24) setup under gcloud
project 'apache-beam-testing' for Beam Jenkins. The old machines are
currently disconnected and they will be removed in next week. Major updates
are as follows:

-- Upgraded machine type from n1-standard-4 (4 vCPUs, 15GB RAM) to
n1-highmem-16 (16 vCPUs, 104GB Ram);
-- Upgraded OS from Ubuntu 14.04 to 16.04;
-- Increased quantity of instances to 16;
-- Installed the latest version of packages and underlying tools;

The overall build duration are dropping and the stability is improved since
the new powerful machines.  In addition, python tests are no longer limited
to some specific nodes. It significantly reduce the waiting time in job
queue. For example, before swapping, the average waiting time of 10 latest
Python PreCommits was 22.2 minutes, and now it drops to 10 seconds!

Special thanks to Alan Myrvold and Jason Kuster for helping on the smooth
swapping process.

Regards.
Yifan Zou