Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial
On Mon, Nov 7, 2016, at 01:48 PM, Clark Boylan wrote: > Hello everyone, > > The infra team would really like to get the Ubuntu Xenial for testing > transition completed early this cycle. We are planning to switch any > jobs that remain on Ubuntu Trusty but should be on Ubuntu Xenial on > December 6, 2016. That gives us about a month from today to more > gracefully migrate jobs while still getting it done early enough in the > cycle to fix any issues and put it behind us. Would be great for project > teams to test if their jobs run on Xenial and propose updates to > openstack-infra/project-config as necessary to switch to Ubuntu Xenial. After much editing of yaml the last few days this work is done. If you notice that we missed something please let us know and we will get it sorted out. Generally though you should notice that changes to master no longer have tests run on Trusty. Thanks again to all those that helped get their projects ready ahead of time and to those that helped with the transition this week. Clark __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial
Clark, for Trove, I'm in the process of finishing this and there is a change [1] that is currently up for review (I have to incorporate changes to reflect Andreas' comments). If you find something amiss with the Trove jobs (trove, trove client, trove-integration or dashboard), please let me know and I'll fix it up pronto. Thanks, -amrith [1] https://review.openstack.org/#/c/405018/ > -Original Message- > From: Clark Boylan [mailto:cboy...@sapwetik.org] > Sent: Monday, December 5, 2016 4:53 PM > To: openstack-dev@lists.openstack.org > Subject: Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial > > On Mon, Nov 7, 2016, at 01:48 PM, Clark Boylan wrote: > > Hello everyone, > > > > The infra team would really like to get the Ubuntu Xenial for testing > > transition completed early this cycle. We are planning to switch any > > jobs that remain on Ubuntu Trusty but should be on Ubuntu Xenial on > > December 6, 2016. That gives us about a month from today to more > > gracefully migrate jobs while still getting it done early enough in > > the cycle to fix any issues and put it behind us. Would be great for > > project teams to test if their jobs run on Xenial and propose updates > > to openstack-infra/project-config as necessary to switch to Ubuntu Xenial. > > As a heads up the Infra team has begun pushing changes to start this work. > The vast majority of them likely won't start merging until tomorrow, however > you may start to see changes going in particularly for experimental and non > voting jobs. > > Thank you to all the teams that got ahead of this and worked to make the > transition earlier. > > One thing that pops out at me as we go through this work is that we have a > lot of experimental and non voting jobs that need to be updated. > Considering that experimental jobs in particular and often non voting jobs > are supposed to be works in progress to get to voting, does the lack of > interest in updating these from the projects themselves imply the jobs are > dead and not needed? Maybe we should be doing cleanup of old forgotten > experimental and non voting jobs that aren't being used? > > Thank you, > Clark > > __ > > OpenStack Development Mailing List (not for usage questions) > Unsubscribe: OpenStack-dev- > requ...@lists.openstack.org?subject:unsubscribe > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev smime.p7s Description: S/MIME cryptographic signature __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial
On Mon, Nov 7, 2016, at 01:48 PM, Clark Boylan wrote: > Hello everyone, > > The infra team would really like to get the Ubuntu Xenial for testing > transition completed early this cycle. We are planning to switch any > jobs that remain on Ubuntu Trusty but should be on Ubuntu Xenial on > December 6, 2016. That gives us about a month from today to more > gracefully migrate jobs while still getting it done early enough in the > cycle to fix any issues and put it behind us. Would be great for project > teams to test if their jobs run on Xenial and propose updates to > openstack-infra/project-config as necessary to switch to Ubuntu Xenial. As a heads up the Infra team has begun pushing changes to start this work. The vast majority of them likely won't start merging until tomorrow, however you may start to see changes going in particularly for experimental and non voting jobs. Thank you to all the teams that got ahead of this and worked to make the transition earlier. One thing that pops out at me as we go through this work is that we have a lot of experimental and non voting jobs that need to be updated. Considering that experimental jobs in particular and often non voting jobs are supposed to be works in progress to get to voting, does the lack of interest in updating these from the projects themselves imply the jobs are dead and not needed? Maybe we should be doing cleanup of old forgotten experimental and non voting jobs that aren't being used? Thank you, Clark __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial
On Tue, Nov 22, 2016 at 2:00 PM Neil Jerram wrote: > After fixing those... I see that the reproduce.sh script appears to do > DevStack setup correctly, but not to run any Tempest tests. Is > reproduce.sh supposed to run the Tempest tests as well? > > Sorry, please ignore that. I still have a Xenial-related issue in my DevStack setup. Neil __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial
On Tue, Nov 22, 2016 at 11:41 AM Neil Jerram wrote: > On Tue, Nov 22, 2016 at 10:58 AM Neil Jerram wrote: > > On Mon, Nov 7, 2016 at 9:50 PM Clark Boylan wrote: > > [...] > > If you have jobs still running on trusty the next step is to fire up a > Xenial instance locally and run that test to see if it works. Usually > this will mean running the appropriate tox target or if using > devstack-gate you can grab the reproduce.sh script for that job and run > that script locally. > > > Is there doc somewhere about what needs adding to a fresh Xenial server > image, to allow reproduce.sh script to run successfully? > > So far, I've hit: > - virtualenv > - gcc > > - python-all-dev > > Then I think I'm into genuine issues with my DevStack plugin... > After fixing those... I see that the reproduce.sh script appears to do DevStack setup correctly, but not to run any Tempest tests. Is reproduce.sh supposed to run the Tempest tests as well? Thanks, Neil __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial
On Tue, Nov 22, 2016 at 10:58 AM Neil Jerram wrote: > On Mon, Nov 7, 2016 at 9:50 PM Clark Boylan wrote: > > [...] > > If you have jobs still running on trusty the next step is to fire up a > Xenial instance locally and run that test to see if it works. Usually > this will mean running the appropriate tox target or if using > devstack-gate you can grab the reproduce.sh script for that job and run > that script locally. > > > Is there doc somewhere about what needs adding to a fresh Xenial server > image, to allow reproduce.sh script to run successfully? > > So far, I've hit: > - virtualenv > - gcc > - python-all-dev Then I think I'm into genuine issues with my DevStack plugin... > Neil > > __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial
Hello Neil See comments inline Kind regards, Denis Makogon 2016-11-22 12:58 GMT+02:00 Neil Jerram : > On Mon, Nov 7, 2016 at 9:50 PM Clark Boylan wrote: > >> [...] > > If you have jobs still running on trusty the next step is to fire up a >> Xenial instance locally and run that test to see if it works. Usually >> this will mean running the appropriate tox target or if using >> devstack-gate you can grab the reproduce.sh script for that job and run >> that script locally. >> >> > Is there doc somewhere about what needs adding to a fresh Xenial server > image, to allow reproduce.sh script to run successfully? > > So far, I've hit: > - virtualenv > In Python 3.x you can create virtualenv with command: python3 -m virtualenv .venv > - gcc > > Neil > > > __ > OpenStack Development Mailing List (not for usage questions) > Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > > __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial
On Mon, Nov 7, 2016 at 9:50 PM Clark Boylan wrote: > [...] If you have jobs still running on trusty the next step is to fire up a > Xenial instance locally and run that test to see if it works. Usually > this will mean running the appropriate tox target or if using > devstack-gate you can grab the reproduce.sh script for that job and run > that script locally. > > Is there doc somewhere about what needs adding to a fresh Xenial server image, to allow reproduce.sh script to run successfully? So far, I've hit: - virtualenv - gcc Neil __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial
On Mon, Nov 14, 2016, at 03:30 PM, Clark Boylan wrote: > On Mon, Nov 7, 2016, at 01:48 PM, Clark Boylan wrote: > > Hello everyone, > > > > The infra team would really like to get the Ubuntu Xenial for testing > > transition completed early this cycle. We are planning to switch any > > jobs that remain on Ubuntu Trusty but should be on Ubuntu Xenial on > > December 6, 2016. That gives us about a month from today to more > > gracefully migrate jobs while still getting it done early enough in the > > cycle to fix any issues and put it behind us. Would be great for project > > teams to test if their jobs run on Xenial and propose updates to > > openstack-infra/project-config as necessary to switch to Ubuntu Xenial. > > Just a friendly reminder that this is still happening. We will be > updating any jobs running on Trusty that should be running on Xenial on > December 6th. I have seen a few projects jump on this and start making > the necessary changes. Thank you for doing that! > > As always feel free to ask questions or ping us (the infra team) for > help if you need it. Sorry for being a pest but Andreas wanted us to overcommunicate this so here is your weekly reminder :) Don't forget this is happening December 6th. That said I have been really happy with the turnout on fixing these sorts of issues. Thank you to everyone who has shown up to update their project job configs. One thing that has occurred to me that would've been nice to have in previous emails is if we use a common topic for these changes it may help reviews get through quicker. Maybe we should try using "xenial" as a common topic then reviewers can search for topic:xenial in gerrit. Thank you, Clark __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial
On 18/11/2016 12:17, Jakub Libosvar wrote: On 07/11/2016 23:04, Clark Boylan wrote: On Mon, Nov 7, 2016, at 01:48 PM, Clark Boylan wrote: How can you do this? First double check your job logs to see where your tests are running. The first few lines of your job console logs should say "[Zuul] Building remotely on ubuntu-xenial" if running on Xenial. Any changes to master should not run on Trusty and instead should run on Xenial. Point of clarification here, stable/newton and master jobs should both be transitioned to Xenial. I noticed gate-grenade-dsvm-ubuntu-xenial job is run on stable Newton branch for devstack. It basically means Mitaka devstack is used to deploy on Xenial but Xenial is not among supported distros in Mitaka [1]. What is recommended way of upgrade for Ubuntu users running Mitaka on Trusy? Is it: upgrade Ubuntu to Xenial first, then upgrade Mitaka to Newton? I see three ways how to solve this problem: 1) Implement support to devstack Mitaka. 2) Use FORCE value for grenade Newton (I sent experimental patch [2]). 3) Run Trusty only for upgrades Mitaka->Newton. Any thoughts or comments? I see it was resolved by https://bugs.launchpad.net/openstack-gate/+bug/1642543 Sorry for the noise. Thanks, Jakub [1] https://github.com/openstack-dev/devstack/blob/stable/mitaka/stack.sh#L188 [2] https://review.openstack.org/#/c/399526/ Clark __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial
On 07/11/2016 23:04, Clark Boylan wrote: On Mon, Nov 7, 2016, at 01:48 PM, Clark Boylan wrote: How can you do this? First double check your job logs to see where your tests are running. The first few lines of your job console logs should say "[Zuul] Building remotely on ubuntu-xenial" if running on Xenial. Any changes to master should not run on Trusty and instead should run on Xenial. Point of clarification here, stable/newton and master jobs should both be transitioned to Xenial. I noticed gate-grenade-dsvm-ubuntu-xenial job is run on stable Newton branch for devstack. It basically means Mitaka devstack is used to deploy on Xenial but Xenial is not among supported distros in Mitaka [1]. What is recommended way of upgrade for Ubuntu users running Mitaka on Trusy? Is it: upgrade Ubuntu to Xenial first, then upgrade Mitaka to Newton? I see three ways how to solve this problem: 1) Implement support to devstack Mitaka. 2) Use FORCE value for grenade Newton (I sent experimental patch [2]). 3) Run Trusty only for upgrades Mitaka->Newton. Any thoughts or comments? Thanks, Jakub [1] https://github.com/openstack-dev/devstack/blob/stable/mitaka/stack.sh#L188 [2] https://review.openstack.org/#/c/399526/ Clark __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial
On Mon, Nov 14, 2016, at 05:21 PM, Neil Jerram wrote: > On Mon, Nov 7, 2016 at 9:50 PM Clark Boylan wrote: > > > If you have jobs still running on trusty the next step is to fire up a > > Xenial instance locally and run that test to see if it works. > > > > Can you advise how big (RAM, CPU, disk) the Xenial instance should be, so > as to be similar to what is used in the gate? Working on documenting that at https://review.openstack.org/#/c/394566/1/doc/source/testing.rst still a bit of a work in progress overall but should include those specifics. Clark __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial
On Mon, Nov 7, 2016 at 9:50 PM Clark Boylan wrote: > If you have jobs still running on trusty the next step is to fire up a > Xenial instance locally and run that test to see if it works. > Can you advise how big (RAM, CPU, disk) the Xenial instance should be, so as to be similar to what is used in the gate? Thanks, Neil __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial
On Mon, Nov 7, 2016, at 01:48 PM, Clark Boylan wrote: > Hello everyone, > > The infra team would really like to get the Ubuntu Xenial for testing > transition completed early this cycle. We are planning to switch any > jobs that remain on Ubuntu Trusty but should be on Ubuntu Xenial on > December 6, 2016. That gives us about a month from today to more > gracefully migrate jobs while still getting it done early enough in the > cycle to fix any issues and put it behind us. Would be great for project > teams to test if their jobs run on Xenial and propose updates to > openstack-infra/project-config as necessary to switch to Ubuntu Xenial. Just a friendly reminder that this is still happening. We will be updating any jobs running on Trusty that should be running on Xenial on December 6th. I have seen a few projects jump on this and start making the necessary changes. Thank you for doing that! As always feel free to ask questions or ping us (the infra team) for help if you need it. Clark __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial
On Mon, Nov 7, 2016, at 01:48 PM, Clark Boylan wrote: > How can you do this? First double check your job logs to see where your > tests are running. The first few lines of your job console logs should > say "[Zuul] Building remotely on ubuntu-xenial" if running on Xenial. > Any changes to master should not run on Trusty and instead should run on > Xenial. Point of clarification here, stable/newton and master jobs should both be transitioned to Xenial. Clark __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] [All] Finish test job transition to Ubuntu Xenial
Hello everyone, The infra team would really like to get the Ubuntu Xenial for testing transition completed early this cycle. We are planning to switch any jobs that remain on Ubuntu Trusty but should be on Ubuntu Xenial on December 6, 2016. That gives us about a month from today to more gracefully migrate jobs while still getting it done early enough in the cycle to fix any issues and put it behind us. Would be great for project teams to test if their jobs run on Xenial and propose updates to openstack-infra/project-config as necessary to switch to Ubuntu Xenial. How can you do this? First double check your job logs to see where your tests are running. The first few lines of your job console logs should say "[Zuul] Building remotely on ubuntu-xenial" if running on Xenial. Any changes to master should not run on Trusty and instead should run on Xenial. If you have jobs still running on trusty the next step is to fire up a Xenial instance locally and run that test to see if it works. Usually this will mean running the appropriate tox target or if using devstack-gate you can grab the reproduce.sh script for that job and run that script locally. If everything works, then push a change to openstack-infra/project-config. We have been using a job name suffix of -ubuntu-xenial to indicate jobs should run on xenial. An example change that does this can be found at [0]. If you run into failures hopefully you can iterate on them locally using your Xenial test setup, get them fixed, then update the job location. This work is important because it helps ensure that OpenStack functions on more "modern" linuxes. We get shiny new things like newer versions of libvirt and ovs. We also get to stop worrying about upstart. As always I and the rest of the infra team are happy to help should you have questions or concerns or just need eyeballs to help debug problems. [0] https://review.openstack.org/#/c/348078 Thank you Clark __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev