Re: Volunteers needed -- Automated Image Testing for flavors
Hi, I have a few updates for you. I tried to run the tests on ec2 and on digital ocean. The tests uses qemu with kvm to boot the isos. Unfortunately I turned off the usage of kvm, which resulted in two things: a) It's rather slow. b) irqbalance keeps crashing. I've tried to run the tests on different days, with differents isos and different ubuntu versions. The main issue was, that irqbalance on the slave (the booted iso system) keeps crashing. Atleast it did work at the beginning - sometimes. I would suggest to run the tests on real hardware. Running the tests in the cloud doesn't seem to be really doable, if irqbalance keeps crashing. If someone knows how to fix that, it might be a bit different. -- Sujee Am 01.08.2015 um 15:19 schrieb Sujeevan (svij) Vijayakumaran: > Hi, > > Am 31.07.2015 um 22:32 schrieb Nicholas Skaggs: >> -svij and shrini agreed to setup a test jenkins instance to help answer >> our lingering questions on what we need. Specifically they'll be looking at >> where should we host this? >> can we test in the cloud? >> what type of setup should we have (how many slaves, how many instances)? >> and trying to get us all setup with a jenkins instance we can add jobs >> to and iterate on moving forward. >> > > I've set up an Jenkins-Master server today, but there isn't anything yet > (http://jenkins.svij.org). It runs on digital ocean (for 10$/month + > 2$/month for backups) > > I also had a look into the tests to check the other questions. The sad > thing is, that we can't host this on digitalocean, because digitalocean > doesn't support nested kvm virtualisation. The tests do use local kvm on > the host machine. > > We have three options now: > > * rent a physical machine, where we can run the tests on local kvm > * buy a physical machine and host that somewhere (e.g. at someones home…) > * rent a amazon ec2 instance (which is virtualized but uses hvm with xen) > > All three options are kind of expensive. The first option probably needs > a contract for atleast a year (depends on the provider). IMHO the best > solution is to use amazon ec2. We could write a script which starts an > fresh ec2 instance and runs the tests. After that we can drop the ec2 > instance again. Running the ec2 instance (t2.medium with 2GB RAM) 24/7 > would nearly cost 40$… but they were idling most of the time anyway. So > the best and cheapest option is to only use them, when there are new iso > images to test. The jenkins master server needs to run 24/7, that could > continue to run on digital ocean. > > I don't have experience with amazon aws/ec2, if theres something wrong, > please correct me. > > Cheers, > Sujeevan > -- Ubuntu-quality mailing list Ubuntu-quality@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality
Re: Volunteers needed -- Automated Image Testing for flavors
Hi, Am 04.08.2015 um 16:39 schrieb Mike Lloyd: > I have two G5s, a G4 and a 4U G1 I can donate if someone wants to pay for > shipping or hosting. Can you give as a few more details about CPU/RAM/HDD etc? It seems for me that those are HP Servers. -- svij > Mike. > > On Tue, 4 Aug 2015 at 08:36 Nicholas Skaggs > wrote: > >> On 08/01/2015 09:19 AM, Sujeevan (svij) Vijayakumaran wrote: >>> Hi, >>> >>> Am 31.07.2015 um 22:32 schrieb Nicholas Skaggs: >>>> -svij and shrini agreed to setup a test jenkins instance to help answer >>>> our lingering questions on what we need. Specifically they'll be >> looking at >>>> where should we host this? >>>> can we test in the cloud? >>>> what type of setup should we have (how many slaves, how many instances)? >>>> and trying to get us all setup with a jenkins instance we can add jobs >>>> to and iterate on moving forward. >>>> >>> I've set up an Jenkins-Master server today, but there isn't anything yet >>> (http://jenkins.svij.org). It runs on digital ocean (for 10$/month + >>> 2$/month for backups) >>> >>> I also had a look into the tests to check the other questions. The sad >>> thing is, that we can't host this on digitalocean, because digitalocean >>> doesn't support nested kvm virtualisation. The tests do use local kvm on >>> the host machine. >>> >>> We have three options now: >>> >>> * rent a physical machine, where we can run the tests on local kvm >>> * buy a physical machine and host that somewhere (e.g. at someones >> home…) >>> * rent a amazon ec2 instance (which is virtualized but uses hvm with >> xen) >>> >>> All three options are kind of expensive. The first option probably needs >>> a contract for atleast a year (depends on the provider). IMHO the best >>> solution is to use amazon ec2. We could write a script which starts an >>> fresh ec2 instance and runs the tests. After that we can drop the ec2 >>> instance again. Running the ec2 instance (t2.medium with 2GB RAM) 24/7 >>> would nearly cost 40$… but they were idling most of the time anyway. So >>> the best and cheapest option is to only use them, when there are new iso >>> images to test. The jenkins master server needs to run 24/7, that could >>> continue to run on digital ocean. >>> >>> I don't have experience with amazon aws/ec2, if theres something wrong, >>> please correct me. >>> >>> Cheers, >>> Sujeevan >>> >> Sujeevan, thanks for looking into this! While I see there's some tricks >> available to allow for nested virtualization, do we know this will >> actually work? Can anyone comment if they've used things like >> xen-blanket in the past for this? >> >> On the other options, I'm open to feedback. Does anyone have suggested >> hardware or hosting since we are looking more and more like we need >> physical servers for this? Those with jenkins experience, what about the >> thought of keeping master as a cloud server, and have a physical machine >> be the slave that is located in someone's house or hosted? >> >> Nicholas >> >> -- >> Ubuntu-quality mailing list >> Ubuntu-quality@lists.ubuntu.com >> Modify settings or unsubscribe at: >> https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality >> -- Ubuntu-quality mailing list Ubuntu-quality@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality
Re: Volunteers needed -- Automated Image Testing for flavors
Hey, Am 04.08.2015 um 19:12 schrieb Nicholas Skaggs: > On 08/04/2015 10:40 AM, Shrinivasan T wrote: >>> I don't have experience with amazon aws/ec2, if theres something wrong, >>> please correct me. >> I have a EC-2 instance. >> >> How to check if it supports virtualization? >> >> If you tell to run something on it and share the results, I can do it. >> >> > Shrinivasan, if you wish to try, > https://code.google.com/p/xen-blanket/wiki/InstallOnEC2 seems like the > way to do it. Note it requires and HVM. Looks like they use centos in > their example though, and it's a quite dated. Hence my thoughts are that > it's unlikely to be successful. I don't know of anything else that > claims to allow nested virtualization. Uh, I don't think we need that… Trying to run the tests on a ec2 instance should be the way to go. See https://bazaar.launchpad.net/~ubuntu-installer/ubiquity/trunk/view/head:/autopilot/README.md#L69 This script uses local kvm on ec2 to boot the isos as it seems for me on the first quick look… If that script starts, than it should work fine for our tests. -- Sujeevan -- Ubuntu-quality mailing list Ubuntu-quality@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality
Re: Volunteers needed -- Automated Image Testing for flavors
Hi, Am 31.07.2015 um 22:32 schrieb Nicholas Skaggs: > -svij and shrini agreed to setup a test jenkins instance to help answer > our lingering questions on what we need. Specifically they'll be looking at > where should we host this? > can we test in the cloud? > what type of setup should we have (how many slaves, how many instances)? > and trying to get us all setup with a jenkins instance we can add jobs > to and iterate on moving forward. > I've set up an Jenkins-Master server today, but there isn't anything yet (http://jenkins.svij.org). It runs on digital ocean (for 10$/month + 2$/month for backups) I also had a look into the tests to check the other questions. The sad thing is, that we can't host this on digitalocean, because digitalocean doesn't support nested kvm virtualisation. The tests do use local kvm on the host machine. We have three options now: * rent a physical machine, where we can run the tests on local kvm * buy a physical machine and host that somewhere (e.g. at someones home…) * rent a amazon ec2 instance (which is virtualized but uses hvm with xen) All three options are kind of expensive. The first option probably needs a contract for atleast a year (depends on the provider). IMHO the best solution is to use amazon ec2. We could write a script which starts an fresh ec2 instance and runs the tests. After that we can drop the ec2 instance again. Running the ec2 instance (t2.medium with 2GB RAM) 24/7 would nearly cost 40$… but they were idling most of the time anyway. So the best and cheapest option is to only use them, when there are new iso images to test. The jenkins master server needs to run 24/7, that could continue to run on digital ocean. I don't have experience with amazon aws/ec2, if theres something wrong, please correct me. Cheers, Sujeevan -- Ubuntu-quality mailing list Ubuntu-quality@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality
Re: Volunteers needed -- Automated Image Testing for flavors
Hi all, Am 29.07.2015 um 22:01 schrieb Nicholas Skaggs: > > > Even with the tests working, however, we still need to setup a jenkins > to run them. We'll also need to maintain this server. Anyone with > experience or desire in this area? Ideas for reporting results (on the > isotracker for instance) also need to be explored. This is likely to > involve some python, and potentially some web work. Is anyone interested? > I could help with that. I do have experience with setting up and maintaining a Jenkins-Server for a couple of years. I'll currently doing that anyway on my normal day job. So I'm happy to help! > If you have some technical skills and want to help out, please do get > in touch with myself, DanChapman or dkessel. The goal behind this > effort is to see these tests be useful again this cycle for image > testing and lowering the burden for manual testers. Sounds good, even if my experience with writing tests with autopilot are pretty low. Cheers, Sujeevan -- Ubuntu-quality mailing list Ubuntu-quality@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality
