Re: [ovirt-devel] Question about testing

[Eyal Edri]

On Sun, Feb 5, 2017 at 4:38 PM, Marc Young <3vilpeng...@gmail.com> wrote:

> I'm not sure the process for posting on oVirt.org but I wouldn't mind at
> all. I was going to write one on my personal blog as well. I'll send an
> email in a few.
>
> As for the tests, the unit tests are rspec and can run without a server.
> The acceptance tests were, in my mind, just going to be a bunch of
> directories, each with a vagrantfile specific to the test, such as one with
> specific CPU/ram, one with a bash provisioner, and the tests were going to
> be simple `bats` tests that vagrant up, vagrant halt, snapshot , restore
> from snapshot, etc and test error codes. Those will need a master but the
> tests would just be time consuming workflow specific assertions. Feel free
> to suggest something else, but that's what I had planned
>

I think for most cases you described above, the 'check-patch.sh' flow will
work for you, and you'll just need to specify your needs in the relevant
files under 'automation' dir in your project,
As described in [1], for e.g, add 'vagrant' pkg to the check-patch.packages
file and perhaps the vagrant repo for the 'check-patch.repos' file, while
writing all your bats tests in check-patch.sh script.

If you'll want to run more complex end-to-end tests which requires
installing oVirt / hosts / etc.. then we need to check how you can
integrate with oVirt System Tests framework.

Feel free to ask for help on in...@ovirt.org or open a ticket @
jira.ovirt.org.

[1]
http://infra-docs.readthedocs.io/en/latest/CI/Build_and_test_standards.html



>
> On Sun, Feb 5, 2017, 8:17 AM Yaniv Kaul  wrote:
>
>>
>>
>> On Feb 5, 2017 1:58 PM, "Marc Young" <3vilpeng...@gmail.com> wrote:
>>
>> I see emails floating around about Jenkins.
>>
>> Is there a public Jenkins, or possibly one that I can be invited to?
>> I just finished the vagrant provider and
>>
>>
>>
>> Excellent news -  saw it on twitter!
>> Can you send an email to the users mailing list about it?
>> Perhaps even a blog post on ovirt.org?
>>
>> pushed it to rubygems and am
>> currently bringing up a new permanent oVirt server so that i can write
>> some acceptance tests, but having access to a Jenkins and a testable
>> oVirt setup would save me a ton of time.
>>
>>
>> I'm sure it can be integrated nicely to ovirt-system-tests. Let me think
>> about it for awhile.
>> Y.
>>
>> ___
>> Devel mailing list
>> Devel@ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/devel
>>
>>
>>
> ___
> Devel mailing list
> Devel@ovirt.org
> http://lists.ovirt.org/mailman/listinfo/devel
>



-- 
Eyal Edri
Associate Manager
RHV DevOps
EMEA ENG Virtualization R
Red Hat Israel

phone: +972-9-7692018
irc: eedri (on #tlv #rhev-dev #rhev-integ)
___
Devel mailing list
Devel@ovirt.org
http://lists.ovirt.org/mailman/listinfo/devel

Re: [ovirt-devel] Question about testing

[Marc Young]

I'm not sure the process for posting on oVirt.org but I wouldn't mind at
all. I was going to write one on my personal blog as well. I'll send an
email in a few.

As for the tests, the unit tests are rspec and can run without a server.
The acceptance tests were, in my mind, just going to be a bunch of
directories, each with a vagrantfile specific to the test, such as one with
specific CPU/ram, one with a bash provisioner, and the tests were going to
be simple `bats` tests that vagrant up, vagrant halt, snapshot , restore
from snapshot, etc and test error codes. Those will need a master but the
tests would just be time consuming workflow specific assertions. Feel free
to suggest something else, but that's what I had planned

On Sun, Feb 5, 2017, 8:17 AM Yaniv Kaul  wrote:

>
>
> On Feb 5, 2017 1:58 PM, "Marc Young" <3vilpeng...@gmail.com> wrote:
>
> I see emails floating around about Jenkins.
>
> Is there a public Jenkins, or possibly one that I can be invited to?
> I just finished the vagrant provider and
>
>
>
> Excellent news -  saw it on twitter!
> Can you send an email to the users mailing list about it?
> Perhaps even a blog post on ovirt.org?
>
> pushed it to rubygems and am
> currently bringing up a new permanent oVirt server so that i can write
> some acceptance tests, but having access to a Jenkins and a testable
> oVirt setup would save me a ton of time.
>
>
> I'm sure it can be integrated nicely to ovirt-system-tests. Let me think
> about it for awhile.
> Y.
>
> ___
> Devel mailing list
> Devel@ovirt.org
> http://lists.ovirt.org/mailman/listinfo/devel
>
>
>
___
Devel mailing list
Devel@ovirt.org
http://lists.ovirt.org/mailman/listinfo/devel

Re: [ovirt-devel] Question about testing

[Yaniv Kaul]

On Feb 5, 2017 1:58 PM, "Marc Young" <3vilpeng...@gmail.com> wrote:

I see emails floating around about Jenkins.

Is there a public Jenkins, or possibly one that I can be invited to?
I just finished the vagrant provider and



Excellent news -  saw it on twitter!
Can you send an email to the users mailing list about it?
Perhaps even a blog post on ovirt.org?

pushed it to rubygems and am
currently bringing up a new permanent oVirt server so that i can write
some acceptance tests, but having access to a Jenkins and a testable
oVirt setup would save me a ton of time.


I'm sure it can be integrated nicely to ovirt-system-tests. Let me think
about it for awhile.
Y.

___
Devel mailing list
Devel@ovirt.org
http://lists.ovirt.org/mailman/listinfo/devel
___
Devel mailing list
Devel@ovirt.org
http://lists.ovirt.org/mailman/listinfo/devel

Re: [ovirt-devel] Question about testing

[Eyal Edri]

On Sun, Feb 5, 2017 at 3:07 PM, Barak Korren  wrote:

> On 5 February 2017 at 14:58, Marc Young <3vilpeng...@gmail.com> wrote:
> > I see emails floating around about Jenkins.
> >
> > Is there a public Jenkins, or possibly one that I can be invited to?
> > I just finished the vagrant provider and pushed it to rubygems and am
> > currently bringing up a new permanent oVirt server so that i can write
> > some acceptance tests, but having access to a Jenkins and a testable
> > oVirt setup would save me a ton of time.
>
> Yes, oVirt has Jenkins server, and a set of standards about how to
> enable a project to use it [1].
> There is also the "oVirt Systems Tests" project [2] that knows how to
> bring up a fully functional oVirt for testing purposes.
>
> Since you're project is on GitHub as opposed to oVirt's Gerrit, I'm
> afraid it will have to wait a while until we can accomodate it, but
> hopefully not for long [3].
>

Adding Evgheni, the oVirt infra sys admin and the one who is also taking
care of the Jenkins server.
I'm also adding the 'in...@ovirt.org' which is the mailing list for the
oVirt infra team ( the team who provides all CI/CD/Testing services for the
oVirt project ).

So we have our 'production' jenkins @ jenkins.ovirt.org where all oVirt
projects are built & tested using the oVirt standard CI [1], as mentioned
below,
And we also have a staging jenkins [1] which is probably the best place to
do tests on before deploying to the production instance.

As for getting an oVirt instance up & running, its quite easy to do as
Barak said, you just need to run any 'basic suite' from the
ovirt-system-tests repository and you'll have a working oVirt running in
less than 20 min
on your laptop. More info on the OST doc page [2]


[1] http://jenkins-staging.phx.ovirt.org/login?from=%2F
[2]
http://ovirt-system-tests.readthedocs.io/en/latest/docs/general/running_tests.html



>
> [1]: http://ovirt-infra-docs.readthedocs.io/en/latest/CI/
> Build_and_test_standards.html
> [2]: http://ovirt-system-tests.readthedocs.io/en/latest/
> [3]: https://ovirt-jira.atlassian.net/browse/OVIRT-970
>
> --
> Barak Korren
> bkor...@redhat.com
> RHCE, RHCi, RHV-DevOps Team
> https://ifireball.wordpress.com/
> ___
> Devel mailing list
> Devel@ovirt.org
> http://lists.ovirt.org/mailman/listinfo/devel
>
>
>


-- 
Eyal Edri
Associate Manager
RHV DevOps
EMEA ENG Virtualization R
Red Hat Israel

phone: +972-9-7692018
irc: eedri (on #tlv #rhev-dev #rhev-integ)
___
Devel mailing list
Devel@ovirt.org
http://lists.ovirt.org/mailman/listinfo/devel

Re: [ovirt-devel] Question about testing

[Barak Korren]

On 5 February 2017 at 15:11, Marc Young <3vilpeng...@gmail.com> wrote:
> Thanks for the quick reply, I was actually in the process of rephrasing to
> make sure my question was clear. Thanks, I found the Jenkins instance and
> I'll follow that ticket. In the meantime I'll spin up my own to do github
> pull request tests, it's not a problem.

If you can organise things in a way that matches the existing
standards, it will make things easier in the future. You can probably
"borrow" some of our code to do that...
I'll be happy to help...

-- 
Barak Korren
bkor...@redhat.com
RHCE, RHCi, RHV-DevOps Team
https://ifireball.wordpress.com/
___
Devel mailing list
Devel@ovirt.org
http://lists.ovirt.org/mailman/listinfo/devel

Re: [ovirt-devel] Question about testing

[Marc Young]

Thanks for the quick reply, I was actually in the process of rephrasing to
make sure my question was clear. Thanks, I found the Jenkins instance and
I'll follow that ticket. In the meantime I'll spin up my own to do github
pull request tests, it's not a problem.

On Sun, Feb 5, 2017, 6:58 AM Marc Young <3vilpeng...@gmail.com> wrote:

> I see emails floating around about Jenkins.
>
> Is there a public Jenkins, or possibly one that I can be invited to?
> I just finished the vagrant provider and pushed it to rubygems and am
> currently bringing up a new permanent oVirt server so that i can write
> some acceptance tests, but having access to a Jenkins and a testable
> oVirt setup would save me a ton of time.
>
___
Devel mailing list
Devel@ovirt.org
http://lists.ovirt.org/mailman/listinfo/devel

Re: [ovirt-devel] Question about testing

[Barak Korren]

On 5 February 2017 at 14:58, Marc Young <3vilpeng...@gmail.com> wrote:
> I see emails floating around about Jenkins.
>
> Is there a public Jenkins, or possibly one that I can be invited to?
> I just finished the vagrant provider and pushed it to rubygems and am
> currently bringing up a new permanent oVirt server so that i can write
> some acceptance tests, but having access to a Jenkins and a testable
> oVirt setup would save me a ton of time.

Yes, oVirt has Jenkins server, and a set of standards about how to
enable a project to use it [1].
There is also the "oVirt Systems Tests" project [2] that knows how to
bring up a fully functional oVirt for testing purposes.

Since you're project is on GitHub as opposed to oVirt's Gerrit, I'm
afraid it will have to wait a while until we can accomodate it, but
hopefully not for long [3].

[1]: 
http://ovirt-infra-docs.readthedocs.io/en/latest/CI/Build_and_test_standards.html
[2]: http://ovirt-system-tests.readthedocs.io/en/latest/
[3]: https://ovirt-jira.atlassian.net/browse/OVIRT-970

-- 
Barak Korren
bkor...@redhat.com
RHCE, RHCi, RHV-DevOps Team
https://ifireball.wordpress.com/
___
Devel mailing list
Devel@ovirt.org
http://lists.ovirt.org/mailman/listinfo/devel