Re: [Openstack] [QA] openstack-integration-tests

2011-10-20 Thread Anne Gentle
have multiple swim lanes of these hardware environments (I do already) and to automate the burn-down, install, configuration, and testing of those environments. I would like the testing portion of this to be consistent - and I'm looking to the OpenStack Integration Tests to be the basis

Re: [Openstack] [QA] openstack-integration-tests

2011-10-19 Thread Rohit Karajgi
/openstack/openstack-integration-tests is actually a merge of Kong and Stacktester. The other point I wanted to have more clarity on was on using both novaclient AND httplib2 to make the API requests. Though wwkeyboard did mention issues regarding spec bug proliferation into the client, how can we

Re: [Openstack] [QA] openstack-integration-tests

2011-10-19 Thread Daryl Walleck
/openstack-integration-tests is actually a merge of Kong and Stacktester. The other point I wanted to have more clarity on was on using both novaclient AND httplib2 to make the API requests. Though wwkeyboard did mention issues regarding spec bug proliferation into the client, how can we best

Re: [Openstack] [QA] openstack-integration-tests

2011-10-19 Thread Brebner, Gavin
+gavin.brebner=hp@lists.launchpad.net [mailto:openstack-bounces+gavin.brebner=hp@lists.launchpad.net] On Behalf Of Daryl Walleck Sent: Wednesday, October 19, 2011 6:27 PM To: Rohit Karajgi Cc: openstack@lists.launchpad.net Subject: Re: [Openstack] [QA] openstack-integration-tests Hi Rohit

Re: [Openstack] [QA] openstack-integration-tests

2011-10-19 Thread Joseph Heck
in a known state is to walk it there through sequences of tests. I believe we essentially already have this framework in place with the openstack-integration-tests repo and the proposed (but not yet implemented) set of tests using proboscis to enable dependencies and grouping in those tests. -joe

Re: [Openstack] [QA] openstack-integration-tests

2011-10-19 Thread Ngo, Donald (HP Cloud Services : QA)
@lists.launchpad.net [mailto:openstack-bounces+donald.ngo=hp@lists.launchpad.net] On Behalf Of Brebner, Gavin Sent: Wednesday, October 19, 2011 10:39 AM To: Daryl Walleck; Rohit Karajgi Cc: openstack@lists.launchpad.net Subject: Re: [Openstack] [QA] openstack-integration-tests My 2c To me, the end

Re: [Openstack] [QA] openstack-integration-tests

2011-10-19 Thread Joseph Heck
of this to be consistent - and I'm looking to the OpenStack Integration Tests to be the basis for that - and to which we'll be submitting back tests working the Dashboard as it goes forward. Something to note - (kind of buried in: http://wiki.openstack.org/openstack-integration-test-suites

Re: [Openstack] [QA] openstack-integration-tests

2011-10-12 Thread James E. Blair
is for the openstack-integration-tests project. The project is currently on github and gerrit: https://github.com/openstack/openstack-integration-tests I think there should be a new group, perhaps openstack-qa-core, that is the group of core committers to the project that can approve changes

Re: [Openstack] [QA] openstack-integration-tests

2011-10-12 Thread Jay Pipes
jenkins, it should be included in the community github repository. Hi, During the meeting today, folks asked about what the core group is for the openstack-integration-tests project. The project is currently on github and gerrit: https://github.com/openstack/openstack-integration

Re: [Openstack] [QA] openstack-integration-tests

2011-10-12 Thread Nati Ueno
, it should be included in the community github repository. Hi, During the meeting today, folks asked about what the core group is for the openstack-integration-tests project. The project is currently on github and gerrit:  https://github.com/openstack/openstack-integration-tests I think

[Openstack] [QA] openstack-integration-tests

2011-10-10 Thread Gabe Westmaas
I'd like to try to summarize and propose at least one next step for the content of the openstack-integration-tests git repository. Note that this is only about the actual tests themselves, and says absolutely nothing about any gating decisions made in other sessions. First

Re: [Openstack] Integration tests

2011-09-13 Thread Thierry Carrez
Matt Dietz wrote: Ditto On 9/12/11 2:10 PM, Sandy Walsh sandy.wa...@rackspace.com wrote: From: Jay Pipes [jaypi...@gmail.com] Can we discuss pulling novaclient into Nova's source tree at the design summit? +1 Someone should file it at summit.openstack.org, then :) -- Thierry Carrez

Re: [Openstack] Integration tests

2011-09-13 Thread Sandy Walsh
@lists.launchpad.net Subject: Re: [Openstack] Integration tests Matt Dietz wrote: Ditto On 9/12/11 2:10 PM, Sandy Walsh sandy.wa...@rackspace.com wrote: From: Jay Pipes [jaypi...@gmail.com] Can we discuss pulling novaclient into Nova's source tree at the design summit? +1 Someone should file

Re: [Openstack] Integration tests

2011-09-12 Thread Jay Pipes
To: openstack@lists.launchpad.net Subject: Re: [Openstack] Integration tests That link shouldn't have included the +bug bit. Copy/paste fail. :( Sent from my phone. Pardon my brevity. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack

Re: [Openstack] Integration tests

2011-09-12 Thread Tim Simpson
variables even as we pass state between related tests. I think the openstack-integration-tests would definitely benefit from it. I'd love to have a conversation about getting the traits outlined above adopted into this standardized testing solution. :) Output of our tests running: http://pastie.org

Re: [Openstack] Integration tests

2011-09-12 Thread Matt Dietz
fails, and avoid global variables even as we pass state between related tests. I think the openstack-integration-tests would definitely benefit from it. I'd love to have a conversation about getting the traits outlined above adopted into this standardized testing solution. :) Output of our tests

Re: [Openstack] Integration tests

2011-09-12 Thread Jay Pipes
it uses a 3rd party library for executing the tests. We can try merging these things together, if that's what everyone wants. I'd be totally cool with bringing DTest goodness into https://github.com/sorenh/openstack-integration-tests. :) Less duplication of effort, the better IMHO. openstack

Re: [Openstack] Integration tests

2011-09-12 Thread Sandy Walsh
From: Jay Pipes [jaypi...@gmail.com] Can we discuss pulling novaclient into Nova's source tree at the design summit? +1 This email may include confidential information. If you received it in error, please delete it.

Re: [Openstack] Integration tests

2011-09-12 Thread Tim Simpson
@lists.launchpad.net Subject: Re: [Openstack] Integration tests Regarding novaclient, I was debating this myself last night. Our backfire suite currently uses it. However, I can see scenarios where nova has advanced but novaclient has yet to, and because all three projects are independently developed

Re: [Openstack] Integration tests

2011-09-12 Thread Matt Dietz
Ditto On 9/12/11 2:10 PM, Sandy Walsh sandy.wa...@rackspace.com wrote: From: Jay Pipes [jaypi...@gmail.com] Can we discuss pulling novaclient into Nova's source tree at the design summit? +1 This email may include confidential information. If you

Re: [Openstack] Integration tests

2011-09-12 Thread Gabe Westmaas
: [Openstack] Integration tests Regarding novaclient, I was debating this myself last night. Our backfire suite currently uses it. However, I can see scenarios where nova has advanced but novaclient has yet to, and because all three projects are independently developed, we're stuck temporarily. I

Re: [Openstack] Integration tests

2011-09-12 Thread Matt Dietz
everyone wants. I'd be totally cool with bringing DTest goodness into https://github.com/sorenh/openstack-integration-tests. :) Less duplication of effort, the better IMHO. openstack-integration-tests should be in the business of writing integration tests, not multi-processing testing libraries. -jay

Re: [Openstack] Integration tests

2011-09-12 Thread Tim Simpson
Sent: Monday, September 12, 2011 3:16 PM To: Tim Simpson; Matt Dietz; Jay Pipes Cc: openstack@lists.launchpad.net Subject: Re: [Openstack] Integration tests On 9/12/11 2:54 PM, Tim Simpson tim.simp...@rackspace.com wrote: It would be advantageous for the tests to only use one client, whatever

Re: [Openstack] Integration tests

2011-09-12 Thread Ed Leafe
On Sep 12, 2011, at 3:16 PM, Gabe Westmaas wrote: It would be advantageous for the tests to only use one client, whatever it turns out to be. I think it would be most practical to use a bleeding edge version of Nova client and add any features necessary to it in its own repo directly or by

Re: [Openstack] Integration tests

2011-09-11 Thread Matt Dietz
Subject: Re: [Openstack] Integration tests That link shouldn't have included the +bug bit. Copy/paste fail. :( Sent from my phone. Pardon my brevity. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack

[Openstack] Integration tests

2011-09-09 Thread Soren Hansen
://github.com/openstack/openstack-integration-tests and is managed by Gerrit like everything else (see http://wiki.openstack.org/GerritWorkflow for details). A bit of history: A number of different integration test projects existed. The most extensive ones I knew of, Kong and Stacktester, were used

Re: [Openstack] Integration tests

2011-09-09 Thread Soren Hansen
That link shouldn't have included the +bug bit. Copy/paste fail. :( Sent from my phone. Pardon my brevity. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More