[Openstack] How do I stop image-create from using /tmp?

2012-06-29 Thread Lars Kellogg-Stedman
I'm running "nova image-create" for the first time, and on the compute node I see: qemu-img convert -f qcow2 -O qcow2 -s 98a8efe9ec114b489eb163c64661441a /virt/pools/openstack_2/instance-0011/disk /tmp/tmpH9KkUZ/98a8efe9ec114b489eb163c64661441a I am concerned to see this operation d

Re: [Openstack] Unit tests, individual vs. test suite

2012-06-29 Thread Andrew Bogott
On 6/29/12 10:57 AM, Kevin L. Mitchell wrote: On Fri, 2012-06-29 at 10:34 -0500, Andrew Bogott wrote: $ /opt/stack/nova$ ./run_tests.sh test_virt_drivers AbstractDriverTestCase test_add_to_aggregateERROR 0.02 test_agent_update

Re: [Openstack] HA inside VMs (via Corosync/Pacemaker)

2012-06-29 Thread Vishvananda Ishaya
Seems like you could use a floating ip for this. You can define a range for internal floating ips by using a separate floating ip pool. On Jun 29, 2012 7:06 PM, "Christian Parpart" wrote: > Hey all, > > I would like to setup a highly available service *inside* two KVM > instances, > so I have cre

[Openstack] HA inside VMs (via Corosync/Pacemaker)

2012-06-29 Thread Christian Parpart
Hey all, I would like to setup a highly available service *inside* two KVM instances, so I have created a security group to contain all required service ports, so clients can connect to either VM and that works. And both instances have their own designated IP address, provided by nova itself. An

Re: [Openstack] OVF vs. bare container formats for qcow2 images

2012-06-29 Thread Adam Young
On 04/01/2012 11:15 AM, Lorin Hochstein wrote: On Mar 29, 2012, at 12:40 PM, Daniel P. Berrange wrote: On Wed, Mar 28, 2012 at 04:41:28PM -0400, Lorin Hochstein wrote: All: Given that I have a qcow2 image from somewhere (e.g., downloaded it from a uec-images.ubuntu.com

Re: [Openstack] Nova and asynchronous instance launching

2012-06-29 Thread Chris Behrens
There's only 1 rpc call unless you're running cactus or something. All schedulers have a loop...not API. min-count is unfortunately special cased right now to be a single call vs cast, though. I was going to fix that real soon. Problem is scheduler creating the DB records vs API in this case

[Openstack] OpenStack Community Weekly Newsletter (June 22-29)

2012-06-29 Thread Stefano Maffulli
Highlights of the week OpenStack Events at OSCON & Discounted Passes We have quite a few activities planned for OSCON to celebrate OpenStack's second birthday. Kicking off with the first OpenS

Re: [Openstack] Nova and asynchronous instance launching

2012-06-29 Thread Doug Davis
True that's all useful info but I thought the original problem being addressed was how the end-user could know what's going on for long-running ops. thanks -Doug __ STSM | Standards Architect | IBM Software Group (919) 254-6905 | IBM 444-6

Re: [Openstack] Nova and asynchronous instance launching

2012-06-29 Thread Jay Pipes
On 06/29/2012 05:45 PM, Doug Davis wrote: You don't really expect a client (think ec2-like-user) to analyze debug info do you? I really think we need a nice consistent way for people to see what's going on with long-running operations. Debug info isn't that to me. thanks -Doug Also, see: h

Re: [Openstack] Nova and asynchronous instance launching

2012-06-29 Thread Jay Pipes
I'm not expecting a client to do anything, and I'm not sure where you got that from my response below... I'm talking about adding debug statements into the nova-compute/nova-network logs that an *operator* or *core developer* would use to determine which parts of the code are taking that most a

Re: [Openstack] Nova and asynchronous instance launching

2012-06-29 Thread Doug Davis
You don't really expect a client (think ec2-like-user) to analyze debug info do you? I really think we need a nice consistent way for people to see what's going on with long-running operations. Debug info isn't that to me. thanks -Doug __ STS

Re: [Openstack] Performance metrics

2012-06-29 Thread Rick Jones
On 06/21/2012 02:21 PM, Rick Jones wrote: TSO and GRO can cover a multitude of path-length sins :) That is one of the reasons netperf does more than just bulk transfer :) When I was/am measuring "scaling" of an SMP node I would use aggregate, burst-mode, single-byte netperf TCP_RR tests to max

Re: [Openstack] RFC: Thoughts on improving OpenStack GIT commit practice/history

2012-06-29 Thread Andrew Bogott
On 6/27/12 8:40 AM, Daniel P. Berrange wrote: On Wed, Jun 27, 2012 at 03:24:21PM +0200, Vincent Untz wrote: Hi, It'd be really great if we could first improve Gerrit to handle the patch series workflow in a better way. Without such a change, pushing patch series to Gerrit is really no fun for

Re: [Openstack] hostnames on kvm images with periods

2012-06-29 Thread Drewski
I have also verified this happens as well with debian wheezy and essex. On Fri, 2012-06-29 at 13:42 -0400, Drewski wrote: > I have setup Essex on Centos 6.2 64 bit as per > http://fedoraproject.org/wiki/Getting_started_with_OpenStack_EPEL > I am using kvm/libvirt > > I can create images fine with

Re: [Openstack] Nova and New Hardware

2012-06-29 Thread Mikyung Kang
Hello Trinath, We're working on general bare-metal provisioning framework including several architecture types such as x86-64/i386/ARM/tilera. The target release for this is Folsom. That's not merged into upstream yet. We're going to request whole review before August. Please refer the following

Re: [Openstack] setuptools-git

2012-06-29 Thread Monty Taylor
On 06/29/2012 10:48 AM, Alan Pevec wrote: > On Fri, Jun 29, 2012 at 7:19 PM, Monty Taylor wrote: >> We use pip-requires as part of building the virtualenvs. Once we start >> using it, setuptools-git is pretty much required for running setup.py, >> so many common actions in our workflow will requ

Re: [Openstack] setuptools-git

2012-06-29 Thread Monty Taylor
On 06/29/2012 10:48 AM, Alan Pevec wrote: > On Fri, Jun 29, 2012 at 7:19 PM, Monty Taylor wrote: >> We use pip-requires as part of building the virtualenvs. Once we start >> using it, setuptools-git is pretty much required for running setup.py, >> so many common actions in our workflow will requ

Re: [Openstack] [OpenStack][Nova] Issues with "run_tests.sh", no tests are run when "import libvirt is present"

2012-06-29 Thread Jay Pipes
Hi Leander, I've noticed some weirdness with the openstack.nose_plugin (which is used by default for the Nova test runner) sometimes either throwing errors (particularly errors raised by nosetests) away and/or coming up with a different set of skip tests than when running just with nosetests.

Re: [Openstack] Nova and asynchronous instance launching

2012-06-29 Thread David Kranz
An assumption is being made here that the "user" and "cloud provider" are unrelated. But I think there are many projects under development where a cloud-based service is being provided on top of an OpenStack infrastructure. In that use case, the direct user of OpenStack APIs and the "cloud prov

Re: [Openstack] setuptools-git

2012-06-29 Thread Alan Pevec
On Fri, Jun 29, 2012 at 7:19 PM, Monty Taylor wrote: > We use pip-requires as part of building the virtualenvs. Once we start > using it, setuptools-git is pretty much required for running setup.py, > so many common actions in our workflow will require it. > > It's a good question though - and I c

Re: [Openstack] Nova and asynchronous instance launching

2012-06-29 Thread Jay Pipes
On 06/29/2012 04:25 AM, Huang Zhiteng wrote: Sound like a performance issue. I think this symptom can be much eased if we spend sometime fixing whatever bottleneck causing this (slow AMQP, scheduler, or network)? Now that Nova API has got multprocess enabled, we'd move to next bottleneck in lon

Re: [Openstack] setuptools-git

2012-06-29 Thread Monty Taylor
On 06/29/2012 10:30 AM, Joshua Harlow wrote: > Should there be a separation of build-time setup.py and run-time setup.py?? > > I’m not sure if something like that is possible (maybe with a setuptools > variant, distribute or something similar??) Well, we use distribute already - but the problem

[Openstack] hostnames on kvm images with periods

2012-06-29 Thread Drewski
I have setup Essex on Centos 6.2 64 bit as per http://fedoraproject.org/wiki/Getting_started_with_OpenStack_EPEL I am using kvm/libvirt I can create images fine with nova boot. If I choose the name to be my.test.server, nova shows the name as local.test.server correctly, however, when I ssh to the

Re: [Openstack] [metering] resource metadata changes and billing

2012-06-29 Thread Doug Hellmann
On Fri, Jun 29, 2012 at 1:19 PM, Julien Danjou wrote: > On Fri, Jun 29 2012, Doug Hellmann wrote: > > > We do have counters for RAM and CPU separate from instance. But the rate > at > > which the provider bills for those things may vary based on metadata. My > > example may be bad because it uses

Re: [Openstack] setuptools-git

2012-06-29 Thread Joshua Harlow
Should there be a separation of build-time setup.py and run-time setup.py?? I'm not sure if something like that is possible (maybe with a setuptools variant, distribute or something similar??) On 6/29/12 4:06 AM, "Alan Pevec" wrote: On Thu, Jun 28, 2012 at 9:56 PM, Monty Taylor wrote: > https

Re: [Openstack] [metering] resource metadata changes and billing

2012-06-29 Thread Julien Danjou
On Fri, Jun 29 2012, Doug Hellmann wrote: > We do have counters for RAM and CPU separate from instance. But the rate at > which the provider bills for those things may vary based on metadata. My > example may be bad because it uses 2 values we're measuring, one of which > also shows up in the meta

Re: [Openstack] setuptools-git

2012-06-29 Thread Monty Taylor
On 06/29/2012 04:06 AM, Alan Pevec wrote: > On Thu, Jun 28, 2012 at 9:56 PM, Monty Taylor wrote: >> https://review.openstack.org/9109 > > Why is setuptools_git added in pip-requires, I thought that's for > run-time, not build-time dependencies? Hey Alan! We use pip-requires as part of buildin

Re: [Openstack] [OpenStack] duplicate option: scheduler_host_manager

2012-06-29 Thread Joseph Suh
Leander, As the error message indicates, it usually comes when the option is found in more than one place. Thanks, Joseph (w) 703-248-6160 (f) 703-812-3712 http://www.east.isi.edu/~jsuh Information Sciences Institute University of Southern California 3811 N. Fairfax Drive Suite 200 Arlin

Re: [Openstack] Unit tests, individual vs. test suite

2012-06-29 Thread Kevin L. Mitchell
On Fri, 2012-06-29 at 10:34 -0500, Andrew Bogott wrote: > $ /opt/stack/nova$ ./run_tests.sh test_virt_drivers > AbstractDriverTestCase > test_add_to_aggregateERROR > 0.02 > test_agent_updateERROR > 0.0

Re: [Openstack] Nova and asynchronous instance launching

2012-06-29 Thread Day, Phil
>However, considering the unhappy-path for a second, is there a place for surfacing some more context as to why the new instance unexpectedly went into the ERROR state? I assume the philosophy is that the API has validated the request as far and it can, and returned any meaningful error messages

[Openstack] Unit tests, individual vs. test suite

2012-06-29 Thread Andrew Bogott
Lately I've been noticing that some individual unit tests fail for me, even though the overall test suite succeeds. So, for example: $ /opt/stack/nova$ ./run_tests.sh OK (SKIP=5) $ /opt/stack/nova$ ./run_tests.sh test_virt_drivers AbstractDriverTestCase test_add_to_aggregate

[Openstack] Jenkins and transient failures

2012-06-29 Thread Kevin L. Mitchell
One of the things that's really bugging me these days is transient failures, such as the inability to download a package, causing a gate job to fail. It seems to me that we can distinguish "test failure" from "environment build failure" easily enough, and automatically retry in the latter case. I

Re: [Openstack] Nova and asynchronous instance launching

2012-06-29 Thread Eoghan Glynn
> Right - examining the current state isn't a good way to determine > what happened with one particular request. This is exactly one of > the reasons some providers create Jobs for all actions. Checking the > resource "later" to see why something bad happened is fragile since > other opertaons mig

Re: [Openstack] [metering] resource metadata changes and billing

2012-06-29 Thread Julien Danjou
On Fri, Jun 29 2012, Doug Hellmann wrote: > Thoughts? Please correct me if I'm wrong. What I understand is that you're saying that something like: GET v1/[SOURCES//]USERS//RESOURCES///VOLUME as defined in the current API draft, for a counter like instance CPU time or RAM size has no sense b

[Openstack] Bugs for Client libraries back to their own projects

2012-06-29 Thread Thierry Carrez
Hello everyone, Once upon a time, each OpenStack client library was independent and had its own project in Launchpad. Then when Core projects came to rely on them, we pulled them in as "official projects" but since we didn't want to create "Core projects" for each of them, we considered them "sepa

[Openstack] [metering] resource metadata changes and billing

2012-06-29 Thread Doug Hellmann
tl;dr: Ceilometer should ignore resource metadata when computing sums or maximum values for counters through the API. One of the things we discussed early during the design meetings was the need to track metadata along with resources so providers could use the metadata to determine the rate to cha

[Openstack] [OpenStack][Nova] Issues with "run_tests.sh", no tests are run when "import libvirt is present"

2012-06-29 Thread Leander Bessa Beernaert
Hello, I'm sorry to restart the topic ( https://lists.launchpad.net/openstack/msg13621.html), but i accidentally deleted the message in my inbox :S. I'm still having the same problem, each time i add "import libvirt" to the file "diangostics.py" (https://review.openstack.org/#/c/8839/) the entire

[Openstack] Nova and New Hardware

2012-06-29 Thread Trinath Somanchi
Hi- I'm new this community. And in need of help.. I have gone through Tilera support in the web documentation. Can any one guide me on How to enable NON x_86 arch. support in Openstack like enabling Tilera board support or some other Hardware architecture support in an already installed openstac

Re: [Openstack] Nova and asynchronous instance launching

2012-06-29 Thread Doug Davis
Right - examining the current state isn't a good way to determine what happened with one particular request. This is exactly one of the reasons some providers create Jobs for all actions. Checking the resource "later" to see why something bad happened is fragile since other opertaons might ha

Re: [Openstack] setuptools-git

2012-06-29 Thread Alan Pevec
On Thu, Jun 28, 2012 at 9:56 PM, Monty Taylor wrote: > https://review.openstack.org/9109 Why is setuptools_git added in pip-requires, I thought that's for run-time, not build-time dependencies? Cheers, Alan ___ Mailing list: https://launchpad.net/~ope

Re: [Openstack] Nova and asynchronous instance launching

2012-06-29 Thread Eoghan Glynn
> Note that I do distinguish between a 'real' async op (where you > really return little more than a 202) and one that returns a > skeleton of the resource being created - like instance.create() does > now. So the latter approach at least provides a way to poll on the resource status, so as to fi

Re: [Openstack] RFC: Thoughts on improving OpenStack GIT commit practice/history

2012-06-29 Thread Vaze, Mandar
> At the very least it is always possible to describe what area of the code is > being changed, so that you alert the reviewers you are familiar with that > area. Yes, Makes sense. -Mandar __ Disclaimer:This email and any att

Re: [Openstack] RFC: Thoughts on improving OpenStack GIT commit practice/history

2012-06-29 Thread Daniel P. Berrange
On Fri, Jun 29, 2012 at 04:57:06AM +, Vaze, Mandar wrote: > > I particularly hate the single-line "Fixes bug 1234566"-type commit > > messages. > > I assume your concern was regarding commits where "Fixes bug 1234566" is the > first and ONLY line. > > "Fixes bug 1234566" comes from Wiki. >

Re: [Openstack] RFC: Thoughts on improving OpenStack GIT commit practice/history

2012-06-29 Thread Thierry Carrez
Vaze, Mandar wrote: >> I particularly hate the single-line "Fixes bug 1234566"-type commit messages. > > I assume your concern was regarding commits where "Fixes bug 1234566" is the > first and ONLY line. Yes, that is the particularly offensive form :) > Plus there is restriction on how long th

Re: [Openstack] inter vm communication issue

2012-06-29 Thread Tom Sante
Hi, I am a colleague of Bram working with him on these same systems. We are now experiencing other issues related to networking on our nodes: - we gave openstack eth0 as the vlan interface - eth0 en eth1 are still slaves in a bond0 (mode 6) ==> we are seeing a big number of dropped packets on th

Re: [Openstack] Nova and asynchronous instance launching

2012-06-29 Thread Huang Zhiteng
On Fri, Jun 29, 2012 at 5:19 AM, Devin Carlen wrote: > On Jun 28, 2012, at 9:01 AM, Jay Pipes wrote: > >> On 06/27/2012 06:51 PM, Doug Davis wrote: >>> Consider the creation of a "Job" type of entity that will be returned >>> from the original call - probably a 202.  Then the client can check the

Re: [Openstack] Jenkins vs SmokeStack tests & Gerrit merge blockers

2012-06-29 Thread Rafael Durán Castañeda
On 06/28/2012 11:58 PM, Monty Taylor wrote: On 06/28/2012 01:49 PM, Dan Prince wrote: - Original Message - From: "Monty Taylor" To: openstack@lists.launchpad.net Sent: Thursday, June 28, 2012 11:13:28 AM Subject: Re: [Openstack] Jenkins vs SmokeStack tests & Gerrit merge blockers

Re: [Openstack] About floating IP access

2012-06-29 Thread David
The reasion is open the promisc of br100 ~#ifconfig br100 promisc David(李跃洲) 发件人: openstack-bounces+yuezhou.li=hisoft@lists.launchpad.net [mailto:openstack-bounces+yuezhou.li=hisoft@lists.launchpad.net] 代表 David 发送时间: 2012年6月29日 0:22 收件人: openstack@lists.launchpad.net 主题: [Openstack]