Re: [Openstack] storage for virtual machines

2012-06-12 Thread Jay Pipes
Sebastien, you are correct. Udit, you will need to provide a bit more information on what you are looking to do with Swift. Thanks, -jay p.s. sorry for top-posting. On 06/12/2012 08:02 AM, Sébastien Han wrote: Hi, If you planned to use Swift to store the virtual images disk and run instanc

Re: [Openstack] request and transaction IDs across all projects

2012-06-12 Thread Jay Pipes
On 06/12/2012 01:27 AM, Gabe Westmaas wrote: In nova we use a request ID to to help in finding all logs associated with a particular request, and this has proven to be extremely useful when debugging issues. This should be taken a bit further, in two different directions. First, I'd like to see

Re: [Openstack] [keystone] v3 API draft (update and questions to the community)

2012-06-12 Thread Jay Pipes
On 06/12/2012 04:24 AM, Gabriel Hurley wrote: Mark, Apparently you must have missed my lightning talk at the Essex summit... ;-) (http://gabrielhurley.github.com/slides/openstack/apis_like_orms/index.html) Filtering, pagination, and many other API features are *critical* for a rich dashboard

Re: [Openstack] [keystone] v3 API draft (update and questions to the community)

2012-06-12 Thread Jay Pipes
On 06/12/2012 12:21 PM, Adam Young wrote: On 06/12/2012 04:24 AM, Gabriel Hurley wrote: That said, we have also considered the case you propose where you effectively "request everything and handle it on the client-side"... however, I see that as a tremendously lazy solution. On the service-provi

Re: [Openstack] instance snapshotting failed. now in permanent Image_Snapshot state.

2012-06-13 Thread Jay Pipes
On 06/13/2012 02:41 AM, Christian Parpart wrote: Hey all, I feel really sorry to bother you about that, but it really annoys me now for quite a while now. I used snapshotting quite a few times already - in success - but this time (maybe due to my HA tries on the cloud controller node) the snapsh

Re: [Openstack] request and transaction IDs across all projects

2012-06-13 Thread Jay Pipes
On 06/13/2012 01:21 PM, Gabe Westmaas wrote: On 6/12/12 12:32 PM, "Jay Pipes" wrote: On 06/12/2012 01:27 AM, Gabe Westmaas wrote: In nova we use a request ID to to help in finding all logs associated with a particular request, and this has proven to be extremely useful when

Re: [Openstack] Intermittent devstack-gate failures

2012-06-14 Thread Jay Pipes
In recent devstack builds, I've seen g-api fail intermittently, too, and couldn't figure out why it failed (nothing in logs). This might have been the reason. -jay On 06/14/2012 05:48 PM, Dan Prince wrote: Hey Jim, Any updates or new ideas on the cause of the intermittent hangs? I mentioned

Re: [Openstack] Openstack common

2012-06-17 Thread Jay Pipes
What version of pep8 are you using? The errors look to be warnings that are no longer printed in more modern versions of pep8... All the best, -jay On 06/17/2012 03:42 AM, Gary Kotton wrote: Hi, Over the weekend patches were made to Quantum to support Pep 1.3. Some of the patches were in the o

Re: [Openstack] Test tool

2012-06-18 Thread Jay Pipes
On 06/14/2012 05:26 AM, Neelakantam Gaddam wrote: Hi All, Recently I came across the tool called Tempest to perform he integration tests on a live cluster running openstack. Can we use this tool to test Quantum networks also? Yes, though support is very new :) If you run Tempest (nosetests -

Re: [Openstack] glance_api_servers vs. glance_host vs. keystone?

2012-06-18 Thread Jay Pipes
On 06/18/2012 10:41 AM, Lars Kellogg-Stedman wrote: Thus, I suspect that nova may not even use the Keystone endpoints... That sounds crazy to me, but I just got here. That is, why go to the effort to develop an endpoint registration service and then decide not to use it? Given the asynchronou

Re: [Openstack] [Openstack-qa-team] wait_for_server_status and Compute API

2012-06-18 Thread Jay Pipes
On 06/18/2012 12:01 PM, David Kranz wrote: There are a few tempest tests, and many in the old kong suite that is still there, that wait for a server status that is something other than ACTIVE or VERIFY_RESIZE. These other states, such as BUILD or REBOOT, are transient so I don't understand why it

Re: [Openstack] [Openstack-qa-team] wait_for_server_status and Compute API

2012-06-18 Thread Jay Pipes
make sure, since the semantics and tenses of the power, VM, and task states are a bit inconsistent. Best, -jay Original message Subject: Re: [Openstack-qa-team] wait_for_server_status and Compute API From: Jay Pipes To: "openstack-qa-t...@lists.launchpad.net&qu

Re: [Openstack] Swift Probetests

2012-06-19 Thread Jay Pipes
On 06/19/2012 11:10 AM, Maru Newby wrote: The swift probetests are broken: https://bugs.launchpad.net/swift/+bug/1014931 Does the swift team intend to maintain probetests going forward? Given how broken they are at present (bad imports, failures even when imports are fixed), it would appear

Re: [Openstack] Common openstack client library

2012-06-19 Thread Jay Pipes
Did you see: https://github.com/openstack/python-openstackclient Also, keep in mind that some of the ways the existing Glance client (and Swift client FTM) work is due to lack of support in httplib2 for chunked-transfer encoding. Best, -jay On 06/19/2012 12:43 PM, Alexey Ababilov wrote: Hi

Re: [Openstack] Timeout during image build (task Networking)

2012-06-19 Thread Jay Pipes
Hi Ross, In the process of diagnosing this, but I'm seeing this sporadically when running Tempest against a devstack install. I'll try to pinpoint the issue later today and post back my findings. Best, -jay p.s. Sorry for top-posting. On 06/18/2012 06:03 PM, Lillie Ross-CDSR11 wrote: I'm r

Re: [Openstack] [metering] Glance usage data retrieval

2012-06-19 Thread Jay Pipes
Hi Julien and Stuart! Comments inline... On 06/19/2012 07:12 AM, stuart.mcla...@hp.com wrote: Brian, Jay, I'll give you a chance to reply to Julien first, but I have a follow on query... It doesn't seem like right now Glance produces enough records for full metering of operations. Eg if you wa

Re: [Openstack] Need help and guidance of Openstack Swift

2012-06-19 Thread Jay Pipes
Some links to show you: https://github.com/openstack/horizon/blob/7b565fc9839833b4b99b1fc3b02269b79071af3e/horizon/api/swift.py https://github.com/openstack/horizon/blob/f6f2a91e14f6bdd4e1a87e31a1d6923127afee1b/horizon/dashboards/nova/containers/views.py Best, -jay On 06/19/2012 02:04 PM, Yoge

Re: [Openstack] Timeout during image build (task Networking)

2012-06-19 Thread Jay Pipes
cc'ing Vish on this, as this is now occurring on every single devstack + Tempest run, for multiple servers. Vish, I am seeing the exact same issue as shown below. Instances end up in ERROR state and looking into the nova-network log, I find *no* errors at all, and yet looking at the nova-compu

Re: [Openstack] Timeout during image build (task Networking)

2012-06-19 Thread Jay Pipes
On 06/19/2012 03:13 PM, Vishvananda Ishaya wrote: Sorry, paste fail on the last message. This seems like a likely culprit: https://review.openstack.org/#/c/8339/ I'm guessing it only happens on concurrent builds? We probably need a synchronized somewhere. I notice the the RPC calls to the ne

Re: [Openstack] Deleting a volume stuck in "attaching" state?

2012-06-20 Thread Jay Pipes
On 06/20/2012 11:52 AM, Lars Kellogg-Stedman wrote: A strategy we are making in Nova (WIP) is to allow instance termination no matter what. Perhaps a similar strategy could be adopted for volumes too? Thanks, The 'nova-manage volume delete ...' solution worked just fine in this case...but in ge

Re: [Openstack] Timeout during image build (task Networking)

2012-06-20 Thread Jay Pipes
Vish On Jun 19, 2012, at 12:03 PM, Jay Pipes wrote: cc'ing Vish on this, as this is now occurring on every single devstack + Tempest run, for multiple servers. Vish, I am seeing the exact same issue as shown below. Instances end up in ERROR state and looking into the nova-network log, I f

Re: [Openstack] Timeout during image build (task Networking)

2012-06-20 Thread Jay Pipes
Ah, good to know. Thanks Yun! -jay On 06/20/2012 03:32 PM, Yun Mao wrote: Jay, there is a tools/clean_file_locks.py that you might be able to take advantage of. Yun On Wed, Jun 20, 2012 at 3:23 PM, Jay Pipes wrote: Turns out my issue was a borked run of Tempest that left a nova

Re: [Openstack] Need help and guidance of Openstack Swift

2012-06-20 Thread Jay Pipes
On 06/19/2012 04:34 PM, Yogesh Bansal wrote: Hi Jay, Thanks a lot for quick response. This was little helpful. I need how to send the parameters to the swift server by making the connection. I think that task is happening in inside the below code. Could you please tell me what is happening in cl

Re: [Openstack] AttributeError: "virDomain instance has no attribute 'reset'"

2012-06-22 Thread Jay Pipes
That's pretty much what I understood based on a conversation with Vish on IRC the other day. It's caused me to pretty much give up on 11.10 for modern OpenStack (Nova) installs. -jay On 06/22/2012 01:23 AM, Vaze, Mandar wrote: Found this bug (albeit for Fedora 16) https://bugs.launchpad.net/n

Re: [Openstack] [OpenStack][Nova] Possible inconsistency between devstack/nova execution and test_virt_drivers.py

2012-06-25 Thread Jay Pipes
You are not returning the data in the test method, whereas you are in the real method :) -jay On 06/25/2012 10:44 AM, Leander Bessa Beernaert wrote: Sorry, forgot to add the code: *This is my method (this worked with devstack):* def get_diagnostics(self, instance): dom = self._l

Re: [Openstack] nova boot --hint same_host=[UUID] fails with "InstanceNotFound: Instance [ could not be found." ?

2012-06-26 Thread Jay Pipes
On 06/26/2012 04:31 AM, Christian Parpart wrote: Hey all, while strictly following the guidelines [1] on how to spawn an instance on the same host as another instance, I don't see any link for [1] above? I run into the error, that it cannot find some instanced called: "[", which - of course

Re: [Openstack] Adding docs gating jobs?

2012-06-26 Thread Jay Pipes
++ -jay On 06/26/2012 10:02 AM, Monty Taylor wrote: Hey guys! We have all of the projects properly and consistently building and uploading sphinx docs from in tree. This is pretty exciting, because it means one more resource we can expect to work. So related to that, we were talking about put

Re: [Openstack] Swift Probetests

2012-06-26 Thread Jay Pipes
Not that I know of. Best, -jay On 06/26/2012 04:54 PM, Maru Newby wrote: Have I missed a response in the past week? On 2012-06-19, at 12:14 PM, Jay Pipes wrote: On 06/19/2012 11:10 AM, Maru Newby wrote: The swift probetests are broken: https://bugs.launchpad.net/swift/+bug/1014931 Does

Re: [Openstack] create volume hangs at creating.

2012-06-27 Thread Jay Pipes
On 06/27/2012 06:45 AM, Milind wrote: Hi, I am still facing this problem following is the log. I actually don't see any errors in the log file contents below (you can ignore the silly AssertionError thing about threading.pyc). Perhaps you could try executing the underlying volume creation c

Re: [Openstack] [OpenStack][Nova] Snapshot stuck in Queued state, no erros found in compute log

2012-06-27 Thread Jay Pipes
This looks very familiar :) Make sure that you have enough space in the partition that houses /tmp (usually whatever partition has / mounted). The snapshot operation requires at least as much space in /tmp as the size of the snapshot to be made. If you have improperly given yourself a very sma

Re: [Openstack] glance access error from remote client

2012-06-27 Thread Jay Pipes
On 06/27/2012 10:04 AM, Xin Zhao wrote: Hello, I have an Essex install of openstack on RHEL6. The controller node has all openstack services running, and there are several separate compute nodes. Now I have a problem using glance. If I issue "glance index --host=XXX --port=9292" on the control

Re: [Openstack] [OpenStack][Nova] Possible inconsistency between devstack/nova execution and test_virt_drivers.py

2012-06-27 Thread Jay Pipes
On 06/27/2012 10:17 AM, Leander Bessa Beernaert wrote: How do I proceed now? Should i ate the required methods to the fake_libvirt? Do note that i dont have the latest libvirt installed and am therefore missing another set of crucial methods which i can't test. :s No. In general, you only want

Re: [Openstack] [OpenStack][Nova] Snapshot stuck in Queued state, no erros found in compute log

2012-06-27 Thread Jay Pipes
On 06/27/2012 12:28 PM, Leander Bessa Beernaert wrote: You sir a my hero! I turned out someone altered the filesystem before installing OpenStack leaving me with 3gb partition for the operating system. LOL, no worries. I remembered running into that in the first TryStack zone deployment. Bes

Re: [Openstack] Nova and asynchronous instance launching

2012-06-28 Thread Jay Pipes
On 06/27/2012 06:51 PM, Doug Davis wrote: Consider the creation of a "Job" type of entity that will be returned from the original call - probably a 202. Then the client can check the Job to see how things are going. BTW - this pattern can be used for any async op, not just the launching of multi

Re: [Openstack] compute_rpcapi ?

2012-06-28 Thread Jay Pipes
Hi Phil! :) I believe Russell Bryant recently did some work on pulling the RPC code out of Nova and into openstack-common. Russell, perhaps you have some insight into Phil's question below? Best, -jay On 06/28/2012 09:46 AM, Day, Phil wrote: Hi All, At the risk of sounding badly behind the

Re: [Openstack] Nova and asynchronous instance launching

2012-06-29 Thread Jay Pipes
On 06/29/2012 04:25 AM, Huang Zhiteng wrote: Sound like a performance issue. I think this symptom can be much eased if we spend sometime fixing whatever bottleneck causing this (slow AMQP, scheduler, or network)? Now that Nova API has got multprocess enabled, we'd move to next bottleneck in lon

Re: [Openstack] [OpenStack][Nova] Issues with "run_tests.sh", no tests are run when "import libvirt is present"

2012-06-29 Thread Jay Pipes
Hi Leander, I've noticed some weirdness with the openstack.nose_plugin (which is used by default for the Nova test runner) sometimes either throwing errors (particularly errors raised by nosetests) away and/or coming up with a different set of skip tests than when running just with nosetests.

Re: [Openstack] Nova and asynchronous instance launching

2012-06-29 Thread Jay Pipes
isn't that to me. thanks -Doug __ STSM | Standards Architect | IBM Software Group (919) 254-6905 | IBM 444-6905 | d...@us.ibm.com The more I'm around some people, the more I like my dog. *Jay Pipes * Sent by: openstack-bounces

Re: [Openstack] Nova and asynchronous instance launching

2012-06-29 Thread Jay Pipes
On 06/29/2012 05:45 PM, Doug Davis wrote: You don't really expect a client (think ec2-like-user) to analyze debug info do you? I really think we need a nice consistent way for people to see what's going on with long-running operations. Debug info isn't that to me. thanks -Doug Also, see: h

Re: [Openstack] Nova and asynchronous instance launching

2012-07-01 Thread Jay Pipes
On 06/29/2012 01:50 PM, David Kranz wrote: > An assumption is being made here that the "user" and "cloud provider" > are unrelated. But I think there are many projects under development > where a cloud-based service is being provided on top of an OpenStack > infrastructure. In that use case, the di

Re: [Openstack] How do I stop image-create from using /tmp?

2012-07-01 Thread Jay Pipes
On 06/30/2012 09:25 PM, Lars Kellogg-Stedman wrote: >> So, maybe setting any of this environment variables for nova-compute >> to desired value sholuld help. > > Yeah, I was expecting that. > > Given that this could easily take out a compute host I'd like to see > it get an explicit configuration

Re: [Openstack] Heterogeneous hardware support

2012-07-02 Thread Jay Pipes
On 07/02/2012 01:23 AM, balaji patnala wrote: > Hi, > > Does open stack [Essex] release support Heterogeneous hardware for > creating VMs with Security Applications? > If not, what is the road map for this. Please let me know. Could you please elaborate on what you mean by "creating VMs with sec

Re: [Openstack] CY12-Q2 Community Analysis — OpenStack vs OpenNebula vs Eucalyptus vs CloudStack

2012-07-02 Thread Jay Pipes
On 07/02/2012 05:00 AM, Thierry Carrez wrote: > Qingye Jiang (John) wrote: >> I would like to let you know that I have just finished an analysis on >> the 4 open source projects (OpenStack, OpenNebula, Eucalyptus, >> CloudStack) from a community activity perspective. The analysis report >> could be

Re: [Openstack] [OpenStack][Nova] Issues with "run_tests.sh", no tests are run when "import libvirt is present"

2012-07-02 Thread Jay Pipes
On 07/02/2012 08:57 AM, Leander Bessa Beernaert wrote: > I'm developing on custom branch and haven't updated the repository for > at least 3 weeks. > Do i fetch the lastest changes like this: > > git remote update > git checkout master > git pull origin master > > git checkout

[Openstack] [CHEF] Clarification on osops/chef-repo/roles/nova-compute.rb

2012-07-02 Thread Jay Pipes
Hi Ron, cc'ing the openstack ML for extra eyes and opinions... So, Nati and I are looking to use either the osops chef-repo or something similar as the basis of the new TryStack zone chef deployment. I've been going through the recipes and roles and I have a question on the nova-compute *role*: h

Re: [Openstack] Openstack and Google Compute Engine

2012-07-02 Thread Jay Pipes
On 07/02/2012 10:25 AM, Simon G. wrote: > Noone tested or noone is interested in Google Compute Engine and Openstack? No, I think it's just that nobody has looked into it yet. Also, when you say "their test app is 600,000 cores", I don't think you have any providers of OpenStack that (yet) have an

Re: [Openstack] Heterogeneous hardware support

2012-07-02 Thread Jay Pipes
e focusing on security-related things at all. Best, -jay > On Mon, Jul 2, 2012 at 5:59 PM, Jay Pipes <mailto:jaypi...@gmail.com>> wrote: > > On 07/02/2012 01:23 AM, balaji patnala wrote: > > Hi, > > > > Does open stack [Essex] release support

Re: [Openstack] How do I stop image-create from using /tmp?

2012-07-02 Thread Jay Pipes
On 07/02/2012 01:32 PM, Mark Lehrer wrote: >> just did an "ln -s /some/dir/with/space /tmp" and that does solve > > I added an option to /etc/init/nova_compute.conf to specify the tmp > space, so the start line looks like this: > > exec su -s /bin/sh -c "export TMPDIR=/var/tmp; exec nova-compute

Re: [Openstack] new locations for some things

2012-07-02 Thread Jay Pipes
Very good work, CI team! Thank you! -jay On 07/02/2012 07:02 PM, Monty Taylor wrote: > Hey all! > > (It must be a busy day - I'm writing you all so many emails...) > > A little while ago, after chatting with Anne Gentle, we started > publishing the sphinx documentation to > docs.openstack.org/

Re: [Openstack] coding standards

2012-07-05 Thread Jay Pipes
On 07/03/2012 09:50 PM, Dan Wendlandt wrote: > I think everyone (including the reviewer) would agree that the review > comments went beyond this, with spelling and grammer suggestions. My s/grammer/grammar /me runs for the hills. -jay ___ Mailing lis

Re: [Openstack] OVF vs. bare container formats for qcow2 images

2012-07-05 Thread Jay Pipes
On 07/03/2012 10:07 PM, Lorin Hochstein wrote: > Does anybody know if OpenStack (nova+glance) currently supports OVA > packages? No, not really. Glance will store pretty much anything you throw at it, but the virt driver(s) in Nova will need to know how to handle what gets returned from Glance. I

Re: [Openstack] Glance Image Upload error.

2012-07-07 Thread Jay Pipes
On 07/06/2012 01:26 AM, Trinath Somanchi wrote: > Hi - > > Nope, I'm not working on Diablo release. > > But I have image in 3 parts. I want to store these three parts of the > image into glance as a single image. To achieve the same while doing a > google search found this procedure. > > Hence,

Re: [Openstack] Performance metrics of RabbitMQServer

2012-07-07 Thread Jay Pipes
On 07/06/2012 06:52 AM, Naveen Kuna wrote: > > Hi All, > > Can anyone know performance metrics of RabbitMQServer ? Google is your friend :) http://stackoverflow.com/questions/7921324/performance-comparison-between-zeromq-rabbitmq-and-apache-qpid Keep in mind you have different feature sets bet

Re: [Openstack] Anyone using instance metadata?

2012-07-08 Thread Jay Pipes
On 07/04/2012 06:20 PM, Steve Baker wrote: > To fix this semantic clash I would advocate adopting Amazon's Tags > terminology but I won't be pushing this too hard since I'm new here ;) I've been saying this for years now. Metadata is absolutely used incorrectly in the Compute and Images APIs.

Re: [Openstack] [Openstack-qa-team] QA for Live Migration

2012-07-08 Thread Jay Pipes
On 07/06/2012 05:34 AM, John Garbutt wrote: > Hi, > > I am in the process of adding Live Migration support into the XenAPI driver. > Are there any current plans on how to test Live Migration, is it done already? > I was thinking of copying what has been done for Migration. cc'ing Anne Gentle beca

Re: [Openstack] [CHEF] Clarification on osops/chef-repo/roles/nova-compute.rb

2012-07-09 Thread Jay Pipes
Vish and Ron, just getting back to this... see inline continued questions for you both. On 07/02/2012 04:24 PM, Vishvananda Ishaya wrote: > > On Jul 2, 2012, at 7:28 AM, Jay Pipes wrote: > >> Hi Ron, cc'ing the openstack ML for extra eyes and opinions... >> >> S

Re: [Openstack] QA for Live Migration

2012-07-09 Thread Jay Pipes
On 07/09/2012 09:35 AM, John Garbutt wrote: > Renuka and I are looking at proposing a blueprint to try and sort out some of > this confusion. > > I think this is the current situation: > - historically XenAPI had migrate, Libvirt had live migrate > - But by end of Folsom we should have both havin

Re: [Openstack] Call for comments and testing: prototype for OpenStack Document translation process

2012-07-10 Thread Jay Pipes
Awesome work, Daisy! Comments inline... On 07/09/2012 04:59 PM, Ying Chun Guo wrote: > Hi, team > > I created a prototype of document translation, to verify the whole > document translation process: slicing a doc, uploading to transifex, > translating, > downloading to local disk, merging the tra

Re: [Openstack] [CHEF] Clarification on osops/chef-repo/roles/nova-compute.rb

2012-07-10 Thread Jay Pipes
//github.com/rcbops/chef-cookbooks > > > > --- > Joseph Breu > Deployment Engineer > Rackspace Cloud Builders > 210-312-3508 > > On Jul 9, 2012, at 8:01 AM, Jay Pipes wrote: > >> Vish and Ron, just getting back to this... see inline continued >

Re: [Openstack] [CHEF] Clarification on osops/chef-repo/roles/nova-compute.rb

2012-07-10 Thread Jay Pipes
po > > Thanks, > Matt Ray > Senior Technical Evangelist | Opscode Inc. > m...@opscode.com | (512) 731-2218 > Twitter, IRC, GitHub: mattray > > > On Tue, Jul 10, 2012 at 10:22 AM, Jay Pipes wrote: >> Gah... probably would be good if you guys either shut down the r

Re: [Openstack] QA for Live Migration

2012-07-10 Thread Jay Pipes
On 07/09/2012 10:09 AM, John Garbutt wrote: >>> - historically XenAPI had migrate, Libvirt had live migrate >>> - But by end of Folsom we should have both having both >> >> Yes, but what is the difference between the two? > Got you. I think this is right: > > Migration: > - shutdown the VM > - mov

Re: [Openstack] Don't bypass code-review.

2012-07-10 Thread Jay Pipes
On 07/10/2012 01:52 PM, Eric Windisch wrote: > I've had code reviews sitting out for over a week, looking to fix issues with > the ZeroMQ driver in openstack-common. I'd love to get it fixed, and nudged a > couple of people to get the reviews in, but figured that it would get in > eventually - a

Re: [Openstack] [CHEF] Clarification on osops/chef-repo/roles/nova-compute.rb

2012-07-11 Thread Jay Pipes
On 07/11/2012 12:00 PM, Monty Taylor wrote: > Let me know if there are any things that people are wanting related to > any of these projects from the OpenStack CI infrastructure. > Foodcritic/jsonlint seem pretty easy - deployments on to bare nodes > using the chef stuff similar to our devstack-b

Re: [Openstack] [nova] mysql connection optimization

2012-07-11 Thread Jay Pipes
+1 to all your ideas below, Devananda. On 07/11/2012 01:33 PM, Devananda van der Veen wrote: > Hi all, > > I've been taking a look at the way Nova uses its MySQL database. Having > done MySQL performance audits for years as a consultant, a few things > jumped out right away at me. First is the wa

Re: [Openstack] [keystone] Rate limit middleware

2012-07-12 Thread Jay Pipes
On 07/11/2012 07:28 PM, Rafael Durán Castañeda wrote: > Thank you guys for the info, I didn't know about some of the projects. > However writing my "on-house" own stuff is not what I was considering > but adding a middleware into Keystone, nothing fancy but extensible so > it covers at least most b

Re: [Openstack] [nova] [cinder] Nova-volume vs. Cinder in Folsom

2012-07-12 Thread Jay Pipes
On 07/12/2012 10:36 AM, Thomas, Duncan wrote: > We’ve got volumes in production, and while I’d be more comfortable with > option 2 for the reasons you list below, plus the fact that cinder is > fundamentally new code with totally new HA and reliability work needing > to be done (particularly for th

Re: [Openstack] [keystone] Rate limit middleware

2012-07-12 Thread Jay Pipes
On 07/12/2012 12:26 PM, Rafael Durán Castañeda wrote: > Unless I'm missing something, nova_limits is not applicable to Keystone > since it takes the tenant_id from 'nova.context', which obiously is not > available for Keystone; thought adapt/extend it to keystone should be > trivial and probably is

Re: [Openstack] [nova] [cinder] Nova-volume vs. Cinder in Folsom

2012-07-12 Thread Jay Pipes
On 07/12/2012 12:32 PM, George Reese wrote: > This community just doesn't give a rat's ass about compatibility, does it? a) Please don't be inappropriate on the mailing list b) Vish sent the email below to the mailing list *precisely because* he cares about compatibility. He wants to discuss the o

Re: [Openstack] Capacity based scheduling: What updated free_ram_mb in Folsom

2012-07-13 Thread Jay Pipes
Hi Phil, The nova.db.api.compute_node_update() call is what the individual virt drivers call to update the compute node stats. grep for that and you'll see where the calls to set the compute node data are called. Best, -jay On 07/13/2012 09:38 AM, Day, Phil wrote: > Hi Folks, > > > > I was r

Re: [Openstack] [nova] [cinder] Nova-volume vs. Cinder in Folsom

2012-07-16 Thread Jay Pipes
On 07/16/2012 09:55 AM, David Kranz wrote: > An excellent idea. I believe that if the below message had been sent in > April, the tenor of the discussion would have been much different. I > think a main source of angst around this was that there was no mention > at the Folsom summit of nova-volume

Re: [Openstack] Heat application for incubation

2012-07-16 Thread Jay Pipes
cc'ing the PPB mailing list... On 07/16/2012 06:25 PM, Steven Dake wrote: > Dear members of the Project Policy Board: > > After four months of development on the Heat project[1], the developers > voted[2] to apply for incubation. The developers feel Heat provides a > feature rich user experience

Re: [Openstack] [nova] [cinder] Nova-volume vs. Cinder in Folsom

2012-07-17 Thread Jay Pipes
On 07/17/2012 05:47 AM, Thomas, Duncan wrote: > Jay Pipes on 16 July 2012 18:31 wrote: > >> On 07/16/2012 09:55 AM, David Kranz wrote: > > >> Sure, although in this *particular* case the Cinder project is a >> bit-for-bit copy of nova-volumes. In fact, the onl

Re: [Openstack] [Quantum] Network, Subnet and Port names

2012-07-17 Thread Jay Pipes
On 07/17/2012 01:27 AM, Dan Wendlandt wrote: > Hi Gary, this is an example of when I wish openstack APIs had a > "style-guide" to try to ensure some consistency across projects. Yeah, we actually discussed this a long time ago on the PPB and, IIRC, the decision was made to not have some strict A

Re: [Openstack] Distributed quota manager concept

2012-07-18 Thread Jay Pipes
On 07/17/2012 06:08 PM, Everett Toews wrote: > Setting aside any SQL/NoSQL religious debate or even the "best tool for > the job" argument, I think you'd find this to be a hard sell to the > operations crowd. Nobody is going to want to have all of their OpenStack > data in an SQL DB (which they may

Re: [Openstack] [Quantum] Network, Subnet and Port names

2012-07-18 Thread Jay Pipes
On 07/18/2012 04:53 AM, Hua ZZ Zhang wrote: > All networks information of all tenants are stored in one table. If the > name is defined unique, it implicates all tenants have to make sure the > name of new network will not be conflict with others even they don't > know each other. the system has to

Re: [Openstack] Possible Glance Bug?

2012-07-18 Thread Jay Pipes
Try: (old glance client) glance index deleted=True to see image records that are marked deleted. or: glance index deleted=None to see ALL image records. The new glance client -- python-glanceclient -- does not yet support filtering for deleted image records, but it should be able to do: gla

[Openstack] [DIABLO] EC2 Metadata API service slow? Try this patch.

2012-07-19 Thread Jay Pipes
Hey all, A few deployers of Diablo, including Wikipedia, were experiencing very slow response times from the EC2 metadata service in Nova. Yesterday and today I tracked the bug down to a problem in the way the database queries for the metadata results were being generated. I'm not all tha

Re: [Openstack] Improving logging

2012-07-20 Thread Jay Pipes
On 07/19/2012 08:38 PM, Michael Still wrote: > On 19/07/12 23:16, Gabe Westmaas wrote: > >> There is definitely support for logging only patches that help us >> find problems easier. I just added openstack operators, because I >> think it would be good to get as much input as possible over what >

Re: [Openstack] When are the IRC meetings for Nova, Glance and Swift?

2012-07-20 Thread Jay Pipes
Glance does not have any regular weekly IRC meetings. Not sure about Swift or Nova. Best, -jay On 07/20/2012 02:40 AM, Sheng Bo Hou wrote: > Hi OpenStackers, > > From this link http://wiki.openstack.org/Meetings/, I cannot find when > the IRC meetings for Nova, Glance and Swift will be. > Can s

Re: [Openstack] [Quantum] Public Network spec proposal

2012-07-20 Thread Jay Pipes
On 07/20/2012 10:24 AM, Lew Tucker wrote: > We might want to think a bit about words here. I believe it would be > less confusing to call this something else such as a "shared" network > instead of public. As Salvatore indicates below, this is simply a > network that is "shared among several tena

Re: [Openstack] [KeyStone] Requestid, context, notification in Keystone

2012-07-23 Thread Jay Pipes
On 07/21/2012 02:57 AM, Joseph Heck wrote: > Hey Nachi > > If by this you mean the idea that a request ID is created at a user request > action, and then propagated through all relevant systems and API calls to > make tracing the distributed calls easier, I'm totally in favor of the idea. > Di

Re: [Openstack] Incremental Backup of Instances

2012-07-23 Thread Jay Pipes
On 07/22/2012 11:22 PM, Kobagana Kumar wrote: > Hi All, > > I am working on *Delta Changes *of an instance. Can you please tell me > The procedure to take *Incremental Backups (Delta Changes) *of VMs, > instead of taking the snapshot of entire instance. The only non-commerical solution I know of

Re: [Openstack] High Available queues in rabbitmq

2012-07-23 Thread Jay Pipes
On 07/23/2012 09:02 AM, Alessandro Tagliapietra wrote: > Hi guys, > > just an idea, i'm deploying Openstack trying to make it HA. > The missing thing is rabbitmq, which can be easily started in > active/active mode, but it needs to declare the queues adding an > x-ha-policy entry. > http://www.rab

Re: [Openstack] [nova] core members

2012-07-23 Thread Jay Pipes
On 07/23/2012 02:31 PM, Vishvananda Ishaya wrote: > Sean Dague: 2 I'm not nova-core, but I'd recommend Sean as a core committer. He's been active in both reviews and patches recently. Best, -jay ___ Mailing list: https://launchpad.net/~openstack Post t

Re: [Openstack] High Available queues in rabbitmq

2012-07-23 Thread Jay Pipes
RIs. We do that for Glance APi servers, for example, in the glance_api_servers flag: https://github.com/openstack/nova/blob/master/nova/flags.py#L138 So, perhaps you can add a rabbit_ha_servers ListOpt flag that, when filled, would be used instead of rabbit_host and rabbit_port. That way you won

Re: [Openstack] [nova] a proposal to change metadata API data

2012-07-23 Thread Jay Pipes
On 07/21/2012 09:00 PM, Matt Joyce wrote: > Preamble: > > Until now, all data that is made available by the metadata server has > been data that cannot be found anywhere else at the time it may be needed. > > In short, an instance can't be passed it's instance id before it's > instance id has bee

Re: [Openstack] VM High Availability and Floating IP

2012-07-24 Thread Jay Pipes
On 07/24/2012 04:29 AM, Alessandro Tagliapietra wrote: > Hi guys, > > i've 2 missing pieces in my HA openstack install. Actually all openstack > services are managed by pacemaker and i can succesfully start/stop vm > etc. when the cloud controller is down (i've only 2 servers atm). > > 1 - how ca

Re: [Openstack] public-interface ignored

2012-07-24 Thread Jay Pipes
On 07/24/2012 06:58 AM, Wolfgang Hennerbichler wrote: > hi, > > running openstack essex with vlan-networking: > --network_manager=nova.network.manager.VlanManager > --vlan_interface=bond0 > --public_interface=bridge_130 > --auto_assign_floating_ip=True > > all works great except for floating ips.

Re: [Openstack] [nova] a proposal to change metadata API data

2012-07-24 Thread Jay Pipes
Thanks Matt, comments inline... On 07/23/2012 05:25 PM, Matt Joyce wrote: > > I wish to add some data to the metadata server that can be found > > somewhere else. That a user could jump through a hoop or two to > add to > > their instances. Esteemed personages are concerned that

Re: [Openstack] VM High Availability and Floating IP

2012-07-24 Thread Jay Pipes
On 07/24/2012 12:52 PM, Alessandro Tagliapietra wrote: > Thank you Jay, never read about that. > Seems something like scalr/chef? WHich handles application and keeps a > minimum number of vm running? Yeah, kinda.. just one more way of doing things... :) -jay _

Re: [Openstack] [nova] a proposal to change metadata API data

2012-07-24 Thread Jay Pipes
On 07/24/2012 12:47 PM, Martin Packman wrote: > On 23/07/2012, Jay Pipes wrote: >> >> This is only due to the asinine EC2 API -- or rather the asinine >> implementation in EC2 that doesn't create an instance ID before the >> instance is launched. > > So, I&#

Re: [Openstack] [nova] a proposal to change metadata API data

2012-07-24 Thread Jay Pipes
On 07/24/2012 01:10 PM, Martin Packman wrote: > On 24/07/2012, Jay Pipes wrote: >> >> The OpenStack Compute API POST /servers command creates a server UUID >> that is passed back in the initial response and allows the user to query >> the status of the server thr

Re: [Openstack] Qcow2 Details on base images

2012-07-28 Thread Jay Pipes
On 07/28/2012 11:10 AM, Gaurab Basu wrote: > Another thing I would like to know is whether it uses snapshot mechanism > over time. What is "it" you are referring to above? Are you asking whether Nova automatically takes snapshots of images over time? If so, no, it does not. If a user requests a sn

Re: [Openstack] [Nova] proposal to provide project specific instance type

2012-07-28 Thread Jay Pipes
On 07/28/2012 01:10 AM, unicell wrote: > Hi, > > In our use case, there is a need to provide project-specific instance > type. Meaning that this instance type is only visible and available > for several projects. It's an idea kind of like private image concept > for Glance project. > > Has this p

Re: [Openstack] Suspend/Stop VM

2012-07-30 Thread Jay Pipes
On 07/30/2012 12:48 PM, George Reese wrote: > Thanks for this and a number of other suggestions. I am giving them a try. > > Just a note though: some of the things that appear to work are > inconsistent with other server actions in structure (os-stop vs. pause > vs. os-start vs. reboot). Yeah, de

Re: [Openstack] Default reply to behavior for mailing list

2012-07-31 Thread Jay Pipes
On 07/31/2012 02:09 PM, Johannes Erdfelt wrote: > On Tue, Jul 31, 2012, Bhuvaneswaran A wrote: >> If a subscriber reply to a mailing list message, it's sent to the >> author only. Each subscriber should use "Reply to All" every time, to >> post a reply to mailing list. >> >> Can you please configu

Re: [Openstack] Default reply to behavior for mailing list

2012-07-31 Thread Jay Pipes
On 07/31/2012 03:21 PM, Sean Dague wrote: > On 07/31/2012 02:13 PM, Jay Pipes wrote: >>> >>> As a counter-point, I'd prefer to keep the list as it is and *not* munge >>> Reply-To. >>> >>> Since Chip summarizes it better than I can, I'

Re: [Openstack] [glance] legacy client removal and python-glanceclient

2012-07-31 Thread Jay Pipes
On 08/01/2012 12:49 AM, Matt Joyce wrote: > I think we're running out of opportunities to do stuff like this. > > This is exactly the sort of thing that will drive George Reese into a > homocidal rage. More to the point its exactly the sort of thing our > users are going to despise us for. And t

Re: [Openstack] python novaclient's response when extension is disabled

2012-08-01 Thread Jay Pipes
On 08/01/2012 10:10 AM, Jiang, Yunhong wrote: > Currently, if an extension is disabled, there will be no clear information > like "extension is not support", instead, it will return " ERROR: n/a (HTTP > 404)", like followed output in my devstack. > > yjiang5@yjiang5-linux1:~/work/openstack/devst

Re: [Openstack] [glance] legacy client removal and python-glanceclient

2012-08-01 Thread Jay Pipes
On 08/01/2012 03:18 PM, Kevin L. Mitchell wrote: > On Wed, 2012-08-01 at 18:37 +, Gabriel Hurley wrote: >> As a rule of thumb, we need to start doing proper deprecation on all >> public interfaces, whether that's a CLI, client method signatures, >> APIs, etc. It's a little late for this on the

<    1   2   3   4   5   6   7   8   9   >