Re: [Openstack-operators] Display all nova (or other service) configuration paramete

2016-05-07 Thread Edmund Rhudy (BLOOMBERG/ 120 PARK)
Enable debug logging and restart the service. All configuration values will be printed in the service's log on startup. - Original Message - From: Sergio Cuellar Valdes To: openstack-operators@lists.openstack.org At: 07-May-2016 16:19:06 Hi everybody, How can you display all the val

[Openstack-operators] Keystone issues when upgrading from Kilo to Liberty

2016-05-27 Thread Edmund Rhudy (BLOOMBERG/ 120 PARK)
I am working on our Kilo->Liberty upgrade path at present, and when upgrading existing test Kilo controller nodes to Liberty, Keystone gets extremely weird. When evaluating token timestamps for revocation, it looks like sometimes the timestamps are processed as datetime.datetime objects and othe

Re: [Openstack-operators] VirtIO and IDE disk

2016-08-10 Thread Edmund Rhudy (BLOOMBERG/ 120 PARK)
Hi Emilio, I had to solve getting Windows 2012 running in KVM recently and was able to do so with this nova boot command: From: emilio.mor...@adam.es Subject: Re: [Openstack-operators] VirtIO and IDE disk Hi Peter, Drivers are correct for Windows 2012 R2, if I install one server wit

Re: [Openstack-operators] VirtIO and IDE disk

2016-08-10 Thread Edmund Rhudy (BLOOMBERG/ 120 PARK)
(Sorry, this got sent prematurely.) Hi Emilio, I had to solve getting Windows 2012 running in KVM recently and was able to do so with this nova boot command: nova boot \ --image [[WINDOWS 2012 INSTALL MEDIA]] \ --block-device source=blank,dest=volume,size=40,shutdown=preserve,device=vda \ --blo

Re: [Openstack-operators] Converged infrastructure

2016-08-31 Thread Edmund Rhudy (BLOOMBERG/ 120 PARK)
We currently run converged at Bloomberg with Ceph (all SSD) and I strongly dislike it. OSDs and VMs battle for CPU time and memory, VMs steal memory that would go to the HV pagecache, and it puts a real dent in any plans to be able to deploy hypervisors (mostly) statelessly. Ceph on our largest

[Openstack-operators] Database cleanup scripts?

2016-09-02 Thread Edmund Rhudy (BLOOMBERG/ 120 PARK)
Does anyone have any database cleanup scripts (especially for Nova/Cinder) that they are proud of and are willing to share? Googling around didn't turn up anything I felt was trustworthy; I found one in a GitHub Gist and stopped reading as soon as it disabled foreign key constraints.

Re: [Openstack-operators] Database cleanup scripts?

2016-09-02 Thread Edmund Rhudy (BLOOMBERG/ 120 PARK)
broken on Liberty and I think also Kilo, you will need Mitaka for that or you could roll your own. Our largest DBs were heat and nova so that was my focus. On Fri, Sep 2, 2016 at 8:14 AM, Edmund Rhudy (BLOOMBERG/ 120 PARK) wrote: Does anyone have any database cleanup scripts (especially for

Re: [Openstack-operators] Managing quota for Nova local storage?

2016-11-10 Thread Edmund Rhudy (BLOOMBERG/ 120 PARK)
We didn't come up with one. RAM on our HVs is the limiting factor since we don't run with memory overcommit, so the ability of people to run an HV out of disk space ended up being moot. ¯\_(ツ)_/¯ Long term we would like to switch to being exclusively RBD-backed and get rid of local storage ent

[Openstack-operators] Delegating quota management for all projects to a user without the admin role?

2017-01-26 Thread Edmund Rhudy (BLOOMBERG/ 120 PARK)
I'm looking for a way to allow a user that does not have the admin role to be able to view and set quota (both Nova/Cinder) for all projects in an OpenStack cluster. For us, the boundary of a Keystone region is coterminous with an OpenStack cluster - we don't currently use any sort of federated

Re: [Openstack-operators] Delegating quota management for all projects to a user without the admin role?

2017-01-27 Thread Edmund Rhudy (BLOOMBERG/ 120 PARK)
would have access to. We have used this to provide the centre operator with abilities such as stop/start. The technical details are described at https://openstack-in-production.blogspot.fr/2015/02/delegation-of-roles.html. Tim From: "Edmund Rhudy (BLOOMBERG/ 120 PARK)" Reply

[Openstack-operators] libvirt freezing when loading Nova instance nwfilters

2017-02-22 Thread Edmund Rhudy (BLOOMBERG/ 120 PARK)
I recently witnessed a strange issue with libvirt when upgrading one of our clusters from Kilo to Liberty. I'm not really looking for a specific diagnosis here because of the large number of confounding factors and the relative ease of remediating it, but I'm interested to hear if anyone else ha

Re: [Openstack-operators] libvirt freezing when loading Nova instance nwfilters

2017-02-22 Thread Edmund Rhudy (BLOOMBERG/ 120 PARK)
VMs on these machines by any chance? We've seen issues with libvirt taking a long time with a large number of VMs as it sets up all the network filters. Sent from my iPhone On Feb 22, 2017, at 10:33 AM, Edmund Rhudy (BLOOMBERG/ 120 PARK) wrote: I recently witnessed a strange issue

Re: [Openstack-operators] libvirt freezing when loading Nova instance nwfilters

2017-02-23 Thread Edmund Rhudy (BLOOMBERG/ 120 PARK)
t that he noticed some problems with his instance (not one of the ones destroyed) and thought it might have to do with the leap second. No idea if that's true, but the timing kind of works out. Hope that helps, Joe On Wed, Feb 22, 2017 at 8:33 AM, Edmund Rhudy (BLOOMBERG/ 120 PARK) wrote: I re

Re: [Openstack-operators] ceph rbd root disk unexpected deletion

2017-03-13 Thread Edmund Rhudy (BLOOMBERG/ 120 PARK)
I recall encountering something like this once when an instance termination failed halfway through - the root disk was removed but the instance record remained in the database. In my case, it didn't spontaneously happen, but was a requested termination that blew up at some point between removing

Re: [Openstack-operators] Memory usage of guest vms, ballooning and nova

2017-03-23 Thread Edmund Rhudy (BLOOMBERG/ 120 PARK)
What sort of memory overcommit value are you running Nova with? The scheduler looks at an instance's reservation rather than how much memory is actually being used by QEMU when making a decision, as far as I'm aware (but please correct me if I am wrong on this point). If the HV has 128GB of memo

Re: [Openstack-operators] Operator feedback on App Keys...

2017-04-06 Thread Edmund Rhudy (BLOOMBERG/ 120 PARK)
We have had internal discussions about app keys in Keystone and would be very happy to see it implemented (and to assist with the implementation where possible). From: ronald.de.r...@intel.com Subject: Re:[Openstack-operators] Operator feedback on App Keys... During the PTG, the keyston

Re: [Openstack-operators] [openstack-operators] [nova] cloud.cfg not applied

2017-04-12 Thread Edmund Rhudy (BLOOMBERG/ 120 PARK)
Are you starting the file with "#cloud-config"? AFAIK, cloud-init uses the first line to decide how to process the file (e.g. if it starts with a shell shebang it will treat it as a shell script, #cloud-config will cause it to process it as cloud-init YAML, and so forth). I am not sure if it wil