Re: [openstack-dev] [tripleo] New "validation" subcommand for "openstack undercloud"
Hi Dear Stackers, In order to let operators properly validate their undercloud node, I propose to create a new subcommand in the "openstack undercloud" "tree": `openstack undercloud validate' This should only run the different validations we have in the undercloud_preflight.py That way, an operator will be able to ensure all is valid before starting "for real" any other command like "install" or "upgrade". Of course, this "validate" step is embedded in the "install" and "upgrade" already, but having the capability to just validate without any further action is something that can be interesting, for example: - ensure the current undercloud hardware/vm is sufficient for an update - ensure the allocated VM for the undercloud is sufficient for a deploy - and so on There are probably other possibilities, if we extend the "validation" scope outside the "undercloud" (like, tripleo, allinone, even overcloud). What do you think? Any pros/cons/thoughts? Great idea. We did something similar from support side with https://citellus.org not just for upgrades but also for identifying ongoing issues also from sosreports. Wes did a POC at https://review.openstack.org/#/c/553571/ for integrating it too. So if we could even reuse them somehow, that will be great. Thanks! Pablo Cheers, C. -- Pablo Iranzo Gómez (pablo.ira...@redhat.com) GnuPG: 0x5BD8E1E4 Senior Software Maintenance Engineer - OpenStack RHC{A,SS,DS,VA,E,SA,SP,AOSP}, JBCAA #110-215-852 signature.asc Description: PGP signature __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [Openstack] HA Compute & Instance Evacuation
+++ Torin Woltjer [02/05/18 20:39 +]: There is no HA behaviour for compute nodes. You are referring to HA of workloads running on compute nodes, not HA of compute nodes themselves. It was a mistake for me to say HA when referring to compute and instances. Really I want to avoid a situation where one of my compute hosts gives up the ghost, and all of the instances are offline until someone reboots them on a different host. I would like them to automatically reboot on a healthy compute node. Check out Masakari: https://wiki.openstack.org/wiki/Masakari This looks like the kind of thing I'm searching for. I'm seeing 3 components here, I'm assuming one goes on compute hosts and one or both of the others go on the control nodes? Is there any documentation outlining the procedure for deploying this? Will there be any problem running the Masakari API service on 2 machines simultaneously, sitting behind HAProxy? Check for 'Instance HA': https://blueprints.launchpad.net/tripleo/+spec/instance-ha Which more or less came with: https://github.com/beekhof/osp-ha-deploy/blob/master/pcmk/compute-managed.scenario https://github.com/beekhof/osp-ha-deploy/blob/master/pcmk/controller-managed.scenario Ansible scripts are at git://github.com/redhat-openstack/tripleo-quickstart-utils And enabled via: ansible-playbook /home/stack/ansible-instanceha/playbooks/overcloud-instance-ha.yml \ -e release="RELEASE" This of course requires a valid HA deployment setup on the controllers (usually tripleO or OSP Director). Regards, Pablo ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack -- Pablo Iranzo Gómez (pablo.ira...@redhat.com) GnuPG: 0x5BD8E1E4 Principal Software Maintenance Engineer - OpenStackiranzo @ IRC RHC{A,SS,DS,VA,E,SA,SP,AOSP}, JBCAA#110-215-852RHCA Level V Blog: https://iranzo.github.io Citellus: https://citellus.org signature.asc Description: PGP signature ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Re: [Openstack] Clock Drift
+++ Chris Friesen [22/03/18 16:22 -0600]: On 03/21/2018 08:17 PM, Tyler Bishop wrote: We've been fighting a constant clock skew issue lately on 4 of our clusters. They all use NTP but seem to go into WARN every 12 hours or so. Anyone else experiencing this? What clock are you using in the guest? And how many NTPD sources? Chris ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack -- Pablo Iranzo Gómez (pablo.ira...@redhat.com) GnuPG: 0x5BD8E1E4 Senior Software Maintenance Engineer - OpenStack iranzo @ IRC RHC{A,SS,DS,VA,E,SA,SP,AOSP}, JBCAA#110-215-852RHCA Level V signature.asc Description: PGP signature ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Re: [Openstack-operators] Request for [ideas][help wanted] with OpenStack tooling
+++ Pablo Iranzo Gómez [14/03/18 22:22 +0100]: Hi all, Apart of some updates above what Robin mentioned in December (Now: 170+ plugins, ansible support, checks across different systems, web interface, json output, pip package, container, etc) we're starting to add support for Debian-based distributions. Would it be possible for you running OSP on Debian (or even regular Debian/Ubuntu/etc) installations to contribute a 'sosreport' (yes you can install sosreport tool on Debian*) ? If so, would you mind attaching them at https://www.dropbox.com/request/8LGneF9i9nc9RB6aqXge Or reply to us with the url for us to download? Sorry, forgot to add that if you're running on top of CentOS/Fedora it will be also great to get them. Thanks! Pablo Thanks a lot! Pablo PD: In case you're interested we've #citellus channel on freenode and mailing list at citellus-...@redhat.com +++ Robin Cernin [01/12/17 15:39 +1000]: Hello, This is my second time reaching out to this ML. We are all having same ultimate goal guys. Fixing the problems as soon as possible. Back then in June (SUBJ:OpenStack logs Health Validator) we had rough version, now we are reaching 6 months and we have done 75 scripts (currently) checking things not only in OpenStack deployment. https://github.com/zerodayz/citellus What I am looking for from you is if you would be please so kind and take a look, create issues what you think would be the best to bring this tool to a higher level. 75 scripts so far having output to JSON planning on adding Web front-end. From last OpenStack Australia Group Meetup here in Brisbane I got some feedback on adding configuration options so one doesn't have to re-type all the things and instead use config file. We have all documentation you can imagine including templates: How to Contribute: https://github.com/zerodayz/citellus/blob/master/CONTRIBUTING.md Templates: https://github.com/zerodayz/citellus/tree/master/doc/templates Writing Tests: https://github.com/zerodayz/citellus/blob/master/TESTING.md Presentation in reveal-md: https://github.com/zerodayz/citellus/blob/master/doc/presentation-revealmd.md How to Review code: https://github.com/zerodayz/citellus/blob/master/REVIEWER.md We are now mainly focused on RPM distribution but we could add multiple distros, we are also discussing the possible way of integrating this with Ansible and it's playbook so we could use them too. if you are interested please create issue, code(see How to Contribute), join discussion in github. Thank you! Robin Černín -- Pablo Iranzo Gómez (pablo.ira...@redhat.com) GnuPG: 0x5BD8E1E4 Senior Software Maintenance Engineer - OpenStack iranzo @ IRC RHC{A,SS,DS,VA,E,SA,SP,AOSP}, JBCAA#110-215-852RHCA Level V -- Pablo Iranzo Gómez (pablo.ira...@redhat.com) GnuPG: 0x5BD8E1E4 Senior Software Maintenance Engineer - OpenStack iranzo @ IRC RHC{A,SS,DS,VA,E,SA,SP,AOSP}, JBCAA#110-215-852RHCA Level V signature.asc Description: PGP signature ___ OpenStack-operators mailing list OpenStack-operators@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
Re: [Openstack-operators] Request for [ideas][help wanted] with OpenStack tooling
Hi all, Apart of some updates above what Robin mentioned in December (Now: 170+ plugins, ansible support, checks across different systems, web interface, json output, pip package, container, etc) we're starting to add support for Debian-based distributions. Would it be possible for you running OSP on Debian (or even regular Debian/Ubuntu/etc) installations to contribute a 'sosreport' (yes you can install sosreport tool on Debian*) ? If so, would you mind attaching them at https://www.dropbox.com/request/8LGneF9i9nc9RB6aqXge Or reply to us with the url for us to download? Thanks a lot! Pablo PD: In case you're interested we've #citellus channel on freenode and mailing list at citellus-...@redhat.com +++ Robin Cernin [01/12/17 15:39 +1000]: Hello, This is my second time reaching out to this ML. We are all having same ultimate goal guys. Fixing the problems as soon as possible. Back then in June (SUBJ:OpenStack logs Health Validator) we had rough version, now we are reaching 6 months and we have done 75 scripts (currently) checking things not only in OpenStack deployment. https://github.com/zerodayz/citellus What I am looking for from you is if you would be please so kind and take a look, create issues what you think would be the best to bring this tool to a higher level. 75 scripts so far having output to JSON planning on adding Web front-end. From last OpenStack Australia Group Meetup here in Brisbane I got some feedback on adding configuration options so one doesn't have to re-type all the things and instead use config file. We have all documentation you can imagine including templates: How to Contribute: https://github.com/zerodayz/citellus/blob/master/CONTRIBUTING.md Templates: https://github.com/zerodayz/citellus/tree/master/doc/templates Writing Tests: https://github.com/zerodayz/citellus/blob/master/TESTING.md Presentation in reveal-md: https://github.com/zerodayz/citellus/blob/master/doc/presentation-revealmd.md How to Review code: https://github.com/zerodayz/citellus/blob/master/REVIEWER.md We are now mainly focused on RPM distribution but we could add multiple distros, we are also discussing the possible way of integrating this with Ansible and it's playbook so we could use them too. if you are interested please create issue, code(see How to Contribute), join discussion in github. Thank you! Robin Černín -- Pablo Iranzo Gómez (pablo.ira...@redhat.com) GnuPG: 0x5BD8E1E4 Senior Software Maintenance Engineer - OpenStack iranzo @ IRC RHC{A,SS,DS,VA,E,SA,SP,AOSP}, JBCAA#110-215-852RHCA Level V signature.asc Description: PGP signature ___ OpenStack-operators mailing list OpenStack-operators@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
Re: [Openstack] Setting remove_unused_original_minimum_age_seconds in /etc/nova/nova.conf
Hi Kevin, +++ Kevin Wilson [27/09/16 15:30 +0300]: Thanks for your quick response Pablo. Try to set log level to Debug and check what are the options defined on the logs for nova. It's on the ops manual: http://docs.openstack.org/ops-guide/ops-logging.html And also, on th elink with the configuration defauls for nova: http://docs.openstack.org/liberty/config-reference/content/list-of-compute-config-options.html Set debug = True under [DEFAULT] I am quite new to OpenStack: How do I set the log level to debug ? I tried: more /etc/nova/nova.conf | grep -i debug gives nothing and more /etc/nova/nova.conf | grep -i log logdir=/var/log/nova Regards, Kevin Regards, Pablo -- Pablo Iranzo Gómez (pablo.ira...@redhat.com) GnuPG: 0x5BD8E1E4 Senior Software Maintenance Engineer - OpenStack RHC{A,SS,DS,VA,E,SA,SP,AOSP}, JBCAA #110-215-852 signature.asc Description: PGP signature ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Re: [Openstack] Setting remove_unused_original_minimum_age_seconds in /etc/nova/nova.conf
+++ Kevin Wilson [27/09/16 14:53 +0300]: Hello, There is a configuration setting called: remove_unused_original_minimum_age_seconds by which you can define the timeout by which used instances will be removed. This instances are cached under: /var/lib/nova/instances/_base/ see for example: http://docs.openstack.org/developer/openstack-ansible/liberty/install-guide/configure-openstack.html My first question is: what is the value of this remove_unused_original_minimum_age_seconds setting ? I think I somewhere saw that it is (or was) 24 hours but I am not sure. is there a way I can query for this value (apart from probing into the code). Check the reference configuration file for each version, form your above link I'll supose liberty: http://docs.openstack.org/liberty/config-reference/content/list-of-compute-config-options.html If you scroll down to Table 4.39 it lists the "configuration option = Default value", which stands to: remove_unused_original_minimum_age_seconds = 86400 And the description: (IntOpt) Unused unresized base images younger than this will not be removed My second question is: I want to change the value of remove_unused_original_minimum_age_seconds(assuming that it is indeed 24 or event 12 or 3 hours) to be 120 seconds or 60 seconds. I tried adding an entry in /etc/nova/nova.conf saying remove_unused_original_minimum_age_seconds = 60 Is it under DEFAULT ? Try to set log level to Debug and check what are the options defined on the logs for nova. Regards, Pablo And then restart the nova-compute service by: service nova-compute stop and then service nova-compute start but this seems not to achieve the expected result; I still see unused images under for time intervals way too larger than 60 seconds. Can anyone advise about this ? should I restart additional nova services ? Regards, Kevin ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack -- Pablo Iranzo Gómez (pablo.ira...@redhat.com) GnuPG: 0x5BD8E1E4 Senior Software Maintenance Engineer - OpenStack RHC{A,SS,DS,VA,E,SA,SP,AOSP}, JBCAA #110-215-852 signature.asc Description: PGP signature ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Re: [Openstack] Projects deals tricky job
That's HMT or 'reseller use case', you can implement something similar by using 'flat hierarchies', but by default, as you experienced, any admin, even if under a tenant, is an admin of the whole infrastructure. Regards, Pablo +++ Venkatesh Kotipalli [20/06/16 17:05 +0530]: Hi Folks, Is it possible to create a project admin in openstack. As we identified when ever we created a project admin it will show entire cloud (Like : other users and all services completely admin access). but i want to see the particular project users,admins and control all the services. Guys please help me this part. I am really very confused. Regards, Venkatesh.k ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack -- Pablo Iranzo Gómez (pablo.ira...@redhat.com) GnuPG: 0x5BD8E1E4 Senior Technical Account Manager RHC{A,SS,DS,VA,E,SA,SP,AOSP}, JBCAA #110-215-852 signature.asc Description: PGP signature ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack