Re: [openstack-dev] [heat] convergence cancel messages

2016-08-19 Thread Anant Patil
On Tue, Apr 19, 2016 at 9:36 PM Zane Bitter <zbit...@redhat.com> wrote: > On 17/04/16 00:44, Anant Patil wrote: > > I think it is a good idea, but I see that a resource can be > marked > > unhealthy only after it is done. > > > > > > C

Re: [openstack-dev] [heat] enabled convergence background

2016-05-20 Thread Anant Patil
On 20-May-16 13:51, Steven Hardy wrote: > On Fri, May 20, 2016 at 09:26:46AM +0200, Thomas Herve wrote: >> On Fri, May 20, 2016 at 5:46 AM, xiangxinyong wrote: >>> Hi Team, >>> >>> I noticed that heat enabled convergence. >> >> I hope that's not the case :). We haven't made

[openstack-dev] [heat] RPC messaging issue and convergence

2016-05-11 Thread Anant Patil
Hi, I have confirmed that the issue related to locally queueing of resource requests, which I highlighted at the design summit, exists currently. I have also confirmed that the issue is solved in oslo.messaging version 5.0.0. The issue is with oslo messaging library below version 5.0.0. The

Re: [openstack-dev] [heat] convergence cancel messages

2016-04-16 Thread Anant Patil
On Sat, Apr 16, 2016 at 1:18 AM, Zane Bitter <zbit...@redhat.com> wrote: > On 15/04/16 10:58, Anant Patil wrote: > >> On 14-Apr-16 23:09, Zane Bitter wrote: >> >>> On 11/04/16 04:51, Anant Patil wrote: >>> >>>> After lot of ping-pong in my hea

Re: [openstack-dev] [heat] convergence cancel messages

2016-04-15 Thread Anant Patil
On 14-Apr-16 23:09, Zane Bitter wrote: > On 11/04/16 04:51, Anant Patil wrote: >> On 14-Mar-16 14:40, Anant Patil wrote: >>> On 24-Feb-16 22:48, Clint Byrum wrote: >>>> Excerpts from Anant Patil's message of 2016-02-23 23:08:31 -0800: >>>>> Hi,

Re: [openstack-dev] [heat] convergence cancel messages

2016-04-11 Thread Anant Patil
On 14-Mar-16 14:40, Anant Patil wrote: > On 24-Feb-16 22:48, Clint Byrum wrote: >> Excerpts from Anant Patil's message of 2016-02-23 23:08:31 -0800: >>> Hi, >>> >>> I would like the discuss various approaches towards fixing bug >>> https://launch

Re: [openstack-dev] [heat] Issue with validation and preview due to get_attr==None

2016-03-27 Thread Anant Patil
On 24-Mar-16 20:26, Sergey Kraynev wrote: > Zane, I like you idea. As example we may discuss some steps for it > during summit session (if it need). > > Also I have another question, which probably came in your heads a lot of times: > Can we somekind improve our existing approach for validation?

Re: [openstack-dev] [heat] convergence cancel messages

2016-03-14 Thread Anant Patil
On 24-Feb-16 22:48, Clint Byrum wrote: > Excerpts from Anant Patil's message of 2016-02-23 23:08:31 -0800: >> Hi, >> >> I would like the discuss various approaches towards fixing bug >> https://launchpad.net/bugs/1533176 >> >> When convergence is on, and if the stack is stuck, there is no way to

[openstack-dev] [heat] SSL(https) support for software configuration

2016-03-10 Thread Anant Patil
Hi, There are certain gaps in SSL(https mainly) support in software configuration and I would like to discuss it. This is in addition to what is described in bug #1482510 [1]. I am not sure if all of this is already thought by folks, if so do let me know. Tools for software configuration should

Re: [openstack-dev] [heat] convergence cancel messages

2016-02-24 Thread Anant Patil
On 24-Feb-16 14:26, Anant Patil wrote: > On 24-Feb-16 13:12, Clint Byrum wrote: >> Excerpts from Anant Patil's message of 2016-02-23 23:08:31 -0800: >>> Hi, >>> >>> I would like the discuss various approaches towards fixing bug >>> https://launch

Re: [openstack-dev] [heat] convergence cancel messages

2016-02-24 Thread Anant Patil
On 24-Feb-16 13:12, Clint Byrum wrote: > Excerpts from Anant Patil's message of 2016-02-23 23:08:31 -0800: >> Hi, >> >> I would like the discuss various approaches towards fixing bug >> https://launchpad.net/bugs/1533176 >> >> When convergence is on, and if the stack is stuck, there is no way to

Re: [openstack-dev] [heat] Questions on template-validate

2016-02-23 Thread Anant Patil
On 23-Feb-16 20:34, Jay Dobies wrote: > I am going to bring this up in the team meeting tomorrow, but I figured > I'd send it out here as well. Rather than retype the issue, please look at: > > https://bugs.launchpad.net/heat/+bug/1548856 > > My question is what the desired behavior of

[openstack-dev] [heat] convergence cancel messages

2016-02-23 Thread Anant Patil
Hi, I would like the discuss various approaches towards fixing bug https://launchpad.net/bugs/1533176 When convergence is on, and if the stack is stuck, there is no way to cancel the existing request. This feature was not implemented in convergence, as the user can again issue an update on an

[openstack-dev] [heat] Convergence status

2016-01-18 Thread Anant Patil
Hi, This is to discuss the status of convergence patches and plans for making it default. The convergence gate jobs have been running successfully since more than a month now. There were three integration tests skipped: 1. StackValidationTest 2. UpdateStackTest.test_stack_update_alias_type 3.

[openstack-dev] [heat] Convergence plans

2015-10-26 Thread Anant Patil
I will not be able to attend the Mitaka summit, but I have captured my thought process in https://etherpad.openstack.org/p/heat-convergence-mitaka Kanagaraj Manickam will represent me there for these discussions. Thanks & Regards, Anant

[openstack-dev] [heat][oslo] Exchanges in RabbitMQ

2015-10-13 Thread Anant Patil
Hi, I am quite not sure on how RabbitMQ is working with Heat. We have 3 exchange topics: "engine", "heat-engine-listener" and "engine_worker" defined in heat RPC. But, When I do list_exchanges I see: heattopic heat-engine-listener_fanout fanout engine_fanout fanout

[openstack-dev] [heat] Convergence: Detecting and handling worker failures

2015-09-30 Thread Anant Patil
Hi, One of remaining items in convergence is detecting and handling engine (the engine worker) failures, and here are my thoughts. Background: Since the work is distributed among heat engines, by some means heat needs to detect the failure and pick up the tasks from failed engine and

Re: [openstack-dev] [heat] Convergence: Detecting and handling worker failures

2015-09-30 Thread Anant Patil
On 30-Sep-15 14:59, Clint Byrum wrote: > Excerpts from Anant Patil's message of 2015-09-30 00:10:52 -0700: >> Hi, >> >> One of remaining items in convergence is detecting and handling engine >> (the engine worker) failures, and here are my thoughts. >> >> Background: Since the work is distributed

Re: [openstack-dev] [heat] Convergence: Detecting and handling worker failures

2015-09-30 Thread Anant Patil
On 30-Sep-15 18:13, Ryan Brown wrote: > On 09/30/2015 03:10 AM, Anant Patil wrote: >> Hi, >> >> One of remaining items in convergence is detecting and handling engine >> (the engine worker) failures, and here are my thoughts. >> >> Background: Since the

Re: [openstack-dev] [Heat] convergence rally test results (so far)

2015-09-01 Thread Anant Patil
When the stack fails, it is marked as FAILED and all the sync points that are needed to trigger the next set of resources are deleted. The resources at same level in the graph, like here, they are suppose to timeout or fail for an exception. Many DB hits means that the cache data we were

Re: [openstack-dev] [Heat] convergence rally test results (so far)

2015-08-31 Thread Anant Patil
Hi Angus, Thanks for doing the tests with convergence. We are now assured that convergence has not impacted the performance in a negative way. Given that, in convergence, a stack provisioning process goes through a lot of RPC calls, it puts a lot of load on the message broker and the request

[openstack-dev] [heat] Can't make it to the summit.

2015-05-20 Thread Anant Patil
Hi, Due to some visa issues, my travel to Vancouver summit is canceled. I will miss meeting the Heat team and the planned session on convergence phase 2. Kanagaraj M has some context on the phase 2 plans and he should be able to drive it. Hope you will have a good discussion. - Anant

Re: [openstack-dev] [Heat] moving sqlite migration scripts to tests

2015-04-26 Thread Anant Patil
On 18-Apr-15 02:41, Mike Bayer wrote: On 4/17/15 1:29 PM, Zane Bitter wrote: On 16/04/15 04:05, Anant Patil wrote: Hi, Sometime back we had a discussion on IRC regarding sqlite migration scripts. Since sqlite is mostly used for testing, we were thinking about moving the sqlite migration

[openstack-dev] [Heat] moving sqlite migration scripts to tests

2015-04-16 Thread Anant Patil
Hi, Sometime back we had a discussion on IRC regarding sqlite migration scripts. Since sqlite is mostly used for testing, we were thinking about moving the sqlite migration related code to tests folder and keep the migrate_repo sane (with only production code). There was utility class[1] added

Re: [openstack-dev] [Heat] Precursor to Phase 1 Convergence

2015-01-14 Thread Anant Patil
On 09-Jan-15 19:19, Zane Bitter wrote: On 09/01/15 01:07, Angus Salkeld wrote: I am not in favor of the --continue as an API. I'd suggest responding to resource timeouts and if there is no response from the task, then re-start (continue) the task. Yeah, I am not in favour of a new API

Re: [openstack-dev] [Heat] Convergence proof-of-concept showdown

2015-01-08 Thread Anant Patil
On 08-Jan-15 16:09, Anant Patil wrote: On 16-Dec-14 09:41, Zane Bitter wrote: On 15/12/14 09:32, Anant Patil wrote: On 12-Dec-14 06:29, Zane Bitter wrote: On 11/12/14 01:14, Anant Patil wrote: On 04-Dec-14 10:49, Zane Bitter wrote: On 01/12/14 02:02, Anant Patil wrote: On GitHub:https

Re: [openstack-dev] [Heat] Convergence proof-of-concept showdown

2015-01-08 Thread Anant Patil
On 16-Dec-14 09:41, Zane Bitter wrote: On 15/12/14 09:32, Anant Patil wrote: On 12-Dec-14 06:29, Zane Bitter wrote: On 11/12/14 01:14, Anant Patil wrote: On 04-Dec-14 10:49, Zane Bitter wrote: On 01/12/14 02:02, Anant Patil wrote: On GitHub:https://github.com/anantpatil/heat-convergence-poc

Re: [openstack-dev] [Heat] Convergence proof-of-concept showdown

2014-12-16 Thread Anant Patil
On 16-Dec-14 00:59, Clint Byrum wrote: Excerpts from Anant Patil's message of 2014-12-15 07:15:30 -0800: On 13-Dec-14 05:42, Zane Bitter wrote: On 12/12/14 05:29, Murugan, Visnusaran wrote: -Original Message- From: Zane Bitter [mailto:zbit...@redhat.com] Sent: Friday, December 12,

Re: [openstack-dev] [Heat] Convergence proof-of-concept showdown

2014-12-15 Thread Anant Patil
On 12-Dec-14 06:29, Zane Bitter wrote: On 11/12/14 01:14, Anant Patil wrote: On 04-Dec-14 10:49, Zane Bitter wrote: On 01/12/14 02:02, Anant Patil wrote: On GitHub:https://github.com/anantpatil/heat-convergence-poc I'm trying to review this code at the moment, and finding some stuff I don't

Re: [openstack-dev] [Heat] Convergence proof-of-concept showdown

2014-12-15 Thread Anant Patil
On 13-Dec-14 05:42, Zane Bitter wrote: On 12/12/14 05:29, Murugan, Visnusaran wrote: -Original Message- From: Zane Bitter [mailto:zbit...@redhat.com] Sent: Friday, December 12, 2014 6:37 AM To: openstack-dev@lists.openstack.org Subject: Re: [openstack-dev] [Heat] Convergence

Re: [openstack-dev] [Heat] Convergence proof-of-concept showdown

2014-12-02 Thread Anant Patil
On Tue, Dec 2, 2014 at 1:49 AM, Clint Byrum cl...@fewbar.com wrote: Excerpts from Anant Patil's message of 2014-11-30 23:02:29 -0800: On 27-Nov-14 18:03, Murugan, Visnusaran wrote: Hi Zane, At this stage our implementation (as mentioned in wiki

Re: [openstack-dev] [Heat] Convergence proof-of-concept showdown

2014-12-02 Thread Anant Patil
Yes, that's the synchronization block for which we use the stack lock. Currently, a thread spin waits to acquire the lock to enter this critical section. I don't really know how to do application level transaction. Is there an external library for that? AFAIK, we cannot switch from DB transaction

Re: [openstack-dev] [Heat] Convergence proof-of-concept showdown

2014-11-30 Thread Anant Patil
On 27-Nov-14 18:03, Murugan, Visnusaran wrote: Hi Zane, At this stage our implementation (as mentioned in wiki https://wiki.openstack.org/wiki/Heat/ConvergenceDesign) achieves your design goals. 1. In case of a parallel update, our implementation adjusts graph according

Re: [openstack-dev] [Heat] Convergence prototyping

2014-10-28 Thread Anant Patil
On 23-Oct-14 23:40, Zane Bitter wrote: Hi folks, I've been looking at the convergence stuff, and become a bit concerned that we're more or less flying blind (or at least I have been) in trying to figure out the design, and also that some of the first implementation efforts seem to be

[openstack-dev] [Heat] Covergence: Persisting dependency task graph and resource versioning

2014-09-24 Thread Anant Patil
Hi, The convergence spec is really big to be seen and understood in entirety without going through multiple iterations. It is probably a good idea to break the spec into multiple implementable specs and move a chunk of material from main convergence spec to individual implementable specs like

Re: [openstack-dev] [Heat] Convergence: Backing up template instead of stack

2014-09-24 Thread Anant Patil
/09/14 09:44, Anant Patil wrote: On 23-Sep-14 09:42, Clint Byrum wrote: Excerpts from Angus Salkeld's message of 2014-09-22 20:15:43 -0700: On Tue, Sep 23, 2014 at 1:09 AM, Anant Patil anant.pa...@hp.com wrote: Hi, One of the steps in the direction of convergence is to enable Heat engine

Re: [openstack-dev] [Heat] Convergence: Backing up template instead of stack

2014-09-23 Thread Anant Patil
On 23-Sep-14 09:42, Clint Byrum wrote: Excerpts from Angus Salkeld's message of 2014-09-22 20:15:43 -0700: On Tue, Sep 23, 2014 at 1:09 AM, Anant Patil anant.pa...@hp.com wrote: Hi, One of the steps in the direction of convergence is to enable Heat engine to handle concurrent stack

[openstack-dev] [Heat] Question regarding Stack updates and templates

2014-09-22 Thread Anant Patil
Hi, In convergence, we discuss about having concurrent updates to a stack. I wanted to know if it is safe to assume that the an update will be a super set of it's previous updates. Understanding this is critical to arrive at implementation of concurrent stack operations. Assuming that an admin

[openstack-dev] [Heat] Convergence: Backing up template instead of stack

2014-09-22 Thread Anant Patil
Hi, One of the steps in the direction of convergence is to enable Heat engine to handle concurrent stack operations. The main convergence spec talks about it. Resource versioning would be needed to handle concurrent stack operations. As of now, while updating a stack, a backup stack is created

Re: [openstack-dev] [heat] Stack update and raw_template backup

2014-08-06 Thread Anant Patil
On 30-Jul-14 23:24, Zane Bitter wrote: On 30/07/14 02:21, Anant Patil wrote: On 28-Jul-14 22:37, Clint Byrum wrote: Excerpts from Zane Bitter's message of 2014-07-28 07:25:24 -0700: On 26/07/14 00:04, Anant Patil wrote: When the stack is updated, a diff of updated template and current

[openstack-dev] Too long stack delete method.

2014-08-06 Thread Anant Patil
Hi, I see that the stack delete method is too long to comprehend easily without going to-and-fro few times. I think we should refactor it and move out the UpdateReplace related logic for backup stack to another method. We can also move the user credentials deletion related logic to another

[openstack-dev] [heat] Too long stack delete method

2014-08-06 Thread Anant Patil
Hi, I see that the stack delete method is too long to comprehend easily without going to-and-fro few times. I think we should refactor it and move out the UpdateReplace related logic for backup stack to another method. We can also move the user credentials deletion related logic to another

Re: [openstack-dev] [Heat] Too long stack delete method.

2014-08-06 Thread Anant Patil
On 06-Aug-14 20:20, Zane Bitter wrote: On 06/08/14 10:37, Anant Patil wrote: Hi, I see that the stack delete method is too long to comprehend easily without going to-and-fro few times. I think we should refactor it and move out the UpdateReplace related logic for backup stack to another

Re: [openstack-dev] [heat] Stack update and raw_template backup

2014-07-30 Thread Anant Patil
On 28-Jul-14 22:37, Clint Byrum wrote: Excerpts from Zane Bitter's message of 2014-07-28 07:25:24 -0700: On 26/07/14 00:04, Anant Patil wrote: When the stack is updated, a diff of updated template and current template can be stored to optimize database. And perhaps Heat should have an API

[openstack-dev] [heat] Stack update and raw_template backup

2014-07-25 Thread Anant Patil
Hi, When we do a stack update, I see that there are 2 copies of raw_template stored in database for each update. For n updates there are 2n + 1 entries of raw_template in database. Is this expected or is it a bug? When I dug more into it, I see that the deep copy of template is not copying the

[openstack-dev] Using devstack to setup external network on existing infrastrucutre

2014-07-05 Thread Anant Patil
Hi, In my setup, I have a single node with two NICs: eth0 and eth1. eth0 connects to local network and eth1 connects to public network. I want to use eth1 as conduit to the default external network created by devstack. Basically, 1. Is it possible to specify to eth1 (or any other for that

Re: [openstack-dev] [DevStack] neutron config not working

2014-07-04 Thread Anant Patil
Paul, you need run the command as admin. If you are sourcing openrc as demo tenant or something it will not list. However, I also face this issue of IP address not getting assigned. On Fri, Jul 4, 2014 at 2:35 AM, Kyle Mestery mest...@noironetworks.com wrote: On Thu, Jul 3, 2014 at 10:14 AM,

Re: [openstack-dev] [DevStack] neutron config not working

2014-07-04 Thread Anant Patil
I am using Ubuntu 14.04 and running devstack from top of the tree. Everything goes fine, but I am not able to ping the instance IP addresses. I am not able to log into the VM using novnc, but I am sure the VM is not getting the IP Address. On Fri, Jul 4, 2014 at 4:47 PM, Anant Patil anant.tec

Re: [openstack-dev] [DevStack] neutron config not working

2014-07-04 Thread Anant Patil
at 4:49 PM, Anant Patil anant.tec...@gmail.com wrote: I am using Ubuntu 14.04 and running devstack from top of the tree. Everything goes fine, but I am not able to ping the instance IP addresses. I am not able to log into the VM using novnc, but I am sure the VM is not getting the IP Address

Re: [openstack-dev] Using tmux instead of screen in devstack

2014-07-02 Thread Anant Patil
I am sure there are many developers learning screen in order to work with devstack and I don't want to rob them off of their efforts. However, there are developers (like me :) ) who use tmux everyday. I had used screen for some duration and moved to tmux as it provided some features that helped