Re: [DISCUSS] Ambari Metron Configuration Management consequences and call to action

2017-01-16 Thread Matt Foley
s of course the > > initiating > > >>> action was a Start command from the administrator). > > >>> > > >>> Make sense? It’s all quite straightforward in concept, there’s just > an > > >>> awful lot of stuff

Re: [DISCUSS] Ambari Metron Configuration Management consequences and call to action

2017-01-16 Thread Casey Stella
ed, > > >>> but does not initiate that action itself (unless of course the > > initiating > > >>> action was a Start command from the administrator). > > >>> > > >>> Make sense? It’s all quite straightforward in concept, there’s jus

Re: [DISCUSS] Ambari Metron Configuration Management consequences and call to action

2017-01-16 Thread David Lyle
n that the Ambari-agent also caches (on > >>> each node) both the template files and COMPILED forms of the python > files > >>> (.pyc) involved in transforming them. The pyc files incorporate some > >>> amount of additional info regarding parameter values, b

Re: [DISCUSS] Ambari Metron Configuration Management consequences and call to action

2017-01-16 Thread James Sirota
s (on each >>>  node) to force the data to be reloaded from Ambari-server. Best solution >>>  is don’t cheat. >>> >>>  Also, there may be circumstances under which the Ambari-agent will detect >>>  changes and re-write the latest version it knows of

Re: [DISCUSS] Ambari Metron Configuration Management consequences and call to action

2017-01-15 Thread JJ Meyer
ll detect >> changes and re-write the latest version it knows of the config files, even >> without a Save or Start action at the Ambari-server. I’m not sure of this >> and need to check with Ambari developers. It may no longer happen, altho >> I’m pretty sure change

Re: [DISCUSS] Ambari Metron Configuration Management consequences and call to action

2017-01-15 Thread Michael Miklavcic
ith Ambari developers. It may no longer happen, altho > I’m pretty sure change detection/reversion was a feature of early versions > of Ambari. > > Hope this helps, > --Matt > > ============ > From: Michael Miklavcic <michael.miklav...@gmail.

Re: [DISCUSS] Ambari Metron Configuration Management consequences and call to action

2017-01-15 Thread Dima Kovalyov
> > > > > > > > > > > > > Scheduler > > > > > > > > > > > > > > > > > > Configuration Tool” example in the > > Ambari > > > > > > > > documentation, >

Re: [DISCUSS] Ambari Metron Configuration Management consequences and call to action

2017-01-13 Thread Casey Stella
t; > > > > > > be > > > > > > > > > > > > > > > > > integrated in an “Ambari View”. (Eg, > see the > > > > “Yarn > > > > > > > > Capacity > > > > > > >

Re: [DISCUSS] Ambari Metron Configuration Management consequences and call to action

2017-01-13 Thread Matt Foley
t; spending weeks and weeks of developer time > over > > > the > > > > > > next > > > > > > > > year > > > > > > > > > > > > > > reinventing &g

Re: [DISCUSS] Ambari Metron Configuration Management consequences and call to action

2017-01-13 Thread David Lyle
; > > > > > > > > > > > > > > > Arguments are: Parsimony, Sufficiency, Not > > > > reinventing > > > > > > the > > > > > > > > > wheel, > > > > > > > > >

Re: [DISCUSS] Ambari Metron Configuration Management consequences and call to action

2017-01-13 Thread Nick Allen
> > > > > > > > > the wheel while getting details wrong multiple > > times… > > > > > > > > > > > > > > > > > > > > > > > > > > > > Okay, off soapbox. > > >

Re: [DISCUSS] Ambari Metron Configuration Management consequences and call to action

2017-01-13 Thread zeo...@gmail.com
> > > > Mpack > > > > > > > > > for > > > > > > > > > > > > > Metron. I am not otherwise an Ambari expert, so > > > tomorrow > > > > > > I’ll > > > > > > > > get > &

Re: [DISCUSS] Ambari Metron Configuration Management consequences and call to action

2017-01-13 Thread Nick Allen
t; on > > > > each > > > > > > of > > > > > > > > all > > > > > > > > > > the > > > > > > > > > > > > nodes. > > > > > > > > > > > > Ambari-server has a private set

Re: [DISCUSS] Ambari Metron Configuration Management consequences and call to action

2017-01-13 Thread David Lyle
gt; GUI, > > > > > > > with > > > > > > > > > > > defaults, and to generate configuration files (of any > > > needed > > > > > > > > filetype) > > > > > > > > > > for > > > > >

Re: [DISCUSS] Ambari Metron Configuration Management consequences and call to action

2017-01-13 Thread Ryan Merriman
you reach in and edit Ambari’s > > files, > > > > it > > > > > > will > > > > > > > > > Error > > > > > > > > > > out if the set of parameters or parameter names changes. > > The > > > >

Re: [DISCUSS] Ambari Metron Configuration Management consequences and call to action

2017-01-13 Thread Casey Stella
> > > > > there > > > > > > > > > is a python file which controls the logic for these > actions, > > > > among > > > > > > > > others: > > > > > > > > > - Install > &

Re: [DISCUSS] Ambari Metron Configuration Management consequences and call to action

2017-01-13 Thread Carolyn Duby
ch of these API calls. But the >> current >> > > > code, >> > > > > > and >> > > > > > > I believe this is typical of Ambari-managed components, >> performs >> > a >> > > > > > > “Configure” action w

Re: [DISCUSS] Ambari Metron Configuration Management consequences and call to action

2017-01-13 Thread Casey Stella
owing > > > sequence > > > > > > (see > > > > > > > disclaimer above :-) > > > > > > > - Recreate the generated config files, using the template files > > and > > > > the > > > > > > > act

Re: [DISCUSS] Ambari Metron Configuration Management consequences and call to action

2017-01-13 Thread Nick Allen
> > > this is the appropriate place to push to ZK if desired. > > > > > > - Propagate those config files to each Ambari-agent, with a > command > > > to > > > > > set > > > > > > them locally > > > >

Re: [DISCUSS] Ambari Metron Configuration Management consequences and call to action

2017-01-13 Thread David Lyle
ge > > > > > > > > > > Ambari-server then whines that the updated services should be > > > restarted, > > > > > but does not initiate that action itself (unless of course the > > > initiating > > > > > action was a Start com

Re: [DISCUSS] Ambari Metron Configuration Management consequences and call to action

2017-01-13 Thread Casey Stella
gt; each node) both the template files and COMPILED forms of the python > > files > > > > (.pyc) involved in transforming them. The pyc files incorporate some > > > > amount of additional info regarding parameter values, but I’m not > sure > > of > > > > the f

Re: [DISCUSS] Ambari Metron Configuration Management consequences and call to action

2017-01-13 Thread David Lyle
ditional info regarding parameter values, but I’m not sure > of > > > the form. I don’t think that changes the above in any practical way > > unless > > > you’re trying to cheat Ambari by reaching in and editing its files > > > directly. In that case, you also

Re: [DISCUSS] Ambari Metron Configuration Management consequences and call to action

2017-01-13 Thread Casey Stella
smoothly and > > > > handle the problems when it doesn’t. > > > > > > > > There’s additional complexity in that the Ambari-agent also caches > (on > > > > each node) both the template files and COMPILED forms of the python > > files > &

Re: [DISCUSS] Ambari Metron Configuration Management consequences and call to action

2017-01-13 Thread Casey Stella
gt; node) to force the data to be reloaded from Ambari-server. Best solution > > is don’t cheat. > > > > Also, there may be circumstances under which the Ambari-agent will detect > > changes and re-write the latest version it knows of the config files, > even > >

Re: [DISCUSS] Ambari Metron Configuration Management consequences and call to action

2017-01-13 Thread David Lyle
’t think that changes the above in any practical way > > unless > > > you’re trying to cheat Ambari by reaching in and editing its files > > > directly. In that case, you also need to whack the pyc files (on each > > > node) to force the data to be reloaded from A

Re: [DISCUSS] Ambari Metron Configuration Management consequences and call to action

2017-01-13 Thread Casey Stella
t will detect > > changes and re-write the latest version it knows of the config files, > even > > without a Save or Start action at the Ambari-server. I’m not sure of > this > > and need to check with Ambari developers. It may no longer happen, altho > > I’m pretty su

Re: [DISCUSS] Ambari Metron Configuration Management consequences and call to action

2017-01-13 Thread David Lyle
ns > of Ambari. > > Hope this helps, > --Matt > > ============ > From: Michael Miklavcic <michael.miklav...@gmail.com> > Reply-To: "dev@metron.incubator.apache.org" <dev@metron.incubator.apache. > org> > Date: Thursday, Janua

Re: [DISCUSS] Ambari Metron Configuration Management consequences and call to action

2017-01-12 Thread Matt Foley
<michael.miklav...@gmail.com> Reply-To: "dev@metron.incubator.apache.org" <dev@metron.incubator.apache.org> Date: Thursday, January 12, 2017 at 3:59 PM To: "dev@metron.incubator.apache.org" <dev@metron.incubator.apache.org> Subject: Re: [DISCUSS] Ambari Metron

Re: [DISCUSS] Ambari Metron Configuration Management consequences and call to action

2017-01-12 Thread Michael Miklavcic
Hi Casey, Thanks for starting this thread. I believe you are correct in your assessment of the 4 options for updating configs in Metron. When using more than one of these options we can get into a split-brain scenario. A basic example is updating the global config on disk and using the