s of course the
> > initiating
> > >>> action was a Start command from the administrator).
> > >>>
> > >>> Make sense? It’s all quite straightforward in concept, there’s just
> an
> > >>> awful lot of stuff
ed,
> > >>> but does not initiate that action itself (unless of course the
> > initiating
> > >>> action was a Start command from the administrator).
> > >>>
> > >>> Make sense? It’s all quite straightforward in concept, there’s jus
n that the Ambari-agent also caches (on
> >>> each node) both the template files and COMPILED forms of the python
> files
> >>> (.pyc) involved in transforming them. The pyc files incorporate some
> >>> amount of additional info regarding parameter values, b
s (on each
>>> node) to force the data to be reloaded from Ambari-server. Best solution
>>> is don’t cheat.
>>>
>>> Also, there may be circumstances under which the Ambari-agent will detect
>>> changes and re-write the latest version it knows of
ll detect
>> changes and re-write the latest version it knows of the config files, even
>> without a Save or Start action at the Ambari-server. I’m not sure of this
>> and need to check with Ambari developers. It may no longer happen, altho
>> I’m pretty sure change
ith Ambari developers. It may no longer happen, altho
> I’m pretty sure change detection/reversion was a feature of early versions
> of Ambari.
>
> Hope this helps,
> --Matt
>
> ============
> From: Michael Miklavcic <michael.miklav...@gmail.
> > > > > > > > > > > > > Scheduler
> > > > > > > > > > > > > > > > > > Configuration Tool” example in the
> > Ambari
> > > > > > > > documentation,
>
t; > > > > > > be
> > > > > > > > > > > > > > > > > integrated in an “Ambari View”. (Eg,
> see the
> > > > “Yarn
> > > > > > > > Capacity
> > > > > > >
t; spending weeks and weeks of developer time
> over
> > > the
> > > > > > next
> > > > > > > > year
> > > > > > > > > > > > > > reinventing
&g
;
> > > > > > > > > > > > > > > Arguments are: Parsimony, Sufficiency, Not
> > > > reinventing
> > > > > > the
> > > > > > > > > wheel,
> > > > > > > > >
> > > > > > > > > the wheel while getting details wrong multiple
> > times…
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Okay, off soapbox.
> > >
> > > > Mpack
> > > > > > > > > for
> > > > > > > > > > > > > Metron. I am not otherwise an Ambari expert, so
> > > tomorrow
> > > > > > I’ll
> > > > > > > > get
> &
t; on
> > > > each
> > > > > > of
> > > > > > > > all
> > > > > > > > > > the
> > > > > > > > > > > > nodes.
> > > > > > > > > > > > Ambari-server has a private set
gt; GUI,
> > > > > > > with
> > > > > > > > > > > defaults, and to generate configuration files (of any
> > > needed
> > > > > > > > filetype)
> > > > > > > > > > for
> > > > >
you reach in and edit Ambari’s
> > files,
> > > > it
> > > > > > will
> > > > > > > > > Error
> > > > > > > > > > out if the set of parameters or parameter names changes.
> > The
> > > >
> > > > > there
> > > > > > > > > is a python file which controls the logic for these
> actions,
> > > > among
> > > > > > > > others:
> > > > > > > > > - Install
> &
ch of these API calls. But the
>> current
>> > > > code,
>> > > > > > and
>> > > > > > > I believe this is typical of Ambari-managed components,
>> performs
>> > a
>> > > > > > > “Configure” action w
owing
> > > sequence
> > > > > > (see
> > > > > > > disclaimer above :-)
> > > > > > > - Recreate the generated config files, using the template files
> > and
> > > > the
> > > > > > > act
> > > this is the appropriate place to push to ZK if desired.
> > > > > > - Propagate those config files to each Ambari-agent, with a
> command
> > > to
> > > > > set
> > > > > > them locally
> > > >
ge
> > > > >
> > > > > Ambari-server then whines that the updated services should be
> > > restarted,
> > > > > but does not initiate that action itself (unless of course the
> > > initiating
> > > > > action was a Start com
gt; each node) both the template files and COMPILED forms of the python
> > files
> > > > (.pyc) involved in transforming them. The pyc files incorporate some
> > > > amount of additional info regarding parameter values, but I’m not
> sure
> > of
> > > > the f
ditional info regarding parameter values, but I’m not sure
> of
> > > the form. I don’t think that changes the above in any practical way
> > unless
> > > you’re trying to cheat Ambari by reaching in and editing its files
> > > directly. In that case, you also
smoothly and
> > > > handle the problems when it doesn’t.
> > > >
> > > > There’s additional complexity in that the Ambari-agent also caches
> (on
> > > > each node) both the template files and COMPILED forms of the python
> > files
> &
gt; node) to force the data to be reloaded from Ambari-server. Best solution
> > is don’t cheat.
> >
> > Also, there may be circumstances under which the Ambari-agent will detect
> > changes and re-write the latest version it knows of the config files,
> even
> >
’t think that changes the above in any practical way
> > unless
> > > you’re trying to cheat Ambari by reaching in and editing its files
> > > directly. In that case, you also need to whack the pyc files (on each
> > > node) to force the data to be reloaded from A
t will detect
> > changes and re-write the latest version it knows of the config files,
> even
> > without a Save or Start action at the Ambari-server. I’m not sure of
> this
> > and need to check with Ambari developers. It may no longer happen, altho
> > I’m pretty su
ns
> of Ambari.
>
> Hope this helps,
> --Matt
>
> ============
> From: Michael Miklavcic <michael.miklav...@gmail.com>
> Reply-To: "dev@metron.incubator.apache.org" <dev@metron.incubator.apache.
> org>
> Date: Thursday, Janua
<michael.miklav...@gmail.com>
Reply-To: "dev@metron.incubator.apache.org" <dev@metron.incubator.apache.org>
Date: Thursday, January 12, 2017 at 3:59 PM
To: "dev@metron.incubator.apache.org" <dev@metron.incubator.apache.org>
Subject: Re: [DISCUSS] Ambari Metron
Hi Casey,
Thanks for starting this thread. I believe you are correct in your
assessment of the 4 options for updating configs in Metron. When using more
than one of these options we can get into a split-brain scenario. A basic
example is updating the global config on disk and using the
29 matches
Mail list logo
