>> > - Service discovery
>> > - Elastic scaling
>> > - High Availability
>> > - Placement policies - Which rack/host should the model run on?
>> > - Security - Kerberos ticket refresh?
>> >
>> > Just wanted to float the thought in the community and see if anyone has
>> > experience with Twill. I need to do some more research myself.
>> >
>> > [1] http://twill.apache.org/
>> >
---
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
s://github.com/apache/incubator-metron/pull/500).
>>> >
>>> > However, the REST application currently does not work in a kerberized
>>> > environment. That work has already started so it won't be an issue for
>>> > long but how should we handle situations like this in the future where
>>> we
>>> > want to add a service but it's not quite ready for Kerberos? Should
>>> > Kerberos support be a prerequisite before it's added to the MPack?
>>> Should
>>> > we look at ways to make these services optional? Any other thoughts or
>>> > ideas?
>>> >
>>> > Ryan
>>> >
---
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
Github user james-sirota commented on the issue:
https://github.com/apache/incubator-metron/pull/525
+ 1
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
in, but not before Monday)
>> > > will
>> > > > surely
>> > > > > be included in the RC, unless something has a bug that can’t be
>> > > > readily
>> > > > > resolved.
>> > > > >
>> > &g
Github user james-sirota commented on the issue:
https://github.com/apache/incubator-metron/pull/489
+1 Just verified via squid example on a running cluster. Was able to
create and modify squid pattern, deploy topology, modify topology,
start/stop/edit, modify configs. Upon
dvance for any help or advice you can give me. I am not able to
> find a clear example or explanation and want to make sure this gets done
> correctly.
>
> Ryan Merriman
---
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
;>>> > > > > > wrote:
>>>> > > > > > >
>>>> > > > > > > > So, I do agree with the concern. Is there a way to
>>>> host the
>>>> > > > package
>>>> > > > > > > > within Metron? I definitely would like to see the
>>>> > > > modifications at
>>>> > > > > > > > https://github.com/bro/bro-plu
>>>> gins/commit/b9f1f35415cb0db
>>>> > > > > > > > 065348da0a5043a8353b4a0a8 brought back into Metron and
>>>> I'd
>>>> > > > love for
>>>> > > > > us
>>>> > > > > > to
>>>> > > > > > > > host the plugin.
>>>> > > > > > > >
>>>> > > > > > > > Thoughts?
>>>> > > > > > > >
>>>> > > > > > > >
>>>> > > > > > > > On Thu, Mar 30, 2017 at 9:09 PM, zeo...@gmail.com <
>>>> > > > zeo...@gmail.com>
>>>> > > >
>>>> > > > > > > > wrote:
>>>> > > > > > > >
>>>> > > > > > > >> Today I was taking a look at METRON-812
>>>> > > > > > > >> <https://issues.apache.org/jira/browse/METRON-812>,
>>>> which
>>>> > > > made me
>>>> > > > > > > recall
>>>> > > > > > > >> some conversations from a while back regarding where
>>>> the
>>>> > bro
>>>> > > > kafka
>>>> > > > > > > plugin
>>>> > > > > > > >> should ultimately live, and how to update it.
>>>> > > > > > > >>
>>>> > > > > > > >> Back in METRON-348 <https://issues.apache.org/
>>>> > > > > jira/browse/METRON-348>
>>>> > > > > > I
>>>> > > > > > > >> brought up the fact that some important changes
>>>> > > > > > > >> <https://github.com/bro/bro-plugins/commit/
>>>> > > b9f1f35415cb0db06
>>>> > > > > > > >> 5348da0a5043a8353b4a0a8>
>>>> > > > > > > >> were made to the externally hosted version of the
>>>> kafka
>>>> > > > plugin,
>>>> > > > and
>>>> > > > > > were
>>>> > > > > > > >> never introduced to Metron's hosted version (i.e. the
>>>> one
>>>> > we
>>>> > > > use
>>>> > > > > > > >> <https://github.com/apache/inc
>>>> ubator-metron/blob/master/
>>>> > > metr
>>>> > > > > > > >> on-deployment/roles/bro/tasks/bro-plugin-kafka.yml>
>>>> > > > > > > >> in vagrant when bro is installed). The conversation
>>>> went
>>>> > > down
>>>> > > > the
>>>> > > > > > route
>>>> > > > > > > >> of
>>>> > > > > > > >> discussing whether or not the bro kafka plugin code
>>>> should
>>>> > > > continue
>>>> > > > > to
>>>> > > > > > > >> live
>>>> > > > > > > >> in Metron in the first place. Now, with METRON-812, I
>>>> see
>>>> > us
>>>> > > > > further
>>>> > > > > > > >> muddying the waters of where to go for the right
>>>> plugin,
>>>> > as
>>>> > > > our
>>>> > > > > > version
>>>> > > > > > > is
>>>> > > > > > > >> still missing the public changes but adds some very
>>>> > > important
>>>> > > > new
>>>> > > > > > > >> functionality.
>>>> > > > > > > >>
>>>> > > > > > > >> I'd like to bring up the idea of using bro's packages
>>>> > > > > > > >> <https://github.com/bro/packages> framework,
>>>> released in
>>>> > > > late 2016
>>>> > > > > > > >> <
>>>> > > > http://blog.bro.org/2016/10/introducing-bro-package-manager.html>
>>>> > > > > > > >> (additional
>>>> > > > > > > >> documentation here <
>>>> > > > > > > http://bro-package-manager.readthedocs.io/en/stable/
>>>> > > > > > > >> >),
>>>> > > > > > > >> as a potential place for this to be hosted/referenced.
>>>> > This
>>>> > > > is a
>>>> > > > > > simple
>>>> > > > > > > >> and supported method (funded by Mozilla
>>>> > > > > > > >> <https://blog.mozilla.org/blog
>>>> /2015/12/10/mozilla-open-
>>>> > > sourc
>>>> > > > > > > >> e-support-first-awards-made/>)
>>>> > > > > > > >> to install and uninstall bro scripts, plugins, etc.,
>>>> and
>>>> > it
>>>> > > > also
>>>> > > > > > allows
>>>> > > > > > > us
>>>> > > > > > > >> to continue to have enough control over updates to the
>>>> > > plugin
>>>> > > > so
>>>> > > > > that
>>>> > > > > > it
>>>> > > > > > > >> will not slow down Metron development by having it as
>>>> a
>>>> > > > dependency
>>>> > > > > > > >> (resolving both of Casey's concerns noted here
>>>> > > > > > > >> <https://issues.apache.org/jira/browse/METRON-348?
>>>> > > focusedCom
>>>> > > > > > > >> mentId=15391865&page=com.atlas
>>>> sian.jira.plugin.system.
>>>> > > > > > > >> issuetabpanels:comment-tabpanel#comment-15391865>,
>>>> > > > > > > >> and I think this solution is supported by Nick's
>>>> comments
>>>> > > here
>>>> > > > > > > >> <https://issues.apache.org/jira/browse/METRON-348?
>>>> > > focusedCom
>>>> > > > > > > >> mentId=15391872&page=com.atlas
>>>> sian.jira.plugin.system.
>>>> > > > > > > >> issuetabpanels:comment-tabpanel#comment-15391872>
>>>> > > > > > > >> as
>>>> > > > > > > >> well).
>>>> > > > > > > >>
>>>> > > > > > > >> The only thing I'm not sure about is where to host the
>>>> > > plugin
>>>> > > > itself
>>>> > > > > -
>>>> > > > > > > my
>>>> > > > > > > >> first thought would be Nick's github <
>>>> > > > https://github.com/nickwallen
>>>> > > > > >,
>>>> > > > > > > as
>>>> > > > > > > >> he
>>>> > > > > > > >> really kicked off this effort, but maybe we can think
>>>> of
>>>> > > > something
>>>> > > > > > > better.
>>>> > > > > > > >>
>>>> > > > > > > >> Is this approach of interest to anybody? It is
>>>> extremely
>>>> > > > simple to
>>>> > > > > > put
>>>> > > > > > > >> together - I was able to throw one together
>>>> > > > > > > >> <https://github.com/bro/packages/blob/master/
>>>> > > > > jonzeolla/bro-pkg.index>
>>>> > > > > > > and
>>>> > > > > > > >> get it working with a fresh bro 2.5 install when
>>>> attending
>>>> > > the
>>>> > > > > brocon
>>>> > > > > > > talk
>>>> > > > > > > >> <
>>>> > https://www.bro.org/brocon2016/brocon2016_abstracts.html#
>>>> > > > > > > >> bro-packagemanager>
>>>> > > > > > > >> (recording <https://www.youtube.com/watch
>>>> ?v=9RFfPJeGkcE>,
>>>> > > > slides
>>>> > > > > > > >> <https://www.bro.org/brocon2016/slides/hall_bpm.pdf>)
>>>> > that
>>>> > > > > introduced
>>>> > > > > > > >> this
>>>> > > > > > > >> to me in the first place.
>>>> > > > > > > >>
>>>> > > > > > > >> Jon
>>>> > > > > > > >> --
>>>> > > > > > > >>
>>>> > > > > > > >> Jon
>>>> > > > > > > >>
>>>> > > > > > > >
>>>> > > > > > > >
>>>> > > > > > >
>>>> > > > > > --
>>>> > > > > >
>>>> > > > > > Jon
>>>> > > > > >
>>>> > > > >
>>>> > > > > --
>>>> > > > >
>>>> > > > > Jon
>>>> > > > >
>>>> > > >
>>>> > > > --
>>>> > > >
>>>> > > > Jon
>>>> > > >
>>>> > > >
>>>> > > >
>>>> > > > --
>>>> > > >
>>>> > > > Jon
>>>> > > >
>>>> > > > --
>>>> > > >
>>>> > > > Jon
>>>> > > >
>>>> > > --
>>>> > >
>>>> > > Jon
>>>> > >
>>>> >
>>>> --
>>>>
>>>> Jon
---
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
bator wiki page. Signing off reports shows that you are
> following the project - projects that are not signed may raise alarms
> for the Incubator PMC.
>
> Incubator PMC
---
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
;
>>> What do you-all think?
>>> Also, what additional work do you think should be included in this
>>> release, and can it realistically get done by the end of this week? The
>>> time frame is, of course, flexible at the pleasure of the community – but
>>> also, there will be another release in another couple months or so, so no
>>> need to rush stuff.
>>>
>>> Thanks,
>>> --Matt
>>>
>>> --
>>
>> Jon
---
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
Github user james-sirota commented on the issue:
https://github.com/apache/incubator-metron/pull/490
I reviewed this with 793. I was able to validate this on a single-node
Suse-based Hadoop cluster once with Kerberos disabled and second time with
Kerberos enabled. That's a
Github user james-sirota commented on the issue:
https://github.com/apache/incubator-metron/pull/486
I was able to validate this on a single-node Suse-based Hadoop cluster once
with Kerberos disabled and second time with Kerberos enabled. That's a good
first step. I will try t
Mentors,
Looks like we have everything we need to initiate the incubator board vote to
leave the incubator. Can you provide some guidance as to what is the best way
to approach this?
---
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
Vote passes with 4 binding +1s (casey, david, kyle, james)
on to the next steps...
22.03.2017, 09:50, "James Sirota" :
> + 1 (binding)
>
> 22.03.2017, 08:30, "Casey Stella" :
>> +1 binding
>>
>> On Wed, Mar 22, 2017 at 11:23 AM, David Lyle wrot
>>
>> > +1 (binding)
>> >
>> > On Mon, Mar 20, 2017 at 3:05 AM, James Sirota
>> wrote:
>> >
>> > >
>> > > - Removed affiliations
>> > > - Added apache IDs where possible
>> > > - Removed co
des (prhodes)
Sean Schulte (sirsean)
James Sirota (jsirota)
Casey Stella (cstella)
Bryan Taylor (UKNOWN)
Ray Urciuoli(UKNOWN)
Vinod Kumar Vavilapalli (vinodkv)
George Vetticaden (gvetticaden)
Oskar Zabik (smogg)
David Lyle (lyle)
Nick Allen (nickallen)
NOW, THEREFORE, BE IT FURTHER RESOLVED, th
s
> - Remove the list of committers (only PMC members are listed in a graduation
> resolution)
> - You can drop the paragraph about bylaws since it’s not required and you
> already have bylaws
>
> -Taylor
>
>> On Mar 15, 2017, at 3:24 PM, James Sirota wrote:
>>
>> P
f committers (only PMC members are listed in a graduation
> resolution)
> - You can drop the paragraph about bylaws since it’s not required and you
> already have bylaws
>
> -Taylor
>
>> On Mar 15, 2017, at 3:24 PM, James Sirota wrote:
>>
>> Please vote 1
mitters (only PMC members are listed in a
>> graduation resolution)
>> - You can drop the paragraph about bylaws since it’s not required and you
>> already have bylaws
>>
>> -Taylor
>>
>> > On Mar 15, 2017, at 3:24 PM, James Sirota wrote:
>&g
C:
Mark Bittmann
Sheetal Dolas
Debo Dutta
Discovery Gerdes
P. Taylor Goetz
Andrew Hartnett
Dave Hirko
Paul Kehrer
Brad Kolarov
Kiran Komaravolu
Larry McCay
Ryan Merriman
Michael Perez
Charles Porter
Phillip Rhodes
Sean Schulte
James Sirota
Casey Stella
Bryan Taylor
Ray Urciuoli
Vinod Kumar Vavila
The vote passes with 9 binding +1s and 4 non-binding +1s
14.03.2017, 09:22, "Billie Rinaldi" :
> +1 binding
>
> On Mon, Mar 13, 2017 at 3:33 PM, James Sirota wrote:
>
>> This vote is to make Casey Stella our VP after graduation
>>
>> ------
The vote passes with 10 binding +1s, 1 non-binding +1s, and 2 non-binding 0s
14.03.2017, 10:42, "P. Taylor Goetz" :
> +1 (binding)
>
> -Taylor
>
>> On Mar 13, 2017, at 6:37 PM, James Sirota wrote:
>>
>> Do we feel it's time for us to exit the Apach
, 09:42, "Otto Fowler" :
> Does anyone have a recommendation for what type of AWS account to look and
> cost if you wanted to
> test metron aws deployment?
---
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
, need 2 more.
>
> On Thu, Mar 9, 2017 at 1:25 PM, Casey Stella wrote:
>
>> Hi Mentors,
>>
>> We have a release going on in incubator-general for around 10 days now
>> with no reviews. Would a couple of y'all mind reviewing for us?
>>
>> T
"Otto Fowler"?
>
> Justin
>
> On Mon, Mar 13, 2017 at 12:13 AM, James Sirota wrote:
>
>> The incubating Apache Metron community believes it is time to graduate to
>> TLP.
>>
>> Apache Metron entered incubation in December of 2015. Since then,
>> In the list of initial people, can we change "otto" to "Otto Fowler"?
>>
>> Justin
>>
>> On Mon, Mar 13, 2017 at 12:13 AM, James Sirota
>> wrote:
>>
>> > The incubating Apache Metron community believe
gs, but it’s clearly reproducible.
>
> Will take a look to see if the cause is obvious.
> --Matt
---
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
ectories vs. one extension dir are welcome )
>> > > * the storm process only references metron-parsers-common
>> > > * the parser bolt uses the nar class loading system to load the
>
> parser
>> > > * the rest api uses the nar class loading system to load the parser
>> > > * etc etc
>> > > * a new version of a parser is deployed as a nar, when the service
>> > > restarts, the new nar is unpacked and replaces the old version in the
>> > > working system ( we could change the restart requirement ……)
>> > >
>> > > The nar system gives us something that is:
>> > > * production quality
>> > > * small enough to grok and extend as opposed to some other solutions
>> > > * comes with a highly accessible sister project
>> > > * maven plugin tooling to build
>> > > * reference archetype for packaging
>> > > and other things
>> > >
>> > > There are a few ways we could approach using Nar:
>> > >
>> > > 1. ‘fork’ and appropriate the components and ‘metronize’ them
>> > > * the maven plugin
>> > > * the nar-utils package
>> > > 2. Ask for and participate in an effort to pull NAR out into it’s own
>> > > project,
>> > > * make it more generic
>> > > * usable by more than one project
>> > > * goal to replace NiFi’s use of nar too
>> > > 3. Create our own generic version as a fork
>> > > * use it in metron
>> > > * submit to NiFi as a proposal
>> > >
>> > > MattF was nice enough to float this by Joe Witt, who is at
>
> Hortonworks
>> > > and
>> > > is the NiFi lead.
>> > > He agrees with the idea of making nar usable for multiple projects,
>
> but
>> > > does not see them
>> > > having time to do it soon, and suggests we go with 1.
>> > >
>> > > I will openly admit to ignorance about apache subproject or other
>> > > things
>> > > that might come into play here.
>> > >
>> > > I think that 1 is the best option in the near term, and if we can
>> > > socialize
>> > > and see that there is a demand we can move forward with 2/3 down the
>> > > road.
>> > >
>> > > ??
>> > > Discuss
>> > > Profit
>> > >
>> > >
>> > >
>> > >
>> >
>> >
---
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
process. This should enable better productivity.
Being a PMC member enables assistance with the management
and to guide the direction of the project.
---
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
process. This should enable better productivity.
Being a PMC member enables assistance with the management
and to guide the direction of the project.
---
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
+1 (binding)
13.03.2017, 15:37, "James Sirota" :
> Do we feel it's time for us to exit the Apache incubator and petition to make
> Metron a TLP?
>
> Please vote 1 for yes, -1 for no, 0 for neutral.
>
> The vote will be open for 72 hours
>
> ------
Do we feel it's time for us to exit the Apache incubator and petition to make
Metron a TLP?
Please vote 1 for yes, -1 for no, 0 for neutral.
The vote will be open for 72 hours
---
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
+1 (binding)
13.03.2017, 15:34, "James Sirota" :
> This vote is to make Casey Stella our VP after graduation
>
> ---
> Thank you,
>
> James Sirota
> PPMC- Apache Metron (Incubating)
> jsirota AT apache DOT org
---
Thank you,
This vote is to make Casey Stella our VP after graduation
---
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
continue with Metron. I am still very excited
> about Metron's probable graduation!
>
> Billie
>
> On Sun, Mar 12, 2017 at 8:52 PM, James Sirota wrote:
>
>> As we are getting ready to graduate I wanted to poll the mentors and see
>> who wanted to stay on with
I would like to propose that Casey Stella be our VP upon graduation. I think
has been the most outspoken proponent of the "Apache way" on our project and
has made very significant contributions to moving it forward.
---
Thank you,
James Sirota
PPMC- Apa
ichael Perez
Charles Porter
Phillip Rhodes
Sean Schulte
James Sirota
Casey Stella
Bryan Taylor
Ray Urciuoli
Vinod Kumar Vavilapalli
George Vetticaden
Oskar Zabik
David Lyle
Nick Allen
otto
Kyle Richardson
Justin Leet
Michael Miklavcic
NOW, THEREFORE, BE IT FURTHER RESOLVED, that [TBD]
be appoin
As we are getting ready to graduate I wanted to poll the mentors and see who
wanted to stay on with the project after our graduation. You guys did a great
job with us and I personally would love to see you stay on.
---
Thank you,
James Sirota
PPMC- Apache Metron (Incubating
gt; components
>>>> > etc
>>>> > * metron-parser-base
>>>> > * This has the Grok, CSV, and JsonMap parsers and support
>>>> > * metron-parser-X
>>>> > * A module per parser type which we currently have in the system
>>>> > * Each parser has all the indexing, enrichment and parser
>>>> > configurations
>>>> > for that parser in its package
>>>> >
>>>> > I will go into packaging and deployment issues in another email.
>>>> >
>>>> > I have this all working:
>>>> > * the parsers are built
>>>> > * the parsers are tested
>>>> > * the parsers are integrated into the deployment build such that
>>>> > vagrant up
>>>> > just works as previously in full and quick dev
>>>> > * maven component of rpm docker
>>>> > * the metron.spec file
>>>> > * ambari installation
>>>> > * zookeeper configuration deployment
>>>> > * the ambari parser service code
>>>> > * the Rest interface works
>>>> > * see all installed parser configurations etc
>>>> >
>>>> >
>>>> > So this part of the work, is I think ready for a PR and review/next
>>>> > steps
>>>> > on it’s own.
>>>> >
>>>> > I think that it sets up the components and is a base for building out
>>>> > the
>>>> > rest of the functionality we want.
>>>> >
>>>> >
>>>> >
---
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
Github user james-sirota commented on the issue:
https://github.com/apache/incubator-metron/pull/470
+1
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
Github user james-sirota commented on the issue:
https://github.com/apache/incubator-metron/pull/471
+1 i agree thats a great idea. Should this be on the wiki or version
controlled? The other two docs this refers to are on the wiki. we should
probably be consistent. either
Github user james-sirota commented on the issue:
https://github.com/apache/incubator-metron/pull/453
Hi guys, this PR is built on one fundamental assumption: kafka is always
available. The source of truth for errors, therefore, is a kafka topic. In a
production setting errors
bator/metron/0.3.
>> >> >>>>>> 1-RC5-incubating/CHANGES
>> >> >>>>>>
>> >> >>>>>> The tag/commit to be voted upon is apache-metron-0.3.1-rc5-
>> >> >>> incubating:
>> >> >>>>>> https://git-wip-us.apache.org/repos/asf?p=incubator-metron.
>> >> >>>>>> git;a=shortlog;h=refs/tags/apache-metron-0.3.1-rc5-
>> incubating
>> >> >>>>>>
>> >> >>>>>> The source archive being voted upon can be found here:
>> >> >>>>>> https://dist.apache.org/repos/dist/dev/incubator/metron/0.3.
>> >> >>>>>> 1-RC5-incubating/apache-metron-0.3.1-rc5-incubating.tar.gz
>> >> >>>>>>
>> >> >>>>>> Other release files, signatures and digests can be found
>> here:
>> >> >>>>>> https://dist.apache.org/repos/dist/dev/incubator/metron/0.3.
>> >> >>>>>> 1-RC5-incubating/
>> >> >>>>>>
>> >> >>>>>> The release artifacts are signed with the following key:
>> >> >>>>>> https://git-wip-us.apache.org/repos/asf?p=incubator-metron.
>> >> >>>>>> git;a=blob;f=KEYS;h=8381e96d64c249a0c1b489bc0c234d
>> >> >>>>> 9c260ba55e;hb=refs/tags/
>> >> >>>>>> apache-metron-0.3.1-rc5-incubating
>> >> >>>>>>
>> >> >>>>>> The book associated with this RC is located at
>> >> >>>>>> https://dist.apache.org/repos/dist/dev/incubator/metron/0.3.
>> >> >>>>>> 1-RC5-incubating/book-site/index.html
>> >> >>>>>>
>> >> >>>>>> Please vote on releasing this package as Apache Metron
>> 0.3.1-RC5
>> >> >>>>> incubating
>> >> >>>>>>
>> >> >>>>>> When voting, please list the actions taken to verify the
>> release.
>> >> >>>>>>
>> >> >>>>>> Recommended build validation and verification instructions
>> are
>> >> >> posted
>> >> >>>>> here:
>> >> >> https://cwiki.apache.org/confluence/display/METRON/
>> Verifying+Builds
>> >> >>>>>>
>> >> >>>>>>
>> >> >>>>>> This vote will be open for at least 72 hours.
>> >> >>>>>>
>> >> >>>>>> [ ] +1 Release this package as Apache Metron 0.3.1-RC5
>> incubating
>> >> >>>>>>
>> >> >>>>>> [ ] 0 No opinion
>> >> >>>>>>
>> >> >>>>>> [ ] -1 Do not release this package because...
>> >> >>
>> >>
>> >
>> >
---
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
contribution to the
project since there is no need to go via the patch
submission process. This should enable better productivity.
Being a PMC member enables assistance with the management
and to guide the direction of the project.
23.02.2017, 13:14, "James Sirota" :
> The Podling Proje
submission process. This should enable better productivity.
Being a PMC member enables assistance with the management
and to guide the direction of the project.
---
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
Github user james-sirota commented on the issue:
https://github.com/apache/incubator-metron/pull/453
I think for a single node this is not an issue because all your storm logs
are in the same place so you can just pipe to grep. This feature is meant to
address gathering errors from
Github user james-sirota commented on the issue:
https://github.com/apache/incubator-metron/pull/453
I lean toward having a separate kafka queue for errors. Errors are lower
in volume, but are a lot more verbose. You are essentially indexing large text
document when you do this and
>
>> >> >>>> On February 17, 2017 at 13:22:45, Simon Elliston Ball (
>> >> >> si...@simonellistonball.com <mailto:si...@simonellistonball.com>)
>> wrote:
>> >> >>>>
>> >> >>>> A little while
;>> works fine in Ambari today, but I could be convinced otherwise.
>> >>>>>
>> >>>>>
>> >>>>>
>> >>>>> On Wed, Feb 1, 2017 at 9:51 AM, Dima Kovalyov <
>> dima.koval...@sstech.us
>> >>>
>> >>>>> wrote:
>> >>>>>
>> >>>>>> Thank you Houshang,
>> >>>>>>
>> >>>>>> That looks absolutely great, loved it!
>> >>>>>> Will it make sense to also add ElasticSearch index templates
>> >>>>>> querying/creation here?
>> >>>>>>
>> >>>>>> - Dima
>> >>>>>>
>> >>>>>> On 02/01/2017 02:06 AM, Houshang Livian wrote:
>> >>>>>>> Hello Metron Community,
>> >>>>>>>
>> >>>>>>> We have constructed a Management Module UI, built on top of
>> >> METRON-503
>> >>>>>> (REST API) (currently under review). This Module gives users the
>> >> ability to
>> >>>>>> setup and administer much of the product through the UI.
>> >>>>>>>
>> >>>>>>> Here are some screens to show you what we are thinking. Please
>> take a
>> >>>>>> look:
>> >>>>>>> http://imgur.com/a/QAQyu?
>> >>>>>>>
>> >>>>>>> Does this look like a reasonable place to start?
>> >>>>>>> Is there anything that is an absolute MUST have or MUST NOT have?
>> >>>>>>>
>> >>>>>>> Houshang Livian
>> >>>>>>> Senior User Experience Designer
>> >>>>>>> Hortonworks
>> >>>>>>>
>> >>>>>>> www.hortonworks.com<http://www.hortonworks.com/>
>> >>>>>>>
>> >>>>>>>
>> >>>>>>> Mobile: (831) 521-4176
>> >>>>>>> hliv...@hortonworks.com<mailto:hliv...@hortonworks.com>
>> >>>>>>>
>> >>>>>>>
>> >>>>>>>
>> >>>>>>
>> >>>>>>
>> >>>>>
>> >>>>>
>> >>>>> --
>> >>>>> Nick Allen
>> >>>>
>> >>>
>> >>
>> > --
>> >
>> > Jon
>> >
>> > Sent from my mobile device
>>
>> --
>
> Jon
>
> Sent from my mobile device
---
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
de or modify the sample
>> * build
>> * run the installer script or the ui to upload/deploy the package
>> * use the console or ui to create an instance
>>
>> QUESTIONS:
>> * it seems strange to have this as ‘parsers’ when conceptually parsers
>
> are
>> a part of the whole, should we introduce something like ‘source’ that is
>> all of it?
>> * should configurations etc be in ZK or on disk? or HDFS? or All of the
>> above?
>> * did you read this far? good!
>> * I am sure that after hitting send I will think of 10 things that are
>> missing from this
>>
>> I have started a POC of this, and thus far have created
>> metron-parsers-common and started breaking out metron-parser-asa.
>> I will continue to work through some of this here
>> https://github.com/ottobackwards/incubator-metron/tree/METRON-258
>>
>> Again, thank you for your time and feedback.
---
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
Github user james-sirota commented on the issue:
https://github.com/apache/incubator-metron/pull/438
I think a better approach is to bake in an enforcement layer within Metron
to only allow flat maps (key-value pairs where the value cannot be a complex
object). You would enforce
Github user james-sirota commented on a diff in the pull request:
https://github.com/apache/incubator-metron/pull/449#discussion_r100719426
--- Diff:
metron-analytics/metron-profiler/src/main/java/org/apache/metron/profiler/bolt/KafkaDestinationHandler.java
---
@@ -0,0 +1,78
Github user james-sirota commented on the issue:
https://github.com/apache/incubator-metron/pull/450
I think taking the string as an argument is really powerful, but it's also
really flexible. "1 hour window every 24 hours starting from 14 days ago
including the current
Github user james-sirota commented on the issue:
https://github.com/apache/incubator-metron/pull/450
I think the API looks great. Can we provide a grammar in the comments for
constructing the PROFILE_WINDOW function? I think the API is so flexible that
it may be hard to wrap your
; Recommended build validation and verification instructions are posted here:
> https://cwiki.apache.org/confluence/display/METRON/Verifying+Builds
>
> This vote will be open for at least 72 hours.
>
> [ ] +1 Release this package as Apache Metron 0.3.1-RC4 incubating
>
> [ ] 0 No opinion
>
Github user james-sirota commented on the issue:
https://github.com/apache/incubator-metron/pull/451
+1 via inspection. This is a great contribution. Thanks, Simon. I think
it would be nice to get more test data from different instances of Arcsight.
Does anyone in the community
Github user james-sirota commented on a diff in the pull request:
https://github.com/apache/incubator-metron/pull/451#discussion_r100716097
--- Diff:
metron-platform/metron-parsers/src/test/java/org/apache/metron/parsers/cef/CEFParserTest.java
---
@@ -0,0 +1,186
Github user james-sirota commented on a diff in the pull request:
https://github.com/apache/incubator-metron/pull/451#discussion_r100715818
--- Diff:
metron-platform/metron-parsers/src/main/java/org/apache/metron/parsers/cef/CEFParser.java
---
@@ -0,0 +1,274
Github user james-sirota commented on a diff in the pull request:
https://github.com/apache/incubator-metron/pull/451#discussion_r100716155
--- Diff:
metron-platform/metron-parsers/src/test/resources/org/apache/metron/parsers/cef/adallom.cef
---
@@ -0,0 +1 @@
+2016-04-01T09
Github user james-sirota commented on the issue:
https://github.com/apache/incubator-metron/pull/452
+1 by inspection. thanks for catching this, simon
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does
tectural or project decisions were made during this meeting.
10.02.2017, 13:12, "Kyle Richardson" :
> Great! Glad it will be available. Like Jon, I had a conflict today.
>
> -Kyle
>
>> On Feb 10, 2017, at 2:10 PM, James Sirota wrote:
>>
>> Thats
g with
>> a
>> > > Kafka sensor and doing basic enrichment.
>> > >
>> > > Thanks & Regards,
>> > > Jimson James
>> > >
>> > > On Wed, Feb 8, 2017 at 1:47 AM, Matt Foley wrote:
>> > >
>> > > > I
Github user james-sirota commented on a diff in the pull request:
https://github.com/apache/incubator-metron/pull/438#discussion_r100599107
--- Diff:
metron-platform/metron-enrichment/src/main/java/org/apache/metron/enrichment/bolt/ThreatIntelJoinBolt.java
---
@@ -133,14 +136,18
Github user james-sirota commented on the issue:
https://github.com/apache/incubator-metron/pull/446
+1 great job fixing this
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
-RC2 incubating
>
> When voting, please list the actions taken to verify the release.
>
> Recommended build validation and verification instructions are posted here:
> https://cwiki.apache.org/confluence/display/METRON/Verifying+Builds
>
> This vote will be open for at least 72 hours.
>
> [ ] +1 Release this package as Apache Metron 0.3.1-RC2 incubating
>
> [ ] 0 No opinion
>
> [ ] -1 Do not release this package because...
---
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
---
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
>> https://cwiki.apache.org/confluence/display/METRON/Verifying+Builds
>>
>> This vote will be open for at least 72 hours.
>>
>> [ ] +1 Release this package as Apache Metron 0.3.1-RC1 incubating
>>
>> [ ] 0 No opinion
>>
>> [ ] -1 Do not release this package because...
---
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
; > ./metron-analytics/metron-profiler-client/README.md
> > > > > > > > ./metron-analytics/metron-statistics/README.md
> > > > > > > > ./metron-deployment/README.md
> > > > > > > > ./metron-deployment/amazon-ec2/README.md
> > > >
t; > > binSize - The size of the lookback bin
>>> > > > -
>>> > > >
>>> > > > binUnits - The units of the lookback bin
>>> > > >
>>> > > > Given the number of arguments and their complexity a
Lyle
>> > > > >
>> > > > > wrote:
>> > > > >
>> > > > >
>> > > > > The bolded didn't come through, but I'm guessing it's here:
>> > > > >
>> > > > > *If the contribution
Github user james-sirota commented on a diff in the pull request:
https://github.com/apache/incubator-metron/pull/429#discussion_r98728815
--- Diff: site-book/bin/generate-md.sh ---
@@ -190,7 +190,13 @@ cd site-book/src/site/markdown
# Rewrite hrefs for resource references
Github user james-sirota commented on the issue:
https://github.com/apache/incubator-metron/pull/427
+1 Great job
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
y than 4. Thoughts?
>
> Ryan
>
> On Mon, Jan 23, 2017 at 5:44 PM, zeo...@gmail.com wrote:
>
>> In that case the hash would be of the value in the IP field, such as
>> sha3(8.8.8.8).
>>
>> Jon
>>
>> On Mon, Jan 23, 2017, 6:41 PM James Sirota w
graduation?
---
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
, a hash gives
> us some protection that the issue will not occur twice.
>
> Jon
>
> On Mon, Jan 23, 2017, 2:47 PM James Sirota wrote:
>
> Jon,
>
> With regards to 1, collapsing to a single dashboard for each would be
> fine. So we would have one error index and o
')
>>
>> *The same time window every sunday for the last month starting one hour ago
>> skipping holidays*
>>
>> Just to make this as clear as possible, if this is run at 3PM on Monday
>> January 22rd, 2017, it would include the following bins:
>>
, this would look like:
>
> PROFILE_LOOKBACK( { 'from' : 1, 'fromUnits' : 'HOURS', 'to' : 1, 'toUnits'
> : 'MONTH', 'including' : [ 'tuesday'], 'excluding' : [ 'holidays' ],
> 'binSi
ave back
> to back failures (i.e. instead of storing the value itself). Additionally,
> I think it's helpful to be able to search all times there was an indexing
> error (instead of it hitting the catch-all).
>
> Jon
>
> On Fri, Jan 20, 2017 at 1:17 PM James Sirota wrote:
&g
otentially add a hash of the content that failed validation to
> help identify repeats over time with less of a concern that you'd have back
> to back failures (i.e. instead of storing the value itself). Additionally,
> I think it's helpful to be able to search all times there was
Sorry that's a typo. Was meant to be 10. Just fixed
20.01.2017, 13:22, "zeo...@gmail.com" :
> -1 (non-binding).
>
> There appears to be a minor oversight where it goes from Step 9 to Step 14.
>
> Jon
>
> On Fri, Jan 20, 2017 at 11:56 AM James Sirota wrote:
enience
> binaries are documented to not be warranted or guaranteed in any way.”
> It might be advisable to check the documentation to confirm (b).
>
> QU30 – “identified addressed” – insert “and”
> “the Metron's” – delete “the”
>
> QU50 – “Metorn” – should
--Generic catch-all for all other errors
For validation reporting:
--What part of message failed validation
--What stellar validator caused the failure
---
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
change flag on the issue's JIRA is set appropriately for this
patch
For incompatible changes, major features/improvements, and other release
notable issues, the Release Note field has a sufficient comment
---
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
---
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
n
created.
The release manager has a responsibility to review all commits to the
maintenance line since last release, and make sure they were duplicated to the
feature branch (unless not relevant, which must also be determined).
---
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
3 binding +1 (james, kyle, casey), 1 non-binding +1 (matt)
Thanks for voting
James
20.01.2017, 09:33, "James Sirota" :
> +1 (binding)
>
> 18.01.2017, 13:03, "Matt Foley" :
>> +1 (non-binding)
>>
>> BTW, here is a collection of small editoria
, but the 72 hour waiting period
> can be waved.”
> Should be changed to:
> “Second, if a critical JIRA comes in that requires an immediate
> patch, the votes with three binding +1's are still required, but Step 1
> (discussion) and Step 2 (Jira collecting and tracki
The vote passes with 3 binding +1 votes (James, Casey, Nick), 4 non-binding
+1s, (matt, JJ, Anand, Jon), and a 0 from Kyle
Thanks everyone for voting
18.01.2017, 06:15, "Nick Allen" :
> +1 binding
>
> On Thu, Jan 5, 2017 at 5:41 PM, James Sirota wrote:
>
>>
Right now we have 2 entries for Metron Community. One on our Wiki, which I
think is outdated and should be removed as it no longer offers value. The
second is on our website, which is up to date. So I am proposing we remove the
wiki entry.
---
Thank you,
James Sirota
Github user james-sirota commented on the issue:
https://github.com/apache/incubator-metron/pull/399
@mattf-horton does this adequately meet your concerns?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
ey wrote:
>> > >>>
>> > >>> +1 (non-binding)
>> > >>>
>> > >>> One typo is still in there:
>> > >>>>> After discussion of the issue on the JIRA if it is clear that you
>> > >>> fo
Documentation
Revisions in Tutorials
Developer Guide
Expansions in readme's
Changes to System Interfaces
Stellar Shell
REST APIs
Etc...
think that is good enough?
Thanks,
James
16.01.2017, 13:47, "Matt Foley" :
> +1 to both.
>
> On 1/16/17, 12:02 PM, "James Sirota&q
maintenance line since last release, and make sure they were duplicated to the
feature branch (unless not relevant, which must also be determined).
---
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
; Consistency
> > > > > between Feature and Maint Releases), which are very good.
> > > > >
> > > > > One major issue: Step 4 says:
> > > > > >> Now, we must grab the release candidate binary from the github
>
an immediate patch we may forego
>>> steps 2-5 and immediately cut the MR release. A critical JIRA is something
>>> that is either a security vulnerability or a functional show stopper .
>>
>> Do maintenance releases or releases that are due to urgent security issues
>> still have to go through the normal apache voting process?
>>
>> Casey
---
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
I’d love if I could get anyone involved here to
> represent the project and present, co-present with me, or just hang around
> at the event. Again, this is in Pittsburgh PA, Feb 9th in the evening
> starting around 7pm.
>
> Jon
>
> On Fri, Nov 4, 2016 at 1:16 PM James Sirota w
; > >> > > > 2 and 3. You'd end up with one kafka queue
>> > > with 3
>> > > > &g
rgets to pull the configs from zookeeper to disk, before
>>> they do
>>> a push via zk_load_utils, they will clobber the configs in zookeeper
>>> with
>>> old configs.
>>> - If the global config is changed on disk and the ambari service
>>&
t;>> by
> > > > > >>>>>> MySQL (the connectors are LGPL licensed and we need to
> sever
> > our
> > > > > Maven
> > > > > >>>>>> dependency on it before next release). We currently depend
&g
If no one has additional comments on this document i'll go ahead and put it up
for a vote...
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=66854770
10.01.2017, 12:50, "James Sirota" :
> Hi Larry,
>
> Thanks for the comments. I beefed up the technica
ounting on others like Nick
>> > or Casey
>> > > to understand anything that may be missing from a submission when I
>> > review
>> > > it. Should there by an Ambari/RPM change? Does this change the
>> > RestAPI?
>> > > Does this effect STELLAR Lang/SHELL? Does it need customer Docker
>> > Compose
>> > > work? etc etc.
>> > >
>> > > I think as we grow the community and try to get out of incubation
>> it
>> > will
>> > > be impractical for us to count on this, and we are even now
>> > increasing the
>> > > risk of regression or functional gaps ( unrealized ) that will have
>> > an
>> > > adverse effect on having a stable master.
>> > >
>> > > I think we should discuss if and how we can improve this or the
>> > issue of my
>> > > sanity ;).
>> > >
>> > > What are the criteria that we need to have submitters and reviewers
>> > have in
>> > > mind?
>> > > * Test
>> > > * Doc
>> > > ** Obsoleting of existing documentation/how-to’s ( even hortonworks
>> > posts )
>> > > * Performance
>> > > ** How do we test for performance?
>> > > *** Standards
>> > > *** Tools and processes
>> > > * Deployment
>> > > ** RPM
>> > > ** Docker
>> > > ** Ansible
>> > > ** Ambari
>> > > ** AWS Script
>> > > * Functional
>> > > ** STELLAR/Shell
>> > > ** REST api’s
>> > > * Dev/review guide
>> > > ** Does the review / submit guide need to account for it?
>> > >
>> > > Any thoughts?
>> > >
>> >
>> >
>> >
>> >
>> >
---
Thank you,
James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org
1 - 100 of 441 matches
Mail list logo