Re: MaaS + Apache Twill ?

2017-04-18 Thread James Sirota
>>  > - Service discovery >>  > - Elastic scaling >>  > - High Availability >>  > - Placement policies - Which rack/host should the model run on? >>  > - Security - Kerberos ticket refresh? >>  > >>  > Just wanted to float the thought in the community and see if anyone has >>  > experience with Twill. I need to do some more research myself. >>  > >>  > [1] http://twill.apache.org/ >>  > ---  Thank you, James Sirota PPMC- Apache Metron (Incubating) jsirota AT apache DOT org

Re: [DISCUSS] MPack components that don't support Kerberos

2017-04-13 Thread James Sirota
s://github.com/apache/incubator-metron/pull/500). >>>  > >>>  > However, the REST application currently does not work in a kerberized >>>  > environment. That work has already started so it won't be an issue for >>>  > long but how should we handle situations like this in the future where >>>  we >>>  > want to add a service but it's not quite ready for Kerberos? Should >>>  > Kerberos support be a prerequisite before it's added to the MPack? >>>  Should >>>  > we look at ways to make these services optional? Any other thoughts or >>>  > ideas? >>>  > >>>  > Ryan >>>  > ---  Thank you, James Sirota PPMC- Apache Metron (Incubating) jsirota AT apache DOT org

[GitHub] incubator-metron issue #525: METRON-845 Increment build number to 0.4.0

2017-04-11 Thread james-sirota
Github user james-sirota commented on the issue: https://github.com/apache/incubator-metron/pull/525 + 1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

Re: [DISCUSS] next release proposal

2017-04-11 Thread James Sirota
in, but not before Monday) >>  > > will >>  > > > surely >>  > > > > be included in the RC, unless something has a bug that can’t be >>  > > > readily >>  > > > > resolved. >>  > > > > >>  > &g

[GitHub] incubator-metron issue #489: METRON-623: Management UI

2017-04-07 Thread james-sirota
Github user james-sirota commented on the issue: https://github.com/apache/incubator-metron/pull/489 +1 Just verified via squid example on a running cluster. Was able to create and modify squid pattern, deploy topology, modify topology, start/stop/edit, modify configs. Upon

Re: [MENTORS] Minified javascript license

2017-04-05 Thread James Sirota
dvance for any help or advice you can give me. I am not able to > find a clear example or explanation and want to make sure this gets done > correctly. > > Ryan Merriman ---  Thank you, James Sirota PPMC- Apache Metron (Incubating) jsirota AT apache DOT org

Re: [DISCUSS] The bro kafka plugin

2017-04-05 Thread James Sirota
;>>>  > > > > > wrote: >>>>  > > > > > > >>>>  > > > > > > > So, I do agree with the concern. Is there a way to >>>>  host the >>>>  > > > package >>>>  > > > > > > > within Metron? I definitely would like to see the >>>>  > > > modifications at >>>>  > > > > > > > https://github.com/bro/bro-plu >>>>  gins/commit/b9f1f35415cb0db >>>>  > > > > > > > 065348da0a5043a8353b4a0a8 brought back into Metron and >>>>  I'd >>>>  > > > love for >>>>  > > > > us >>>>  > > > > > to >>>>  > > > > > > > host the plugin. >>>>  > > > > > > > >>>>  > > > > > > > Thoughts? >>>>  > > > > > > > >>>>  > > > > > > > >>>>  > > > > > > > On Thu, Mar 30, 2017 at 9:09 PM, zeo...@gmail.com < >>>>  > > > zeo...@gmail.com> >>>>  > > > >>>>  > > > > > > > wrote: >>>>  > > > > > > > >>>>  > > > > > > >> Today I was taking a look at METRON-812 >>>>  > > > > > > >> <https://issues.apache.org/jira/browse/METRON-812>, >>>>  which >>>>  > > > made me >>>>  > > > > > > recall >>>>  > > > > > > >> some conversations from a while back regarding where >>>>  the >>>>  > bro >>>>  > > > kafka >>>>  > > > > > > plugin >>>>  > > > > > > >> should ultimately live, and how to update it. >>>>  > > > > > > >> >>>>  > > > > > > >> Back in METRON-348 <https://issues.apache.org/ >>>>  > > > > jira/browse/METRON-348> >>>>  > > > > > I >>>>  > > > > > > >> brought up the fact that some important changes >>>>  > > > > > > >> <https://github.com/bro/bro-plugins/commit/ >>>>  > > b9f1f35415cb0db06 >>>>  > > > > > > >> 5348da0a5043a8353b4a0a8> >>>>  > > > > > > >> were made to the externally hosted version of the >>>>  kafka >>>>  > > > plugin, >>>>  > > > and >>>>  > > > > > were >>>>  > > > > > > >> never introduced to Metron's hosted version (i.e. the >>>>  one >>>>  > we >>>>  > > > use >>>>  > > > > > > >> <https://github.com/apache/inc >>>>  ubator-metron/blob/master/ >>>>  > > metr >>>>  > > > > > > >> on-deployment/roles/bro/tasks/bro-plugin-kafka.yml> >>>>  > > > > > > >> in vagrant when bro is installed). The conversation >>>>  went >>>>  > > down >>>>  > > > the >>>>  > > > > > route >>>>  > > > > > > >> of >>>>  > > > > > > >> discussing whether or not the bro kafka plugin code >>>>  should >>>>  > > > continue >>>>  > > > > to >>>>  > > > > > > >> live >>>>  > > > > > > >> in Metron in the first place. Now, with METRON-812, I >>>>  see >>>>  > us >>>>  > > > > further >>>>  > > > > > > >> muddying the waters of where to go for the right >>>>  plugin, >>>>  > as >>>>  > > > our >>>>  > > > > > version >>>>  > > > > > > is >>>>  > > > > > > >> still missing the public changes but adds some very >>>>  > > important >>>>  > > > new >>>>  > > > > > > >> functionality. >>>>  > > > > > > >> >>>>  > > > > > > >> I'd like to bring up the idea of using bro's packages >>>>  > > > > > > >> <https://github.com/bro/packages> framework, >>>>  released in >>>>  > > > late 2016 >>>>  > > > > > > >> < >>>>  > > > http://blog.bro.org/2016/10/introducing-bro-package-manager.html> >>>>  > > > > > > >> (additional >>>>  > > > > > > >> documentation here < >>>>  > > > > > > http://bro-package-manager.readthedocs.io/en/stable/ >>>>  > > > > > > >> >), >>>>  > > > > > > >> as a potential place for this to be hosted/referenced. >>>>  > This >>>>  > > > is a >>>>  > > > > > simple >>>>  > > > > > > >> and supported method (funded by Mozilla >>>>  > > > > > > >> <https://blog.mozilla.org/blog >>>>  /2015/12/10/mozilla-open- >>>>  > > sourc >>>>  > > > > > > >> e-support-first-awards-made/>) >>>>  > > > > > > >> to install and uninstall bro scripts, plugins, etc., >>>>  and >>>>  > it >>>>  > > > also >>>>  > > > > > allows >>>>  > > > > > > us >>>>  > > > > > > >> to continue to have enough control over updates to the >>>>  > > plugin >>>>  > > > so >>>>  > > > > that >>>>  > > > > > it >>>>  > > > > > > >> will not slow down Metron development by having it as >>>>  a >>>>  > > > dependency >>>>  > > > > > > >> (resolving both of Casey's concerns noted here >>>>  > > > > > > >> <https://issues.apache.org/jira/browse/METRON-348? >>>>  > > focusedCom >>>>  > > > > > > >> mentId=15391865&page=com.atlas >>>>  sian.jira.plugin.system. >>>>  > > > > > > >> issuetabpanels:comment-tabpanel#comment-15391865>, >>>>  > > > > > > >> and I think this solution is supported by Nick's >>>>  comments >>>>  > > here >>>>  > > > > > > >> <https://issues.apache.org/jira/browse/METRON-348? >>>>  > > focusedCom >>>>  > > > > > > >> mentId=15391872&page=com.atlas >>>>  sian.jira.plugin.system. >>>>  > > > > > > >> issuetabpanels:comment-tabpanel#comment-15391872> >>>>  > > > > > > >> as >>>>  > > > > > > >> well). >>>>  > > > > > > >> >>>>  > > > > > > >> The only thing I'm not sure about is where to host the >>>>  > > plugin >>>>  > > > itself >>>>  > > > > - >>>>  > > > > > > my >>>>  > > > > > > >> first thought would be Nick's github < >>>>  > > > https://github.com/nickwallen >>>>  > > > > >, >>>>  > > > > > > as >>>>  > > > > > > >> he >>>>  > > > > > > >> really kicked off this effort, but maybe we can think >>>>  of >>>>  > > > something >>>>  > > > > > > better. >>>>  > > > > > > >> >>>>  > > > > > > >> Is this approach of interest to anybody? It is >>>>  extremely >>>>  > > > simple to >>>>  > > > > > put >>>>  > > > > > > >> together - I was able to throw one together >>>>  > > > > > > >> <https://github.com/bro/packages/blob/master/ >>>>  > > > > jonzeolla/bro-pkg.index> >>>>  > > > > > > and >>>>  > > > > > > >> get it working with a fresh bro 2.5 install when >>>>  attending >>>>  > > the >>>>  > > > > brocon >>>>  > > > > > > talk >>>>  > > > > > > >> < >>>>  > https://www.bro.org/brocon2016/brocon2016_abstracts.html# >>>>  > > > > > > >> bro-packagemanager> >>>>  > > > > > > >> (recording <https://www.youtube.com/watch >>>>  ?v=9RFfPJeGkcE>, >>>>  > > > slides >>>>  > > > > > > >> <https://www.bro.org/brocon2016/slides/hall_bpm.pdf>) >>>>  > that >>>>  > > > > introduced >>>>  > > > > > > >> this >>>>  > > > > > > >> to me in the first place. >>>>  > > > > > > >> >>>>  > > > > > > >> Jon >>>>  > > > > > > >> -- >>>>  > > > > > > >> >>>>  > > > > > > >> Jon >>>>  > > > > > > >> >>>>  > > > > > > > >>>>  > > > > > > > >>>>  > > > > > > >>>>  > > > > > -- >>>>  > > > > > >>>>  > > > > > Jon >>>>  > > > > > >>>>  > > > > >>>>  > > > > -- >>>>  > > > > >>>>  > > > > Jon >>>>  > > > > >>>>  > > > >>>>  > > > -- >>>>  > > > >>>>  > > > Jon >>>>  > > > >>>>  > > > >>>>  > > > >>>>  > > > -- >>>>  > > > >>>>  > > > Jon >>>>  > > > >>>>  > > > -- >>>>  > > > >>>>  > > > Jon >>>>  > > > >>>>  > > -- >>>>  > > >>>>  > > Jon >>>>  > > >>>>  > >>>>  -- >>>> >>>>  Jon ---  Thank you, James Sirota PPMC- Apache Metron (Incubating) jsirota AT apache DOT org

Re: Podling Report Reminder - April 2017

2017-04-05 Thread James Sirota
bator wiki page. Signing off reports shows that you are > following the project - projects that are not signed may raise alarms > for the Incubator PMC. > > Incubator PMC ---  Thank you, James Sirota PPMC- Apache Metron (Incubating) jsirota AT apache DOT org

Re: [DISCUSS] next release proposal

2017-04-05 Thread James Sirota
; >>>  What do you-all think? >>>  Also, what additional work do you think should be included in this >>>  release, and can it realistically get done by the end of this week? The >>>  time frame is, of course, flexible at the pleasure of the community – but >>>  also, there will be another release in another couple months or so, so no >>>  need to rush stuff. >>> >>>  Thanks, >>>  --Matt >>> >>>  -- >> >>  Jon ---  Thank you, James Sirota PPMC- Apache Metron (Incubating) jsirota AT apache DOT org

[GitHub] incubator-metron issue #490: DO NOT MERGE METRON-797: Pass security.protocol...

2017-03-26 Thread james-sirota
Github user james-sirota commented on the issue: https://github.com/apache/incubator-metron/pull/490 I reviewed this with 793. I was able to validate this on a single-node Suse-based Hadoop cluster once with Kerberos disabled and second time with Kerberos enabled. That's a

[GitHub] incubator-metron issue #486: METRON-793: Migrate to storm-kafka-client kafka...

2017-03-26 Thread james-sirota
Github user james-sirota commented on the issue: https://github.com/apache/incubator-metron/pull/486 I was able to validate this on a single-node Suse-based Hadoop cluster once with Kerberos disabled and second time with Kerberos enabled. That's a good first step. I will try t

[MENTORS] initiating the TLP vote

2017-03-22 Thread James Sirota
Mentors, Looks like we have everything we need to initiate the incubator board vote to leave the incubator. Can you provide some guidance as to what is the best way to approach this? ---  Thank you, James Sirota PPMC- Apache Metron (Incubating) jsirota AT apache DOT org

[RESULT][VOTE] Final Board Resolution Draft V2

2017-03-22 Thread James Sirota
Vote passes with 4 binding +1s (casey, david, kyle, james) on to the next steps... 22.03.2017, 09:50, "James Sirota" : > + 1 (binding) > > 22.03.2017, 08:30, "Casey Stella" : >>  +1 binding >> >>  On Wed, Mar 22, 2017 at 11:23 AM, David Lyle wrot

Re: [VOTE] Final Board Resolution Draft V2

2017-03-22 Thread James Sirota
>> >>  > +1 (binding) >>  > >>  > On Mon, Mar 20, 2017 at 3:05 AM, James Sirota >>  wrote: >>  > >>  > > >>  > > - Removed affiliations >>  > > - Added apache IDs where possible >>  > > - Removed co

[VOTE] Final Board Resolution Draft V2

2017-03-20 Thread James Sirota
des (prhodes) Sean Schulte (sirsean) James Sirota (jsirota) Casey Stella (cstella) Bryan Taylor (UKNOWN) Ray Urciuoli(UKNOWN) Vinod Kumar Vavilapalli (vinodkv) George Vetticaden (gvetticaden) Oskar Zabik (smogg) David Lyle (lyle) Nick Allen (nickallen) NOW, THEREFORE, BE IT FURTHER RESOLVED, th

Re: [VOTE] Final Board Resolution Draft

2017-03-16 Thread James Sirota
s > - Remove the list of committers (only PMC members are listed in a graduation > resolution) > - You can drop the paragraph about bylaws since it’s not required and you > already have bylaws > > -Taylor > >>  On Mar 15, 2017, at 3:24 PM, James Sirota wrote: >> >>  P

Re: [VOTE] Final Board Resolution Draft

2017-03-15 Thread James Sirota
f committers (only PMC members are listed in a graduation > resolution) > - You can drop the paragraph about bylaws since it’s not required and you > already have bylaws > > -Taylor > >>  On Mar 15, 2017, at 3:24 PM, James Sirota wrote: >> >>  Please vote 1

[CANCEL] [VOTE] Final Board Resolution Draft

2017-03-15 Thread James Sirota
mitters (only PMC members are listed in a >>  graduation resolution) >>  - You can drop the paragraph about bylaws since it’s not required and you >>  already have bylaws >> >>  -Taylor >> >>  > On Mar 15, 2017, at 3:24 PM, James Sirota wrote: >&g

[VOTE] Final Board Resolution Draft

2017-03-15 Thread James Sirota
C: Mark Bittmann Sheetal Dolas Debo Dutta Discovery Gerdes P. Taylor Goetz Andrew Hartnett Dave Hirko Paul Kehrer Brad Kolarov Kiran Komaravolu Larry McCay Ryan Merriman Michael Perez Charles Porter Phillip Rhodes Sean Schulte James Sirota Casey Stella Bryan Taylor Ray Urciuoli Vinod Kumar Vavila

Re: [VOTE] Cesey Stella for Metron VP

2017-03-15 Thread James Sirota
The vote passes with 9 binding +1s and 4 non-binding +1s 14.03.2017, 09:22, "Billie Rinaldi" : > +1 binding > > On Mon, Mar 13, 2017 at 3:33 PM, James Sirota wrote: > >>  This vote is to make Casey Stella our VP after graduation >> >>  ------

Re: [VOTE] Metron to graduate to TLP

2017-03-15 Thread James Sirota
The vote passes with 10 binding +1s, 1 non-binding +1s, and 2 non-binding 0s 14.03.2017, 10:42, "P. Taylor Goetz" : > +1 (binding) > > -Taylor > >>  On Mar 13, 2017, at 6:37 PM, James Sirota wrote: >> >>  Do we feel it's time for us to exit the Apach

Re: AWS accounts question

2017-03-14 Thread James Sirota
, 09:42, "Otto Fowler" : > Does anyone have a recommendation for what type of AWS account to look and > cost if you wanted to > test metron aws deployment? ---  Thank you, James Sirota PPMC- Apache Metron (Incubating) jsirota AT apache DOT org

Re: [MENTORS][REQUEST] Please review the release currently going on in incubator-general

2017-03-14 Thread James Sirota
, need 2 more. > > On Thu, Mar 9, 2017 at 1:25 PM, Casey Stella wrote: > >>  Hi Mentors, >> >>  We have a release going on in incubator-general for around 10 days now >>  with no reviews. Would a couple of y'all mind reviewing for us? >> >>  T

Re: [DISCUSS][DRAFT] Board Resoluton

2017-03-14 Thread James Sirota
"Otto Fowler"? > > Justin > > On Mon, Mar 13, 2017 at 12:13 AM, James Sirota wrote: > >>  The incubating Apache Metron community believes it is time to graduate to >>  TLP. >> >>  Apache Metron entered incubation in December of 2015. Since then,

Re: [DISCUSS][DRAFT] Board Resoluton

2017-03-14 Thread James Sirota
>>  In the list of initial people, can we change "otto" to "Otto Fowler"? >> >>  Justin >> >>  On Mon, Mar 13, 2017 at 12:13 AM, James Sirota >>  wrote: >> >>  > The incubating Apache Metron community believe

Re: METRON-764 Daylight Savings Time bug in metron-profiler-client Unit Tests

2017-03-14 Thread James Sirota
gs, but it’s clearly reproducible. > > Will take a look to see if the cause is obvious. > --Matt ---  Thank you, James Sirota PPMC- Apache Metron (Incubating) jsirota AT apache DOT org

Re: [DISCUSS] SIDELOADING PARSERS: Packaging and Loading and Extensions [oh.my]

2017-03-14 Thread James Sirota
ectories vs. one extension dir are welcome ) >>  > > * the storm process only references metron-parsers-common >>  > > * the parser bolt uses the nar class loading system to load the > > parser >>  > > * the rest api uses the nar class loading system to load the parser >>  > > * etc etc >>  > > * a new version of a parser is deployed as a nar, when the service >>  > > restarts, the new nar is unpacked and replaces the old version in the >>  > > working system ( we could change the restart requirement ……) >>  > > >>  > > The nar system gives us something that is: >>  > > * production quality >>  > > * small enough to grok and extend as opposed to some other solutions >>  > > * comes with a highly accessible sister project >>  > > * maven plugin tooling to build >>  > > * reference archetype for packaging >>  > > and other things >>  > > >>  > > There are a few ways we could approach using Nar: >>  > > >>  > > 1. ‘fork’ and appropriate the components and ‘metronize’ them >>  > > * the maven plugin >>  > > * the nar-utils package >>  > > 2. Ask for and participate in an effort to pull NAR out into it’s own >>  > > project, >>  > > * make it more generic >>  > > * usable by more than one project >>  > > * goal to replace NiFi’s use of nar too >>  > > 3. Create our own generic version as a fork >>  > > * use it in metron >>  > > * submit to NiFi as a proposal >>  > > >>  > > MattF was nice enough to float this by Joe Witt, who is at > > Hortonworks >>  > > and >>  > > is the NiFi lead. >>  > > He agrees with the idea of making nar usable for multiple projects, > > but >>  > > does not see them >>  > > having time to do it soon, and suggests we go with 1. >>  > > >>  > > I will openly admit to ignorance about apache subproject or other >>  > > things >>  > > that might come into play here. >>  > > >>  > > I think that 1 is the best option in the near term, and if we can >>  > > socialize >>  > > and see that there is a demand we can move forward with 2/3 down the >>  > > road. >>  > > >>  > > ?? >>  > > Discuss >>  > > Profit >>  > > >>  > > >>  > > >>  > > >>  > >>  > ---  Thank you, James Sirota PPMC- Apache Metron (Incubating) jsirota AT apache DOT org

new committer: Matt Foley

2017-03-14 Thread James Sirota
process. This should enable better productivity. Being a PMC member enables assistance with the management and to guide the direction of the project. ---  Thank you, James Sirota PPMC- Apache Metron (Incubating) jsirota AT apache DOT org

new committer: Jon Zeolla

2017-03-14 Thread James Sirota
process. This should enable better productivity. Being a PMC member enables assistance with the management and to guide the direction of the project. ---  Thank you, James Sirota PPMC- Apache Metron (Incubating) jsirota AT apache DOT org

Re: [VOTE] Metron to graduate to TLP

2017-03-13 Thread James Sirota
+1 (binding) 13.03.2017, 15:37, "James Sirota" : > Do we feel it's time for us to exit the Apache incubator and petition to make > Metron a TLP? > > Please vote 1 for yes, -1 for no, 0 for neutral. > > The vote will be open for 72 hours > > ------

[VOTE] Metron to graduate to TLP

2017-03-13 Thread James Sirota
Do we feel it's time for us to exit the Apache incubator and petition to make Metron a TLP? Please vote 1 for yes, -1 for no, 0 for neutral. The vote will be open for 72 hours ---  Thank you, James Sirota PPMC- Apache Metron (Incubating) jsirota AT apache DOT org

Re: [VOTE] Cesey Stella for Metron VP

2017-03-13 Thread James Sirota
+1 (binding) 13.03.2017, 15:34, "James Sirota" : > This vote is to make Casey Stella our VP after graduation > > --- > Thank you, > > James Sirota > PPMC- Apache Metron (Incubating) > jsirota AT apache DOT org ---  Thank you,

[VOTE] Cesey Stella for Metron VP

2017-03-13 Thread James Sirota
This vote is to make Casey Stella our VP after graduation ---  Thank you, James Sirota PPMC- Apache Metron (Incubating) jsirota AT apache DOT org

Re: [MENTORS] POLL: Staying after graduation

2017-03-13 Thread James Sirota
continue with Metron. I am still very excited > about Metron's probable graduation! > > Billie > > On Sun, Mar 12, 2017 at 8:52 PM, James Sirota wrote: > >>  As we are getting ready to graduate I wanted to poll the mentors and see >>  who wanted to stay on with

[DISCUSS] Metron VP

2017-03-12 Thread James Sirota
I would like to propose that Casey Stella be our VP upon graduation. I think has been the most outspoken proponent of the "Apache way" on our project and has made very significant contributions to moving it forward. ---  Thank you, James Sirota PPMC- Apa

[DISCUSS][DRAFT] Board Resoluton

2017-03-12 Thread James Sirota
ichael Perez Charles Porter Phillip Rhodes Sean Schulte James Sirota Casey Stella Bryan Taylor Ray Urciuoli Vinod Kumar Vavilapalli George Vetticaden Oskar Zabik David Lyle Nick Allen otto Kyle Richardson Justin Leet Michael Miklavcic NOW, THEREFORE, BE IT FURTHER RESOLVED, that [TBD] be appoin

[MENTORS] POLL: Staying after graduation

2017-03-12 Thread James Sirota
As we are getting ready to graduate I wanted to poll the mentors and see who wanted to stay on with the project after our graduation. You guys did a great job with us and I personally would love to see you stay on. ---  Thank you, James Sirota PPMC- Apache Metron (Incubating

Re: [Discuss] SIDELOADING PARSERS: Parsers as components

2017-03-12 Thread James Sirota
gt; components >>>>  > etc >>>>  > * metron-parser-base >>>>  > * This has the Grok, CSV, and JsonMap parsers and support >>>>  > * metron-parser-X >>>>  > * A module per parser type which we currently have in the system >>>>  > * Each parser has all the indexing, enrichment and parser >>>>  > configurations >>>>  > for that parser in its package >>>>  > >>>>  > I will go into packaging and deployment issues in another email. >>>>  > >>>>  > I have this all working: >>>>  > * the parsers are built >>>>  > * the parsers are tested >>>>  > * the parsers are integrated into the deployment build such that >>>>  > vagrant up >>>>  > just works as previously in full and quick dev >>>>  > * maven component of rpm docker >>>>  > * the metron.spec file >>>>  > * ambari installation >>>>  > * zookeeper configuration deployment >>>>  > * the ambari parser service code >>>>  > * the Rest interface works >>>>  > * see all installed parser configurations etc >>>>  > >>>>  > >>>>  > So this part of the work, is I think ready for a PR and review/next >>>>  > steps >>>>  > on it’s own. >>>>  > >>>>  > I think that it sets up the components and is a base for building out >>>>  > the >>>>  > rest of the functionality we want. >>>>  > >>>>  > >>>>  > ---  Thank you, James Sirota PPMC- Apache Metron (Incubating) jsirota AT apache DOT org

[GitHub] incubator-metron issue #470: METRON-752 Fix documentation typos and MD issue...

2017-03-03 Thread james-sirota
Github user james-sirota commented on the issue: https://github.com/apache/incubator-metron/pull/470 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] incubator-metron issue #471: METRON-755 Update GitHub PR Template

2017-03-03 Thread james-sirota
Github user james-sirota commented on the issue: https://github.com/apache/incubator-metron/pull/471 +1 i agree thats a great idea. Should this be on the wiki or version controlled? The other two docs this refers to are on the wiki. we should probably be consistent. either

[GitHub] incubator-metron issue #453: METRON-694: Index Errors from Topologies

2017-03-02 Thread james-sirota
Github user james-sirota commented on the issue: https://github.com/apache/incubator-metron/pull/453 Hi guys, this PR is built on one fundamental assumption: kafka is always available. The source of truth for errors, therefore, is a kafka topic. In a production setting errors

Re: [VOTE] Releasing Apache Metron (incubating) 0.3.1-RC5

2017-02-25 Thread James Sirota
bator/metron/0.3. >>  >> >>>>>> 1-RC5-incubating/CHANGES >>  >> >>>>>> >>  >> >>>>>> The tag/commit to be voted upon is apache-metron-0.3.1-rc5- >>  >> >>> incubating: >>  >> >>>>>> https://git-wip-us.apache.org/repos/asf?p=incubator-metron. >>  >> >>>>>> git;a=shortlog;h=refs/tags/apache-metron-0.3.1-rc5- >>  incubating >>  >> >>>>>> >>  >> >>>>>> The source archive being voted upon can be found here: >>  >> >>>>>> https://dist.apache.org/repos/dist/dev/incubator/metron/0.3. >>  >> >>>>>> 1-RC5-incubating/apache-metron-0.3.1-rc5-incubating.tar.gz >>  >> >>>>>> >>  >> >>>>>> Other release files, signatures and digests can be found >>  here: >>  >> >>>>>> https://dist.apache.org/repos/dist/dev/incubator/metron/0.3. >>  >> >>>>>> 1-RC5-incubating/ >>  >> >>>>>> >>  >> >>>>>> The release artifacts are signed with the following key: >>  >> >>>>>> https://git-wip-us.apache.org/repos/asf?p=incubator-metron. >>  >> >>>>>> git;a=blob;f=KEYS;h=8381e96d64c249a0c1b489bc0c234d >>  >> >>>>> 9c260ba55e;hb=refs/tags/ >>  >> >>>>>> apache-metron-0.3.1-rc5-incubating >>  >> >>>>>> >>  >> >>>>>> The book associated with this RC is located at >>  >> >>>>>> https://dist.apache.org/repos/dist/dev/incubator/metron/0.3. >>  >> >>>>>> 1-RC5-incubating/book-site/index.html >>  >> >>>>>> >>  >> >>>>>> Please vote on releasing this package as Apache Metron >>  0.3.1-RC5 >>  >> >>>>> incubating >>  >> >>>>>> >>  >> >>>>>> When voting, please list the actions taken to verify the >>  release. >>  >> >>>>>> >>  >> >>>>>> Recommended build validation and verification instructions >>  are >>  >> >> posted >>  >> >>>>> here: >>  >> >> https://cwiki.apache.org/confluence/display/METRON/ >>  Verifying+Builds >>  >> >>>>>> >>  >> >>>>>> >>  >> >>>>>> This vote will be open for at least 72 hours. >>  >> >>>>>> >>  >> >>>>>> [ ] +1 Release this package as Apache Metron 0.3.1-RC5 >>  incubating >>  >> >>>>>> >>  >> >>>>>> [ ] 0 No opinion >>  >> >>>>>> >>  >> >>>>>> [ ] -1 Do not release this package because... >>  >> >> >>  >> >>  > >>  > ---  Thank you, James Sirota PPMC- Apache Metron (Incubating) jsirota AT apache DOT org

Re: new committer: Josh Meyer

2017-02-23 Thread James Sirota
contribution to the project since there is no need to go via the patch submission process. This should enable better productivity. Being a PMC member enables assistance with the management and to guide the direction of the project. 23.02.2017, 13:14, "James Sirota" : > The Podling Proje

new committer: Josh Meyer

2017-02-23 Thread James Sirota
submission process. This should enable better productivity. Being a PMC member enables assistance with the management and to guide the direction of the project. ---  Thank you, James Sirota PPMC- Apache Metron (Incubating) jsirota AT apache DOT org

[GitHub] incubator-metron issue #453: METRON-694: Index Errors from Topologies

2017-02-18 Thread james-sirota
Github user james-sirota commented on the issue: https://github.com/apache/incubator-metron/pull/453 I think for a single node this is not an issue because all your storm logs are in the same place so you can just pipe to grep. This feature is meant to address gathering errors from

[GitHub] incubator-metron issue #453: METRON-694: Index Errors from Topologies

2017-02-18 Thread james-sirota
Github user james-sirota commented on the issue: https://github.com/apache/incubator-metron/pull/453 I lean toward having a separate kafka queue for errors. Errors are lower in volume, but are a lot more verbose. You are essentially indexing large text document when you do this and

Re: [DISCUSS] Management of Elastic and other index schemas

2017-02-18 Thread James Sirota
> >>  >> >>>> On February 17, 2017 at 13:22:45, Simon Elliston Ball ( >>  >> >> si...@simonellistonball.com <mailto:si...@simonellistonball.com>) >>  wrote: >>  >> >>>> >>  >> >>>> A little while

Re: [DISCUSS] Metron Management UI

2017-02-18 Thread James Sirota
;>> works fine in Ambari today, but I could be convinced otherwise. >>  >>>>> >>  >>>>> >>  >>>>> >>  >>>>> On Wed, Feb 1, 2017 at 9:51 AM, Dima Kovalyov < >>  dima.koval...@sstech.us >>  >>> >>  >>>>> wrote: >>  >>>>> >>  >>>>>> Thank you Houshang, >>  >>>>>> >>  >>>>>> That looks absolutely great, loved it! >>  >>>>>> Will it make sense to also add ElasticSearch index templates >>  >>>>>> querying/creation here? >>  >>>>>> >>  >>>>>> - Dima >>  >>>>>> >>  >>>>>> On 02/01/2017 02:06 AM, Houshang Livian wrote: >>  >>>>>>> Hello Metron Community, >>  >>>>>>> >>  >>>>>>> We have constructed a Management Module UI, built on top of >>  >> METRON-503 >>  >>>>>> (REST API) (currently under review). This Module gives users the >>  >> ability to >>  >>>>>> setup and administer much of the product through the UI. >>  >>>>>>> >>  >>>>>>> Here are some screens to show you what we are thinking. Please >>  take a >>  >>>>>> look: >>  >>>>>>> http://imgur.com/a/QAQyu? >>  >>>>>>> >>  >>>>>>> Does this look like a reasonable place to start? >>  >>>>>>> Is there anything that is an absolute MUST have or MUST NOT have? >>  >>>>>>> >>  >>>>>>> Houshang Livian >>  >>>>>>> Senior User Experience Designer >>  >>>>>>> Hortonworks >>  >>>>>>> >>  >>>>>>> www.hortonworks.com<http://www.hortonworks.com/> >>  >>>>>>> >>  >>>>>>> >>  >>>>>>> Mobile: (831) 521-4176 >>  >>>>>>> hliv...@hortonworks.com<mailto:hliv...@hortonworks.com> >>  >>>>>>> >>  >>>>>>> >>  >>>>>>> >>  >>>>>> >>  >>>>>> >>  >>>>> >>  >>>>> >>  >>>>> -- >>  >>>>> Nick Allen >>  >>>> >>  >>> >>  >> >>  > -- >>  > >>  > Jon >>  > >>  > Sent from my mobile device >> >>  -- > > Jon > > Sent from my mobile device ---  Thank you, James Sirota PPMC- Apache Metron (Incubating) jsirota AT apache DOT org

Re: [DISCUSS][PROPOSAL] Side Loading and Installation of telemetry sources [METRON-258]

2017-02-18 Thread James Sirota
de or modify the sample >>  * build >>  * run the installer script or the ui to upload/deploy the package >>  * use the console or ui to create an instance >> >>  QUESTIONS: >>  * it seems strange to have this as ‘parsers’ when conceptually parsers > > are >>  a part of the whole, should we introduce something like ‘source’ that is >>  all of it? >>  * should configurations etc be in ZK or on disk? or HDFS? or All of the >>  above? >>  * did you read this far? good! >>  * I am sure that after hitting send I will think of 10 things that are >>  missing from this >> >>  I have started a POC of this, and thus far have created >>  metron-parsers-common and started breaking out metron-parser-asa. >>  I will continue to work through some of this here >>  https://github.com/ottobackwards/incubator-metron/tree/METRON-258 >> >>  Again, thank you for your time and feedback. ---  Thank you, James Sirota PPMC- Apache Metron (Incubating) jsirota AT apache DOT org

[GitHub] incubator-metron issue #438: METRON-686 Record Rule Set that Fired During Th...

2017-02-12 Thread james-sirota
Github user james-sirota commented on the issue: https://github.com/apache/incubator-metron/pull/438 I think a better approach is to bake in an enforcement layer within Metron to only allow flat maps (key-value pairs where the value cannot be a complex object). You would enforce

[GitHub] incubator-metron pull request #449: METRON-701 Triage Metrics Produced by th...

2017-02-12 Thread james-sirota
Github user james-sirota commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/449#discussion_r100719426 --- Diff: metron-analytics/metron-profiler/src/main/java/org/apache/metron/profiler/bolt/KafkaDestinationHandler.java --- @@ -0,0 +1,78

[GitHub] incubator-metron issue #450: METRON-690: Create a DSL-based timestamp lookup...

2017-02-12 Thread james-sirota
Github user james-sirota commented on the issue: https://github.com/apache/incubator-metron/pull/450 I think taking the string as an argument is really powerful, but it's also really flexible. "1 hour window every 24 hours starting from 14 days ago including the current

[GitHub] incubator-metron issue #450: METRON-690: Create a DSL-based timestamp lookup...

2017-02-12 Thread james-sirota
Github user james-sirota commented on the issue: https://github.com/apache/incubator-metron/pull/450 I think the API looks great. Can we provide a grammar in the comments for constructing the PROFILE_WINDOW function? I think the API is so flexible that it may be hard to wrap your

Re: [VOTE] Releasing Apache Metron (incubating) 0.3.1-RC4

2017-02-12 Thread James Sirota
; Recommended build validation and verification instructions are posted here: > https://cwiki.apache.org/confluence/display/METRON/Verifying+Builds > > This vote will be open for at least 72 hours. > > [ ] +1 Release this package as Apache Metron 0.3.1-RC4 incubating > > [ ] 0 No opinion >

[GitHub] incubator-metron issue #451: METRON-157: Added CEF Parser

2017-02-12 Thread james-sirota
Github user james-sirota commented on the issue: https://github.com/apache/incubator-metron/pull/451 +1 via inspection. This is a great contribution. Thanks, Simon. I think it would be nice to get more test data from different instances of Arcsight. Does anyone in the community

[GitHub] incubator-metron pull request #451: METRON-157: Added CEF Parser

2017-02-12 Thread james-sirota
Github user james-sirota commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/451#discussion_r100716097 --- Diff: metron-platform/metron-parsers/src/test/java/org/apache/metron/parsers/cef/CEFParserTest.java --- @@ -0,0 +1,186

[GitHub] incubator-metron pull request #451: METRON-157: Added CEF Parser

2017-02-12 Thread james-sirota
Github user james-sirota commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/451#discussion_r100715818 --- Diff: metron-platform/metron-parsers/src/main/java/org/apache/metron/parsers/cef/CEFParser.java --- @@ -0,0 +1,274

[GitHub] incubator-metron pull request #451: METRON-157: Added CEF Parser

2017-02-12 Thread james-sirota
Github user james-sirota commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/451#discussion_r100716155 --- Diff: metron-platform/metron-parsers/src/test/resources/org/apache/metron/parsers/cef/adallom.cef --- @@ -0,0 +1 @@ +2016-04-01T09

[GitHub] incubator-metron issue #452: Removed MySQL from Enrichment Diagram

2017-02-12 Thread james-sirota
Github user james-sirota commented on the issue: https://github.com/apache/incubator-metron/pull/452 +1 by inspection. thanks for catching this, simon --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

Re: [ANNOUNCE] Metron Apache Community Demo for Metron_0.3.1

2017-02-10 Thread James Sirota
tectural or project decisions were made during this meeting. 10.02.2017, 13:12, "Kyle Richardson" : > Great! Glad it will be available. Like Jon, I had a conflict today. > > -Kyle > >>  On Feb 10, 2017, at 2:10 PM, James Sirota wrote: >> >>  Thats

Re: [ANNOUNCE] Metron Apache Community Demo for Metron_0.3.1

2017-02-10 Thread James Sirota
g with >>  a >>  > > Kafka sensor and doing basic enrichment. >>  > > >>  > > Thanks & Regards, >>  > > Jimson James >>  > > >>  > > On Wed, Feb 8, 2017 at 1:47 AM, Matt Foley wrote: >>  > > >>  > > > I

[GitHub] incubator-metron pull request #438: METRON-686 Record Rule Set that Fired Du...

2017-02-10 Thread james-sirota
Github user james-sirota commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/438#discussion_r100599107 --- Diff: metron-platform/metron-enrichment/src/main/java/org/apache/metron/enrichment/bolt/ThreatIntelJoinBolt.java --- @@ -133,14 +136,18

[GitHub] incubator-metron issue #446: METRON-707: Correct ansible to execute threat i...

2017-02-08 Thread james-sirota
Github user james-sirota commented on the issue: https://github.com/apache/incubator-metron/pull/446 +1 great job fixing this --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

Re: [VOTE] Releasing Apache Metron (incubating) 0.3.1-RC2 (corrected links, same RC)

2017-02-08 Thread James Sirota
-RC2 incubating > > When voting, please list the actions taken to verify the release. > > Recommended build validation and verification instructions are posted here: > https://cwiki.apache.org/confluence/display/METRON/Verifying+Builds > > This vote will be open for at least 72 hours. > > [ ] +1 Release this package as Apache Metron 0.3.1-RC2 incubating > > [ ] 0 No opinion > > [ ] -1 Do not release this package because... ---  Thank you, James Sirota PPMC- Apache Metron (Incubating) jsirota AT apache DOT org

[ANNOUNCE] Metron Apache Community Demo for Metron_0.3.1

2017-02-07 Thread James Sirota
---  Thank you, James Sirota PPMC- Apache Metron (Incubating) jsirota AT apache DOT org

Re: [VOTE] Releasing Apache Metron (incubating) 0.3.1-RC1

2017-02-06 Thread James Sirota
>>  https://cwiki.apache.org/confluence/display/METRON/Verifying+Builds >> >>  This vote will be open for at least 72 hours. >> >>  [ ] +1 Release this package as Apache Metron 0.3.1-RC1 incubating >> >>  [ ] 0 No opinion >> >>  [ ] -1 Do not release this package because... ---  Thank you, James Sirota PPMC- Apache Metron (Incubating) jsirota AT apache DOT org

Re: [PROPOSAL] up-to-date versioned documentation

2017-01-31 Thread James Sirota
; > ./metron-analytics/metron-profiler-client/README.md > > > > > > > > ./metron-analytics/metron-statistics/README.md > > > > > > > > ./metron-deployment/README.md > > > > > > > > ./metron-deployment/amazon-ec2/README.md > > > >

Re: [DISCUSS] Expansion of the capabilities of PROFILE_GET

2017-01-31 Thread James Sirota
t; > > binSize - The size of the lookback bin >>>  > > > - >>>  > > > >>>  > > > binUnits - The units of the lookback bin >>>  > > > >>>  > > > Given the number of arguments and their complexity a

Re: [DISCUSS] Contributions with multiple authors and requisite modifications to the development guide

2017-01-31 Thread James Sirota
Lyle >>  > > > > >>  > > > > wrote: >>  > > > > >>  > > > > >>  > > > > The bolded didn't come through, but I'm guessing it's here: >>  > > > > >>  > > > > *If the contribution

[GitHub] incubator-metron pull request #429: METRON-660 [Umbrella] up-to-date version...

2017-01-31 Thread james-sirota
Github user james-sirota commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/429#discussion_r98728815 --- Diff: site-book/bin/generate-md.sh --- @@ -190,7 +190,13 @@ cd site-book/src/site/markdown # Rewrite hrefs for resource references

[GitHub] incubator-metron issue #427: METRON-676 Create Zeppelin Notebook for YAF Tel...

2017-01-31 Thread james-sirota
Github user james-sirota commented on the issue: https://github.com/apache/incubator-metron/pull/427 +1 Great job --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

Re: [DISCUSS] Error Indexing

2017-01-24 Thread James Sirota
y than 4. Thoughts? > > Ryan > > On Mon, Jan 23, 2017 at 5:44 PM, zeo...@gmail.com wrote: > >>  In that case the hash would be of the value in the IP field, such as >>  sha3(8.8.8.8). >> >>  Jon >> >>  On Mon, Jan 23, 2017, 6:41 PM James Sirota w

[DISCUSS] Gratuating to Apache Top Level Project

2017-01-23 Thread James Sirota
graduation? ---  Thank you, James Sirota PPMC- Apache Metron (Incubating) jsirota AT apache DOT org

Re: [DISCUSS] Error Indexing

2017-01-23 Thread James Sirota
, a hash gives > us some protection that the issue will not occur twice. > > Jon > > On Mon, Jan 23, 2017, 2:47 PM James Sirota wrote: > > Jon, > > With regards to 1, collapsing to a single dashboard for each would be > fine. So we would have one error index and o

Re: [DISCUSS] Expansion of the capabilities of PROFILE_GET

2017-01-23 Thread James Sirota
') >> >>  *The same time window every sunday for the last month starting one hour ago >>  skipping holidays* >> >>  Just to make this as clear as possible, if this is run at 3PM on Monday >>  January 22rd, 2017, it would include the following bins: >>

Re: [DISCUSS] Expansion of the capabilities of PROFILE_GET

2017-01-23 Thread James Sirota
, this would look like: > > PROFILE_LOOKBACK( { 'from' : 1, 'fromUnits' : 'HOURS', 'to' : 1, 'toUnits' > : 'MONTH', 'including' : [ 'tuesday'], 'excluding' : [ 'holidays' ], > 'binSi

Re: [DISCUSS] Error Indexing

2017-01-23 Thread James Sirota
ave back > to back failures (i.e. instead of storing the value itself). Additionally, > I think it's helpful to be able to search all times there was an indexing > error (instead of it hitting the catch-all). > > Jon > > On Fri, Jan 20, 2017 at 1:17 PM James Sirota wrote: &g

Re: [DISCUSS] Error Indexing

2017-01-23 Thread James Sirota
otentially add a hash of the content that failed validation to > help identify repeats over time with less of a concern that you'd have back > to back failures (i.e. instead of storing the value itself). Additionally, > I think it's helpful to be able to search all times there was

Re: [VOTE] Release Process Documentation

2017-01-23 Thread James Sirota
Sorry that's a typo. Was meant to be 10. Just fixed 20.01.2017, 13:22, "zeo...@gmail.com" : > -1 (non-binding). > > There appears to be a minor oversight where it goes from Step 9 to Step 14. > > Jon > > On Fri, Jan 20, 2017 at 11:56 AM James Sirota wrote:

Re: [DISCUSS] Mtron Project Maturity

2017-01-23 Thread James Sirota
enience > binaries are documented to not be warranted or guaranteed in any way.” > It might be advisable to check the documentation to confirm (b). > > QU30 – “identified addressed” – insert “and” > “the Metron's” – delete “the” > > QU50 – “Metorn” – should

[DISCUSS] Error Indexing

2017-01-20 Thread James Sirota
--Generic catch-all for all other errors For validation reporting: --What part of message failed validation --What stellar validator caused the failure ---  Thank you, James Sirota PPMC- Apache Metron (Incubating) jsirota AT apache DOT org

[VOTE] Development Guidelines

2017-01-20 Thread James Sirota
change flag on the issue's JIRA is set appropriately for this patch For incompatible changes, major features/improvements, and other release notable issues, the Release Note field has a sufficient comment ---  Thank you, James Sirota PPMC- Apache Metron (Incubating) jsirota AT apache DOT org

[DISCUSS] Mtron Project Maturity

2017-01-20 Thread James Sirota
---  Thank you, James Sirota PPMC- Apache Metron (Incubating) jsirota AT apache DOT org

[VOTE] Release Process Documentation

2017-01-20 Thread James Sirota
n created. The release manager has a responsibility to review all commits to the maintenance line since last release, and make sure they were duplicated to the feature branch (unless not relevant, which must also be determined). ---  Thank you, James Sirota PPMC- Apache Metron (Incubating) jsirota AT apache DOT org

[RESULT] [VOTE] Release Process

2017-01-20 Thread James Sirota
3 binding +1 (james, kyle, casey), 1 non-binding +1 (matt) Thanks for voting James 20.01.2017, 09:33, "James Sirota" : > +1 (binding) > > 18.01.2017, 13:03, "Matt Foley" : >>  +1 (non-binding) >> >>  BTW, here is a collection of small editoria

Re: [VOTE] Release Process

2017-01-20 Thread James Sirota
, but the 72 hour waiting period > can be waved.” > Should be changed to: > “Second, if a critical JIRA comes in that requires an immediate > patch, the votes with three binding +1's are still required, but Step 1 > (discussion) and Step 2 (Jira collecting and tracki

[RESULT] [VOTE] Reporting Issues Wiki

2017-01-18 Thread James Sirota
The vote passes with 3 binding +1 votes (James, Casey, Nick), 4 non-binding +1s, (matt, JJ, Anand, Jon), and a 0 from Kyle Thanks everyone for voting 18.01.2017, 06:15, "Nick Allen" : > +1 binding > > On Thu, Jan 5, 2017 at 5:41 PM, James Sirota wrote: > >>

[PROPOSAL] Metron Community

2017-01-17 Thread James Sirota
Right now we have 2 entries for Metron Community. One on our Wiki, which I think is outdated and should be removed as it no longer offers value. The second is on our website, which is up to date. So I am proposing we remove the wiki entry. ---  Thank you, James Sirota

[GitHub] incubator-metron issue #399: METRON-600: Fix Metron Website

2017-01-17 Thread james-sirota
Github user james-sirota commented on the issue: https://github.com/apache/incubator-metron/pull/399 @mattf-horton does this adequately meet your concerns? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

Re: [VOTE] Reporting Issues Wiki

2017-01-17 Thread James Sirota
ey wrote: >>  > >>> >>  > >>> +1 (non-binding) >>  > >>> >>  > >>> One typo is still in there: >>  > >>>>> After discussion of the issue on the JIRA if it is clear that you >>  > >>> fo

Re: [DISCUSS] Dev Guide and Committer Review Guide additions?

2017-01-17 Thread James Sirota
Documentation Revisions in Tutorials Developer Guide Expansions in readme's Changes to System Interfaces Stellar Shell REST APIs Etc... think that is good enough? Thanks, James 16.01.2017, 13:47, "Matt Foley" : > +1 to both. > > On 1/16/17, 12:02 PM, "James Sirota&q

[VOTE] Release Process

2017-01-17 Thread James Sirota
maintenance line since last release, and make sure they were duplicated to the feature branch (unless not relevant, which must also be determined). ---  Thank you, James Sirota PPMC- Apache Metron (Incubating) jsirota AT apache DOT org

Re: [DISCUSS] Release Process

2017-01-17 Thread James Sirota
; Consistency > > > > > between Feature and Maint Releases), which are very good. > > > > > > > > > > One major issue: Step 4 says: > > > > > >> Now, we must grab the release candidate binary from the github >

Re: [MENTORS] Questions about Release Process

2017-01-17 Thread James Sirota
an immediate patch we may forego >>>  steps 2-5 and immediately cut the MR release. A critical JIRA is something >>>  that is either a security vulnerability or a functional show stopper . >> >>  Do maintenance releases or releases that are due to urgent security issues >>  still have to go through the normal apache voting process? >> >>  Casey ---  Thank you, James Sirota PPMC- Apache Metron (Incubating) jsirota AT apache DOT org

Re: Pittsburgh PA Meetup

2017-01-17 Thread James Sirota
I’d love if I could get anyone involved here to > represent the project and present, co-present with me, or just hang around > at the event. Again, this is in Pittsburgh PA, Feb 9th in the evening > starting around 7pm. > > Jon > > On Fri, Nov 4, 2016 at 1:16 PM James Sirota w

Re: [DISCUSS] Turning off indexing writers feature discussion

2017-01-16 Thread James Sirota
; > >> > > > 2 and 3. You'd end up with one kafka queue >>  > > with 3 >>  > > > &g

Re: [DISCUSS] Ambari Metron Configuration Management consequences and call to action

2017-01-16 Thread James Sirota
rgets to pull the configs from zookeeper to disk, before >>>  they do >>> a push via zk_load_utils, they will clobber the configs in zookeeper >>>  with >>> old configs. >>> - If the global config is changed on disk and the ambari service >>&

Re: [DISCUSS] Moving GeoIP management away from MySQL

2017-01-16 Thread James Sirota
t;>> by > > > > > >>>>>> MySQL (the connectors are LGPL licensed and we need to > sever > > our > > > > > Maven > > > > > >>>>>> dependency on it before next release). We currently depend &g

Re: [DISCUSS] Release Process

2017-01-16 Thread James Sirota
If no one has additional comments on this document i'll go ahead and put it up for a vote... https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=66854770 10.01.2017, 12:50, "James Sirota" : > Hi Larry, > > Thanks for the comments. I beefed up the technica

Re: [DISCUSS] Dev Guide and Committer Review Guide additions?

2017-01-16 Thread James Sirota
ounting on others like Nick >>  > or Casey >>  > > to understand anything that may be missing from a submission when I >>  > review >>  > > it. Should there by an Ambari/RPM change? Does this change the >>  > RestAPI? >>  > > Does this effect STELLAR Lang/SHELL? Does it need customer Docker >>  > Compose >>  > > work? etc etc. >>  > > >>  > > I think as we grow the community and try to get out of incubation >>  it >>  > will >>  > > be impractical for us to count on this, and we are even now >>  > increasing the >>  > > risk of regression or functional gaps ( unrealized ) that will have >>  > an >>  > > adverse effect on having a stable master. >>  > > >>  > > I think we should discuss if and how we can improve this or the >>  > issue of my >>  > > sanity ;). >>  > > >>  > > What are the criteria that we need to have submitters and reviewers >>  > have in >>  > > mind? >>  > > * Test >>  > > * Doc >>  > > ** Obsoleting of existing documentation/how-to’s ( even hortonworks >>  > posts ) >>  > > * Performance >>  > > ** How do we test for performance? >>  > > *** Standards >>  > > *** Tools and processes >>  > > * Deployment >>  > > ** RPM >>  > > ** Docker >>  > > ** Ansible >>  > > ** Ambari >>  > > ** AWS Script >>  > > * Functional >>  > > ** STELLAR/Shell >>  > > ** REST api’s >>  > > * Dev/review guide >>  > > ** Does the review / submit guide need to account for it? >>  > > >>  > > Any thoughts? >>  > > >>  > >>  > >>  > >>  > >>  > ---  Thank you, James Sirota PPMC- Apache Metron (Incubating) jsirota AT apache DOT org

  1   2   3   4   5   >