Help with custom enrichment / parser

2016-11-02 Thread Tyler Moore
Hey everyone, I've had a few sticking points that I encountered while trying to create some custom solutions using the Metron platform and could use some guidance. 1) My custom enrichment config is not writing to elasticsearch or may be configured improperly. My extractor config: { "config" :

[GitHub] incubator-metron issue #338: METRON-295: Script parsing bolt

2016-11-02 Thread ottobackwards
Github user ottobackwards commented on the issue: https://github.com/apache/incubator-metron/pull/338 https://issues.apache.org/jira/browse/METRON-534 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] incubator-metron issue #338: METRON-295: Script parsing bolt

2016-11-02 Thread ottobackwards
Github user ottobackwards commented on the issue: https://github.com/apache/incubator-metron/pull/338 https://github.com/onefoursix/hdfs-inotify-example/blob/master/src/main/java/com/onefoursix/HdfsINotifyExample.java Could we not investigate using INotify for notification of

[GitHub] incubator-metron issue #338: METRON-295: Script parsing bolt

2016-11-02 Thread ottobackwards
Github user ottobackwards commented on the issue: https://github.com/apache/incubator-metron/pull/338 You can solve this problem ( and the grok problem ) without storing the world in ZK with tooling. An official set of scripts/web interface for deploying scripts/topologies/grok rules

Re: [DISCUSS] Next Release Name

2016-11-02 Thread zeo...@gmail.com
That would break searching on uri entirely unless you queried and knew to truncate at 32766 because it's not analyzed. I don't like pushing that complication to the end user. I would suggest truncation in the indexingBolt (not using stellar because you'd want this across the board) for all

Re: [DISCUSS] Next Release Content

2016-11-02 Thread Kyle Richardson
I'd like to selfishly add METRON-363 into consideration for the next release. This is complete pending final review and merge. -Kyle On Wed, Nov 2, 2016 at 5:00 PM, Casey Stella wrote: > Hey Jon, > > Regarding the

Re: [DISCUSS] Storm worker processes not properly terminating on restart (METRON-485)

2016-11-02 Thread zeo...@gmail.com
I added a 60s wait and still saw the issue but less frequently. In the middle of upgrading to master to get the 1.0.x changes. Jon On Wed, Nov 2, 2016, 19:41 James Sirota wrote: > > Resurrecting this thread. Were we able to come to a resolution on this? > Or is it still

Re: [DISCUSS] Next Release Name

2016-11-02 Thread James Sirota
Jon, For METRON-517 would it suffice to have a stellar statement to take a URI string and truncate it to length of 32766 in the ES writer? But still write the actual string to HDFS? You can then search against ES on the truncated portion, but retrieve the actual timestamp from HDFS. It's

Re: [DISCUSS] Storm worker processes not properly terminating on restart (METRON-485)

2016-11-02 Thread James Sirota
Resurrecting this thread. Were we able to come to a resolution on this? Or is it still causing problems? Thanks, James 05.10.2016, 12:55, "zeo...@gmail.com" : > Right, I will try that. I guess my main question, though, is why would > that need more time? Is it a function

Re: [DISCUSS] Next Release Name

2016-11-02 Thread James Sirota
Sounds to me that we should close METRON-370 as non-discrepant. If we want a feature later on to be able to replay enrichments we should add a Jira on that instead. I don't see why you would do this, though. If the enrichment fails you want to pass the message through unenriched. Otherwise

[GitHub] incubator-metron issue #338: METRON-295: Script parsing bolt

2016-11-02 Thread james-sirota
Github user james-sirota commented on the issue: https://github.com/apache/incubator-metron/pull/338 By the way sounds like the Travis build fails the RAT check. [ERROR] Failed to execute goal org.apache.rat:apache-rat-plugin:0.12:check (default) on project metron-integration-test:

[GitHub] incubator-metron issue #338: METRON-295: Script parsing bolt

2016-11-02 Thread james-sirota
Github user james-sirota commented on the issue: https://github.com/apache/incubator-metron/pull/338 I will try to verify this on a production deployment with production data on Friday. I'll let you know how it goes --- If your project is set up for it, you can reply to this email

Re: [DISCUSS] Next Release Name

2016-11-02 Thread Michael Miklavcic
Hi Jon, I have commented on 370 - https://issues.apache.org/jira/browse/METRON-370 Best, Mike On Wed, Nov 2, 2016 at 3:11 PM, zeo...@gmail.com wrote: > I personally would like to see the following things done before things > leave BETA: > (1) Address data integrity concerns

Re: [DISCUSS] Next Release Name

2016-11-02 Thread David Lyle
I'm +1 dropping the BETA. Correct me if I'm wrong, but there are users in production. I think leaving it in the 0 major is appropriate until the concerns Jon mentioned are addressed. -D... On Wed, Nov 2, 2016 at 5:11 PM, zeo...@gmail.com wrote: > I personally would like to

Re: [DISCUSS] Metron REST API Architecture and Design

2016-11-02 Thread Ryan Merriman
Hey Jon sorry for the delay. These are new to me so I'm not sure where to start. Is there a common use case we could explore initially? Ryan On Thu, Oct 27, 2016 at 9:02 AM, zeo...@gmail.com wrote: > Another thought that came to me recently - Has there been any

[GitHub] incubator-metron issue #340: METRON-520: /apps/metron/enrichment directory d...

2016-11-02 Thread cestella
Github user cestella commented on the issue: https://github.com/apache/incubator-metron/pull/340 Would you please update the JIRA with the 0.2.2BETA release and mark it as in-progress? --- If your project is set up for it, you can reply to this email and have your reply appear on

Re: [DISCUSS] Next Release Name

2016-11-02 Thread zeo...@gmail.com
I personally would like to see the following things done before things leave BETA: (1) Address data integrity concerns (Specifically thinking of METRON-370, METRON-517) (2) Make cluster tuning easier and more consistent (METRON-485, METRON-470, and the "[DISCUSS] moving parsers back to flux" which

[GitHub] incubator-metron issue #338: METRON-295: Script parsing bolt

2016-11-02 Thread merrimanr
Github user merrimanr commented on the issue: https://github.com/apache/incubator-metron/pull/338 @rkarthik29 One of the advantages of keeping the configuration (scripts in this case) in Zookeeper is that you get notified when something changes. You don't need to track versions.

[GitHub] incubator-metron pull request #340: METRON-520: /apps/metron/enrichment dire...

2016-11-02 Thread justinleet
GitHub user justinleet opened a pull request: https://github.com/apache/incubator-metron/pull/340 METRON-520: /apps/metron/enrichment directory does not get created for Metron cluster deployed via Ambari In addition to the main goal, there's a couple minor changes I made while I

Re: [DISCUSS] Next Release Content

2016-11-02 Thread Casey Stella
Hey Jon, Regarding the relationship between 463 and 460, agreed. I adjusted 460 to correctly reflect that observation. I'll reserve further comment on the others until after I've reflected a bit more. Regardless, thanks for the feedback; very valuable as usual. Casey On Wed, Nov 2, 2016 at

[GitHub] incubator-metron pull request #339: METRON-463: Pull RPMs from Remote (confi...

2016-11-02 Thread dlyle65535
GitHub user dlyle65535 opened a pull request: https://github.com/apache/incubator-metron/pull/339 METRON-463: Pull RPMs from Remote (configurable) repos Tested on Docker cluster following procedure here: [Metron MPack](https://www.evernote.com/l/AhLFVR-9CsFIYYnOnF43BlxSsT4F856qwaY)

Re: [DISCUSS] Next Release Content

2016-11-02 Thread zeo...@gmail.com
*Proposing and justifying a JIRA from the list of unresolved JIRAs* - Doesn't METRON-463 finish off METRON-460 as well? 460 doesn't appear to be slated for the next release. - I think METRON-447 should be in the next release, as it provides continuity for upgrades. I'd call it critical and I'm

[GitHub] incubator-metron issue #338: METRON-295: Script parsing bolt

2016-11-02 Thread rkarthik29
Github user rkarthik29 commented on the issue: https://github.com/apache/incubator-metron/pull/338 i am coming in late to this party, but i think the core issue , how would the bolt know that the script has changed so it can reload the parser. I was thinking if the previous bolt

Re: [DISCUSS] Next Release Content

2016-11-02 Thread Casey Stella
Yeah, good catch. Josh Elsner had issue with the underlying problem in METRON-501 and I agree. How about I start a new discuss thread about the BETA tag? I'd like to keep this one centered around what's in the release. On Wed, Nov 2, 2016 at 4:31 PM, David Lyle wrote: >

[GitHub] incubator-metron issue #323: METRON-514: Snort kafka topic fails to get any ...

2016-11-02 Thread merrimanr
Github user merrimanr commented on the issue: https://github.com/apache/incubator-metron/pull/323 @dlyle65535 conflict is resolved --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

Re: [DISCUSS] Next Release Content

2016-11-02 Thread David Lyle
Makes sense, thanks! On Wed, Nov 2, 2016 at 4:41 PM, Casey Stella wrote: > Yeah, good catch. Josh Elsner had issue with the underlying problem in > METRON-501 and I agree. > > How about I start a new discuss thread about the BETA tag? I'd like to > keep this one centered

[DISCUSS] Next Release Name

2016-11-02 Thread Casey Stella
Hello Everyone, Now that the discussion around the next release has started, it has been proposed and I think it's a good time to discuss what to name this next release. Before, we have adopted the BETA suffix. I think it might be time to drop it and call the next release 0.2.2 Thoughts?

[GitHub] incubator-metron issue #338: METRON-295: Script parsing bolt

2016-11-02 Thread cestella
Github user cestella commented on the issue: https://github.com/apache/incubator-metron/pull/338 Could you add a section to [here|https://github.com/apache/incubator-metron/tree/master/metron-platform/metron-parsers#grok-parser-adapters] describing the parser's config and

[GitHub] incubator-metron issue #338: METRON-295: Script parsing bolt

2016-11-02 Thread ottobackwards
Github user ottobackwards commented on the issue: https://github.com/apache/incubator-metron/pull/338 yeah, as a Minimum Viable, but those limitations need to be spelled out, per language. Actually all the points above may have per language implications --- If your project is set

[GitHub] incubator-metron issue #338: METRON-295: Script parsing bolt

2016-11-02 Thread cestella
Github user cestella commented on the issue: https://github.com/apache/incubator-metron/pull/338 @ottobackwards Yeah, that's sensible. As far as the features, I think it's ok for this to support the JVM-supported scripting languages with all their limitations (IMO). --- If your

[GitHub] incubator-metron issue #338: METRON-295: Script parsing bolt

2016-11-02 Thread cestella
Github user cestella commented on the issue: https://github.com/apache/incubator-metron/pull/338 It may be, of course, that this shouldn't be pulled from zookeeper and should be kept a file. I'm not sure how I feel either way. If we keep it a file, I am unclear how we manage to

[GitHub] incubator-metron issue #338: METRON-295: Script parsing bolt

2016-11-02 Thread cestella
Github user cestella commented on the issue: https://github.com/apache/incubator-metron/pull/338 There has been a lot of thought and modification around updating external content in #308. It seems to me that some of this should be reused or presumed here. We have a similar issue,

[GitHub] incubator-metron pull request #337: METRON-295: Script parsing bolt

2016-11-02 Thread james-sirota
Github user james-sirota commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/337#discussion_r86231950 --- Diff: metron-platform/metron-parsers/src/main/java/org/apache/metron/parsers/ScriptParser.java --- @@ -0,0 +1,175 @@ +package

[GitHub] incubator-metron issue #338: METRON-295: Script parsing bolt

2016-11-02 Thread ottobackwards
Github user ottobackwards commented on the issue: https://github.com/apache/incubator-metron/pull/338 I think the tooling around creating the script parser is very important, although that *could* be tracked in another jira as a follow on. But it may be impactful to this --- If

[DISCUSS] Next Release Content

2016-11-02 Thread Casey Stella
Hello Everyone, It's me, your friendly Metron Release Manager and it's time to start thinking about the next release. *JIRA Housekeeping* For those who get email alerts via JIRA on changes, it should be no surprise that I went through did some JIRA housekeeping in anticipation of the next

[GitHub] incubator-metron pull request #338: METRON-295: Script parsing bolt

2016-11-02 Thread cestella
Github user cestella commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/338#discussion_r86225178 --- Diff: metron-platform/metron-parsers/src/main/java/org/apache/metron/parsers/ScriptParser.java --- @@ -0,0 +1,175 @@ +package

[GitHub] incubator-metron pull request #338: METRON-295: Script parsing bolt

2016-11-02 Thread cestella
Github user cestella commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/338#discussion_r86225430 --- Diff: metron-platform/metron-parsers/src/test/java/org/apache/metron/parsers/JSParserTest.java --- @@ -0,0 +1,81 @@ +package

[GitHub] incubator-metron pull request #338: METRON-295: Script parsing bolt

2016-11-02 Thread cestella
Github user cestella commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/338#discussion_r86224685 --- Diff: metron-platform/metron-parsers/src/main/java/org/apache/metron/parsers/ScriptParser.java --- @@ -0,0 +1,175 @@ +package

[GitHub] incubator-metron pull request #338: METRON-295: Script parsing bolt

2016-11-02 Thread cestella
Github user cestella commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/338#discussion_r86225562 --- Diff: metron-platform/metron-parsers/src/test/java/org/apache/metron/parsers/PythonParserTest.java --- @@ -0,0 +1,81 @@ +package

[GitHub] incubator-metron pull request #338: METRON-295: Script parsing bolt

2016-11-02 Thread cestella
Github user cestella commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/338#discussion_r86225481 --- Diff: metron-platform/metron-parsers/src/test/java/org/apache/metron/parsers/JSParserTest.java --- @@ -0,0 +1,81 @@ +package

[GitHub] incubator-metron pull request #338: METRON-295: Script parsing bolt

2016-11-02 Thread cestella
Github user cestella commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/338#discussion_r86225417 --- Diff: metron-platform/metron-parsers/src/test/java/org/apache/metron/parsers/JSParserTest.java --- @@ -0,0 +1,81 @@ +package

[GitHub] incubator-metron pull request #338: METRON-295: Script parsing bolt

2016-11-02 Thread cestella
Github user cestella commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/338#discussion_r86225310 --- Diff: metron-platform/metron-parsers/src/test/java/org/apache/metron/parsers/GroovyParserTest.java --- @@ -0,0 +1,81 @@ +package

[GitHub] incubator-metron pull request #338: METRON-295: Script parsing bolt

2016-11-02 Thread cestella
Github user cestella commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/338#discussion_r86225520 --- Diff: metron-platform/metron-parsers/src/test/java/org/apache/metron/parsers/PythonParserTest.java --- @@ -0,0 +1,81 @@ +package

[GitHub] incubator-metron pull request #338: METRON-295: Script parsing bolt

2016-11-02 Thread cestella
Github user cestella commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/338#discussion_r86225531 --- Diff: metron-platform/metron-parsers/src/test/java/org/apache/metron/parsers/PythonParserTest.java --- @@ -0,0 +1,81 @@ +package

[GitHub] incubator-metron pull request #338: METRON-295: Script parsing bolt

2016-11-02 Thread cestella
Github user cestella commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/338#discussion_r86225260 --- Diff: metron-platform/metron-parsers/src/test/java/org/apache/metron/parsers/GroovyParserTest.java --- @@ -0,0 +1,81 @@ +package

[GitHub] incubator-metron pull request #338: METRON-295: Script parsing bolt

2016-11-02 Thread cestella
Github user cestella commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/338#discussion_r86225544 --- Diff: metron-platform/metron-parsers/src/test/java/org/apache/metron/parsers/PythonParserTest.java --- @@ -0,0 +1,81 @@ +package

[GitHub] incubator-metron pull request #338: METRON-295: Script parsing bolt

2016-11-02 Thread cestella
Github user cestella commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/338#discussion_r86225466 --- Diff: metron-platform/metron-parsers/src/test/java/org/apache/metron/parsers/JSParserTest.java --- @@ -0,0 +1,81 @@ +package

[GitHub] incubator-metron pull request #338: METRON-295: Script parsing bolt

2016-11-02 Thread cestella
Github user cestella commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/338#discussion_r86225445 --- Diff: metron-platform/metron-parsers/src/test/java/org/apache/metron/parsers/JSParserTest.java --- @@ -0,0 +1,81 @@ +package

[GitHub] incubator-metron pull request #338: METRON-295: Script parsing bolt

2016-11-02 Thread cestella
Github user cestella commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/338#discussion_r86225367 --- Diff: metron-platform/metron-parsers/src/test/java/org/apache/metron/parsers/GroovyParserTest.java --- @@ -0,0 +1,81 @@ +package

[GitHub] incubator-metron pull request #338: METRON-295: Script parsing bolt

2016-11-02 Thread cestella
Github user cestella commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/338#discussion_r86225349 --- Diff: metron-platform/metron-parsers/src/test/java/org/apache/metron/parsers/GroovyParserTest.java --- @@ -0,0 +1,81 @@ +package

[GitHub] incubator-metron pull request #328: METRON-440 - handle empty strings in DOM...

2016-11-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-metron/pull/328 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-metron issue #338: METRON-295: Script parsing bolt

2016-11-02 Thread ottobackwards
Github user ottobackwards commented on the issue: https://github.com/apache/incubator-metron/pull/338 What is the workflow or steps around deploying the scripts? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] incubator-metron issue #338: METRON-295: Script parsing bolt

2016-11-02 Thread ottobackwards
Github user ottobackwards commented on the issue: https://github.com/apache/incubator-metron/pull/338 This is interesting. I would think we would want some tooling like https://github.com/YelpArchive/pyleus around building a jar that contains all the python dependencies for a script

[GitHub] incubator-metron issue #337: METRON-295: Script parsing bolt

2016-11-02 Thread ottobackwards
Github user ottobackwards commented on the issue: https://github.com/apache/incubator-metron/pull/337 This is interesting. I would think we would want some tooling like https://github.com/YelpArchive/pyleus around building a jar that contains all the python dependencies for a script

[GitHub] incubator-metron issue #337: METRON-295: Script parsing bolt

2016-11-02 Thread ottobackwards
Github user ottobackwards commented on the issue: https://github.com/apache/incubator-metron/pull/337 don't forget the reopen part --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] incubator-metron pull request #338: METRON-295: Script parsing bolt

2016-11-02 Thread rkarthik29
GitHub user rkarthik29 opened a pull request: https://github.com/apache/incubator-metron/pull/338 METRON-295: Script parsing bolt addd support for js,python and groovy parser bolt You can merge this pull request into a Git repository by running: $ git pull

[GitHub] incubator-metron issue #337: METRON-295: Script parsing bolt

2016-11-02 Thread rkarthik29
Github user rkarthik29 commented on the issue: https://github.com/apache/incubator-metron/pull/337 i changed the title --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] incubator-metron pull request #337: METRON-295: Script parsing bolt

2016-11-02 Thread rkarthik29
Github user rkarthik29 closed the pull request at: https://github.com/apache/incubator-metron/pull/337 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-metron pull request #337: Metron 295

2016-11-02 Thread rkarthik29
GitHub user rkarthik29 opened a pull request: https://github.com/apache/incubator-metron/pull/337 Metron 295 I have added support for creating parsers using js, python or groovy and using them in metron. This is for Jira Metron-295 You can merge this pull request into a Git

Re: [ANNOUNCE] Metron community demo (November 4, 2016, 11AM PST)

2016-11-02 Thread James Sirota
Forgot the meeting details. James Sirota is inviting you to a scheduled Zoom meeting. Topic: Metron Community Demo Time: this is a recurring meeting Join from PC, Mac, Linux, iOS or Android: https://hortonworks.zoom.us/j/263433204 Or join by phone: +1 408 638 0968 (US

[GitHub] incubator-metron pull request #336: METRON-210: Decom Multi-Node Vagrant Dep...

2016-11-02 Thread dlyle65535
GitHub user dlyle65535 opened a pull request: https://github.com/apache/incubator-metron/pull/336 METRON-210: Decom Multi-Node Vagrant Deployment Removed multi-node vagrant. You can merge this pull request into a Git repository by running: $ git pull

Re: Travis Logging and You

2016-11-02 Thread Ryan Merriman
I vote for 1 logging configuration (ERROR only). Why do we want different logging in Travis vs local? If you are working on a specific component and need more verbose logging, temporarily change the log level to INFO for that component. If we get the logging in shape this will be easy to do.

[GitHub] incubator-metron issue #334: METRON-529 Allow Configurable Periods for Profi...

2016-11-02 Thread mattf-horton
Github user mattf-horton commented on the issue: https://github.com/apache/incubator-metron/pull/334 I'm now a strong +1 on this (by inspection), subject to the usual tests. Really important piece of work, kudos to Nick! --- If your project is set up for it, you can reply to this

Re: Travis Logging and You

2016-11-02 Thread Otto Fowler
On Fri, Oct 28, 2016 at 3:13 PM , David Lyle < dlyle65...@gmail.com> wrote: > I think you noticed the main problem with turning logging off entirely. > > I'd be inclined to have two files: one which defaults to INFO and another > that defaults

[ANNOUNCE] Metron community demo (November 4, 2016, 11AM PST)

2016-11-02 Thread James Sirota
Synopsis of known demos: Advanced use cases of using a profiler and statistical functions to triage alerts Deploying additional models to Model as a Service Various bug fixes Anyone else wants to do a demo? Reply to this thread ---  Thank you, James Sirota PPMC- Apache

[GitHub] incubator-metron pull request #334: METRON-529 Allow Configurable Periods fo...

2016-11-02 Thread mattf-horton
Github user mattf-horton commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/334#discussion_r86208554 --- Diff: metron-analytics/metron-profiler-client/src/main/java/org/apache/metron/profiler/client/stellar/GetProfile.java --- @@ -226,14

[GitHub] incubator-metron pull request #334: METRON-529 Allow Configurable Periods fo...

2016-11-02 Thread mattf-horton
Github user mattf-horton commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/334#discussion_r86208152 --- Diff: metron-analytics/metron-profiler-client/src/main/java/org/apache/metron/profiler/client/stellar/GetProfile.java --- @@ -226,14

[GitHub] incubator-metron pull request #317: METRON-410: mysql_server's MySQL install...

2016-11-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-metron/pull/317 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-metron issue #335: METRON-531: Ensure licenses for bundled compone...

2016-11-02 Thread dlyle65535
Github user dlyle65535 commented on the issue: https://github.com/apache/incubator-metron/pull/335 +1 on this. Thanks for taking it on! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

Re: Travis Logging and You

2016-11-02 Thread Otto Fowler
What about having two logging configurations? One just for travis, and one pretty much what there is now ( the teardown stuff still has to be sorted out ). Maybe Travis can be scripted to put the right logging properties files in place? On November 2, 2016 at 12:42:09, Casey Stella

[GitHub] incubator-metron pull request #334: METRON-529 Allow Configurable Periods fo...

2016-11-02 Thread mattf-horton
Github user mattf-horton commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/334#discussion_r86190240 --- Diff: metron-analytics/metron-profiler-client/src/main/java/org/apache/metron/profiler/client/stellar/GetProfile.java --- @@ -226,14

Re: Travis Logging and You

2016-11-02 Thread Casey Stella
I haven't seen a JIRA about this yet. IMHO, I think a good first-pass would be: * We have a lot of ERROR level logging that happens because during teardown of the in memory components that could be fixed by tearing down components in the right order (possibly). * Teardown in some of our

Travis Logging and You

2016-11-02 Thread Otto Fowler
Did a jira for this actually get created? I would be willing to help work on getting the logs setup for what they need to be for travis and for local. Did we settle on an approach? Is there work ongoing that could use some dev or testing help?

[GitHub] incubator-metron pull request #317: METRON-410: mysql_server's MySQL install...

2016-11-02 Thread dlyle65535
Github user dlyle65535 closed the pull request at: https://github.com/apache/incubator-metron/pull/317 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-metron pull request #317: METRON-410: mysql_server's MySQL install...

2016-11-02 Thread dlyle65535
GitHub user dlyle65535 reopened a pull request: https://github.com/apache/incubator-metron/pull/317 METRON-410: mysql_server's MySQL install causes mutually assured dest… …ruction when installed on the same machine as the Ambari Hive MySQL Allowed the user to indicate

[GitHub] incubator-metron issue #317: METRON-410: mysql_server's MySQL install causes...

2016-11-02 Thread dlyle65535
Github user dlyle65535 commented on the issue: https://github.com/apache/incubator-metron/pull/317 Oh Travis. I just removed a comment. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] incubator-metron pull request #335: METRON-531: Ensure licenses for bundled ...

2016-11-02 Thread cestella
GitHub user cestella opened a pull request: https://github.com/apache/incubator-metron/pull/335 METRON-531: Ensure licenses for bundled components are appropriately reflected Because we shade jars, we must create LICENSE and NOTICE files in the META-INF directory that

Re: Jira Rights

2016-11-02 Thread David Lyle
I think I have him added, James. Kyle- can you try now? -D... On Wed, Nov 2, 2016 at 11:18 AM, Kyle Richardson wrote: > Sorry, I'm not sure I understand. Below is a screenshot from my profile > page on https://issues.apache.org/jira. Is there another place I need

[GitHub] incubator-metron issue #320: Metron 402: Snort timestamp field shows up wron...

2016-11-02 Thread cestella
Github user cestella commented on the issue: https://github.com/apache/incubator-metron/pull/320 Can you please rename this PR to "METRON-402: Snort timestamp field shows up wrong value"? I don't think that the infra bot will register the change, but it'll at least ensure the commit

Re: Jira Rights

2016-11-02 Thread Kyle Richardson
Sorry, I'm not sure I understand. Below is a screenshot from my profile page on https://issues.apache.org/jira. Is there another place I need to sign up? [image: Inline image 1] -Kyle On Wed, Nov 2, 2016 at 11:11 AM, James Sirota wrote: > Its not finding you. Make sure

[GitHub] incubator-metron issue #320: Metron 402: Snort timestamp field shows up wron...

2016-11-02 Thread cestella
Github user cestella commented on the issue: https://github.com/apache/incubator-metron/pull/320 What happens if the user does not configure snort to include the year in the timestamp? Do we have an error or do we assume the current year (the previous behavior)? --- If your

Re: Jira Rights

2016-11-02 Thread James Sirota
Its not finding you. Make sure you sign up for the jira 02.11.2016, 08:00, "Kyle Richardson" : > Thanks, James! My JIRA username is kylerichardson. > > -Kyle > > On Wed, Nov 2, 2016 at 10:28 AM, James Sirota wrote: > >>  Hi Kyle, you can have

Re: Jira Rights

2016-11-02 Thread Kyle Richardson
Thanks, James! My JIRA username is kylerichardson. -Kyle On Wed, Nov 2, 2016 at 10:28 AM, James Sirota wrote: > Hi Kyle, you can have contributor privileges. Please sign up for the Jira > and I'll add you. Does anyone else want that too? > > 31.10.2016, 18:19, "Kyle

[GitHub] incubator-metron issue #317: METRON-410: mysql_server's MySQL install causes...

2016-11-02 Thread justinleet
Github user justinleet commented on the issue: https://github.com/apache/incubator-metron/pull/317 +1. This is really great. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] incubator-metron pull request #317: METRON-410: mysql_server's MySQL install...

2016-11-02 Thread dlyle65535
Github user dlyle65535 commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/317#discussion_r86159948 --- Diff: metron-deployment/packaging/ambari/metron-mpack/src/main/resources/common-services/METRON/0.2.1BETA/package/scripts/params/params_linux.py

[GitHub] incubator-metron pull request #317: METRON-410: mysql_server's MySQL install...

2016-11-02 Thread justinleet
Github user justinleet commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/317#discussion_r86159297 --- Diff: metron-deployment/packaging/ambari/metron-mpack/src/main/resources/common-services/METRON/0.2.1BETA/package/scripts/params/params_linux.py

Re: Jira Rights

2016-11-02 Thread Otto Fowler
I am all set now, thanks On November 2, 2016 at 10:29:00, James Sirota (jsir...@apache.org) wrote: Hi Kyle, you can have contributor privileges. Please sign up for the Jira and I'll add you. Does anyone else want that too? 31.10.2016, 18:19, "Kyle Richardson" : >

Re: Jira Rights

2016-11-02 Thread James Sirota
Hi Kyle, you can have contributor privileges. Please sign up for the Jira and I'll add you. Does anyone else want that too? 31.10.2016, 18:19, "Kyle Richardson" : > Any chance I could also get rights to assign myself issues in JIRA? If it's > for PMC and committers

Re: Jira Rights

2016-11-02 Thread James Sirota
otto, you are definitely in there. can you maybe log out and log back in? 31.10.2016, 19:24, "Otto Fowler" : > I am signed up, but not under my apache ID, does that matter?  I will create > a new account with that ID if it makes it easier. > My current username in jira

[GitHub] incubator-metron issue #321: METRON-443 Exception seen while running stellar...

2016-11-02 Thread cestella
Github user cestella commented on the issue: https://github.com/apache/incubator-metron/pull/321 Ok, I'm reinstating my +1 providing you ran this up in vagrant and tried it out --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] incubator-metron pull request #321: METRON-443 Exception seen while running ...

2016-11-02 Thread justinleet
Github user justinleet commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/321#discussion_r86142473 --- Diff: metron-platform/metron-pcap/src/main/java/org/apache/metron/pcap/PcapPacketComparator.java --- @@ -25,15 +25,13 @@ public

[GitHub] incubator-metron pull request #321: METRON-443 Exception seen while running ...

2016-11-02 Thread cestella
Github user cestella commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/321#discussion_r86142311 --- Diff: metron-platform/metron-pcap/src/main/java/org/apache/metron/pcap/PcapPacketComparator.java --- @@ -25,15 +25,13 @@ public

[GitHub] incubator-metron issue #276: METRON-363 Fix Cisco ASA Parser

2016-11-02 Thread nickwallen
Github user nickwallen commented on the issue: https://github.com/apache/incubator-metron/pull/276 +1 Great contribution --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] incubator-metron pull request #334: METRON-529 Allow Configurable Periods fo...

2016-11-02 Thread nickwallen
Github user nickwallen commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/334#discussion_r86137602 --- Diff: metron-analytics/metron-profiler-client/src/main/java/org/apache/metron/profiler/client/stellar/GetProfile.java --- @@ -226,14

[GitHub] incubator-metron issue #323: METRON-514: Snort kafka topic fails to get any ...

2016-11-02 Thread dlyle65535
Github user dlyle65535 commented on the issue: https://github.com/apache/incubator-metron/pull/323 @merrimanr - I was hoping to merge this in today, but it's conflicted. Think you'd have time to take a peek? --- If your project is set up for it, you can reply to this email and have

[GitHub] incubator-metron issue #276: METRON-363 Fix Cisco ASA Parser

2016-11-02 Thread kylerichardson
Github user kylerichardson commented on the issue: https://github.com/apache/incubator-metron/pull/276 A big thank you to @ottobackwards for helping to troubleshoot the CI build fails. This should be good to go now. --- If your project is set up for it, you can reply to this email

Re: Fix Version

2016-11-02 Thread David Lyle
No worries, we all miss them sometimes it's not critical and I was in the neighborhood anyway. I just set them to release next, so 0.2.2 in this case. -D... On Wed, Nov 2, 2016 at 8:17 AM, Otto Fowler wrote: > Thanks dlyle for fixing up my fix versions. Sorry about

Fix Version

2016-11-02 Thread Otto Fowler
Thanks dlyle for fixing up my fix versions. Sorry about that. How does the project track what to set that to? Or what is current at the time of closing? I don’t want to repeat the error.

[GitHub] incubator-metron issue #331: METRON-526 Fix apache id for Otto Fowler

2016-11-02 Thread ottobackwards
Github user ottobackwards commented on the issue: https://github.com/apache/incubator-metron/pull/331 no problem, who likes unassigned jiras that are closed or could be closed? Let's see the charts! --- If your project is set up for it, you can reply to this email and have your

[GitHub] incubator-metron issue #331: METRON-526 Fix apache id for Otto Fowler

2016-11-02 Thread ottobackwards
Github user ottobackwards commented on the issue: https://github.com/apache/incubator-metron/pull/331 All set thanks. I will go through and clean up the stuff I've been working on --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

  1   2   >