Re: [VOTE] Release of Metron_0.1BETA_rc5

2016-03-23 Thread David Lyle
+1 (non-binding) to release. Ran both singlenode vagrant and ec2. I did notice the following: pycapa needs to be restarted after initial startup- it seems to be timing out on initial startup. On restart it stays up. Here's the stack trace: WARNING: No route found for IPv6 destination :: (no de

Re: [Vote] Release of Apache Metron 0.1BETA-RC6

2016-03-31 Thread David Lyle
I'm currently testing out a fix and would like to see the release come out with a chance of working out of the box. So, I'm -1 (non-binding) until we fix this issue. -David... On Thu, Mar 31, 2016 at 5:07 PM, P. Taylor Goetz wrote: > > On Mar 31, 2016, at 4:49 PM, Casey Stella wrote: > > I t

Re: [DISCUSS] Project reorganization

2016-04-11 Thread David Lyle
I think I was thinking along the same lines as James, let me read it back to make sure: Metron Platform Common (*) Integration-Test (*) DataManagement PCAP Parsers Enrichment Solr Elasticsearch Deployment Streaming UI For Common and Integration-

Re: [GitHub] incubator-metron pull request: METRON-108 Created fast packet capt...

2016-04-12 Thread David Lyle
Makes sense to me. Thanks! On Tuesday, April 12, 2016, nickwallen wrote: > Github user nickwallen commented on the pull request: > > > https://github.com/apache/incubator-metron/pull/73#issuecomment-208918491 > > I think that's a bridge to cross later once we refine specific > deployment top

Re: [ANOUNUCE] Metron IRC Channel

2016-04-13 Thread David Lyle
Good deal- is there any interest in setting up the asf ircbot? http://www.apache.org/dev/asfbot.html. Happy to file the infra ticket. -D... On Tue, Apr 12, 2016 at 10:18 AM, James Sirota wrote: > Thanks to Debo we now have IRC chat for Metron so we can all talk in real > time. > > /join #apach

Re: [DISCUSS] Tagging Jira's for newbies

2016-04-15 Thread David Lyle
I've been using: newbie for low complexity introductory Jiras: https://issues.apache.org/jira/browse/METRON-87?jql=project%20%3D%20METRON%20AND%20labels%20%3D%20newbie newbie++ for medium complexity introductory Jiras: https://issues.apache.org/jira/browse/METRON-91?jql=project%20%3D%20METRON%20AN

Re: [DISCUSS] Tagging Jira's for newbies

2016-04-20 Thread David Lyle
> > We should get this documented on the wiki. > > > > > On Apr 16, 2016, at 2:08 PM, James Sirota > > wrote: > > > > > > Very cool. I like the idea. So we’ll standardize on tagging Jiras > with > > newbie and newbie++ > > > > > > Would an

Re: Metron Person Types...

2016-05-09 Thread David Lyle
Hi John, METRON-78 was originally conceived as a ticket to add the Maven build step to the Ansible scripts. I think that makes the most sense as they're run in the case of EC2 or Vagrant or Production Deployment. I'd happily help get this one closed out. It gets me about once per week. You're rig

Re: Quick start deployment error

2016-05-29 Thread David Lyle
Hi Yazan, Thanks for giving Metron a try. We've seen this before when the Ansible version is not 2.0.0.2. Any chance that is the case for you? -David... On Sun, May 29, 2016 at 9:43 AM, Yazan Boshmaf wrote: > Hello! > > I'm going through the single-node deployment guide ( > https://github.com

Re: [DISCUSS] Bylaws discussion

2016-07-14 Thread David Lyle
What does "Votes relating to code changes are not subject to a strict timetable but should be made as timely as possible" mean to you? One issue I'm concerned about with lazy consensus is having adequate time to review a code change. Requiring 2 +1's has been pain sometimes, but it kind of makes s

Re: [jira] [Created] (METRON-348) bro-plugin-kafka is missing an important update

2016-07-24 Thread David Lyle
I guess what I'm trying to understand is how the patch you pointed to changes the behavior in Metron. That is, if we only grab http and dns and point to a single topic, do we need it? Besides that, we seem to have a licensing issue. The same code in the Bro project is not Apache licensed. That see

Re: [VOTE] Adopting Bylaws

2016-08-17 Thread David Lyle
+1 (non-binding) Adopt the bylaws as stated here . -D... On Wed, Aug 17, 2016 at 3:23 PM, Andrew Psaltis wrote: > +1 (non-binding) Adopt the bylaws as stated here >

Re: [DISCUSS] Storm topology sideloading jars

2016-09-19 Thread David Lyle
I don't believe Storm does, we would have to modify our bolts to add an additional classloader to the current classloader chain. Shouldn't be too much work, but a ton of reward. Accumulo had a similar requirement- distributing and synchronizing jars to distributed components. They introduced a vfs

Re: log parsers-

2016-09-19 Thread David Lyle
Does Elasticsearch Nested Objects [1] help with that? [1] https://www.elastic.co/guide/en/elasticsearch/guide/current/nested-objects.html On Mon, Sep 19, 2016 at 9:43 AM, Casey Stella wrote: > So, just curious, what kind of behavior would you expect if the JSON had a > complex map inside of it

Re: hdp-select missing

2016-09-23 Thread David Lyle
Hi Otto, Afaik, hdp-select only knows about the HDP stack services, so it gets deployed with HDP. I don't understand how it would apply to an add-on management pack. What am I missing? -D... On Fri, Sep 23, 2016 at 11:23 AM, Otto Fowler wrote: > Is there a reason why hdp-select is not deploye

Re: [DISCUSS] Upcoming Metron Build

2016-09-27 Thread David Lyle
I'd like to hold out for https://issues.apache.org/jira/browse/METRON-466. I'm testing this now, so am a few hours out. -D... On Tue, Sep 27, 2016 at 11:41 AM, Michael Miklavcic < michael.miklav...@gmail.com> wrote: > Also need this Jira to bump the version. > > https://issues.apache.org/jira/b

Re: [DISCUSS] Upcoming Metron Build

2016-09-28 Thread David Lyle
No. METRON-466 is in review. On Wednesday, September 28, 2016, James Sirota wrote: > Do we now have everything we wanted in there? > > 27.09.2016, 08:59, "David Lyle" >: > > I'd like to hold out for https://issues.apache.org/ > jira/browse/METRON-466. &

Re: Storm Topology total workers

2016-09-29 Thread David Lyle
IIRC, you're trying to persist a parser as a default in your single node machine? If that's the case, changing lines 75 of single_node_vm.yml to supervisor.slots.ports: "[6700, 6701, 6702, 6703, 6704]" and running full dev should do the trick. You'll need to apply a patch to get full dev to build

Re: Storm Topology total workers

2016-09-29 Thread David Lyle
ail about, I’m not sure if I need to stop > >> more > >> services besides the parsers and I’m hitting a memory thing or what. I > >> really want to validate my end-to-end before redeploying my cluster. > >> > >> I have ‘hand’ applied the start ambari clust

Re: [DISCUSS] Metron IRC channel

2016-09-29 Thread David Lyle
ditto. On Thu, Sep 29, 2016 at 1:29 PM, Casey Stella wrote: > I'd agree; let's focus on #apache-metron > > On Thu, Sep 29, 2016 at 11:55 AM, James Sirota wrote: > > > I would just keep #apache-metron and open it up to general public > > > > 29.09.2016, 08:54, "Yohann Lepage" : > > > Hi everyone

Re: [VOTE] Releasing Apache Metron 0.2.1BETA-RC1

2016-09-29 Thread David Lyle
+1 (binding) checksums/gpg - checked Rat Check - passed Integration Tests - passed Package Builds - success Quick Dev - worked as expected On Thu, Sep 29, 2016 at 2:32 PM, James Sirota wrote: > +1, binding > > 29.09.2016, 11:31, "James Sirota" : > > This is a call to vote on releasing Apache Me

Re: [VOTE] Releasing Apache Metron 0.2.1BETA-RC1

2016-09-29 Thread David Lyle
Correction, the solr bundle didn't deploy - let me retract that +1 for a sec. On Thu, Sep 29, 2016 at 4:09 PM, David Lyle wrote: > +1 (binding) > > checksums/gpg - checked > Rat Check - passed > Integration Tests - passed > Package Builds - success > Quick Dev - wor

Re: [VOTE] Releasing Apache Metron 0.2.1BETA-RC1

2016-09-29 Thread David Lyle
Okay, so it looks like METRON-466 and METRON-389 crossed paths and the metron_version in the quick dev is still 0.2.0BETA. Easy to fix, how do you want to proceed? -D... On Thu, Sep 29, 2016 at 4:13 PM, David Lyle wrote: > Correction, the solr bundle didn't deploy - let me retract

Re: [VOTE] Releasing Apache Metron 0.2.1BETA-RC1

2016-09-29 Thread David Lyle
Sounds good to me. I can push up a pr straightaway. Testing the fix now. -D... On Thu, Sep 29, 2016 at 4:17 PM, Casey Stella wrote: > Let's cancel the vote, someone put up a PR to correct and cut a rc2. How > about that? > > On Thu, Sep 29, 2016 at 4:16 PM, David Lyle wrot

Re: [VOTE] Releasing Apache Metron 0.2.1BETA-RC1

2016-09-29 Thread David Lyle
Hi Mike, Yeah, that's all it is. We just crossed is all. -D... On Thu, Sep 29, 2016 at 4:29 PM, Michael Miklavcic < michael.miklav...@gmail.com> wrote: > Sweet! Thanks David. > > On Thu, Sep 29, 2016 at 4:18 PM, David Lyle wrote: > > > Sounds good to me. I

Re: [VOTE] Releasing Apache Metron 0.2.1BETA-RC2

2016-09-30 Thread David Lyle
+1 (binding) checksums/gpg - checked Rat Check - passed Integration Tests - passed Package Builds - success Quick Dev - Built and data showed up in Kibana -D...

Re: [GitHub] incubator-metron issue #288: METRON-480: Kibana 4.5+ Requires http.cors.enab...

2016-10-06 Thread David Lyle
Got it. This will keep that from happening. If you don't want to reprovision- add a property http.cors.enabled. The display name and the actual property name are different. -D... On Thu, Oct 6, 2016 at 4:07 PM, nickwallen wrote: > Github user nickwallen commented on the issue: > > https://

Re: [DISCUSS] Move grok pattern from HDFS to Zookeeper

2016-10-10 Thread David Lyle
I'm +1 on that. I'd also like to see them removed from the classpath so that Zookeeper is the sole authoritative source for the Grok patterns. -D... On Mon, Oct 10, 2016 at 4:13 PM, Ryan Merriman wrote: > Currently a file with a Grok pattern is stored in HDFS and referenced by > path in a Zooke

Re: [DISCUSS] Upgrading to Storm 1.0.x

2016-10-11 Thread David Lyle
I'm +1 on this. On Tue, Oct 11, 2016 at 9:54 AM, Justin Leet wrote: > Hi all, > > I wanted to start a thread around upgrading our Storm version from 0.10.x > to 1.0.x. I created a Jira at > https://issues.apache.org/jira/browse/METRON-495 to mirror this discussion > and the results and opinions