[GitHub] metron pull request #1039: METRON-1588 Migrate storm-kafka-client to 1.2.1

2018-06-04 Thread HeartSaVioR
Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/metron/pull/1039#discussion_r192684452 --- Diff: metron-platform/metron-storm-kafka-override/src/main/java/org/apache/storm/kafka/spout/KafkaSpoutRetryExponentialBackoff.java --- @@ -0,0 +1,

[jira] [Commented] (METRON-1588) Migrate storm-kafka-client to 1.2.1

2018-06-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/METRON-1588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16499975#comment-16499975 ] ASF GitHub Bot commented on METRON-1588: Github user HeartSaVioR commented on a

[GitHub] metron issue #1040: METRON-1589: '/api/v1/search/search' fails when 'Solr Zo...

2018-06-04 Thread justinleet
Github user justinleet commented on the issue: https://github.com/apache/metron/pull/1040 @cestella Before I merge this in, are you okay with this PR doing this for the existing constant? https://github.com/apache/metron/pull/1040/commits/c04b9462669bbe26de0ee1f6c7d0d39a348e8

[jira] [Commented] (METRON-1589) '/api/v1/search/search' fails when 'Solr Zookeeper Urls' has comma separated multiple zookeeper urls

2018-06-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/METRON-1589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16500210#comment-16500210 ] ASF GitHub Bot commented on METRON-1589: Github user justinleet commented on the

[GitHub] metron issue #1036: METRON-1584 Indexing Topology Crashes with Invalid Messa...

2018-06-04 Thread merrimanr
Github user merrimanr commented on the issue: https://github.com/apache/metron/pull/1036 I ran this up in full dev and everything worked as expected. +1 pending approval from other reviewers. ---

[jira] [Commented] (METRON-1584) Indexing Topology Crashes with Invalid Message

2018-06-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/METRON-1584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16500226#comment-16500226 ] ASF GitHub Bot commented on METRON-1584: Github user merrimanr commented on the

[GitHub] metron pull request #1044: METRON-1593: Setting Metron rest additional class...

2018-06-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/metron/pull/1044 ---

[jira] [Commented] (METRON-1593) Setting Metron rest additional classpath removes HBase and Hadoop configs from classpath

2018-06-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/METRON-1593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16500246#comment-16500246 ] ASF GitHub Bot commented on METRON-1593: Github user asfgit closed the pull requ

[GitHub] metron issue #1045: METRON-1594: KafkaWriter is asynchronous and may lose da...

2018-06-04 Thread mmiklavc
Github user mmiklavc commented on the issue: https://github.com/apache/metron/pull/1045 @ottobackwards I believe this should already be handled by the acking strategy. Anything not acked will be replayed since we're leveraging at least once message processing semantics. ---

[jira] [Commented] (METRON-1594) KafkaWriter is asynchronous and may lose data on node failure

2018-06-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/METRON-1594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16500486#comment-16500486 ] ASF GitHub Bot commented on METRON-1594: Github user mmiklavc commented on the i

[GitHub] metron issue #1037: METRON-1547: Solr Comment Fields

2018-06-04 Thread merrimanr
Github user merrimanr commented on the issue: https://github.com/apache/metron/pull/1037 I agree with you @justinleet, we should drop the optional index from the query. ---

[jira] [Commented] (METRON-1547) Solr Comment Fields

2018-06-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/METRON-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16500597#comment-16500597 ] ASF GitHub Bot commented on METRON-1547: Github user merrimanr commented on the

[jira] [Created] (METRON-1598) NoClassDefFoundError when running with Elasticsearch X-Pack

2018-06-04 Thread Nick Allen (JIRA)
Nick Allen created METRON-1598: -- Summary: NoClassDefFoundError when running with Elasticsearch X-Pack Key: METRON-1598 URL: https://issues.apache.org/jira/browse/METRON-1598 Project: Metron Iss

[jira] [Updated] (METRON-1598) NoClassDefFoundError when running with Elasticsearch X-Pack

2018-06-04 Thread Nick Allen (JIRA)
[ https://issues.apache.org/jira/browse/METRON-1598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Allen updated METRON-1598: --- Description: When running on Elasticsearch with X-Pack enabled, the following exception is thrown i

[jira] [Created] (METRON-1599) Allow user to define global property 'source.type.field' in Ambari

2018-06-04 Thread Nick Allen (JIRA)
Nick Allen created METRON-1599: -- Summary: Allow user to define global property 'source.type.field' in Ambari Key: METRON-1599 URL: https://issues.apache.org/jira/browse/METRON-1599 Project: Metron

[GitHub] metron issue #1043: METRON-1587: Make collection utility work for HDP search

2018-06-04 Thread merrimanr
Github user merrimanr commented on the issue: https://github.com/apache/metron/pull/1043 As I update the documentation in the Solr README it occurs to me that we should consider installing HDP Search 3 in full dev with our Ansible scripts. I have a feeling this will end up being the

[jira] [Commented] (METRON-1587) Make collection utility work for HDP search

2018-06-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/METRON-1587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16500675#comment-16500675 ] ASF GitHub Bot commented on METRON-1587: Github user merrimanr commented on the

[GitHub] metron pull request #1047: METRON-1599 Allow user to define global property ...

2018-06-04 Thread nickwallen
GitHub user nickwallen opened a pull request: https://github.com/apache/metron/pull/1047 METRON-1599 Allow user to define global property 'source.type.field' in Ambari The user can specify the name of the message field containing the source type in the global configuration. This i

[jira] [Commented] (METRON-1599) Allow user to define global property 'source.type.field' in Ambari

2018-06-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/METRON-1599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16500681#comment-16500681 ] ASF GitHub Bot commented on METRON-1599: GitHub user nickwallen opened a pull re

[GitHub] metron pull request #1048: METRON-1598 NoClassDefFoundError when running wit...

2018-06-04 Thread nickwallen
GitHub user nickwallen opened a pull request: https://github.com/apache/metron/pull/1048 METRON-1598 NoClassDefFoundError when running with Elasticsearch X-Pack In the directions for setting up Metron to work with the X-Pack, we just have one exclusion too many. Simple fix.

[GitHub] metron issue #1043: METRON-1587: Make collection utility work for HDP search

2018-06-04 Thread justinleet
Github user justinleet commented on the issue: https://github.com/apache/metron/pull/1043 @merrimanr There was a bit of discussion around this in #934, and it looks like the conclusion was that since HDP Search didn't support Solr 6 at the time, that we would hold off on it. Given th

[jira] [Created] (METRON-1600) Solr should be using threat.triage.score everywhere instead of threat:triage:score (back end)

2018-06-04 Thread Ryan Merriman (JIRA)
Ryan Merriman created METRON-1600: - Summary: Solr should be using threat.triage.score everywhere instead of threat:triage:score (back end) Key: METRON-1600 URL: https://issues.apache.org/jira/browse/METRON-1600

[jira] [Commented] (METRON-1598) NoClassDefFoundError when running with Elasticsearch X-Pack

2018-06-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/METRON-1598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16500710#comment-16500710 ] ASF GitHub Bot commented on METRON-1598: GitHub user nickwallen opened a pull re

[GitHub] metron issue #1043: METRON-1587: Make collection utility work for HDP search

2018-06-04 Thread merrimanr
Github user merrimanr commented on the issue: https://github.com/apache/metron/pull/1043 Ok I'll hold off on that for now and will also hold off on documenting anything Ambari related since it's going to depend on what we decide to do with HDP Search. For this PR I will document stan

[jira] [Commented] (METRON-1587) Make collection utility work for HDP search

2018-06-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/METRON-1587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16500727#comment-16500727 ] ASF GitHub Bot commented on METRON-1587: Github user merrimanr commented on the

[jira] [Commented] (METRON-1587) Make collection utility work for HDP search

2018-06-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/METRON-1587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16500715#comment-16500715 ] ASF GitHub Bot commented on METRON-1587: Github user justinleet commented on the

[jira] [Updated] (METRON-1600) Solr should be using threat.triage.score everywhere instead of threat:triage:score (back end)

2018-06-04 Thread Ryan Merriman (JIRA)
[ https://issues.apache.org/jira/browse/METRON-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Merriman updated METRON-1600: -- Issue Type: Sub-task (was: Bug) Parent: METRON-1416 > Solr should be using threat.tri

[GitHub] metron issue #1046: METRON-1597 EC2 10 Node Deployment - New function to che...

2018-06-04 Thread mmiklavc
Github user mmiklavc commented on the issue: https://github.com/apache/metron/pull/1046 @as22323 Really appreciate the effort to get this working across OSes. My concern with this approach is that ansible.cfg is a file necessarily tracked by our Git repo. Any change to it will be refl

[jira] [Commented] (METRON-1597) EC2 10 Node Deployment - New function to check os and update *.cfg control_path

2018-06-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/METRON-1597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16500781#comment-16500781 ] ASF GitHub Bot commented on METRON-1597: Github user mmiklavc commented on the i

[GitHub] metron pull request #1045: METRON-1594: KafkaWriter is asynchronous and may ...

2018-06-04 Thread mmiklavc
Github user mmiklavc commented on a diff in the pull request: https://github.com/apache/metron/pull/1045#discussion_r192868140 --- Diff: metron-platform/metron-writer/src/main/java/org/apache/metron/writer/kafka/KafkaWriter.java --- @@ -156,33 +172,61 @@ public void configure(Stri

[jira] [Commented] (METRON-1594) KafkaWriter is asynchronous and may lose data on node failure

2018-06-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/METRON-1594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16500805#comment-16500805 ] ASF GitHub Bot commented on METRON-1594: Github user mmiklavc commented on a dif

[GitHub] metron issue #1037: METRON-1547: Solr Comment Fields

2018-06-04 Thread cestella
Github user cestella commented on the issue: https://github.com/apache/metron/pull/1037 Yes, we should drop index from the query, agreed. ---

[jira] [Commented] (METRON-1547) Solr Comment Fields

2018-06-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/METRON-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16500819#comment-16500819 ] ASF GitHub Bot commented on METRON-1547: Github user cestella commented on the i

[GitHub] metron pull request #1040: METRON-1589: '/api/v1/search/search' fails when '...

2018-06-04 Thread cestella
Github user cestella commented on a diff in the pull request: https://github.com/apache/metron/pull/1040#discussion_r192870707 --- Diff: metron-platform/metron-solr/src/main/java/org/apache/metron/solr/writer/SolrWriter.java --- @@ -17,47 +17,46 @@ */ package org.apache

[jira] [Commented] (METRON-1589) '/api/v1/search/search' fails when 'Solr Zookeeper Urls' has comma separated multiple zookeeper urls

2018-06-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/METRON-1589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16500823#comment-16500823 ] ASF GitHub Bot commented on METRON-1589: Github user cestella commented on a dif

[GitHub] metron issue #1043: METRON-1587: Make collection utility work for HDP search

2018-06-04 Thread merrimanr
Github user merrimanr commented on the issue: https://github.com/apache/metron/pull/1043 The latest commit adds documentation on script usage to the Solr README. ---

[jira] [Created] (METRON-1601) Rename metaalert "alert" nested field to "metron_alert" to avoid collision

2018-06-04 Thread Casey Stella (JIRA)
Casey Stella created METRON-1601: Summary: Rename metaalert "alert" nested field to "metron_alert" to avoid collision Key: METRON-1601 URL: https://issues.apache.org/jira/browse/METRON-1601 Project: M

[jira] [Commented] (METRON-1587) Make collection utility work for HDP search

2018-06-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/METRON-1587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16500825#comment-16500825 ] ASF GitHub Bot commented on METRON-1587: Github user merrimanr commented on the

[jira] [Commented] (METRON-1601) Rename metaalert "alert" nested field to "metron_alert" to avoid collision

2018-06-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/METRON-1601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16500828#comment-16500828 ] ASF GitHub Bot commented on METRON-1601: GitHub user cestella opened a pull requ

[GitHub] metron pull request #1049: METRON-1601: Rename metaalert "alert" nested fiel...

2018-06-04 Thread cestella
GitHub user cestella opened a pull request: https://github.com/apache/metron/pull/1049 METRON-1601: Rename metaalert "alert" nested field to "metron_alert" to avoid collision ## Contributor Comments Currently we add a nested field called "alert" to our ES templates to enable me

[jira] [Commented] (METRON-1587) Make collection utility work for HDP search

2018-06-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/METRON-1587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16500839#comment-16500839 ] ASF GitHub Bot commented on METRON-1587: Github user cestella commented on the i

[GitHub] metron issue #1043: METRON-1587: Make collection utility work for HDP search

2018-06-04 Thread cestella
Github user cestella commented on the issue: https://github.com/apache/metron/pull/1043 I'm ok with full-dev off of HDP search, but that's a separate ticket than this IMO. ---

[GitHub] metron issue #1048: METRON-1598 NoClassDefFoundError when running with Elast...

2018-06-04 Thread mmiklavc
Github user mmiklavc commented on the issue: https://github.com/apache/metron/pull/1048 +1 by inspection. ---

[jira] [Commented] (METRON-1598) NoClassDefFoundError when running with Elasticsearch X-Pack

2018-06-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/METRON-1598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16500878#comment-16500878 ] ASF GitHub Bot commented on METRON-1598: Github user mmiklavc commented on the i

[GitHub] metron issue #1046: METRON-1597 EC2 10 Node Deployment - New function to che...

2018-06-04 Thread as22323
Github user as22323 commented on the issue: https://github.com/apache/metron/pull/1046 @mmiklavc. One potential solution is to use changeAnsibleControlPath() to set the ["ANSIBLE_SSH_CONTROL_PATH"](https://docs.ansible.com/ansible/2.4/config.html#envvar-ANSIBLE_SSH_CONTROL_PATH) env

[jira] [Commented] (METRON-1597) EC2 10 Node Deployment - New function to check os and update *.cfg control_path

2018-06-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/METRON-1597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16501107#comment-16501107 ] ASF GitHub Bot commented on METRON-1597: Github user as22323 commented on the is

[GitHub] metron issue #1046: METRON-1597 EC2 10 Node Deployment - New function to che...

2018-06-04 Thread as22323
Github user as22323 commented on the issue: https://github.com/apache/metron/pull/1046 Another approach I just tried (failed so far) was updating the playbook.yml directly with the following: ``` tasks: -name: OSX Execution Check shell: "echo $ANSIBLE_SSH_CONTR

[jira] [Commented] (METRON-1597) EC2 10 Node Deployment - New function to check os and update *.cfg control_path

2018-06-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/METRON-1597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16501222#comment-16501222 ] ASF GitHub Bot commented on METRON-1597: Github user as22323 commented on the is