[GitHub] [metron-bro-plugin-kafka] ottobackwards commented on pull request #12: METRON-1817: Remove bro package dependency on bro source

2020-05-05 Thread GitBox


ottobackwards commented on pull request #12:
URL: 
https://github.com/apache/metron-bro-plugin-kafka/pull/12#issuecomment-624390051


   +1, ship it



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[jira] [Created] (METRON-2352) [BRO-KAFKA-PLUGIN] e2e testing should leverage multiple brokers

2020-05-05 Thread Jon Zeolla (Jira)
Jon Zeolla created METRON-2352:
--

 Summary: [BRO-KAFKA-PLUGIN] e2e testing should leverage multiple 
brokers
 Key: METRON-2352
 URL: https://issues.apache.org/jira/browse/METRON-2352
 Project: Metron
  Issue Type: Bug
Reporter: Jon Zeolla
Assignee: Jon Zeolla


Currently we only create a single kafka broker for e2e testing.  We should 
leverage multiple brokers for a more production-equivalent testing.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [metron-bro-plugin-kafka] JonZeolla commented on pull request #40: METRON-2309 Add a Kafka "metadata.broker.list" for each log writer filter.

2020-05-05 Thread GitBox


JonZeolla commented on pull request #40:
URL: 
https://github.com/apache/metron-bro-plugin-kafka/pull/40#issuecomment-624383143


   Also please align the title of the PR exactly with your 
[JIRA](https://issues.apache.org/jira/browse/METRON-2309)



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [metron-bro-plugin-kafka] JonZeolla edited a comment on pull request #8: METRON-1768: Adjust versioning of metron-bro-plugin-kafka to be x.y.z

2020-05-05 Thread GitBox


JonZeolla edited a comment on pull request #8:
URL: 
https://github.com/apache/metron-bro-plugin-kafka/pull/8#issuecomment-425690228


   This is on hold, pending https://github.com/zeek/zeek/issues/152



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [metron-bro-plugin-kafka] JonZeolla commented on pull request #40: METRON-2309 Add a Kafka "metadata.broker.list" for each log writer filter.

2020-05-05 Thread GitBox


JonZeolla commented on pull request #40:
URL: 
https://github.com/apache/metron-bro-plugin-kafka/pull/40#issuecomment-624373988


   @mauropalumbo75 the issue you were seeing was fixed as of 587e9da and I just 
confirmed that everything is now passing on this branch.
   
   I would love to get this in - can you please add some tests for the new 
logic?



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [metron] ottobackwards commented on a change in pull request #1580: METRON-2348 fix prepare-commit

2020-05-05 Thread GitBox


ottobackwards commented on a change in pull request #1580:
URL: https://github.com/apache/metron/pull/1580#discussion_r420479572



##
File path: dev-utilities/committer-utils/metron-committer-common
##
@@ -135,8 +135,8 @@ function read_pull_request {
   exit 1
 fi
 
-if [[ "$PR_MERGEABLE" != "\"clean\"" ]]; then
-  echo "Error: pull request #$PR is not mergable"
+if [[ "$PR_MERGEABLE" == "\"clean\"" ]] || [[ "$PR_MERGEABLE" == 
"unstable" ]]; then

Review comment:
   drat





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [metron] JonZeolla commented on a change in pull request #1580: METRON-2348 fix prepare-commit

2020-05-05 Thread GitBox


JonZeolla commented on a change in pull request #1580:
URL: https://github.com/apache/metron/pull/1580#discussion_r420477673



##
File path: dev-utilities/committer-utils/metron-committer-common
##
@@ -135,8 +135,8 @@ function read_pull_request {
   exit 1
 fi
 
-if [[ "$PR_MERGEABLE" != "\"clean\"" ]]; then
-  echo "Error: pull request #$PR is not mergable"
+if [[ "$PR_MERGEABLE" == "\"clean\"" ]] || [[ "$PR_MERGEABLE" == 
"unstable" ]]; then

Review comment:
   Not sure what you were getting at with this change.  Did you mean to 
change `!=` to `==`?  Also, if it's `!= "\"clean\""` then it doesn't matter if 
it's `== "unstable"`





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [metron] JonZeolla commented on a change in pull request #1580: METRON-2348 fix prepare-commit

2020-05-05 Thread GitBox


JonZeolla commented on a change in pull request #1580:
URL: https://github.com/apache/metron/pull/1580#discussion_r420477673



##
File path: dev-utilities/committer-utils/metron-committer-common
##
@@ -135,8 +135,8 @@ function read_pull_request {
   exit 1
 fi
 
-if [[ "$PR_MERGEABLE" != "\"clean\"" ]]; then
-  echo "Error: pull request #$PR is not mergable"
+if [[ "$PR_MERGEABLE" == "\"clean\"" ]] || [[ "$PR_MERGEABLE" == 
"unstable" ]]; then

Review comment:
   Not sure what you were getting at with this change.  Did you mean to 
change `!=` to `==`?  Also, if it's `!= "\"clean\""` then it doesn't matter if 
it's `== "unstable"` or `== "literallyanything"`





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [metron] JonZeolla commented on a change in pull request #1580: METRON-2348 fix prepare-commit

2020-05-05 Thread GitBox


JonZeolla commented on a change in pull request #1580:
URL: https://github.com/apache/metron/pull/1580#discussion_r420477673



##
File path: dev-utilities/committer-utils/metron-committer-common
##
@@ -135,8 +135,8 @@ function read_pull_request {
   exit 1
 fi
 
-if [[ "$PR_MERGEABLE" != "\"clean\"" ]]; then
-  echo "Error: pull request #$PR is not mergable"
+if [[ "$PR_MERGEABLE" == "\"clean\"" ]] || [[ "$PR_MERGEABLE" == 
"unstable" ]]; then

Review comment:
   I think you meant `if [[ "$PR_MERGEABLE" != "\"clean\"" ]] || [[ 
"$PR_MERGEABLE" == "unstable" ]]; then`





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[jira] [Created] (METRON-2351) Zeek Plugin should have it's own version of prepare commit

2020-05-05 Thread Otto Fowler (Jira)
Otto Fowler created METRON-2351:
---

 Summary: Zeek Plugin should have it's own version of prepare commit
 Key: METRON-2351
 URL: https://issues.apache.org/jira/browse/METRON-2351
 Project: Metron
  Issue Type: Improvement
Reporter: Otto Fowler
Assignee: Otto Fowler


The plugin project shouldn't depend on the main project



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [metron-bro-plugin-kafka] ottobackwards commented on pull request #44: METRON-2270 Update to reflect bro project rename

2020-05-05 Thread GitBox


ottobackwards commented on pull request #44:
URL: 
https://github.com/apache/metron-bro-plugin-kafka/pull/44#issuecomment-624366596


   for the love of puppies, merge this already



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [metron-bro-plugin-kafka] JonZeolla commented on a change in pull request #44: METRON-2270 Update to reflect bro project rename

2020-05-05 Thread GitBox


JonZeolla commented on a change in pull request #44:
URL: 
https://github.com/apache/metron-bro-plugin-kafka/pull/44#discussion_r420364150



##
File path: README.md
##
@@ -16,7 +16,7 @@ This software is a part of the [Apache 
Metron](http://metron.apache.org/) projec
 
 `zkg` is the preferred mechanism for installing this plugin, as it will 
dynamically retrieve, build, test, and load the plugin.  Note, that you will 
still need to [activate](#activation) and configure the plugin after your 
installation.
 
-1. Install [librdkafka](https://github.com/edenhill/librdkafka), a native 
client library for Kafka.  This plugin has been tested against the latest 
release of librdkafka, which at the time of this writing is v1.4.2.
+1. Install [librdkafka](https://github.com/edenhill/librdkafka), a native 
client library for Kafka.  This plugin has been tested against librdkafka 
v1.4.2.

Review comment:
   Updated documentation to point to RC3 regarding what was tested and 
`zkg.meta` points to `~1.4.2-RC1` as the required external_depends





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [metron-bro-plugin-kafka] JonZeolla commented on a change in pull request #44: METRON-2270 Update to reflect bro project rename

2020-05-05 Thread GitBox


JonZeolla commented on a change in pull request #44:
URL: 
https://github.com/apache/metron-bro-plugin-kafka/pull/44#discussion_r420359510



##
File path: README.md
##
@@ -63,11 +63,11 @@ This software is a part of the [Apache 
Metron](http://metron.apache.org/) projec
 
 ### Manual Installation
 
-Manually installing the plugin should only occur in situations where 
installing and configuring `zkg` is not reasonable, such as in a docker 
container.  If you are running zeek in an environment where you do not have 
Internet connectivity, investigate 
[bundles](https://docs.zeek.org/projects/package-manager/en/stable/zkg.html#bundle)
 or creating an internal [package 
source](https://docs.zeek.org/projects/package-manager/en/stable/source.html).
+Manually installing the plugin should *only* occur in situations where 
installing and configuring `zkg` is not reasonable.  If you are running zeek in 
an environment where you do not have Internet connectivity, investigate 
[bundles](https://docs.zeek.org/projects/package-manager/en/stable/zkg.html#bundle)
 or creating an internal [package 
source](https://docs.zeek.org/projects/package-manager/en/stable/source.html).
 
 These instructions could also be helpful if you were interested in 
distributing this as a package (such as a deb or rpm).
 
-1. Install [librdkafka](https://github.com/edenhill/librdkafka), a native 
client library for Kafka.  This plugin has been tested against the latest 
release of librdkafka, which at the time of this writing is v1.4.2.
+1. Install [librdkafka](https://github.com/edenhill/librdkafka), a native 
client library for Kafka.  This plugin has been tested against librdkafka 
v1.4.2.

Review comment:
   Update made throughout





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [metron-bro-plugin-kafka] ottobackwards commented on a change in pull request #44: METRON-2270 Update to reflect bro project rename

2020-05-05 Thread GitBox


ottobackwards commented on a change in pull request #44:
URL: 
https://github.com/apache/metron-bro-plugin-kafka/pull/44#discussion_r420304901



##
File path: README.md
##
@@ -16,7 +16,7 @@ This software is a part of the [Apache 
Metron](http://metron.apache.org/) projec
 
 `zkg` is the preferred mechanism for installing this plugin, as it will 
dynamically retrieve, build, test, and load the plugin.  Note, that you will 
still need to [activate](#activation) and configure the plugin after your 
installation.
 
-1. Install [librdkafka](https://github.com/edenhill/librdkafka), a native 
client library for Kafka.  This plugin has been tested against the latest 
release of librdkafka, which at the time of this writing is v1.4.2.
+1. Install [librdkafka](https://github.com/edenhill/librdkafka), a native 
client library for Kafka.  This plugin has been tested against librdkafka 
v1.4.2.

Review comment:
   Yes, if we don't have a timeframe.  This is an in between release build 
in our terms, and it passes our tests.  I don't see why we wait.  But maybe I 
don't understand the arguments?





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [metron-bro-plugin-kafka] JonZeolla commented on a change in pull request #44: METRON-2270 Update to reflect bro project rename

2020-05-05 Thread GitBox


JonZeolla commented on a change in pull request #44:
URL: 
https://github.com/apache/metron-bro-plugin-kafka/pull/44#discussion_r420299628



##
File path: README.md
##
@@ -16,7 +16,7 @@ This software is a part of the [Apache 
Metron](http://metron.apache.org/) projec
 
 `zkg` is the preferred mechanism for installing this plugin, as it will 
dynamically retrieve, build, test, and load the plugin.  Note, that you will 
still need to [activate](#activation) and configure the plugin after your 
installation.
 
-1. Install [librdkafka](https://github.com/edenhill/librdkafka), a native 
client library for Kafka.  This plugin has been tested against the latest 
release of librdkafka, which at the time of this writing is v1.4.2.
+1. Install [librdkafka](https://github.com/edenhill/librdkafka), a native 
client library for Kafka.  This plugin has been tested against librdkafka 
v1.4.2.

Review comment:
   Right, we are on the same page.  I'm saying I'm open to waiting to merge 
this until 1.4.2 is released and any remnants for RC3 are removed.  If we don't 
do that, I agree the docs should be accurate as of the commit and refer to RC3.
   
   I assume your preference is update the README to reflect the RC and get this 
merged sooner rather than later, given we don't know what the 1.4.2 timeframe 
is?





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [metron-bro-plugin-kafka] ottobackwards commented on a change in pull request #44: METRON-2270 Update to reflect bro project rename

2020-05-05 Thread GitBox


ottobackwards commented on a change in pull request #44:
URL: 
https://github.com/apache/metron-bro-plugin-kafka/pull/44#discussion_r420274006



##
File path: README.md
##
@@ -16,7 +16,7 @@ This software is a part of the [Apache 
Metron](http://metron.apache.org/) projec
 
 `zkg` is the preferred mechanism for installing this plugin, as it will 
dynamically retrieve, build, test, and load the plugin.  Note, that you will 
still need to [activate](#activation) and configure the plugin after your 
installation.
 
-1. Install [librdkafka](https://github.com/edenhill/librdkafka), a native 
client library for Kafka.  This plugin has been tested against the latest 
release of librdkafka, which at the time of this writing is v1.4.2.
+1. Install [librdkafka](https://github.com/edenhill/librdkafka), a native 
client library for Kafka.  This plugin has been tested against librdkafka 
v1.4.2.

Review comment:
   Ok,  I wasn't thinking of this as a question of the release or release 
process, I'm just thinking that with 'stable master', this needs to be correct 
(as of this commit )
   
   The question of cutting a release off of master or not is separate.





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [metron-bro-plugin-kafka] JonZeolla commented on a change in pull request #44: METRON-2270 Update to reflect bro project rename

2020-05-05 Thread GitBox


JonZeolla commented on a change in pull request #44:
URL: 
https://github.com/apache/metron-bro-plugin-kafka/pull/44#discussion_r420178988



##
File path: README.md
##
@@ -16,7 +16,7 @@ This software is a part of the [Apache 
Metron](http://metron.apache.org/) projec
 
 `zkg` is the preferred mechanism for installing this plugin, as it will 
dynamically retrieve, build, test, and load the plugin.  Note, that you will 
still need to [activate](#activation) and configure the plugin after your 
installation.
 
-1. Install [librdkafka](https://github.com/edenhill/librdkafka), a native 
client library for Kafka.  This plugin has been tested against the latest 
release of librdkafka, which at the time of this writing is v1.4.2.
+1. Install [librdkafka](https://github.com/edenhill/librdkafka), a native 
client library for Kafka.  This plugin has been tested against librdkafka 
v1.4.2.

Review comment:
   This is up for debate, I'm good with waiting for the release or running 
with the RC.





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [metron-bro-plugin-kafka] ottobackwards commented on a change in pull request #44: METRON-2270 Update to reflect bro project rename

2020-05-05 Thread GitBox


ottobackwards commented on a change in pull request #44:
URL: 
https://github.com/apache/metron-bro-plugin-kafka/pull/44#discussion_r420173786



##
File path: README.md
##
@@ -63,11 +63,11 @@ This software is a part of the [Apache 
Metron](http://metron.apache.org/) projec
 
 ### Manual Installation
 
-Manually installing the plugin should only occur in situations where 
installing and configuring `zkg` is not reasonable, such as in a docker 
container.  If you are running zeek in an environment where you do not have 
Internet connectivity, investigate 
[bundles](https://docs.zeek.org/projects/package-manager/en/stable/zkg.html#bundle)
 or creating an internal [package 
source](https://docs.zeek.org/projects/package-manager/en/stable/source.html).
+Manually installing the plugin should *only* occur in situations where 
installing and configuring `zkg` is not reasonable.  If you are running zeek in 
an environment where you do not have Internet connectivity, investigate 
[bundles](https://docs.zeek.org/projects/package-manager/en/stable/zkg.html#bundle)
 or creating an internal [package 
source](https://docs.zeek.org/projects/package-manager/en/stable/source.html).
 
 These instructions could also be helpful if you were interested in 
distributing this as a package (such as a deb or rpm).
 
-1. Install [librdkafka](https://github.com/edenhill/librdkafka), a native 
client library for Kafka.  This plugin has been tested against the latest 
release of librdkafka, which at the time of this writing is v1.4.2.
+1. Install [librdkafka](https://github.com/edenhill/librdkafka), a native 
client library for Kafka.  This plugin has been tested against librdkafka 
v1.4.2.

Review comment:
   same as above, put in the RC version





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [metron-bro-plugin-kafka] ottobackwards commented on a change in pull request #44: METRON-2270 Update to reflect bro project rename

2020-05-05 Thread GitBox


ottobackwards commented on a change in pull request #44:
URL: 
https://github.com/apache/metron-bro-plugin-kafka/pull/44#discussion_r420173561



##
File path: README.md
##
@@ -16,7 +16,7 @@ This software is a part of the [Apache 
Metron](http://metron.apache.org/) projec
 
 `zkg` is the preferred mechanism for installing this plugin, as it will 
dynamically retrieve, build, test, and load the plugin.  Note, that you will 
still need to [activate](#activation) and configure the plugin after your 
installation.
 
-1. Install [librdkafka](https://github.com/edenhill/librdkafka), a native 
client library for Kafka.  This plugin has been tested against the latest 
release of librdkafka, which at the time of this writing is v1.4.2.
+1. Install [librdkafka](https://github.com/edenhill/librdkafka), a native 
client library for Kafka.  This plugin has been tested against librdkafka 
v1.4.2.

Review comment:
   If we are going to commit with the -RC version, this should say the RC 
version.





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [metron-bro-plugin-kafka] JonZeolla commented on pull request #44: METRON-2270 Update to reflect bro project rename

2020-05-05 Thread GitBox


JonZeolla commented on pull request #44:
URL: 
https://github.com/apache/metron-bro-plugin-kafka/pull/44#issuecomment-624043661


   @ottobackwards Unit tests and e2e are both passing now.



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [metron-bro-plugin-kafka] JonZeolla commented on a change in pull request #44: METRON-2270 Update to reflect bro project rename

2020-05-05 Thread GitBox


JonZeolla commented on a change in pull request #44:
URL: 
https://github.com/apache/metron-bro-plugin-kafka/pull/44#discussion_r420092815



##
File path: README.md
##
@@ -12,68 +12,68 @@ This software is a part of the [Apache 
Metron](http://metron.apache.org/) projec
 
 ## Installation

Review comment:
   README should be accurate as of 761462a, ready for review.





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org