Hello,
I didn't check the BIOS if I can enable it.
Then, I see that yesterday has been updated the installation guideline for
Metron 0.3.1 as follows:
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=68718548
Reading that, there is no mention to Docker.
Maybe for my experiments
Github user ottobackwards commented on the issue:
https://github.com/apache/metron/pull/580
Another question here - any parser started from the METRON-UI will not
start the next time the service starts. This problem exists here as well, and
should prob. be another jira
---
If your
Github user ottobackwards commented on the issue:
https://github.com/apache/metron/pull/530
NOTE: I saw an error tonight in the UI that I don't quite understand about
loading grok statements when I clicked on an inactive parser ( yaf ). I have
to look at it tomorrow.
---
If your p
Github user ottobackwards commented on the issue:
https://github.com/apache/metron/pull/530
I have written
metron-extensions/metron-parser-extensions/ADDING_SYSTEM_PARSERS.md, and have
updated the testing portion of the PR description.
---
If your project is set up for it, you can r
Github user ottobackwards commented on a diff in the pull request:
https://github.com/apache/metron/pull/530#discussion_r120786253
--- Diff:
bundles-lib/src/test/java/org/apache/metron/bundles/integration/components/MRComponent.java
---
@@ -0,0 +1,68 @@
+/**
+ * Licensed t
Github user ottobackwards commented on a diff in the pull request:
https://github.com/apache/metron/pull/530#discussion_r120785962
--- Diff:
metron-extensions/metron-parser-extensions/metron-parser-bro-extension/metron-parser-bro/README.md
---
@@ -0,0 +1,3 @@
+# bro Parser
Github user ottobackwards commented on a diff in the pull request:
https://github.com/apache/metron/pull/530#discussion_r120785888
--- Diff:
metron-extensions/metron-parser-extensions/metron-parser-bro-extension/metron-parser-bro/README.md
---
@@ -0,0 +1,3 @@
+# bro Parser
Github user ottobackwards commented on a diff in the pull request:
https://github.com/apache/metron/pull/530#discussion_r120785578
--- Diff: bundles-maven-plugin/README.md ---
@@ -0,0 +1,89 @@
+
+# Apache Metron Bundle Maven Plugin
--- End diff --
Sure, I will f
Github user ottobackwards commented on a diff in the pull request:
https://github.com/apache/metron/pull/530#discussion_r120785493
--- Diff: bundles-maven-plugin/README.md ---
@@ -0,0 +1,89 @@
+
+# Apache Metron Bundle Maven Plugin
--- End diff --
I don't disagr
Github user ottobackwards commented on a diff in the pull request:
https://github.com/apache/metron/pull/530#discussion_r120785075
--- Diff:
metron-extensions/metron-parser-extensions/metron-parser-bro-extension/metron-parser-bro/src/main/config/zookeeper/enrichments/bro.json
---
Github user ottobackwards commented on a diff in the pull request:
https://github.com/apache/metron/pull/530#discussion_r120784845
--- Diff:
metron-extensions/metron-parser-extensions/metron-parser-bro-extension/metron-parser-bro/src/main/config/zookeeper/enrichments/bro.json
---
Github user ottobackwards commented on a diff in the pull request:
https://github.com/apache/metron/pull/530#discussion_r120784563
--- Diff: bundles-lib/pom.xml ---
@@ -0,0 +1,179 @@
+
+
+
+http://maven.apache.org/POM/4.0.0";
xmlns:xsi="http://www.w3.org/2001/XMLSch
Github user ottobackwards commented on a diff in the pull request:
https://github.com/apache/metron/pull/530#discussion_r120784485
--- Diff: bundles-lib/pom.xml ---
@@ -0,0 +1,179 @@
+
+
Github user ottobackwards commented on a diff in the pull request:
https://github.com/apache/metron/pull/530#discussion_r120784388
--- Diff: bundles-lib/pom.xml ---
@@ -0,0 +1,179 @@
+
+
Github user ottobackwards commented on a diff in the pull request:
https://github.com/apache/metron/pull/530#discussion_r120784270
--- Diff: bundles-lib/pom.xml ---
@@ -0,0 +1,179 @@
+
+
+
+http://maven.apache.org/POM/4.0.0";
xmlns:xsi="http://www.w3.org/2001/XMLSch
Github user merrimanr commented on the issue:
https://github.com/apache/metron/pull/613
Still working on updating the integration tests with the new properties.
Will have them fixed shortly.
---
If your project is set up for it, you can reply to this email and have your
reply appear
GitHub user merrimanr opened a pull request:
https://github.com/apache/metron/pull/613
METRON-990: Clean up and organize flux properties
## Contributor Comments
This PR is mainly a refactor of the enrichment and indexing flux files
along with their matching property files. The
Github user ottobackwards commented on the issue:
https://github.com/apache/metron/pull/530
Thanks for the feedback @nickwallen. I'm finishing testing my 'how to add
a new parser to metron proper' instructions at the moment. I will post them
tonight and answer all your questions!
If your processor doesn't support virtualization right now I would suggest
looking into if it is simply disabled in your BIOS/UEFI (most processers
have supported this for 10+ years, excluding some processors of course).
Docker is integrated into the build process right now and is considered
mandat
Github user nickwallen commented on a diff in the pull request:
https://github.com/apache/metron/pull/530#discussion_r120747477
--- Diff: metron-extensions/README.md ---
@@ -0,0 +1,51 @@
+# Metron Extensions
--- End diff --
Your new extension mechanism seems like a
Github user nickwallen commented on a diff in the pull request:
https://github.com/apache/metron/pull/530#discussion_r120743215
--- Diff: bundles-maven-plugin/README.md ---
@@ -0,0 +1,89 @@
+
+# Apache Metron Bundle Maven Plugin
--- End diff --
The new top-level
Github user nickwallen commented on a diff in the pull request:
https://github.com/apache/metron/pull/530#discussion_r120747187
--- Diff: bundles-maven-plugin/pom.xml ---
@@ -0,0 +1,328 @@
+
+
+http://maven.apache.org/POM/4.0.0";
xmlns:xsi="http://www.w3.org/2001/XMLSch
Github user nickwallen commented on a diff in the pull request:
https://github.com/apache/metron/pull/530#discussion_r120740755
--- Diff:
bundles-lib/src/test/java/org/apache/metron/bundles/integration/components/MRComponent.java
---
@@ -0,0 +1,68 @@
+/**
+ * Licensed to t
Github user nickwallen commented on a diff in the pull request:
https://github.com/apache/metron/pull/530#discussion_r120738935
--- Diff: bundles-lib/pom.xml ---
@@ -0,0 +1,179 @@
+
+
+
+http://maven.apache.org/POM/4.0.0";
xmlns:xsi="http://www.w3.org/2001/XMLSchema
Github user nickwallen commented on a diff in the pull request:
https://github.com/apache/metron/pull/530#discussion_r120742937
--- Diff: bundles-maven-plugin/README.md ---
@@ -0,0 +1,89 @@
+
+# Apache Metron Bundle Maven Plugin
--- End diff --
The new top-level
Github user nickwallen commented on a diff in the pull request:
https://github.com/apache/metron/pull/530#discussion_r120745677
--- Diff: bundles-lib/pom.xml ---
@@ -0,0 +1,179 @@
+
+
Github user nickwallen commented on a diff in the pull request:
https://github.com/apache/metron/pull/530#discussion_r120744702
--- Diff:
metron-extensions/metron-parser-extensions/metron-parser-bro-extension/metron-parser-bro/README.md
---
@@ -0,0 +1,3 @@
+# bro Parser
+
Github user nickwallen commented on a diff in the pull request:
https://github.com/apache/metron/pull/530#discussion_r120746288
--- Diff:
bundles-lib/src/test/java/org/apache/metron/bundles/integration/components/MRComponent.java
---
@@ -0,0 +1,68 @@
+/**
+ * Licensed to t
Github user nickwallen commented on a diff in the pull request:
https://github.com/apache/metron/pull/530#discussion_r120741471
--- Diff:
metron-extensions/metron-parser-extensions/metron-parser-bro-extension/metron-parser-bro/src/main/config/zookeeper/enrichments/bro.json
---
@@
Dear All,
I'm installing Metron, following the instructions found here:
https://github.com/apache/metron/tree/master/metron-deployment/vagrant/full-dev-platform
Unfortunately, my processor does not support virtualization and I'm not able to
launch Docker.
Is there any workaround?
I installed
Hi list,
I've installed metron on CentOS 7 and when I start all services, the
load is really high (as in 20+ on 4 and 8 CPUs). The same install on a
CentOS 6 VM is fine... (load is 0.5 there).
When I look at htop, the pid 27867 has 300%+ CPU% which is:
storm 27867 328 3.2 6653844 10563
Github user mattf-horton commented on the issue:
https://github.com/apache/metron/pull/610
> #468 's test plan
Sounds good. I'll start working through it myself. Thanks for the
suggestion.
---
If your project is set up for it, you can reply to this email and have your
rep
Github user justinleet commented on the issue:
https://github.com/apache/metron/pull/579
Just the start. I got the previously existing test cases in a better
shape, and @ctramnitz should be able to add on pretty easily.
I do want to echo what @mattf-horton said about the qual
Hi Raghu, this is appropriate for the ‘dev’ list rather than the ‘user’ list,
since you’re interested in joining in development work – which is great,
welcome! :-)
To enable jira assignment, someone must add your name to the project
contributor list. I’m sure our honored chairman has the ka
Github user mattf-horton commented on the issue:
https://github.com/apache/metron/pull/579
First, a note to @ctramnitz : Christian, please be patient with the long
cycle on this. It is not a reflection on your work, but rather a desire to
make sure that work gets appropriate consider
➢ Will MD files that are not README.md be pulled into site-book?
Yes indeed. All md files are collected and used in the site-book.
Md files named README are renamed to “index” and referenced by a friendly form
of the directory name they are in. All other md files retain their name and
locati
Github user justinleet commented on the issue:
https://github.com/apache/metron/pull/579
https://github.com/ctramnitz/metron/pull/1 opened, if anyone cares. As
noted,
https://github.com/ctramnitz/metron/commit/bf8ce62cb5ed3846f288e4a7a606410ebbaf9d30
is the relevant commit.
---
If
Github user justinleet commented on the issue:
https://github.com/apache/metron/pull/579
I lied, it's a bit circular. It depends on your PR's fixes, so let's go
back to the original strategy of making a PR against your branch. I'm more
than happy to give up credit, since this is jus
Github user justinleet commented on the issue:
https://github.com/apache/metron/pull/579
Actually, I'll just open a separate ticket/PR. You'll still want to merge
it in.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. I
Github user justinleet commented on the issue:
https://github.com/apache/metron/pull/579
@ctramnitz Can you merge/rebase master into this PR? I'd like to make a PR
against your branch, but it depends on METRON-962 being in. Basically I just
pulled out the log files it loaded, and mad
Github user ottobackwards commented on the issue:
https://github.com/apache/metron/pull/530
@justinleet merged in and resolved conflicts
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this f
Github user nickwallen commented on the issue:
https://github.com/apache/metron/pull/530
@ottobackwards I'm good with that, Otto. The benefit doesn't outweigh the
cost at this point. Thanks for clarifying.
---
If your project is set up for it, you can reply to this email and have y
Github user ottobackwards commented on the issue:
https://github.com/apache/metron/pull/530
That being said, I fully understand that in hindsight we all could come up
with ways to have done this differently
---
If your project is set up for it, you can reply to this email and have yo
Github user ottobackwards commented on the issue:
https://github.com/apache/metron/pull/530
@nickwallen I did consider staging the PR's close to what you suggested at
various points ( this is my 3rd re-write of this functionality ( Ansible + just
packages, RPM + just packages, RPM + N
Github user cestella commented on the issue:
https://github.com/apache/metron/pull/530
Regarding creating a separate parser, I mean, you have two telemetries that
are both JSON Maps, so you have 2 instances of the JSONMap parser topologies
running with different names.
---
If your p
Github user cestella commented on the issue:
https://github.com/apache/metron/pull/610
Ok, for testing this, I'd suggest we go through #468 's test plan. That
touches every place we use Stellar atm, I think.
---
If your project is set up for it, you can reply to this email and have
Github user JonZeolla commented on the issue:
https://github.com/apache/metron/pull/530
I'm just poking my head in to say I'm also in favor of a feature branch for
this work, as it will make my functional test much more straightforward.
---
If your project is set up for it, you can r
Github user ottobackwards commented on the issue:
https://github.com/apache/metron/pull/530
Thanks @cestella, I'll refactor with those steps. Although, I don't
understand the create a second instance of a parser part. Can you elaborate?
---
If your project is set up for it, you can
Github user justinleet commented on the issue:
https://github.com/apache/metron/pull/530
@ottobackwards I agree the feature branch approach is probably the best way
to handle things like this. It naturally splits things into a smaller chunks,
and it eliminates the need for all the en
Github user justinleet commented on the issue:
https://github.com/apache/metron/pull/530
@ottobackwards METRON-962 is in and as you expected, the tests have to be
deconflicted. I think you looked over those before, but I'm more than happy to
help if you need anything.
---
If your pr
Github user asfgit closed the pull request at:
https://github.com/apache/metron/pull/612
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enab
Github user cestella commented on the issue:
https://github.com/apache/metron/pull/530
So, the closest thing that I've come to as a comprehensive set of
smoketests is the plan I created for #468 , but it's not nearly comprehensive
enough ;)
For this, I'd definitely validate:
Github user nickwallen commented on the issue:
https://github.com/apache/metron/pull/530
Maybe I am misunderstanding the functionality here, but I see a split
looking like this. Of course, you know the work better than me, so maybe there
is a slightly different way we need to tackle
Github user ottobackwards commented on the issue:
https://github.com/apache/metron/pull/530
ok - I'll add a Programming guide md or something then
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not h
Github user justinleet commented on the issue:
https://github.com/apache/metron/pull/530
@ottobackwards I believe it's all *.md files.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this fea
Github user cestella commented on the issue:
https://github.com/apache/metron/pull/530
@ottobackwards they will be
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wis
Github user ottobackwards commented on the issue:
https://github.com/apache/metron/pull/530
Will MD files that are not README.md be pulled into site-book?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project do
Github user cestella commented on the issue:
https://github.com/apache/metron/pull/530
I tend to agree with @ottobackwards that this is split. For better or
worse, we've preferred in this project to submit PRs to keep master fully
functional. I don't know of a better split that wou
Github user ottobackwards commented on the issue:
https://github.com/apache/metron/pull/530
Also, the PR **is** split. Between the system capability without new user
facing functionality, and the user facing changes, the ability to install
extensions etc by rest.
---
If your projec
Github user cestella commented on a diff in the pull request:
https://github.com/apache/metron/pull/606#discussion_r120628075
--- Diff:
metron-platform/metron-common/src/main/java/org/apache/metron/common/stellar/StellarCompiler.java
---
@@ -40,14 +40,22 @@
import static java
Github user ottobackwards commented on the issue:
https://github.com/apache/metron/pull/530
@justinleet I think this should have been ( and maybe can still be? ) one
of the special branches that james mentioned. I don't see how something of
this scope and breadth can be reviewed in n
Github user justinleet commented on the issue:
https://github.com/apache/metron/pull/530
@cestella @mmiklavc Do we have a generic smoke test documented, e.g. from
the various Storm upgrades or other component upgrades?
---
If your project is set up for it, you can reply to this email
Github user justinleet commented on the issue:
https://github.com/apache/metron/pull/530
@ottobackwards I definitely agree that we need more documentation around
absolutely everything you listed. The main reason I want the outline for
adding a new parser is just so I have a way to a
Github user ottobackwards commented on the issue:
https://github.com/apache/metron/pull/530
@nickwallen WRT Test plan:
Do we have a generic smoke test plan? If so, then I'll reference it. If
not I will spell it out more clearly.
There are, I think two aspects to this tha
Github user cestella commented on a diff in the pull request:
https://github.com/apache/metron/pull/606#discussion_r120623833
--- Diff:
metron-platform/metron-common/src/main/java/org/apache/metron/common/stellar/StellarCompiler.java
---
@@ -76,14 +92,80 @@ public Expression(Deque
Github user cestella commented on a diff in the pull request:
https://github.com/apache/metron/pull/606#discussion_r120623722
--- Diff:
metron-platform/metron-common/src/main/java/org/apache/metron/common/stellar/StellarCompiler.java
---
@@ -40,14 +40,22 @@
import static java
Github user justinleet commented on the issue:
https://github.com/apache/metron/pull/530
@nickwallen I agree in philosophy, but this has been a running PR for
awhile that had plenty of dev list discussion around it before it was made.
There's already follow-on work being done, and I'
Github user cestella commented on a diff in the pull request:
https://github.com/apache/metron/pull/606#discussion_r120622230
--- Diff:
metron-analytics/metron-profiler-client/src/main/java/org/apache/metron/profiler/client/window/WindowProcessor.java
---
@@ -89,7 +89,7 @@ public
Github user cestella commented on the issue:
https://github.com/apache/metron/pull/612
+1 by inspection. This is good work; we inherited a lot of these from the
initial opensoc import, so normalizing and reducing the dead weight is a
valuable contribution. Thanks @justinleet
---
Github user cestella closed the pull request at:
https://github.com/apache/metron/pull/609
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is en
GitHub user cestella reopened a pull request:
https://github.com/apache/metron/pull/609
METRON-987: Allow stellar enrichments to be specified by a list as well as
a map
## Contributor Comments
Currently, stellar enrichments are specified by a map associating fields
with the ste
Github user nickwallen commented on the issue:
https://github.com/apache/metron/pull/530
> @nickwallen: Or did you submit this to get buy-in as a proof-of-concept,
that we can then break down into multiple, smaller PRs, get reviewed and then
merged into master?
I feel like th
Github user nickwallen commented on the issue:
https://github.com/apache/metron/pull/530
> No. I did not write that all out. Do you feel that is required for this?
There is no such guide presently. Can that be a follow on?
Sorry, but I disagree. I really think you need to lay
Github user justinleet commented on the issue:
https://github.com/apache/metron/pull/612
I'm actually just going to kill GrokAsaParser. We know BasicAsaParser is
used. GrokAsaParser seems a bit questionable based on code changes and
restructuring we've done, is less adaptable, and n
Github user justinleet commented on the issue:
https://github.com/apache/metron/pull/612
@kylerichardson What is the difference between the `BasicAsaParser` and the
`GrokAsaParser`? Are you able to shed some light on why both exist? The
motivation for the question is that minor chang
Github user ottobackwards commented on a diff in the pull request:
https://github.com/apache/metron/pull/530#discussion_r120616605
--- Diff: bundles-lib/pom.xml ---
@@ -0,0 +1,206 @@
+
+
+
+http://maven.apache.org/POM/4.0.0";
xmlns:xsi="http://www.w3.org/2001/XMLSch
Github user ottobackwards commented on the issue:
https://github.com/apache/metron/pull/530
@simonellistonball the main thing with the integration tests, is that due
to the nature of the dependencies between the tests and the parsers, the
integration test topologies, when loading the
I've installed cluster with Zeppelin and it works now, does not ask for
the Zeppelin creds.
- Dima
On 06/07/2017 01:27 PM, Dima Kovalyov wrote:
> Thank you Matt,
>
> Image: http://i.imgur.com/EIO7YBr.png
> So far, I workaround it by specifying host and port of the remote
> Zeppelin instance, but
Github user justinleet commented on a diff in the pull request:
https://github.com/apache/metron/pull/602#discussion_r120614845
--- Diff: metron-deployment/roles/ambari_config/vars/single_node_vm.yml ---
@@ -102,7 +102,7 @@ configurations:
required_configurations:
Github user justinleet commented on a diff in the pull request:
https://github.com/apache/metron/pull/530#discussion_r120369783
--- Diff: bundles-lib/pom.xml ---
@@ -0,0 +1,206 @@
+
+
+
+http://maven.apache.org/POM/4.0.0";
xmlns:xsi="http://www.w3.org/2001/XMLSchema
Github user simonellistonball commented on the issue:
https://github.com/apache/metron/pull/530
Awesome, I guess this should be covered by the integration test suite as
well, which has been kept reasonably up to date with the recent changes.
Anything there you think might deserve a li
Github user ottobackwards commented on the issue:
https://github.com/apache/metron/pull/612
+1 by inspection - @justinleet did you assign the jira over?
I will have to port this to 777 when it hits.
---
If your project is set up for it, you can reply to this email and have your
re
Hello Casey,
your explanations (and Matt's one with the other email) help me. By the way, if
I could, I need more details.
The origins of my questions are both conceptual (Metron is absolutely a new
tool for me) and practical (e.g., I didn't find any guideline that explain
where ML model shoul
Thank you Matt,
Image: http://i.imgur.com/EIO7YBr.png
So far, I workaround it by specifying host and port of the remote
Zeppelin instance, but I am not sure if it was ever used.
Can I just specify dummy host:port if I don't need Zeppelin for this
deployment?
- Dima
On 06/06/2017 02:18 AM, Matt
84 matches
Mail list logo
