Re: Graphs based on Metron or PCAP data

2019-01-02 Thread M. Aaron Bossert
If you or one of your co-workers is comfortable using JavaScript, there are a couple of visualization libraries you can use: take a look at cytoscape.js and sigma.js, not offer pretty good visualization options and cytoscape.js supports a decent number of graph algorithms...both would require

Re: Graphs based on Metron or PCAP data

2019-01-02 Thread Pieter Baele
Is JanusGraph part of recent HDP distributions? Thats nice! We are still on 2.6.5, which is obviously required by Metron (currently). Graph DB's are something new for me but my role is typically giving a starting point anyway ;-) Thx! On Wed, Jan 2, 2019 at 3:28 PM M. Aaron Bossert wrote:

Re: Graphs based on Metron or PCAP data

2019-01-02 Thread Pieter Baele
To be honest, primary use case is just for the fancy representation of some data. A lot of people like nice graphs (in both meanings) I am also not yet sure on which functionality is most important (to create a ticket) I saw an example, written in a C# framework on a subset of a security related

Re: Graphs based on Metron or PCAP data

2019-01-02 Thread M. Aaron Bossert
For what it is worth here are my two bits: like Simon said, the best approach depends on your use case: if you are interested in Janus Graph, like Simon suggested, it is part of the Hortonworks distribution and is used internally by Atlas, so it should not be too difficult to integrate...not

Re: Graphs based on Metron or PCAP data

2019-01-02 Thread Simon Elliston Ball
Graph enables a number of interesting use cases, and it really depends on what you’re after as to which tech makes sense. Spark graphx is a strong contender for analytics of things like betweenness and community linkage on HDFS indexed data. That would tend to be batch and through something

RE: Metron - How to use Java API of Profiler client

2019-01-02 Thread Anil Donthireddy
I created a ticket in Jira, Here is the link to ticket https://jira.apache.org/jira/browse/METRON-1960 Thanks, Anil. From: Otto Fowler [mailto:ottobackwa...@gmail.com] Sent: Wednesday, January 2, 2019 5:31 PM To: user@metron.apache.org Subject: Re: Metron - How to use Java API of Profiler

Re: Metron - How to use Java API of Profiler client

2019-01-02 Thread Otto Fowler
Hi Anil, Can you create a jira to capture your use case? On January 2, 2019 at 04:41:18, Anil Donthireddy (anil.donthire...@sstech.us) wrote: Hi, As part of our requirements, it will be good if we have an interface to access Metron profiler statistics from other applications developed in

Re: Graphs based on Metron or PCAP data

2019-01-02 Thread Otto Fowler
Pieter, Can you create a jira with your use case? It is important to capture. We have some outstanding jira’s around graph support. On January 2, 2019 at 04:40:23, Stefan Kupstaitis-Dunkler ( stefan@gmail.com) wrote: Hi Pieter, Happy new year! I believe that always depends on a lot

Re: Build Stuck up in version 0.7

2019-01-02 Thread Farrukh Naveed Anjum
Further details [WARNING] - org.apache.commons.collections.ReferenceMap$1 [WARNING] - 438 more... [WARNING] maven-shade-plugin has detected that some .class files [WARNING] are present in two or more JARs. When this happens, only [WARNING] one single version of the class is copied in the

Build Stuck up in version 0.7

2019-01-02 Thread Farrukh Naveed Anjum
Hi, I am trying to compile up latest version of 0.7. It stuck upon execution. mvn clean package -DskipTests -T 2C -P HDP-2.5.0.0,mpack [INFO] [INFO] --- maven-assembly-plugin:2.6:single (make-assembly) @ metron-rest --- [INFO] Building tar:

Metron - How to use Java API of Profiler client

2019-01-02 Thread Anil Donthireddy
Hi, As part of our requirements, it will be good if we have an interface to access Metron profiler statistics from other applications developed in Java/Python/Spark etc. While going through Profiler client document, I have seen that currently profiler client is supported as Java API and

Re: Graphs based on Metron or PCAP data

2019-01-02 Thread Stefan Kupstaitis-Dunkler
Hi Pieter, Happy new year! I believe that always depends on a lot of factors and applies to any kind of visualization problem with big amounts of data: * How fast do you need the visualisations available? * How up-to-date do they need to be? * How complex? * How