Areas Stuck

2018-01-30 Thread Gaurav Bapat
These are the following ares where we are currently stuck:- 1.> Getting data from Logger to NiFi, using Kafka topic. 2.> Configuring Kafka & Zookeeper 3.> Indexing - spout & bolt 4.> Parsing syslog data 5.> Visualizing logs in Kibana 6.> Connecting Spark and Metron

Re: Deployment help needed.

2018-01-24 Thread Gaurav Bapat
1.>In Full development folder, do vagrant destroy -f 2.>In metron root directory do mvn clean compile -DskipTests 3.>start docker 4.>vagrant up On 24 January 2018 at 08:13, Sujay Jaladi wrote: > Hello, > > Everytime I attempt to deploy apache metron on AWS, I get the following

Re: Getting Syslogs to Metron

2018-01-15 Thread Gaurav Bapat
But I cant find how to configure it On 16 January 2018 at 11:38, Farrukh Naveed Anjum <anjum.farr...@gmail.com> wrote: > yes, do configure it as per metron reference usecase > > On Tue, Jan 16, 2018 at 8:35 AM, Gaurav Bapat <gauravb3...@gmail.com> > wrote: > >>

Re: Getting Syslogs to Metron

2018-01-15 Thread Gaurav Bapat
Hi Kyle, I saw that I can ping from my OS to VM and from VM to OS. Looks like this is some Kafka or Zookeeper environment variables setup issue, do I need to configure that in vagrant ssh? On 16 January 2018 at 08:59, Gaurav Bapat <gauravb3...@gmail.com> wrote: > Hey Kyle, > > I

Re: Getting Syslogs to Metron

2018-01-15 Thread Gaurav Bapat
s do you see? > > On 2018-01-14 19:29, Gaurav Bapat wrote: > > Hey Jon, > > I have Storm UI and the logs are coming from firewalls, servers, etc from > other machines(HP ArcSight Logger). > > I have attached the NiFi screenshots, my logs are coming but there is some >

Re: Getting Syslogs to Metron

2018-01-15 Thread Gaurav Bapat
igure Kafka broker because it is giving me >> failed while waiting for acks to Kafka >> >> >> >> On 15 January 2018 at 16:10, Farrukh Naveed Anjum < >> anjum.farr...@gmail.com> wrote: >> >>> Can you tell me is your KAFKA Topic getting data ?

Re: Getting Syslogs to Metron

2018-01-15 Thread Gaurav Bapat
questions/32499/no- > workers-in-storm-for-squid-topology.html > > > I had similar issue and finally got it fixed > > On Mon, Jan 15, 2018 at 8:45 AM, Gaurav Bapat <gauravb3...@gmail.com> > wrote: > >> Storm UI >> >> On 15 January 2018 at 08:59, Gaurav Bapa

Getting Syslogs to Metron

2018-01-10 Thread Gaurav Bapat
Hello everyone, I have deployed Metron on a single node machine and I would like to know how do I get Syslogs from NiFi into Kibana dashboard? I have created a Kafka topic by the name "cef" and I can see that the topic exists in Metron Configuration but I am unable to connect it with Kibana Need

Re: Metron Installation on EC2

2018-01-08 Thread Gaurav Bapat
mazon-ec2 > > 10 M4 Xlarges for ya. Or just run up a few instances and manually build it. > > > > *From:* Gaurav Bapat [mailto:gauravb3...@gmail.com] > *Sent:* Tuesday, 9 January 2018 2:40 PM > *To:* user@metron.apache.org > *Cc:* ruchi.yag...@sequretek.com > *Subject:

Re: Metron Version

2018-01-05 Thread Gaurav Bapat
the Metron error dashboard? Thanks, > > Jon > > On Thu, Jan 4, 2018, 22:47 Gaurav Bapat <gauravb3...@gmail.com> wrote: > >> Also when I enter indices in Kibana, it fails to search for my Kafka >> topic and I dont know why the cef logs are not coming into Kib

Re: [ANNOUNCE] Apache Metron release 0.4.2 and Apache Metron bro plugin for Kafka release 0.1

2018-01-04 Thread Gaurav Bapat
Hi, I have deployed Metron with 16 GB RAM, but all components are losing heartbeats and they dont go up On 5 January 2018 at 02:41, Matt Foley wrote: > Metron Community: Happy New Year. > > I’m happy to announce the release of Metron 0.4.2. A great deal of work > from

Re: [ANNOUNCE] Apache Metron release 0.4.2 and Apache Metron bro plugin for Kafka release 0.1

2018-01-04 Thread Gaurav Bapat
Hi, That's a great news!! I am forwarding syslogs into Kafka through Nifi but I can't see the logs in Kibana, I have added the CEF Parser with cef topic, is there any issue with parsing and does the newer version directly parse and index telemetry in ES and then to Kibana. Request you to add

Re: Metron Version

2018-01-04 Thread Gaurav Bapat
They are syslogs and my topic name is cef, I get one parsed logs out of 1000+ and I want to do analytics using Spark but I cant find a way out.

Re: bro kafka plugin build error on --bro-init=$BRO_SRC option doesn't exist

2017-12-21 Thread Gaurav Bapat
Can I send syslogs to HDFS using NiFi without using Kafka Topic? On 21 Dec 2017 5:16 p.m., "zeo...@gmail.com" wrote: > Where did you get the plugin from, and do you have $BRO_SRC set? This > plugin has recently moved, had a release, and became a package. The > documentation

Re: Single Node Metron Installation

2017-12-18 Thread Gaurav Bapat
Can you give me the link?? On 18 Dec 2017 5:14 p.m., "zeo...@gmail.com" <zeo...@gmail.com> wrote: > You can send them via email or if they're too long upload to a > pastebin website and send a link. > > Jon > > On Mon, Dec 18, 2017 at 6:14 AM Gaurav Bap

Re: Single Node Metron Installation

2017-12-17 Thread Gaurav Bapat
e your Vagrantfile and any other > changes to ansible or playbooks you made I'll replicate your setup on my > end and see if I hit the TLS issue and troubleshoot it from there. > > Thanks, > Daniel > > On Sun, Dec 17, 2017 at 7:02 PM, Gaurav Bapat <gauravb3...@gmail.com> &g

Re: AWS elastic IP configuration for metron?

2017-12-08 Thread Gaurav Bapat
I am facing issues in Metron Deployment, when I load maven it gives me dependency errors, need help On Fri, Dec 8, 2017 at 20:21 Ahmed Shah wrote: > Hello Pele_smk, > > > Our team adapted the Metron Single Node VM install to deploy a single node > to AWS. > >

Re: machine learning libraries supported

2017-12-06 Thread Gaurav Bapat
Hi Moshe, Even I want to know about ML libraries on Metron, I think Spark might help but I dont know how will I setup Metron Be in touch!! Thank You, Gaurav On 6 December 2017 at 13:15, moshe jarusalem wrote: > Hi All, > Would you please suggest some documentation about

Metron Setup

2017-12-06 Thread Gaurav Bapat
Hi Metron Team, I want to install Metron on a single node VM but I am getting Metron components heartbeat lost errors Please help