Re: Getting Syslogs to Metron

2018-01-15 Thread Gaurav Bapat
Thanks Farrukh, I am not getting data in my kafka topic even after creating one, the issue seems to be with broker config, how to configure Kafka and Zookeeper port? On 15 January 2018 at 13:23, Farrukh Naveed Anjum wrote: > Hi, > > I had similar issue it turned out to be the issue in STROM > >

Metron Reference Application (Profiling Your Streams Fails)

2018-01-15 Thread Farrukh Naveed Anjum
Hi, I am trying to setup up Metron Reference Application (SQUID) Example given on main metron website. I am facing a problem during (Profiling Your Streams ) Config_Put Step CONFIG_PUT(profilerConfig) *It causes to display following error* [!] No enum constant org.apache.metron.common.configu

Re: Getting Syslogs to Metron

2018-01-15 Thread Farrukh Naveed Anjum
Can you tell me is your KAFKA Topic getting data ? What are you machine specifications ? On Mon, Jan 15, 2018 at 2:56 PM, Gaurav Bapat wrote: > Thanks Farrukh, > > I am not getting data in my kafka topic even after creating one, the issue > seems to be with broker config, how to configure Kafka

Re: Metron Reference Application (Profiling Your Streams Fails)

2018-01-15 Thread Farrukh Naveed Anjum
Any Idea of getting ride of this problem ? On Mon, Jan 15, 2018 at 3:38 PM, Farrukh Naveed Anjum < anjum.farr...@gmail.com> wrote: > Hi, > > I am trying to setup up Metron Reference Application (SQUID) Example given > on main metron website. > > I am facing a problem during (Profiling Your Stream

Re: Metron Reference Application (Profiling Your Streams Fails)

2018-01-15 Thread Farrukh Naveed Anjum
Can you help on this ? On Mon, Jan 15, 2018 at 3:42 PM, Farrukh Naveed Anjum < anjum.farr...@gmail.com> wrote: > Any Idea of getting ride of this problem ? > > On Mon, Jan 15, 2018 at 3:38 PM, Farrukh Naveed Anjum < > anjum.farr...@gmail.com> wrote: > >> Hi, >> >> I am trying to setup up Metron R

Re: Getting Syslogs to Metron

2018-01-15 Thread Gaurav Bapat
I am not getting data into my Kafka topic I have used i5 4 Core Processor with 16 GB RAM and I have allocated 12 GB RAM to my vagrant VM. I dont understand how to configure Kafka broker because it is giving me failed while waiting for acks to Kafka On 15 January 2018 at 16:10, Farrukh Naveed A

Re: Getting Syslogs to Metron

2018-01-15 Thread Farrukh Naveed Anjum
Can you check /kafaka-logs on your VM box (It should have a folder named your topic). Can you check if it is there ? On Mon, Jan 15, 2018 at 3:49 PM, Gaurav Bapat wrote: > I am not getting data into my Kafka topic > > I have used i5 4 Core Processor with 16 GB RAM and I have allocated 12 GB > RA

Re: Getting Syslogs to Metron

2018-01-15 Thread Gaurav Bapat
Hi Farrukh, I cant find any folder by my topic On 15 January 2018 at 16:33, Farrukh Naveed Anjum wrote: > Can you check /kafaka-logs on your VM box (It should have a folder named > your topic). Can you check if it is there ? > > On Mon, Jan 15, 2018 at 3:49 PM, Gaurav Bapat > wrote: > >> I am

Re: Getting Syslogs to Metron

2018-01-15 Thread Kyle Richardson
It looks like your Nifi instance is running on your laptop/desktop (e.g. the VM host). My guess would be that name resolution or networking is not properly configured between the host and the guest preventing the data from getting from Nifi to Kafka. What's the contents of /etc/hosts on the VM host

Re: Metron Reference Application (Profiling Your Streams Fails)

2018-01-15 Thread Simon Elliston Ball
Looks like a docs typo on the wiki: What you need is CONFIG_PUT(“PROFILER”, profilerConfig) Simon > On 15 Jan 2018, at 10:45, Farrukh Naveed Anjum > wrote: > > Can you help on this ? > > On Mon, Jan 15, 2018 at 3:42 PM, Farrukh Naveed Anjum > wrote: > Any Idea of getting ride of this prob

Re: Getting Syslogs to Metron

2018-01-15 Thread Laurens Vets
Hi Gaurav, If you click on the red squares in the upper right corners of your processors, what error messages do you see? On 2018-01-14 19:29, Gaurav Bapat wrote: > Hey Jon, > > I have Storm UI and the logs are coming from firewalls, servers, etc from > other machines(HP ArcSight Logger). >

Re: Getting Syslogs to Metron

2018-01-15 Thread Gaurav Bapat
Hey Laurens, My kafka processor says "Failed while waiting for acks from Kafka" On 15 January 2018 at 21:00, Laurens Vets wrote: > Hi Gaurav, > > If you click on the red squares in the upper right corners of your > processors, what error messages do you see? > > On 2018-01-14 19:29, Gaurav Bapa

Re: Getting Syslogs to Metron

2018-01-15 Thread Gaurav Bapat
Hi Kyle, I saw that I can ping from my OS to VM and from VM to OS. Looks like this is some Kafka or Zookeeper environment variables setup issue, do I need to configure that in vagrant ssh? On 16 January 2018 at 08:59, Gaurav Bapat wrote: > Hey Kyle, > > I am running NiFi not on Ambari but on lo

Re: Getting Syslogs to Metron

2018-01-15 Thread Farrukh Naveed Anjum
yes, do configure it as per metron reference usecase On Tue, Jan 16, 2018 at 8:35 AM, Gaurav Bapat wrote: > Hi Kyle, > > I saw that I can ping from my OS to VM and from VM to OS. Looks like this > is some Kafka or Zookeeper environment variables setup issue, do I need to > configure that in vagr

Re: Metron Reference Application (Profiling Your Streams Fails)

2018-01-15 Thread Farrukh Naveed Anjum
Thanks, It seems to have worked for me. On Mon, Jan 15, 2018 at 7:37 PM, Simon Elliston Ball < si...@simonellistonball.com> wrote: > Looks like a docs typo on the wiki: > > What you need is CONFIG_PUT(“PROFILER”, profilerConfig) > > Simon > > > On 15 Jan 2018, at 10:45, Farrukh Naveed Anjum > w

Re: Metron Reference Application (Profiling Your Streams Fails)

2018-01-15 Thread Farrukh Naveed Anjum
Another Typeo i guess *profile := PROFILE_GET("squid-miss", "127.0.0.1", 2, "HOURS")* [!] ERROR: Variable profile not assigned [!] Cannot cast java.lang.Integer to java.util.List java.lang.ClassCastException: Cannot cast java.lang.Integer to java.util.List at java.lang.Class.cast(Class.j

Re: Getting Syslogs to Metron

2018-01-15 Thread Gaurav Bapat
But I cant find how to configure it On 16 January 2018 at 11:38, Farrukh Naveed Anjum wrote: > yes, do configure it as per metron reference usecase > > On Tue, Jan 16, 2018 at 8:35 AM, Gaurav Bapat > wrote: > >> Hi Kyle, >> >> I saw that I can ping from my OS to VM and from VM to OS. Looks like

Metron Install - Vagrant provision error.

2018-01-15 Thread Srikanth Nagarajan
Hi,I am getting the following error in the full development install (single box on Mac OSX ) while following the development install procedure. vagrant provision gives the below error and more below that. fatal: [node1 -> localhost]: FAILED! => { "changed": true, "cmd": "cd /Users/sri/metron/metro