Re: Flume RegexHbaseEventSerializer

2014-03-06 Thread Sandesh Hurli
Got this working, had to change the regex pattern to (.+)\\s(.+)\\s(\\d+)\\s(\\S+)\\s(\\S+)\\s(\\S+)\\s(.+). My bad. Cheers! On Fri, Mar 7, 2014 at 10:37 AM, Sandesh Hurli wrote: > Hi > > I am using Flume's Hbase sink with RegexHbaseEventSerializer, but when I > run the agent I get no entries

Re: Multiple flume agent on single machine

2014-03-06 Thread Simeon Zaharici
Here is a simple example of 2 netcat sources sending to 2 different elasticsearch clusters. The same principle would apply for HBase as well #Flow definition agent.sources = netcat anothernetcat agent.channels = netcat-channel-es anothernetcat-channel-es agent.sinks = netcat-sink-es anothernetcat

Flume RegexHbaseEventSerializer

2014-03-06 Thread Sandesh Hurli
Hi I am using Flume's Hbase sink with RegexHbaseEventSerializer, but when I run the agent I get no entries in the Hbase table. It works perfectly with SimpleHbaseEventSerializer though. Here's my sink configuration: agent.sinks.loggerSink.type = org.apache.flume.sink.hbase.HBaseSink agent.sinks.

RE: Multiple flume agent on single machine

2014-03-06 Thread Chhaya Vishwakarma
Thank you for your reply do you have any sample for the same? From: Simeon Zaharici [mailto:simeon_zahar...@yahoo.com] Sent: Thursday, March 06, 2014 8:23 PM To: user@flume.apache.org Subject: Re: Multiple flume agent on single machine Hello You do not need to run multiple flume agents, although

Re: Flume JMS source

2014-03-06 Thread Richard Ross
Thats correct. On Mar 6, 2014, at 1:09 PMEST, Madabhattula Rajesh Kumar wrote: > > Hello Richard, > > Thank you very much. I'll try this configuration. Could you please clarify > below questions > > a1.sources.r1.providerURL = tcp://:61616 > a1.sources.r1.destinationName = TESTQUEUE -> T

Re: Flume JMS source

2014-03-06 Thread Madabhattula Rajesh Kumar
Hello Richard, Thank you very much. I'll try this configuration. Could you please clarify below questions a1.sources.r1.providerURL = tcp://:61616 a1.sources.r1.destinationName = TESTQUEUE -> *This is queue name right?* a1.sources.r1.destinationType = QUEUE Regards, Rajesh On Tue, Mar 4, 2

Re: Multiple flume agent on single machine

2014-03-06 Thread Simeon Zaharici
Hello You do not need to run multiple flume agents, although this is possible. You could just define multiple sources running on different ports in the same flume agent, each one writing to its own Hbase sink. Regards, Simeon On Wednesday, March 5, 2014 11:30:56 PM, Chhaya Vishwakarma w