Re: support for removing events from channel

2015-07-30 Thread Simeon Zaharici
Which memory channel implementation you mean ? :) On Wednesday, July 29, 2015 5:13 PM, Ashish wrote: This implementation can be used :( but have a look at Memory Channel implementation might discover something useful :) On Wed, Jul 29, 2015 at 2:04 PM, Simeon Zaharici wrote

Re: support for removing events from channel

2015-07-29 Thread Simeon Zaharici
29, 2015 at 1:23 PM, Simeon Zaharici wrote: > Thank you very much Ashish! > So do I understand correctly that this will only work on file channels ? Yes File Channel only. Are you looking for some other channel implementation? > > > > On Wednesday, July 29, 2015 4:17 PM, Ashish

Re: support for removing events from channel

2015-07-29 Thread Simeon Zaharici
release on website. There is no direct delete, just fail the validation and it shall be marked NOOP. On Wed, Jul 29, 2015 at 12:50 PM, Simeon Zaharici wrote: > Hi guys, > > I ran into this jira https://issues.apache.org/jira/browse/FLUME-2613 > regarding support for deleting events fr

support for removing events from channel

2015-07-29 Thread Simeon Zaharici
Hi guys, I ran into this jira https://issues.apache.org/jira/browse/FLUME-2613 regarding support for deleting events from a channel. However I could not figure out how I could do this. Is there any doc on how to delete events from a channel? Thanks a lot,Simeon

Re: flume configuration in zookeeper

2015-02-27 Thread Simeon Zaharici
I created the following jira for the documentation https://issues.apache.org/jira/browse/FLUME-2635  Thanks again,Simeon On Friday, February 27, 2015 10:50 AM, Simeon Zaharici wrote: Thank you very much Ashish, it is working fine after uploading the contents of flume.conf into

Re: flume configuration in zookeeper

2015-02-27 Thread Simeon Zaharici
s for you. On Thu, Feb 26, 2015 at 10:11 PM, Simeon Zaharici wrote: > > Hi guys, > > Do you have an example of how to use the dynamic configuration with > zookeeper > > https://issues.apache.org/jira/browse/FLUME-1491? > > I started flume with the -z flag pointing to a zoo

flume configuration in zookeeper

2015-02-26 Thread Simeon Zaharici
Hi guys, Do you have an example of how to use the dynamic configuration with zookeeper   https://issues.apache.org/jira/browse/FLUME-1491? I started flume with the -z flag pointing to a zookeeper instance and I see that it created a flume  znode but I am not sure how to actually put the configura

Invalid UTF-32 character exception

2014-08-26 Thread Simeon Zaharici
Hi guys, I am getting invalid utf-32 character exceptions in the Elasticsearch sink. It happens on very busy flume servers and as a result the whole delivery of messages to elasticsearch grinds to a halt.  I am not sure if it is related to this issue  https://issues.apache.org/jira/browse/FLUME-

Re: Json over netcat source

2014-04-10 Thread Simeon Zaharici
y don't know what the issue is. Someone more familiar with elastic search sink will need to look at it. > > >Hari > >On Wednesday, April 9, 2014, Simeon Zaharici wrote: > >Hello >> >> >>This is to be able to easily integrate log

Re: Json over netcat source

2014-04-09 Thread Simeon Zaharici
ly because netcat is splitting the events per newline or when it reaches a fixed size.  Hari On Wed, Apr 9, 2014 at 5:58 PM, Simeon Zaharici wrote: Hello > > >No, I did not find any solution to this > > >Simeon >On Monday, April 7, 2014 6:09:21 AM, Deepak Subhramania

Re: Json over netcat source

2014-04-09 Thread Simeon Zaharici
Hello No, I did not find any solution to this Simeon On Monday, April 7, 2014 6:09:21 AM, Deepak Subhramanian wrote: Hi Simeon, I am facing the same problem. Did you find any solution ? Thanks, Deepak  On Wed, Mar 5, 2014 at 5:52 PM, Simeon Zaharici wrote: Hi guys > > >I woul

Re: Multiple flume agent on single machine

2014-03-06 Thread Simeon Zaharici
Here is a simple example of 2 netcat sources sending to 2 different elasticsearch clusters. The same principle would apply for HBase as well #Flow definition agent.sources = netcat anothernetcat agent.channels = netcat-channel-es anothernetcat-channel-es agent.sinks = netcat-sink-es anothernetcat

Re: Multiple flume agent on single machine

2014-03-06 Thread Simeon Zaharici
Hello You do not need to run multiple flume agents, although this is possible. You could just define multiple sources running on different ports in the same flume agent, each one writing to its own Hbase sink. Regards, Simeon On Wednesday, March 5, 2014 11:30:56 PM, Chhaya Vishwakarma w

Json over netcat source

2014-03-05 Thread Simeon Zaharici
Hi guys I would like to send json data to a flume netcat source and then send it to an elasticsearch sink that uses the org.apache.flume.sink.elasticsearch.ElasticSearchLogStashEventSerializer. It works to send plain text on the netcat source, however when I send json the event ends up in ela