Re: Flafka: Kafka channel unable to deliver event

2015-07-06 Thread Jun MA
Hi Gwen, Thank you so much for the comments. I followed your suggestion and get pretty much what I want except one situation which is killing agent unexpected. My test case is: 1 Kafka channel and 1 HDFS sink, 1 topic with 2 partitions, two agents read from same topic with same group id (defau

Problems with Flume truncating syslogudp at 2048 bytes

2015-07-06 Thread Morris, Anthony
I have Flume configured as a UDP syslog listener and storing data to HDFS. Everything works as expected until I send/receive packets more than 2048 bytes at which point they are truncated and data is lost entirely (not just written to the next line). I suspect I am simply missing a simple conf

Re: [ANNOUNCE] New Flume committer - Johny Rufus

2015-07-06 Thread Jarek Jarcec Cecho
Congratulations Johny! Jarcec > On Jun 19, 2015, at 1:38 PM, Hari Shreedharan wrote: > > On behalf of the Apache Flume PMC, I am excited to welcome Johny Rufus as a > committer on the Apache Flume project. Johny has actively contributed several > patches to the Flume project, including bug fi