Re: Flafka: KafkaSource EXCEPTION

2015-03-09 Thread Alex Bohr
Hi Hari, The source I'm building has that patch applied. line 109 of KafkaSource.java : if (kafkaKey != null) { headers.put(KafkaSourceConstants.KEY, new String(kafkaKey)); } The version is Flume 1.6.0-SNAPSHOT (the current trunk of https://github.com/apache/flume).

Re: Flafka: KafkaSource EXCEPTION

2015-03-09 Thread Hari Shreedharan
You are probably hitting https://issues.apache.org/jira/browse/FLUME-2578 Add a key to the message as a workaround or build Flume with that patch. Alex Bohr wrote: Hi, I've been testing out Flafka for a few days but I've been getting lots of errors and message loss. Would really appreciate so

Flafka: KafkaSource EXCEPTION

2015-03-09 Thread Alex Bohr
Hi, I've been testing out Flafka for a few days but I've been getting lots of errors and message loss. Would really appreciate some advice before I abandon it for alternate options. We are still getting Lots of these errors: 2015-03-10 04:04:19,099 (PollableSourceRunner-KafkaSource-kafka-source-1