Error setting consumer offset using SimpleConsumer#commitOffsets.

2016-09-01 Thread David KOCH
Hello, I am having problems setting the partition offset for a given consumer group using SimpleConsumer#commitOffsets. I encounter error code "25". Am I going about this the right way? I am using Kafka 0.10.0. The consumers use the new API. Here is a runnable example

Re: Write-time based synchronization of message consumption from multiple topics

2015-08-20 Thread David KOCH
his is generally solved by partitioner which logs messages > with the same key to the same topic. It is not clear why you can't use this > approach. > > With Regards, > Petr > > On Thu, Aug 20, 2015 at 12:35 PM, David KOCH wrote: > > > Hello, > > >

Write-time based synchronization of message consumption from multiple topics

2015-08-20 Thread David KOCH
Hello, Is it possible to consume messages from multiple topics in a way that messages which were written at the same time in different topics are also consumed at around the same time? Let me explain this with our use case. Our application logs keyed messages of N different types into N topics:

Re: 0.8.2 Producer sends blocking when brokers are unavailable

2015-07-31 Thread David KOCH
> > Kind regards, > Stevo Slavic. > > On Fri, Jul 31, 2015 at 10:15 AM, David KOCH wrote: > > > Hello, > > > > The new producer org.apache.kafka.clients.producer.KafkaProducer seems to > > block on send calls when the cluster is unavailable. > > > &

0.8.2 Producer sends blocking when brokers are unavailable

2015-07-31 Thread David KOCH
Hello, The new producer org.apache.kafka.clients.producer.KafkaProducer seems to block on send calls when the cluster is unavailable. How do I disable this and make send calls fast fail in the event of unavailable brokers? I know the 0.8.1 Scala-based producer did not block in that case. Regards

Re: Kafka log4j2 support

2013-11-04 Thread David KOCH
uses log4j2 to log to various appenders and I don't want to downgrade to log4j 1.x. David On Mon, Nov 4, 2013 at 1:10 AM, Jun Rao wrote: > What's the main benefit of log4j2? > > Thanks, > > Jun > > > On Sun, Nov 3, 2013 at 10:20 AM, David KOCH wrote: > > &

Kafka log4j2 support

2013-11-03 Thread David KOCH
Hello, Are there plans to "port" Kafka to use log4j2 instead of 1.x? Has someone already done this and is willing to share the result? >From the documentation it seems rather straightforward to migrate existing applications from log4j 1.x