Re: KafkaProducer Retries in .9.0.1

Is it an option to set up a cluster and kill the leader? That's the way we checked retries and at if we would not lose messages that way. The sending to Kafka goes in two parts, some serialization etc, before an attempt is made to really send the binary message, and the actual sending. I'm not

Re: Low-level Consumer Example (Scala)

> I use https://github.com/akka/reactive-kafka > . This library has just been taken > over by the Akka team and will in incorporated into future version of Akka. Thanks Dave for the pointer. I downloaded the reactive-kakka .8 branch since we're

Re: Kafka constant shrinking and expanding after deleting a topic

Guozhang, thanks for these links. Hi Alexis, as Guozhang said, yours seems different from our case. We deleted a topic but caused shrinking/expanding for other topics. Yifan On Tue, Apr 5, 2016 at 10:02 PM, Alexis Midon wrote: > I ran into the same issue today. In a

Re: Kafka constant shrinking and expanding after deleting a topic

Alexis, Hmm, yours seems a bug in Kafka brokers since your message relates to a topic that has been deleted months ago, indicating that the topic was not deleted cleanly. Could you file a JIRA with server logs for further investigation? Guozhang On Tue, Apr 5, 2016 at 10:02 PM, Alexis Midon <

kafka issue

Hi, Seeing below exceptions on broker id 3 node, in my three node kafka cluster.Also looks like this broker id is long under replicated and out of sync. [2016-04-06 04:00:00,720] ERROR [Replica Manager on Broker 3]: Error processing fetch operation on partition [subscribed_product_logs,2] offset

Re: Kafka C/C++ client with consumer group support?

Hi Vince, librdkafka (master branch) supports >=0.9 balanced consumers groups: https://github.com/edenhill/librdkafka As long as you are using different consumer groups each group will receive the same set of messages. Example C++ consumer:

Re: Kafka C/C++ client with consumer group support?

Hi Vince, I think this might help you https://github.com/edenhill/librdkafka ( - High-level balanced KafkaConsumer: supported (requires broker >= 0.9)) Regards, Ben On Wed, Apr 6, 2016 at 3:16 PM, Vince Deters wrote: > Hello, we have a requirement to run redundant

Kafka C/C++ client with consumer group support?

Hello, we have a requirement to run redundant Kafka consumers that consume an identical stream of messages in identical order. For this reason we plan to have these consumers consume from the same topic partition and identify themselves as unique consumer groups. Does any C/C++ Kafka client

Does Kafka support federation of clusters?

Hi, For higher availability and more flexible operations (upgrading, rolling ops, etc.), we are considering to federate two or more kafka clusters, each with a separated zk cluster. For example, if "topic-T" has 6 total partitions, 3 on cluster A, and another 3 on cluster B, messages will be

Kafka Consumer Problem

Hi, I am trying to consume message from kafka with using web service. For exapmle; when the user call that web service, the all messages from partitions will be read by consumers and web service will returns the kafka messages to user who called it. I used below code for that purpose but

kafka issue

Hi, Seeing below exceptions on broker id 3 node, in my three node kafka cluster.Also looks like this broker id is long under replicated and out of sync. [2016-04-06 04:00:00,720] ERROR [Replica Manager on Broker 3]: Error processing fetch operation on partition [subscribed_product_logs,2]

Re: Low-level Consumer Example (Scala)

I use https://github.com/akka/reactive-kafka . This library has just been taken over by the Akka team and will in incorporated into future version of Akka. It allows for at-least-once semantics as well as at-most-once semantics. WARNING: The new API (

Re: Question on Java client consumer.seek()

Sounds reasonable to me. On 04/05/2016 05:56 PM, Mario Ricci wrote: > I found this > thread > and see that poll() must be called before seek(). > > This

Re: WARN Error while fetching metadata with correlation id 1 : {MY_TOPIC?=INVALID_TOPIC_EXCEPTION} (org.apache.kafka.clients.NetworkClient)

Sorry my bad..I should not add "?" at the end On 6 April 2016 at 11:01, Ratha v wrote: > Hi all; > when I run the following command with kafka 0.9.0.1 i get this > warnings[1]. Can you please tell me what is wrong with my topics? (I'm > talking to the kafka broker which