Re: Query regarding kafka controller shutdown

2022-06-25 Thread dhiraj prajapati
ivity to some > extent. > > Question - what settings were used for topics like efGamePlay? What is min > insync replicas, replication factor, and what acks settings is the producer > using? > > Cheers, > > Liam > > On Fri, 3 Jun 2022 at 22:55, dhiraj prajapati > w

Query regarding kafka controller shutdown

2022-06-03 Thread dhiraj prajapati
Hi all, Recently we faced an issue with one of our production kafka clusters: - It is a 3 node cluster - kafka server version is 1.0 *Issue*: One of the brokers had some problem resulting in the following: 1. The broker lost leadership of all of the topic-parttions 2. However the kafka server pr

Re: Kafka broker startup issue

2017-05-22 Thread dhiraj prajapati
of Kafka running > against the same ZK broker. Do you have any other versions running? Or is > it possible this is a shared ZK cluster and you're not using a namespace > within ZK for each cluster? > > -Ewen > > On Mon, May 22, 2017 at 12:33 AM, dhiraj prajapati > wrote: &

Kafka broker startup issue

2017-05-22 Thread dhiraj prajapati
Hi, I am getting the below exception while starting kafka broker 0.9.0.1: kafka.common.KafkaException: Version 2 is invalid for UpdateMetadataRequest. Valid versions are 0 or 1. at kafka.api.UpdateMetadataRequest$.readFrom(UpdateMetadataRequest.scala:58) at kafka.api.RequestKeys$$anonfun$7

Commitlog path while Upgrading kafka server from 0.9 to 0.10.2.0

2017-04-20 Thread dhiraj prajapati
Hi, I want to do a rolling upgrade of kafka server from 0.9 to 0.10.2.0. Should I keep path of the commit logs the same? what is the impact of keeping the path same/different? Thanks in advance.

Frequent UNKNOWN_MEMBER_ID errors in kafka consumer

2016-10-19 Thread dhiraj prajapati
Hi, I have a consumer which implements new consumer api (0.9.0.1). I see below errors quite frequently in the consumer application logs: ERROR [pool-4-thread-5] - o.a.k.c.c.i.ConsumerCoordinator - Error UNKNOWN_MEMBER_ID occurred while committing offsets for group audit.consumer.group Can you ple

Re: Regarding log.retention.bytes config

2016-08-28 Thread dhiraj prajapati
It is per partition On Aug 27, 2016 3:10 AM, "Amit Karyekar" wrote: > Hi, > > We’re using Kafka 0.9 > > Wanted to check whether log.retention.bytes works on per partition basis > or is it cumulative of all partitions? > > Regards, > Amit > Information contained in this e-mail message is confiden

Re: How to Identify Consumers of a Topic?

2016-08-11 Thread dhiraj prajapati
For kafka version > 0.9, you can use kafka-consumer-groups.sh On Tue, Aug 9, 2016 at 5:21 AM, Jillian Cocklin < jillian.cock...@danalinc.com> wrote: > Thanks Derar, > > I'll check that out and see if it gives enough information about the > consumer to track it. > > Thanks! > Jillian > > -Or

UNKNOWN_MEMBER_ID

2016-08-03 Thread dhiraj prajapati
Hi, I am using kafka 0.9.0.1 and the corresponding java client for my consumer. I see the below error in my consumer logs: o.a.k.c.c.i.ConsumerCoordinator - Error UNKNOWN_MEMBER_ID occurred while committing offsets for group consumergroup001 Why could this error occur?

How many connections per consumer/producer

2016-06-30 Thread dhiraj prajapati
Hi, I am using new Kafka Consumer and Producer APIs (version 0.9.0.1) I see that my consumer as well as producer has multiple connections established with kafka brokers. Why is this so? Does the consumer and producer APIs use connection pooling? If yes, where do I configure the pool size? Regards,

What happens after connections.max.idle.ms | Kafka Producer

2016-06-30 Thread dhiraj prajapati
Hi, >From the document for producer configs: connections.max.idle.ms is the time after which idle connections will be closed. I wish to know what will happen if my connections are idle for long, and after that if the producer produces message? I dont see any exception. How does the producer client

Consume data in batches from Kafka

2016-05-12 Thread dhiraj prajapati
Hi, Can I coonsume data in batches from kafka using the old High Level Consumer? Is the new consumer API production ready?

Re: Some queries about java api for kafka producer

2015-04-13 Thread dhiraj prajapati
va docs "The producer is *thread safe* and should > > generally be shared among all threads for best performance" > > > > (2) (1) implies no pool is necessary. > > > > regards > > > > On Sun, Apr 12, 2015 at 12:38 AM, dhiraj prajapati > > &

Some queries about java api for kafka producer

2015-04-12 Thread dhiraj prajapati
of the pool and is it configurable? Thanks in advance, Dhiraj Prajapati