Re: Query regarding kafka controller shutdown

2022-06-25 Thread dhiraj prajapati
ity to some > extent. > > Question - what settings were used for topics like efGamePlay? What is min > insync replicas, replication factor, and what acks settings is the producer > using? > > Cheers, > > Liam > > On Fri, 3 Jun 2022 at 22:55, dhiraj prajapati > wro

Query regarding kafka controller shutdown

2022-06-03 Thread dhiraj prajapati
Hi all, Recently we faced an issue with one of our production kafka clusters: - It is a 3 node cluster - kafka server version is 1.0 *Issue*: One of the brokers had some problem resulting in the following: 1. The broker lost leadership of all of the topic-parttions 2. However the kafka server

Re: Kafka broker startup issue

2017-05-23 Thread dhiraj prajapati
r with a newer version of Kafka running > against the same ZK broker. Do you have any other versions running? Or is > it possible this is a shared ZK cluster and you're not using a namespace > within ZK for each cluster? > > -Ewen > > On Mon, May 22, 2017 at 12:33 AM, dhir

Kafka broker startup issue

2017-05-22 Thread dhiraj prajapati
Hi, I am getting the below exception while starting kafka broker 0.9.0.1: kafka.common.KafkaException: Version 2 is invalid for UpdateMetadataRequest. Valid versions are 0 or 1. at kafka.api.UpdateMetadataRequest$.readFrom(UpdateMetadataRequest.scala:58) at

Commitlog path while Upgrading kafka server from 0.9 to 0.10.2.0

2017-04-20 Thread dhiraj prajapati
Hi, I want to do a rolling upgrade of kafka server from 0.9 to 0.10.2.0. Should I keep path of the commit logs the same? what is the impact of keeping the path same/different? Thanks in advance.

Frequent UNKNOWN_MEMBER_ID errors in kafka consumer

2016-10-19 Thread dhiraj prajapati
Hi, I have a consumer which implements new consumer api (0.9.0.1). I see below errors quite frequently in the consumer application logs: ERROR [pool-4-thread-5] - o.a.k.c.c.i.ConsumerCoordinator - Error UNKNOWN_MEMBER_ID occurred while committing offsets for group audit.consumer.group Can you

Re: Regarding log.retention.bytes config

2016-08-28 Thread dhiraj prajapati
It is per partition On Aug 27, 2016 3:10 AM, "Amit Karyekar" wrote: > Hi, > > We’re using Kafka 0.9 > > Wanted to check whether log.retention.bytes works on per partition basis > or is it cumulative of all partitions? > > Regards, > Amit > Information contained in this

Re: How to Identify Consumers of a Topic?

2016-08-11 Thread dhiraj prajapati
For kafka version > 0.9, you can use kafka-consumer-groups.sh On Tue, Aug 9, 2016 at 5:21 AM, Jillian Cocklin < jillian.cock...@danalinc.com> wrote: > Thanks Derar, > > I'll check that out and see if it gives enough information about the > consumer to track it. > > Thanks! > Jillian > >

UNKNOWN_MEMBER_ID

2016-08-03 Thread dhiraj prajapati
Hi, I am using kafka 0.9.0.1 and the corresponding java client for my consumer. I see the below error in my consumer logs: o.a.k.c.c.i.ConsumerCoordinator - Error UNKNOWN_MEMBER_ID occurred while committing offsets for group consumergroup001 Why could this error occur?

What happens after connections.max.idle.ms | Kafka Producer

2016-06-30 Thread dhiraj prajapati
Hi, >From the document for producer configs: connections.max.idle.ms is the time after which idle connections will be closed. I wish to know what will happen if my connections are idle for long, and after that if the producer produces message? I dont see any exception. How does the producer

Consume data in batches from Kafka

2016-05-12 Thread dhiraj prajapati
Hi, Can I coonsume data in batches from kafka using the old High Level Consumer? Is the new consumer API production ready?

Re: Some queries about java api for kafka producer

2015-04-13 Thread dhiraj prajapati
is *thread safe* and should generally be shared among all threads for best performance (2) (1) implies no pool is necessary. regards On Sun, Apr 12, 2015 at 12:38 AM, dhiraj prajapati dhirajp...@gmail.com wrote: Hi, I want to send data to apache kafka using the java api

Some queries about java api for kafka producer

2015-04-12 Thread dhiraj prajapati
of the pool and is it configurable? Thanks in advance, Dhiraj Prajapati