Producer callback not called for small percentage of the messages

Hi All, I am using kafka java client 0.8.2 and I am observing that for a small percentage of the the send call, the onCompletion method of the callback is not getting called. How can it be possible? I was under the impression that since kafka uses tcp internally , based on tcp ack , all callback

[VOTE] 0.10.2.1 RC0

Hello Kafka users, developers and client-developers, This is the first candidate for the release of Apache Kafka 0.10.2.1. This is a bug fix release and it includes fixes and improvements from 24 JIRAs (including a few critical bugs). See the release notes for more details: http://home.apache.org

Does Kafka elect new follower when the original follower is down?

Hello, I have a 6 broker cluster, configured with auto.leader.rebalance.enable=false. The broker ids are 1 thru 6. I have about 160 partitions for which I assigned the replicas to be 1,2,3 (1 is the leader). When broker-2 underwent a controlled shutdown, the 'kafka-topics.sh -describe' command

Re: Topic deletion

Hi Adrian, When you delete a topic, it is marked a under /admin/delete_topics path in zookeeper. Once that is done, controller gets a notification that a topic is marked for delete. The controller then notifies the replcias of the topic-partitions to delete the data for the topic and the topic its

RE: Topic deletion

Indeed, I wish it was explained somewhere what marked for deletion does, and what process handles it. I will have to go and investigate the source. I can confirm the zkCli did the trick, thanks for the hint! Adrian -Original Message- From: Akhilesh Pathodia [mailto:pathodia.akhil...@gma

Re: Topic deletion

I am not sure but kafka delete command does not delete the topic actually, it only marks it for deletion. Probably it is fixed in later version of kafka. On Fri, Apr 7, 2017 at 2:14 PM, Adrian McCague wrote: > Hi Akhilesh, > > Why would this approach need to be taken over the kafka-topics tool,

RE: Topic deletion

Hi Akhilesh, Why would this approach need to be taken over the kafka-topics tool, out of interest? Thanks Adrian -Original Message- From: Akhilesh Pathodia [mailto:pathodia.akhil...@gmail.com] Sent: 07 April 2017 09:37 To: users@kafka.apache.org Subject: Re: Topic deletion Hi Adrian,

RE: Topic deletion

Hi Zakee, this is 0.10.2.0. Thanks for heads up on that issue. -Original Message- From: Zakee [mailto:kzak...@netzero.net] Sent: 06 April 2017 19:28 To: users@kafka.apache.org Subject: Re: Topic deletion What version of kafka you are on? There are issues with delete topic until I guess

Re: Topic deletion

Hi Adrian, You will have to delete the broker directory from zookeeper. This can be done from zookeeper cli. Connect to zookeeper cli using below command: zookeeper-client -server Then run below command : rmr /brokers/topics/ Thanks, AKhilesh On Thu, Apr 6, 2017 at 11:03 PM, Adrian McCague