Issue with Kafka installation - File path not found on Windowsx64

Dear Kafka Community, I am writing to seek your help with an issue that I am facing while installing Kafka on my system. I have tried multiple times to install Kafka, but I am continuously getting an error message stating that the specified file path is not found. I have followed all the

Kafka Consumer Health Check

Hi all, Is there a standardized way to implement a health check for a Kafka Consumer? I.e. for an application that runs in Kubernetes w/liveness probes. There does not seem to be an exposed API method for the Consumer’s current state or anything similar. The example issue we ran into was with

Re: Kafka cluster rolling restart

I concur with what Peter mentioned. You should wait for the under-replicated partition count to be zero. The increase in latency could be expected. Let's try to take a deeper look at what happens during a rolling restart. When you perform a controlled shutdown of a node, it will tell the

Re: Question about REQUEST QUEUE size

Thanks for your reply, after that I figured out my total producer rate is just around 8000/s although message rate is around 80K - 100K (message in per sec metric). Is 8000 requests per sec are simply too tiny to have any significant changes in request queue size ? May I ask you some additional

Fwd: Exactly once kafka connect query

Hi Chrise, Thanks for sharing the details. Regarding the use case, For Asn1 source connector we have a use case to validate number of records in the file with the number of records in the header. So currently, if validation fails we are not sending the last record to the topic. But after

Re: Exactly once kafka connect query

Hi Chrise, Thanks for sharing the details. Regarding the use case, For Asn1 source connector we have a use case to validate number of records in the file with the number of records in the header. So currently, if validation fails we are not sending the last record to the topic. But after

Re: Question about KRaft

Hi Sunil, As mentioned earlier in my question, I have only one "combined" node as both controller and broker, and I totally accept downtime (stop service) So just want to ask for my case, single node, if I want to upgrade to 3.4 then start service under KRaft (get rid of ZK), what would be the

Kafka General Question

Hello Kafka Team I am trying to some POC of the Messaging and it will working fine with the remote host and client . But I have question how I can send message/response from consumer to producer or server using topic . Please Guide me on this and share any doc if possible . Thank You Rohan Kar

Re: Question about REQUEST QUEUE size

The metric that you are monitoring is correct and works correctly in my setup for the versions that you mentioned. 1. To rule out any problems with reading via jconsole, do you see a non-zero value for "kafka.server:type=BrokerTopicMetrics,name=TotalProduceRequestsPerSec,topic=([-.\w]+)" ? 2. Do

Re: Exactly once kafka connect query

Hi Nitty, We've recently added some documentation on implementing exactly-once source connectors here: https://kafka.apache.org/documentation/#connect_exactlyoncesourceconnectors. To quote a relevant passage from those docs: > In order for a source connector to take advantage of this support, it

Fwd: Exactly once kafka connect query

Hi Team, Adding on top of this, I tried creating a TransactionContext object and calling the commitTransaction and abortTranaction methods in source connectors. But the main problem I saw is that if there is any error while parsing the record, connect is calling an abort but we have a use case to

Question about REQUEST QUEUE size

Hi guys, According to the document we can get the request queue size (the one network threads enqueue, IO threads dequeue and will block network thread if full) via "kafka.network:type=RequestChannel,name=RequestQueueSize". However, when I use jconsole to view this metric it always = 0. I have