Re: whether kafka can list producers

2019-09-03 Thread Matthias J. Sax
I don't thinks that is easily possible; at least I think there is no public API to get this information. Maybe, if you have configured unique `client.id` for each producer, you may see the `client.id` in broker logs. Hope this helps. -Matthias On 9/3/19 5:17 AM, Xiangyuan LI wrote: > Hi, >

whether kafka can list producers

2019-09-03 Thread Xiangyuan LI
Hi, I want to know whether kafka can list producers that send messages to specified topic? i need know this because recently my consumer consume some messages that producer haven't send to topic,so we now don't know who send this message. thx...

Re: Failed to rebalance -- Unexpected error in InitProducerIdResponse

2019-09-03 Thread Dimitry Lvovsky
It’s only limited to this one app. I’ll keep digging and let you know. More suggestions always welcome. Thanks. On Tue, Sep 3, 2019 at 13:53 Jonathan Santilli wrote: > Np, > > are other Apps working correctly? (if that the case) > Seems like the hints are around

Re: Failed to rebalance -- Unexpected error in InitProducerIdResponse

2019-09-03 Thread Jonathan Santilli
Np, are other Apps working correctly? (if that the case) Seems like the hints are around "org.apache.kafka.common.KafkaException: Unexpected error in InitProducerIdResponse; The server experienced an unexpected error when processing the request" I would start checking the Broker's health and if

Re: Failed to rebalance -- Unexpected error in InitProducerIdResponse

2019-09-03 Thread Dimitry Lvovsky
Thanks, Jonathan for the quick response. I have, but I didn't see any errors. On Tue, Sep 3, 2019 at 1:43 PM Jonathan Santilli wrote: > Hello, have you check the Brokers Logs? maybe there is something there at > that particular time when the error occurred in the App side. > > Cheers! > > >

Re: Failed to rebalance -- Unexpected error in InitProducerIdResponse

2019-09-03 Thread Jonathan Santilli
Hello, have you check the Brokers Logs? maybe there is something there at that particular time when the error occurred in the App side. Cheers! On Tue, Sep 3, 2019 at 12:38 PM Dimitry Lvovsky wrote: > Hi all, > We have a streaming app running for over a year now without much incident > until

Failed to rebalance -- Unexpected error in InitProducerIdResponse

2019-09-03 Thread Dimitry Lvovsky
Hi all, We have a streaming app running for over a year now without much incident until recently. Suddenly the process keeps failing after a minute or so with a failed to rebalance exception caused by Unexpected error in InitProducerIdResponse; The server experienced an unexpected error when

Uncaught error in kafka producer I/O thread

2019-09-03 Thread Jonathan Santilli
Hello, hope you all are well, I would like to know if you guys also have seen this issue in your Apps logs: ERROR [kafka-producer-network-thread | producer-5] internals.Sender (Sender.java:240) - [Producer clientId=producer-5, transactionalId=client-XXX-1-4] Uncaught error in kafka producer I/O