Well, what you say is correct. However, it's a "bug" in the sense that for some cases the producer does not need to fail, but can re-initialize itself automatically. Of course, you can also see this as an improvement and not a bug :)
-Matthias On 4/25/20 7:48 AM, Pushkar Deole wrote: > version used is 2.3 > however, not sure if this is a bug.. after doing some search, came across > following for the reason of this: > > essentially, the transaction coordinator of streams is cleaning up the > producer and transaction ids after a certain time interval controller by > transactional.id.expiration.ms > <https://docs.confluent.io/current/installation/configuration/broker-configs.html#transactional-id-expiration-ms>, > if the coordinator doesn't receive any updates/writes from the producer for > that much time. Default of this parameter is 7 days and our labs have been > idle for more than that. > > On Fri, Apr 24, 2020 at 10:46 PM Matthias J. Sax <mj...@apache.org> wrote: > >> This version are you using? >> >> Couple of broker and client side exactly-once related bugs got fix in >> the latest release 2.5.0. >> >> >> -Matthias >> >> On 4/23/20 11:59 PM, Pushkar Deole wrote: >>> Hello All, >>> >>> While using kafka streams application, we are intermittently getting >>> following exception and stream is closed. We need to restart the >>> application to get it working again and start processing. This exception >> is >>> observed in some of the labs which are being idle for some time but it is >>> not observed always. Any inputs appreciated here. >>> >>> >> {"@timestamp":"2020-04-15T13:53:52.698+00:00","@version":"1","message":"stream-thread >>> [analytics-event-filter-StreamThread-1] Failed to commit stream task 2_14 >>> due to the following >>> >> error:","logger_name":"org.apache.kafka.streams.processor.internals.AssignedStreamsTasks","thread_name":"analytics-event-filter-StreamThread-1","level":"ERROR","level_value":40000,"stack_trace":"org.apache.kafka.common.KafkaException: >>> Unexpected error in AddOffsetsToTxnResponse: The producer attempted to >> use >>> a producer id which is not currently assigned to its transactional >>> id.\n\tat >>> >> org.apache.kafka.clients.producer.internals.TransactionManager$AddOffsetsToTxnHandler.handleResponse(TransactionManager.java:1406)\n\tat >>> >> org.apache.kafka.clients.producer.internals.TransactionManager$TxnRequestHandler.onComplete(TransactionManager.java:1069)\n\tat >>> >> org.apache.kafka.clients.ClientResponse.onComplete(ClientResponse.java:109)\n\tat >>> >> org.apache.kafka.clients.NetworkClient.completeResponses(NetworkClient.java:561)\n\tat >>> org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:553)\n\tat >>> >> org.apache.kafka.clients.producer.internals.Sender.maybeSendAndPollTransactionalRequest(Sender.java:425)\n\tat >>> >> org.apache.kafka.clients.producer.internals.Sender.runOnce(Sender.java:311)\n\tat >>> >> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:244)\n\tat >>> java.base/java.lang.Thread.run(Unknown Source)\n"} >>> >> >> >
signature.asc
Description: OpenPGP digital signature