[ https://issues.apache.org/jira/browse/KAFKA-16069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17803807#comment-17803807 ]
Sudesh Wasnik commented on KAFKA-16069: --------------------------------------- HI [~gharris1727] ! I would like to pick this up! Can I assign this to myself ? Thanks ! > Source Tasks re-transform records after Retriable exceptions > ------------------------------------------------------------ > > Key: KAFKA-16069 > URL: https://issues.apache.org/jira/browse/KAFKA-16069 > Project: Kafka > Issue Type: Bug > Components: connect > Reporter: Greg Harris > Priority: Minor > > In the SinkTask, records which fail to be delivered to the task#put with a > Retriable exception are re-delivered on the next iteration. The SourceTask > follows a similar pattern, where records which fail to be delivered to > Producer#send with a Retriable exception are retried. > However, the SinkTask accumulates the post-transform records, and does not > recompute the transformations over again after a retriable exception. The > SourceTask does not accumulate ProducerRecords, and instead recomputes the > transformations and converters starting from the pre-transformation > AbstractWorkerSourceTask#toSend list. > This means that stateful transformations and converters may see the records > rewind, without any indication that the records are the same. For stateless > transformations and converters, this means that redundant computation is > performed that may be better allocated to other tasks. -- This message was sent by Atlassian Jira (v8.20.10#820010)