ableegoldman opened a new pull request #9568:
URL: https://github.com/apache/kafka/pull/9568


   Two pieces:
   1) Fix bug in StreamSinkNode#writeToTopology to make sure it always calls 
the `addSink` overload with the specific topic name, when it exists, so that 
this topic gets tracked in the InternalTopologyBuilder's `nodeToSinkTopic` map. 
The sink topics are used by the StreamsPartitionAssignor to resolve the 
upstream subtopology of a repartition source topic, for whom that repartition 
topic will be a sink. Without this information the SPA gets stuck permanently 
during a rebalance
   2) Improve the SPA's `setRepartitionTopicMetadataNumberOfPartitions()` 
method to break out of the loop if we aren't making any progress, to avoid 
infinitely looping if we ever have another bug like KAFKA-10689. If the SPA 
hasn't updated the known partition numbers for any repartition topic in the 
current outer loop, then we know that it's stuck and should throw a 
TaskAssignmentException to shut down the application


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Reply via email to