tzulitai commented on a change in pull request #7020: [FLINK-10774] [Kafka] connection leak when partition discovery is disabled an… URL: https://github.com/apache/flink/pull/7020#discussion_r246082400
########## File path: flink-connectors/flink-connector-kafka-base/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaConsumerBase.java ########## @@ -732,9 +745,7 @@ public void run() { throw new RuntimeException(discoveryLoopError); } } else { - // won't be using the discoverer - partitionDiscoverer.close(); - + // partitionDiscoverer is already closed in open method Review comment: Note that it isn't safe to directly close the partition discoverer as it isn't thread-safe (specifically, the Kafka client isn't thread safe). Would need to consider that when cleaning up the partition discoverer in the finally block. Please see the comments in the `FlinkKafkaConsumerBase.cancel()` method for an example. If the partition discoverer is concurrently being used by the discovery thread, it must be invoked `wakeup()` instead. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services