bowenli-oai opened a new pull request, #275:
URL: https://github.com/apache/flink-connector-kafka/pull/275

   ## What is the purpose of the change
   
   `DynamicKafkaSource` can remain active after a metadata update removes the 
last active Kafka cluster/split from a reader subtask. Since no sub-reader 
remains to report idleness, downstream watermark progress can stall.
   
   This is based on openai/flink-connector-kafka#73 and adapted for Apache main.
   
   ## Brief change log
   
   - Treat an actively consuming dynamic reader with zero active sub-readers as 
idle, and mark it active again when sub-readers return.
   - Complete the previous availability future when resetting availability to 
zero sub-readers.
   - Add no-Docker regression coverage for removing the last active 
cluster/split, releasing the split output, and completing the availability 
transition.
   
   ## Verifying this change
   
   - `mvn -f flink-connector-kafka/pom.xml 
-Dtest=DynamicKafkaSourceReaderIdlenessTest test`
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to