mas-chen opened a new pull request, #79:
URL: https://github.com/apache/flink-connector-kafka/pull/79

   …ith consistency and cleanup notify no more splits to ensure it is sent
   
   I have spent the last few days troubleshooting this and found that most 
issues are related to the bounded mode tests. Issues:
   1. Test records were not being produced to Kafka. I added the Kafka settings 
and refactored to the API to ensure all records are sent to all brokers.
   2. When I fixed this, I ran into some tests that would exceed the 50 minute 
CI. This is because the the no more splits signal was not sent properly. I 
refactored the code a bit to make it clearer.
   
   At this commit, the tests are quite stable. 6/7 CI runs pass.
   <img width="329" alt="Screenshot 2024-01-16 at 10 13 43 PM" 
src="https://github.com/apache/flink-connector-kafka/assets/6834335/c0fae8e0-f8bc-4ad3-8075-ede06a27ef08";>
   
   In one CI run that failed, I did see that there was a Flink error, 
indicating a lost source event. In separate commits, there were other instances 
that exceeded 50 minutes but this can be solved separately, see 
https://issues.apache.org/jira/browse/FLINK-34127.
   
   cc: @mxm @tzulitai @MartijnVisser 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to