Re: Integration Test for Kafka Streaming job

2022-04-21 Thread Alexey Trenikhun
Thank you for information ! From: Farouk Sent: Thursday, April 21, 2022 1:14:00 AM To: Aeden Jameson Cc: Alexey Trenikhun ; Flink User Mail List Subject: Re: Integration Test for Kafka Streaming job Hi I would recommend to use kafka-junit5 from salesforce

Re: Integration Test for Kafka Streaming job

2022-04-21 Thread Farouk
Hi I would recommend to use kafka-junit5 from salesforce https://github.com/salesforce/kafka-junit On top of that, you can use org.apache.flink.runtime.minicluster.TestingMiniCluster Your stack should be complete. Cheers Le jeu. 21 avr. 2022 à 07:10, Aeden Jameson a écrit : > I've had

Re: Integration Test for Kafka Streaming job

2022-04-20 Thread Aeden Jameson
I've had success using Kafka for Junit, https://github.com/mguenther/kafka-junit, for these kinds of tests. On Wed, Apr 20, 2022 at 3:01 PM Alexey Trenikhun wrote: > > Hello, > We have Flink job that read data from multiple Kafka topics, transforms data > and write in output Kafka topics. We

Integration Test for Kafka Streaming job

2022-04-20 Thread Alexey Trenikhun
Hello, We have Flink job that read data from multiple Kafka topics, transforms data and write in output Kafka topics. We want write integration test for it. I've looked at KafkaTableITCase, we can do similar setup of Kafka topics, prepopulate data but since in our case it is endless stream, we