I've found that with our current tooling it's frustrating to try to write good end-to-end tests for real-world jobs with multiple sinks. DataStream#executeAndCollect() is okay for simple pipelines with one sink, but in my opinion we do need something like FLIP-251.
The proposed interface looks good to me. I look forward to trying it. Chesnay, thanks for putting this together! David On Thu, Jul 7, 2022 at 7:35 AM Chesnay Schepler <ches...@apache.org> wrote: > Hello, > > I have created a FLIP for slightly extending the collect() API to > support collecting an arbitrary number of streams, to make it more > useful for testing complex workflows. > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-251%3A+Support+collecting+arbitrary+number+of+streams > > Looking forward to any feedback. > > Regards, > > Chesnay > >
