Thanks Poorvank, The proposal looks great.
Thanks, Matyas On Thu, Sep 11, 2025 at 3:44 AM Poorvank Bhatia <[email protected]> wrote: > Hi all, > I’d like to propose a Pipeline Testing Framework (on Source/Sink V2) as a > part of flink's testing framework, built on concepts presented by the talk > *“*Testing Production Streaming Applications > <https://www.youtube.com/watch?v=lXHleussX9Q>” (Gyula Fóra & Mátyás > Orhidi). > > The aim is to let users write end-to-end pipeline flow tests — replacing > real connectors with lightweight TestSources/TestSinks — so they can > deterministically inject records/watermarks and assert outputs under > parallelism. > > Unlike MiniCluster, local env, or operator harnesses, this provides a small > Source/Sink V2-based *testkit* (send(), sendWatermark(), finish(), > assertSink()), backed by isolated in-JVM buffers for reproducible control. > The focus is on testing *pipeline logic and wiring*, not connector > implementations themselves. > > For more details refer to this doc > < > https://docs.google.com/document/d/1lwA4BE4vHTkIBQ-IyEBjPh2l7y7Z3MGzlbOlDaKDnzE/edit?tab=t.0 > > > . > Looking forward to your feedback. > Thanks, > Poorvank Bhatia >
