Hi all,
I’d like to propose a Pipeline Testing Framework (on Source/Sink V2) as a
part of flink's testing framework, built on concepts presented by the talk
*“*Testing Production Streaming Applications
<https://www.youtube.com/watch?v=lXHleussX9Q>” (Gyula Fóra & Mátyás
Orhidi).

The aim is to let users write end-to-end pipeline flow tests — replacing
real connectors with lightweight TestSources/TestSinks — so they can
deterministically inject records/watermarks and assert outputs under
parallelism.

Unlike MiniCluster, local env, or operator harnesses, this provides a small
Source/Sink V2-based *testkit* (send(), sendWatermark(), finish(),
assertSink()), backed by isolated in-JVM buffers for reproducible control.
The focus is on testing *pipeline logic and wiring*, not connector
implementations themselves.

For more details refer to this doc
<https://docs.google.com/document/d/1lwA4BE4vHTkIBQ-IyEBjPh2l7y7Z3MGzlbOlDaKDnzE/edit?tab=t.0>
.
Looking forward to your feedback.
Thanks,
Poorvank Bhatia

Reply via email to