Hi Hanan,
Flink does handle backpressure gracefully. I guess your custom ZMQ source
is receiving events in a separate thread?
In a Flink source, the SourceContext.collect() method will not return if
the downstream operators are not able to process incoming data fast enough.
If my assumptions are
Hi Hanan,
Sometimes, the behavior depends on your implementation.
Since it's not a built-in connector, it would be better to share your
customized source with the community
so that the community would be better to help you figure out where is the
problem.
WDYT?
Best,
Vino
Hanan Yehudai
HI , I am trying to do some performance test to my flink deployment.
I am implementing an extremely simplistic use case
I built a ZMQ Source
The topology is ZMQ Source - > Mapper- > DIscardingSInk ( a sink that does
nothing )
Data is pushed via ZMQ at a very high rate.
When the incoming rate
