Hi Avi,
did you have a look at the .connect() and .broadcast() API
functionalities? They allow you to broadcast a control stream to all
operators. Maybe this example [1] or other examples in this repository
can help you.
Regards,
Timo
[1]
https://github.com/ververica/flink-training-exercises/blob/master/src/main/java/com/dataartisans/flinktraining/solutions/datastream_java/broadcast/TaxiQuerySolution.java
Am 26.04.19 um 07:57 schrieb Avi Levi:
Hi,
We have a keyed pipeline with persisted state.
Is there a way to broadcast a command and collect all values that
persisted in the state ?
The end result can be for example sending a fetch command to all
operators and emitting the results to some sink
why do we need it ? from time to time we might want to check if we are
missing keys what are the additional keys or simply emit the current
state to a table and to query it.
I tried simply broadcasting a command and addressing the persisted
state but that resulted with:
java.lang.NullPointerException: No key set. This method should not be
called outside of a keyed context.
is there a good way to achieve that ?
Cheers
Avi
