Hi Pavel,
I have tried the setting you have suggested but this does not seem to work.
Looks like this setting bounds the unbounded stream till the specified time
and then closes the stream and it is only after that the records are
applied downstream.
In my case withMaxReadTime = 3 minutes
Logs
Hello!
In case of KinesisIO there is a param which you can set - withMaxReadTime
I think many IOs implement it. It does not check if there is still some
outstanding data, simply finishes the pipeline when this time is over.
Best Regards,
Pavel Solomin
Tel: +351 962 950 692 | Skype:
Hi,
I am kind of building a batch/streaming hybrid beam application.
Data is fed into a kinesis stream and the beam pipeline is run.
I want to stop the pipeline if no new data is fed into the stream for a
certain period of time, say 5 minutes.
Is there a way of achieving this ?
Right now I only
