Re: Emit event to kafka when finish sink

2020-09-15 Thread Dawid Wysakowicz
Hi, I am not sure if I understand your first solution, but it sounds rather complicated. I think implementing a custom operator could be a valid approach. You would have to make sure it is run with parallelism of 1. You could additionally implement a BoundedOneInput interface and notify the exter

Emit event to kafka when finish sink

2020-09-15 Thread Antonio Manzano
Hello guys, i would like to know if there is any possibility to emit an event when a sink has finished. To put it in context, I have a simple ETL (streaming bounded) that reads data from a database, maps, and inserts into another database. Once I finish inserting the data I want to issue an event