Hi, 

We have an use case where we need to ensure that data reaches all 
endpoints/sinks one by one or to split the flow if any of them fails. Here is 
an schema of the use case: 

Current job: Source -> filters/maps/process -> sink1 
\-> sink2 
\-> sink3 

Desired job: Source -> filters/maps/process -> sink1 -> if OK sink2 -> if OK 
sink3 
\-> if NOK sink4 \-> if NOK sink4 

In order to achieve it, we would like to have some kind of side output coming 
out from our sinks but side outputs are not available in SinkFunctions. The 
only way we have come up with is to implement the sink functionality inside a 
ProcessFunction or just call the sink.invoke() method from inside a process 
function but we hope there is a better/cleaner way to do it. 

We are working with the DataStream API in java. 

Thanks in advance, 

Aian 

-- 
----------------------------------------- 
Aian Cantabrana 

ZYLK.net :: consultoría.openSource 
Ribera de Axpe, 11 
Edificio A, modulo 201-203 
48950 Erandio (Bizkaia) 

telf.: +34 747421343 
ofic.: +34 944272119 
----------------------------------------- 

Reply via email to