Re: Dynamic Scaling: State Sharding

2020-10-05 Thread Mazen Ezzeddine
So what is the state of dynamic scaling (non static, set by the user in the code) for SLA gurantees now, is it already included in FLink, and is it still necessaru to stop/restart the job for dynamic scaling. Thanks. -- Sent from: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/

Re: KeyedCoProcessFunction, processElement1, processElement2, onTimer timeout

2020-09-16 Thread Mazen Ezzeddine
OK, thanks so much David very helpful. Sorry for any inconvenience. -- Sent from: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/

Re: Flink stateful functions : compensating callback to invoked functions on a timeout

2020-09-16 Thread Mazen Ezzeddine
Thank you so much Igal, complex things will appear as I progresses on the implementation and I will surely follow up with you. Best regards, -- Sent from: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/

Connecting two streams and order of their processing

2020-09-16 Thread Mazen Ezzeddine
Hello all, If an event is available now to Flink keyedcoprocess operator, and if another event will be available 1 minute later to that operator (same key), as a result of connecting the two streams, Flink does not provide any guarantee that the event available now will be processed

KeyedCoProcessFunction, processElement1, processElement2, onTimer timeout

2020-09-16 Thread Mazen Ezzeddine
Hey all, I am using the KeyedCoProcessFunction class in Flink DataStream APIs to implement a timeout like use case. The scenario is as follows: I have an input kafka topic and an output Kafka topic, a service reads from the input topic processes it (for variable amount of time) and then

KeyedCoProcessFunction, processElement1, processElement2, onTimer timeout

2020-09-16 Thread Mazen Ezzeddine
Hey all, I am using the KeyedCoProcessFunction class in Flink DataStream APIs to implement a timeout like use case. The scenario is as follows: I have an input kafka topic and an output Kafka topic, a service reads from the input topic processes it (for variable amount of time) and then

KeyedCoProcessFunction, processElement1, processElement2, onTimer timeout

2020-09-16 Thread Mazen Ezzeddine
Hey all, I am using the KeyedCoProcessFunction class in Flink DataStream APIs to implement a timeout like use case. The scenario is as follows: I have an input kafka topic and an output Kafka topic, a service reads from the input topic processes it (for variable amount of time) and then

Flink stateful functions : compensating callback to invoked functions on a timeout

2020-09-07 Thread Mazen Ezzeddine
Hi all, I am implementing a use case in Flink stateful functions. My specification highlights that starting from a *stateful function f* a business workflow (in other words a group of stateful functions f1, f2, … fn are called either sequentially or in parallel or both ). Stateful function f