Re: multi tenant workflow execution

Hi Chen, yes, timers of a ProcessFunction are organized by key (you can have multiple timers per key as well), stored in the keyed state, checkpointed, and restored. I'm not sure about the guarantees for iterative streams. Best, Fabian 2017-01-25 8:18 GMT+01:00 Chen Qin :

Re: multi tenant workflow execution

Hi Fabian, AsyncFunction and ProcessFunction do help! I assume per event timers I created in implement RichProcessFunction will be part of key grouped states & cached in memory during runtime right? I am interested in this because we are targeting large deployment of million TPS event source. I

Re: multi tenant workflow execution

Hi Chen, if you plan to implement your application on top of the upcoming Flink 1.2.0 release, you might find the new AsyncFunction [1] and the ProcessFunction [2] helpful. AsyncFunction can be used for non-blocking calls to external services and maintains the checkpointing semantics.

multi tenant workflow execution

Hi there, I am researching running one flink job to support customized event driven workflow executions. The use case is to support running various workflows that listen to a set of kafka topics and performing various rpc checks, a user travel through multiple stages in a rule execution(workflow