Re: CEP: Dynamic Patterns

2017-12-28 Thread Rafi Aroch
Hi Kostas & Ufuk, Appreciate your detailed response. I'll give it a try. Thanks, Rafi On Thu, Dec 28, 2017 at 5:16 PM, Ufuk Celebi wrote: > Looks good to me, Klou. I would only add the following two things: > > 1) UIDs need to be unique for the complete program, so you would

Re: CEP: Dynamic Patterns

2017-12-28 Thread Ufuk Celebi
Looks good to me, Klou. I would only add the following two things: 1) UIDs need to be unique for the complete program, so you would need more specific ones, e.g. `filter-1-version-1` instead of only `version-1`. These are used to map state from the savepoint back to your program. We want to keep

Re: CEP: Dynamic Patterns

2017-12-28 Thread Kostas Kloudas
Hi again Rafi, Coming back to the second part of the question on what you can do right now, I would suggest that you launch your initial job with your initial patterns and in your code you assign UID’s to your sources and the CEP operators, e.g.: CEP.pattern(input,

Re: CEP: Dynamic Patterns

2017-12-28 Thread Kostas Kloudas
Hi Rafi, Currently this is unfortunately not supported out of the box. To support this, we need 2 features with one having to be added in Flink itself, and the other to the CEP library. The first one is broadcast state and the ability to connect keyed and non-keyed streams. This one is to be

Re: CEP: Dynamic Patterns

2017-12-27 Thread Ufuk Celebi
Hey Rafi, this is indeed a very nice feature to have. :-) I'm afraid that this is currently hard to do manually with CEP. Let me pull in Dawid and Klou (cc'd) who have worked a lot on CEP. They can probably update you on the plan for FLINK-7129. Best, Ufuk On Tue, Dec 26, 2017 at 8:47 PM,

Re: CEP: Dynamic Patterns

2017-12-26 Thread Shivam Sharma
Hi Rafi, Even I also wanted this facility from Flink Core. But I think this is already solved by Uber on Flink. https://eng.uber.com/athenax/ Best On Tue, Dec 26, 2017 at 6:21 PM, Rafi Aroch wrote: > Hi, > > I'm Rafi, Data Architect at WalkMe. > > Our Mobile platform

CEP: Dynamic Patterns

2017-12-26 Thread Rafi Aroch
Hi, I'm Rafi, Data Architect at WalkMe. Our Mobile platform generates events coming from the end-users mobile device for different actions that the user does. The use case I wanted to implement using Flink CEP is as follows: We would like to expose a UI where we could define a set of rules.