Re: Is there a way to clean up the state based on custom/business logic?

2020-01-14 Thread Dawid Wysakowicz
Hi, What you are asking is certainly possible with the DataStream API. Table API/SQL is a declarative API, where say what to want to compute not how. As a rule of thumb I would say whenever you need to manually handle your state or timers the DataStream API and ProcessFunction[1] will be a

Is there a way to clean up the state based on custom/business logic?

2020-01-14 Thread kant kodali
Hi All, I read through the doc below and I am wondering if I can clean up the state based on custom logic rather min and max retention time? For example, I want to say clean up all the state where the key = foo or say the value = bar. so until the keys reach a particular value just keep