Re: Event Time Session Window does not trigger..

Hi Hequn, Thanks for link. Looks like I better use ProcessingTime instead of EventTime especially because of the 4th reason you listed.. "Data should cover a longer time span than the window size to advance the event time." I need the trigger when the data stops. I have 1 more question. Can I

Multiple output operations in a job vs multiple jobs

Hi all, I am not sure when I should go for multiple jobs or have 1 job with all the sources and sinks. Following is my code. val env = StreamExecutionEnvironment.getExecutionEnvironment ... // create a Kafka source val srcstream = env.addSource(consumer) srcstream

Re: ProcessFunction example from the documentation giving me error

rk is giving the same error. >> When I have a source generator within the app itself works good. >> >> So, with socketTextStream and kafka source gives me >> java.net.ConnectException: Operation timed out (Connection timed out) >> error >>

Re: ProcessFunction example from the documentation giving me error

, with socketTextStream and kafka source gives me java.net.ConnectException: Operation timed out (Connection timed out) error On Fri, Jul 20, 2018 at 10:29 AM, anna stax wrote: > My object name is CreateUserNotificationRequests, thats why you see > CreateUserNotificationRequests in the Error message. >

Re: ProcessFunction example from the documentation giving me error

My object name is CreateUserNotificationRequests, thats why you see CreateUserNotificationRequests in the Error message. I edited the object name after pasting the code...Hope there is no confusion and I get some help. Thanks On Fri, Jul 20, 2018 at 10:10 AM, anna stax wrote: > Hello

Re: ProcessFunction example from the documentation giving me error

tion you provided, it seems Flink started a network > connect but timed out. > > Thanks, vino. > > 2018-07-20 14:14 GMT+08:00 anna stax : > >> Hi all, >> >> I am new to Flink. I am using the classes CountWithTimestamp and >> CountWithTimeoutFunction from the ex

Re: Is KeyedProcessFunction available in Flink 1.4?

yedprocessfunction>. > It extends ProcessFunction and shares the same functionalities except > giving more access to timers' key, thus you can refer to examples of > ProcessFunction in that document. > > Bowen > > > On Thu, Jul 19, 2018 at 3:26 PM anna stax wrote: > >

ProcessFunction example from the documentation giving me error

Hi all, I am new to Flink. I am using the classes CountWithTimestamp and CountWithTimeoutFunction from the examples found in https://ci.apache.org/projects/flink/flink-docs-release-1.5/dev/stream/operators/process_function.html I am getting the error Exception in thread "main"

Is KeyedProcessFunction available in Flink 1.4?

Hello all, I am using Flink 1.4 because thats the version provided by the latest AWS EMR. Is KeyedProcessFunction available in Flink 1.4? Also please share any links to good examples on using KeyedProcessFunction . Thanks

Re: How to create User Notifications/Reminder ?

Thanks Hequn and Dawid for your input. Thanks Dawid for the link. Great help! On Thu, Jul 12, 2018 at 5:59 AM, Dawid Wysakowicz < wysakowicz.da...@gmail.com> wrote: > Hi shyla, > > It should be doable with CEP. You can create pattern like: >

Re: How to trigger a function on the state periodically?

ys to reduce the number of timers, for example > keyBy(userId%1024), and use a MapState to store different users for the > same group. > > On Tue, Jul 10, 2018 at 1:54 PM, anna stax wrote: > >> Thanks Hequn. I think so too, the large number of timers could be a >> problem

Re: How to trigger a function on the state periodically?

estamp. Also, > note that a large number of timers can significantly increase checkpointing > time. > > On Tue, Jul 10, 2018 at 11:38 AM, anna stax wrote: > >> Thanks Hequn, for the links. >> >> This is my use case.. >> >> When there is no user activ

Re: How to trigger a function on the state periodically?

.org/projects/flink/flink-docs- > master/dev/stream/state/broadcast_state.html > > On Tue, Jul 10, 2018 at 7:47 AM, anna stax wrote: > >> Hi all, >> >> I need to trigger a function once every day to read the state and create >> kafka events and also remove some rec

How to trigger a function on the state periodically?

Hi all, I need to trigger a function once every day to read the state and create kafka events and also remove some records from state if they are too old. Is there a way to do this? I am new to Flink, appreciate any feedback and suggestions. Thanks Anna