Re: replacing WindowFunction with AggregateFunction

2018-09-08 Thread Hequn Cheng
Hi Nicos, I think it should be a type problem. Make sure the input DataStream is type of `IngressPOJO `. There are examples here[1][2] which may be helpful. Best, Hequn [1] https://github.com/apache/flink/blob/master/flink-streaming-java/src/test/java/org/apache/flink/streaming/runtime/operators/

Re: test windows

2018-09-08 Thread Hequn Cheng
Hi Nicos, I think this is what you want. WindowFoldITCase . :-) Flink is a open source project, you can checkout the source code from git and search the tests in it.

Re: Cancel flink job occur exception

2018-09-08 Thread Gary Yao
Hi all, The question is being handled on the dev mailing list [1]. Best, Gary [1] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Cancel-flink-job-occur-exception-td24056.html On Tue, Sep 4, 2018 at 2:21 PM, rileyli(李瑞亮) wrote: > Hi all, > I submit a flink job through yar

Re: test windows

2018-09-08 Thread Nicos Maris
Hi all, It took me some time to reply. I am focusing on testing my job, not on unit tests and the SourceFunction as in WindowFunctionITCase.scala has

Re: replacing WindowFunction with AggregateFunction

2018-09-08 Thread Nicos Maris
This seams to be the way to go but I get "cannot resolve method" at the method 'aggregate'. My aggregareFunction implements the following: AggregateFunc

replacing WindowFunction with AggregateFunction

2018-09-08 Thread Nicos Maris
Hi, I am replacing replacing my legacy WindowFunction with AggregateFunction. I use TumblingEventTimeWindows, how can I get the start

Re: How to customize schedule mode and result partition type?

2018-09-08 Thread Renjie Liu
Hi: 1. I'm wondering in which case you need this LAZY_FROM_SROUCE schedule mode? 2. It seems that this can't be changed for streaming jobs, and it's worth a discussion for an api that changes the schedule mode On Fri, Sep 7, 2018 at 6:25 PM 陈梓立 wrote: > Sorry to attach this message here, but if

Re: Flink RMQSource Consumer: How I get the RabbitMQ UserId

2018-09-08 Thread vino yang
Hi Marke, As you said, you need to extend RMQSource because Flink's rabbitmq connector only extracts the body of Delivery. Therefore, in order to achieve your purpose, you need to add a property to the specific data type of your DataStream to represent the userId, then override the RMQSource#run m

Flink RMQSource Consumer: How I get the RabbitMQ UserId

2018-09-08 Thread Marke Builder
Hi, how I can get the UserId from the Properties in my DataStream? I can read the userId if I extend the RMQSource Class: QueueingConsumer.Delivery delivery = consumer.nextDelivery(); String userId = delivery.getProperties().getUserId(); But how can I provide this to my DataStream ? Best regard