RE: [Flink 1.6] How to get current total number of processed events

2019-01-25 Thread Thanh-Nhan Vo
Hi Kien, Thanks you so much for you answer ! Regards, Nhan De : Kien Truong [mailto:duckientru...@gmail.com] Envoyé : vendredi 25 janvier 2019 13:47 À : Thanh-Nhan Vo ; user@flink.apache.org Objet : Re: [Flink 1.6] How to get current total number of processed events Hi Nhan, To get a global

RE: [Flink 1.6] How to get current total number of processed events

2019-01-25 Thread Thanh-Nhan Vo
: Congxian Qiu [mailto:qcx978132...@gmail.com] Envoyé : vendredi 25 janvier 2019 07:30 À : Kien Truong Cc : Thanh-Nhan Vo ; user@flink.apache.org Objet : Re: [Flink 1.6] How to get current total number of processed events Hi, Nhan Do you want the total number of the current parallelism or the operator

RE: [Flink 1.6] How to get current total number of processed events

2019-01-25 Thread Thanh-Nhan Vo
: Thanh-Nhan Vo ; user@flink.apache.org Objet : Re: [Flink 1.6] How to get current total number of processed events Hi Nhan, You can store the max/min value using the value states of a KeyedProcessFunction, or in the global state of a ProcessWindowFunction. On processing each item, compare

RE: [Flink 1.6] How to get current total number of processed events

2019-01-23 Thread Thanh-Nhan Vo
don't think Flink supports it. Although, I suppose you can get an approximate count by using a non-keyed TumblingWindow, count the item inside the window, then use that value in the next window. Regards, Kien On 1/21/2019 9:34 PM, Thanh-Nhan Vo wrote: Hello all, I have a question, please ! I'm

[Flink 1.6] How to get current total number of processed events

2019-01-21 Thread Thanh-Nhan Vo
Hello all, I have a question, please ! I'm using Flink 1.6 to process our data in streaming mode. I wonder if at a given event, there is a way to get the current total number of processed events (before this event). If possible, I want to get this total number of processed events as a value