Re: Metrics: Non-cumulative values for Distribution

2018-06-01 Thread Jozef Vilcek
Hi Scott, nothing special about the use-case. Just want to monitor upper and lower bound for some data floating in operator. The "report interval" is right now 30 seconds and it is independent of business logic. It is the one mentionedd here: https://ci.apache.org/projects/flink/flink-docs-release

[Call for items] Beam June Newsletter

2018-06-01 Thread Griselda Cuevas
Hi Everyone, Here's [1] the template for the June Beam Newsletter. *Add the updates you want to share with the community by 6/5 11:59 p.m.* *Pacific Time.* I'll edit and send the final version through the user

Re: Metrics: Non-cumulative values for Distribution

2018-06-01 Thread Scott Wegner
Hi Jozef, Can you elaborate a bit on your use-case; is the "report interval" a concept you depend on for your data processing logic? The Metrics API in general is designed to serve data to the executing runner or external service which can then manage the aggregation and reporting through Pipelin

Re: Documentation for Beam on Windows

2018-06-01 Thread Ismaël Mejía
Is there a JIRA for this? Can you create one Udi? On Wed, May 23, 2018 at 11:32 PM Lukasz Cwik wrote: > > There is none to my knowledge. > > On Wed, May 23, 2018 at 1:49 PM Udi Meiri wrote: >> >> Hi all, >> >> I was looking yesterday for a quickstart guide on how to use Beam on Windows >> but sa

Metrics: Non-cumulative values for Distribution

2018-06-01 Thread Jozef Vilcek
Hi, I am running a streaming job on flink and want to monitor MIN and MAX ranges of a metric floating through operator. I did it via org.apache.beam.sdk.metrics.Distribution Problem is, that it seems to report only cumulative values. What I would want instead is discrete report for MIN / MAX whic