Re: [DISCUSS] Bridge beam metrics to underlying runners to support metrics reporters?

2017-06-23 Thread Ben Chambers
I think the distinction between metrics being reported (the API we give users to create Metrics) from getting metrics out of (currently either using the PipelineResult to query results or connecting to an external metric store) is important. There is an additional distinction to be made in data

Re: Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4199

2017-06-23 Thread Jean-Baptiste Onofré
It built without problem on my machine. Let me check on Jenkins. Regards JB On 06/23/2017 04:53 PM, Jean-Baptiste Onofré wrote: Hi Kenn, let me check, but I built early today without problem on my machine. Let me take a look. Regards JB On 06/23/2017 04:48 PM, Kenneth Knowles wrote: Hmm,

Re: Rewind back tuple timestamp in DoFn

2017-06-23 Thread Kenneth Knowles
Hi Shen, In order for this to work well with watermark tracking, we have some initial ideas on https://issues.apache.org/jira/browse/BEAM-644 Kenn On Wed, Jun 14, 2017 at 1:34 PM, Shen Li wrote: > Hi, > > I saw the DoFn#getAllowedTimestampSkew has been marked as

Re: [DISCUSS] Apache Beam 2.1.0 release next week ?

2017-06-23 Thread Kenneth Knowles
For easy reference: https://s.apache.org/beam-2.1.0-burndown At the time I am writing, there are 23 open issues tagged for this release. On Fri, Jun 23, 2017 at 12:22 AM, Jean-Baptiste Onofré wrote: > Hi guys, > > thanks all for your feedback. > > The target is: > - create

Re: [DISCUSS] Bridge beam metrics to underlying runners to support metrics reporters?

2017-06-23 Thread Ismaël Mejía
Cody not sure if I follow, but isn't Distribution on Beam similar to codahale/dropwizard's HIstogram (without the quantiles) ? Meters are also in the plan but not implemented yet, see the Metrics design doc: https://s.apache.org/beam-metrics-api If I understand what you want is to have some sort

Jenkins build is still unstable: beam_Release_NightlySnapshot #456

2017-06-23 Thread Apache Jenkins Server
See

Re: [DISCUSS] Bridge beam metrics to underlying runners to support metrics reporters?

2017-06-23 Thread Cody Innowhere
Yes I agree with you and sorry for messing them together in this discussion. I just wonder if someone plans to support Meters/Histograms in the near future. If so, we might need to modify metrics a bit in beam sdk IMHO, that's the reason I started this discussion. On Fri, Jun 23, 2017 at 3:21 PM,

Re: [DISCUSS] Apache Beam 2.1.0 release next week ?

2017-06-23 Thread Jean-Baptiste Onofré
Hi guys, thanks all for your feedback. The target is: - create the release branch Monday and cherry pick the fixes - vote around end of next week I propose to set "Fix Version" to 2.1.0 in Jira we aim to include in the release. I will do a first Jira pass today. Regards JB On 06/22/2017