DRAFT - Apache Beam Board Report - September 2022

2022-09-13 Thread Kenneth Knowles
Hi all, The next Beam board report is due tomorrow. Sorry for the short notice. Please help me to draft it at https://s.apache.org/beam-draft-report-2022-09. I've opened edit access to anyone with the link to minimize friction of drafting. Ideas: - highlights from CHANGES.md - interesting tech

Re: [Infrastructure] Periodically run Java microbenchmarks on Jenkins

2022-09-13 Thread Kenneth Knowles
Good idea. I'm curious about our current benchmarks. Some of them run on clusters, but I think some of them are running locally and just being noisy. Perhaps this could improve that. (or if they are running on local Spark/Flink then maybe the results are not really meaningful anyhow) On Tue, Sep 1

Re: Beam Website Feedback

2022-09-13 Thread Sachin Agarwal via dev
Andrew, Thanks so much for the feedback and glad the getting started materials are helping. Would you like a downloadable container that works out of the box for your local machine or to spin up on AWS or GCP or DO or something like that? Just trying to make sure we understand the gap correctly s

Beam Website Feedback

2022-09-13 Thread Andrew Hoyle via dev
Hello, This is an exciting technology that I'm enjoying learning about. I'm learning best through the examples throughout the Beam docs. (My favorite examples have been those around the clicks, views, and batch RPC calls in the state and timer sections.) I'm able to run proofs of concept locall

Re: Pass Custom namespaces to RunInference metrics

2022-09-13 Thread Anand Inguva via dev
Thanks for the feedback. I will move forward with solution 1. On Mon, Sep 12, 2022 at 2:20 PM Danny McCormick wrote: > Thanks for writing this up Anand! I agree with you (and Andy) that > solution 1 is the best path forward. > > Thanks, > Danny > > On Mon, Sep 12, 2022 at 2:11 PM Andy Ye via dev

Beam High Priority Issue Report (67)

2022-09-13 Thread beamactions
This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/23179 [Bug]: Parquet size

[Infrastructure] Periodically run Java microbenchmarks on Jenkins

2022-09-13 Thread Moritz Mack
Hi team, I’m looking for some help to setup infrastructure to periodically run Java microbenchmarks (JMH). Results of these runs will be added to our community metrics (InfluxDB) to help us track performance, see [1]. To prevent noisy runs this would require a dedicated Jenkins machine that run