Build failed in Jenkins: beam_Release_Gradle_NightlySnapshot #133

See -- [...truncated 18.72 MB...] Task ':beam-sdks-python-container:prepare' is not up-to-date because: Task has not declared any outputs despite executing actions. U

Beam Dependency Check Report (2018-08-06)

High Priority Dependency Updates Of Beam Python SDK: Dependency Name Current Version Latest Version Release Date Of the Current Used Version Release Date Of The Latest Release google-cloud-bigquery 0.25.0 1.5.0 2017-06-26

Re: Community Examples Repository

The way I see it, the examples repo needs not be versioned. Each example should specify it's dependencies the same way any external application would. In Python this would be the *requirements.txt* where we can specify *apache-beam>=2.5.0* for example. For Java, it can be specified in the *pom.xml*

Maintaining Beam Dependencies

Hi all, As from today, we start filing JIRA issues automatically for tracking Beam dependency updates based on the weekly report . Issues will be created

Re: Parallelizing test runs

How much slower did the post commits become after removing concurrency? On Thu, Aug 2, 2018 at 2:32 PM Mikhail Gryzykhin wrote: > I've disabled concurrency for auto-triggered post-commits job. That should > reduce job scheduling considerably. > > I believe that this change should resolve quota i

Re: Parallelizing test runs

I don't see difference at first glance and no difference is expected. We never utilized concurrent jobs originally, because job took ~1 hour and was triggered once every 6 hours. At some point, I added triggering job when new commit is available and this started triggering jobs in parallel for ea

Re: Runner agnostic Metrics

The JIRA is https://issues.apache.org/jira/browse/BEAM-3310 Here is the link to the discussion thread on the dev ML: https://lists.apache.org/thread.html/01a80d62f2df6b84bfa41f05e15fda900178f882877c294fed8be91e@%3Cdev.beam.apache.org%3E And the design doc: https://s.apache.org/runner_independent_me

[DISCUSSION] Tracking & Visualizing various metrics of the Beam community

Continuing the discussion about improving Beam code review, I am looking into visualizing various helpful Beam community metrics such as code velocity, reviewer load, and new co

Re: [VOTE] Apache Beam, version 2.6.0, release candidate #2

+1 non-binding Verified dataflow items listed in https://s.apache.org/beam-release-validation On Sun, Aug 5, 2018 at 6:37 AM Suneel Marthi wrote: > +1 non-binding > > 1. verified Sigs and Hashes of artifacts > 2. tested with my sample applications with local Runner > > On Sun, Aug 5, 2018 at 12:

Process JobBundleFactory for portable runner

Hi, Currently the portable Flink runner only works with SDK Docker containers for execution (DockerJobBundleFactory, besides an in-process (embedded) factory option for testing [1]). I'm considering adding another out of process JobBundleFactory implementation that directly forks the processes on