Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #5001

See

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Apex #2580

See

[jira] [Assigned] (BEAM-2979) Race condition between KafkaIO.UnboundedKafkaReader.getWatermark() and KafkaIO.UnboundedKafkaReader.advance()

[ https://issues.apache.org/jira/browse/BEAM-2979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-2979: - Assignee: Raghu Angadi (was: Kenneth Knowles) > Race condition between

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Flink #4049

See

[jira] [Commented] (BEAM-2899) Universal Local Runner

[ https://issues.apache.org/jira/browse/BEAM-2899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199760#comment-16199760 ] ASF GitHub Bot commented on BEAM-2899: -- Github user asfgit closed the pull request at:

[2/2] beam git commit: Move the Job Server into a Submodule

Move the Job Server into a Submodule This permits separation of the Job Server and the Java Runner which submits to it, while both being part of the 'ReferenceRunner' Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/992d805b

[1/2] beam git commit: This closes #3967

Repository: beam Updated Branches: refs/heads/master 90f34f289 -> f51a9abc4 This closes #3967 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f51a9abc Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f51a9abc Diff:

[GitHub] beam pull request #3967: [BEAM-2899] Move the Job Server into a Submodule

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3967 ---

[jira] [Commented] (BEAM-2963) Propagate pipeline protos through Dataflow API from Java

[ https://issues.apache.org/jira/browse/BEAM-2963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199742#comment-16199742 ] ASF GitHub Bot commented on BEAM-2963: -- GitHub user kennknowles opened a pull request:

[GitHub] beam pull request #3977: [BEAM-2963] Stage pipeline in DataflowRunner

GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3977 [BEAM-2963] Stage pipeline in DataflowRunner Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA

Jenkins build is back to normal : beam_PostCommit_Python_Verify #3329

See

Jenkins build is unstable: beam_PostCommit_Java_MavenInstall #5000

See

Build failed in Jenkins: beam_PostCommit_Python_Verify #3328

See Changes: [altay] Revert "Use de(stributed)tox rather than plain old tox for Python -- [...truncated 818.74 KB...] testListComprehension

[GitHub] beam pull request #3972: Make linter happy.

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3972 ---

[2/2] beam git commit: This closes #3972

This closes #3972 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/90f34f28 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/90f34f28 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/90f34f28 Branch:

[1/2] beam git commit: Make linter happy.

Repository: beam Updated Branches: refs/heads/master cf8993699 -> 90f34f289 Make linter happy. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/34a2e0c8 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/34a2e0c8 Diff:

[jira] [Commented] (BEAM-3040) Python precommit timed out after 150 minutes

[ https://issues.apache.org/jira/browse/BEAM-3040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199578#comment-16199578 ] ASF GitHub Bot commented on BEAM-3040: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3974: [BEAM-3040] Use tox instead of detox

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3974 ---

[2/2] beam git commit: This closes #3974

This closes #3974 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/cf899369 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/cf899369 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/cf899369 Branch:

[1/2] beam git commit: Revert "Use de(stributed)tox rather than plain old tox for Python testing."

Repository: beam Updated Branches: refs/heads/master bbc231c8e -> cf8993699 Revert "Use de(stributed)tox rather than plain old tox for Python testing." This reverts commit 9052a16a66e71f5c738ee148c81bc3e848a2cabe. Switch back to using tox. We suspect that detox is causing test stuckness,

[GitHub] beam pull request #3976: Clone source to a distinguished subdirectory of Jen...

GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3976 Clone source to a distinguished subdirectory of Jenkins workspace Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[jira] [Updated] (BEAM-3042) Add tracking of bytes read / time spent when reading side inputs

[ https://issues.apache.org/jira/browse/BEAM-3042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-3042: Description: It is difficult for Dataflow users to understand how modifying a pipeline or data set

[jira] [Created] (BEAM-3042) Add tracking of bytes read / time spent when reading side inputs

Pablo Estrada created BEAM-3042: --- Summary: Add tracking of bytes read / time spent when reading side inputs Key: BEAM-3042 URL: https://issues.apache.org/jira/browse/BEAM-3042 Project: Beam

[GitHub] beam pull request #3975: Do not merge: scratch work 3

GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3975 Do not merge: scratch work 3 Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

Build failed in Jenkins: beam_PostCommit_Python_Verify #3327

See Changes: [altay] [BEAM-2600] Add minimal python SDK harness container -- [...truncated 825.34 KB...] testListComprehension

[jira] [Commented] (BEAM-3040) Python precommit timed out after 150 minutes

[ https://issues.apache.org/jira/browse/BEAM-3040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199470#comment-16199470 ] Robert Bradshaw commented on BEAM-3040: --- Yes, Jason and I were discussing this last week. +1 to

[jira] [Commented] (BEAM-3040) Python precommit timed out after 150 minutes

[ https://issues.apache.org/jira/browse/BEAM-3040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199468#comment-16199468 ] ASF GitHub Bot commented on BEAM-3040: -- GitHub user aaltay opened a pull request:

[GitHub] beam pull request #3974: [BEAM-3040] Use tox instead of detox

GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/3974 [BEAM-3040] Use tox instead of detox You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam testt Alternatively you can review and apply

[jira] [Resolved] (BEAM-2875) Portable SDK harness containers

[ https://issues.apache.org/jira/browse/BEAM-2875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde resolved BEAM-2875. - Resolution: Fixed Fix Version/s: 2.3.0 > Portable SDK harness containers >

[GitHub] beam pull request #3973: Add Artifact Staging Endpoint to PrepareJobResponse

GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/3973 Add Artifact Staging Endpoint to PrepareJobResponse Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[jira] [Commented] (BEAM-3040) Python precommit timed out after 150 minutes

[ https://issues.apache.org/jira/browse/BEAM-3040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199463#comment-16199463 ] Ahmet Altay commented on BEAM-3040: --- cc: [~robertwb] I am suspecting that use of {{detox}} to

[jira] [Created] (BEAM-3041) Add portable Python SDK container setup support

Henning Rohde created BEAM-3041: --- Summary: Add portable Python SDK container setup support Key: BEAM-3041 URL: https://issues.apache.org/jira/browse/BEAM-3041 Project: Beam Issue Type:

[jira] [Commented] (BEAM-2878) Release process for container images

[ https://issues.apache.org/jira/browse/BEAM-2878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199440#comment-16199440 ] Kenneth Knowles commented on BEAM-2878: --- Documentation for pushing docker images to bintray:

[jira] [Updated] (BEAM-2600) Python SDK harness container

[ https://issues.apache.org/jira/browse/BEAM-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2600: -- Priority: Major (was: Minor) > Python SDK harness container > > >

[jira] [Updated] (BEAM-2600) Python SDK harness container

[ https://issues.apache.org/jira/browse/BEAM-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2600: -- Priority: Minor (was: Major) > Python SDK harness container > > >

[jira] [Resolved] (BEAM-2600) Python SDK harness container

[ https://issues.apache.org/jira/browse/BEAM-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-2600. --- Resolution: Fixed Fix Version/s: 2.3.0 > Python SDK harness container >

Build failed in Jenkins: beam_PostCommit_Python_Verify #3326

See -- [...truncated 820.19 KB...] testListComprehension (apache_beam.typehints.trivial_inference_test.TrivialInferenceTest) ... ok testMethod

[jira] [Commented] (BEAM-2600) Python SDK harness container

[ https://issues.apache.org/jira/browse/BEAM-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199405#comment-16199405 ] ASF GitHub Bot commented on BEAM-2600: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3965: [BEAM-2600] Add minimal python SDK harness containe...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3965 ---

[1/2] beam git commit: [BEAM-2600] Add minimal python SDK harness container

Repository: beam Updated Branches: refs/heads/master b0030aeb3 -> bbc231c8e [BEAM-2600] Add minimal python SDK harness container Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/79c55db9 Tree:

[2/2] beam git commit: This closes #3965

This closes #3965 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/bbc231c8 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/bbc231c8 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/bbc231c8 Branch:

[GitHub] beam pull request #3972: Make linter happy.

GitHub user tvalentyn opened a pull request: https://github.com/apache/beam/pull/3972 Make linter happy. Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[GitHub] beam pull request #3971: Add an element batching transform.

GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/3971 Add an element batching transform. Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[jira] [Commented] (BEAM-3011) Pin Runner harness container image in Python SDK

[ https://issues.apache.org/jira/browse/BEAM-3011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199120#comment-16199120 ] ASF GitHub Bot commented on BEAM-3011: -- GitHub user tvalentyn opened a pull request:

[GitHub] beam pull request #3970: Pin runner harness container image for Dataflow dis...

GitHub user tvalentyn opened a pull request: https://github.com/apache/beam/pull/3970 Pin runner harness container image for Dataflow distributions of BEAM… … Python SDK This fixes https://issues.apache.org/jira/browse/BEAM-3011 Follow this checklist to help us

[jira] [Commented] (BEAM-2257) KafkaIO write without key requires a producer fn

[ https://issues.apache.org/jira/browse/BEAM-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199111#comment-16199111 ] ASF GitHub Bot commented on BEAM-2257: -- GitHub user nerdynick opened a pull request:

[GitHub] beam pull request #3969: [BEAM-2257] Fixes bug with Kafka Producer needing a...

GitHub user nerdynick opened a pull request: https://github.com/apache/beam/pull/3969 [BEAM-2257] Fixes bug with Kafka Producer needing a key serializer set in the case of value only PCollection …auto add the VoidSerializer for the key.serializer config for kafka producer

Build failed in Jenkins: beam_PostCommit_Python_Verify #3325

See Changes: [valentyn] Pin runner harness container image for Dataflow distributions of BEAM -- [...truncated 822.14 KB...] testListComprehension

Jenkins build is unstable: beam_PostCommit_Java_MavenInstall #4995

See

[jira] [Commented] (BEAM-3011) Pin Runner harness container image in Python SDK

[ https://issues.apache.org/jira/browse/BEAM-3011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199025#comment-16199025 ] ASF GitHub Bot commented on BEAM-3011: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3966: Pin runner harness minimal

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3966 ---

[1/2] beam git commit: Pin runner harness container image for Dataflow distributions of BEAM Python SDK

Repository: beam Updated Branches: refs/heads/master 1001cf1ab -> b0030aeb3 Pin runner harness container image for Dataflow distributions of BEAM Python SDK Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/fe889404 Tree:

[2/2] beam git commit: This closes #3966

This closes #3966 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b0030aeb Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b0030aeb Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/b0030aeb Branch:

[jira] [Updated] (BEAM-3040) Python precommit timed out after 150 minutes

[ https://issues.apache.org/jira/browse/BEAM-3040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-3040: -- Description: https://builds.apache.org/job/beam_PreCommit_Python_MavenInstall/143/consoleFull

[jira] [Created] (BEAM-3040) Python precommit timed out after 150 minutes

Kenneth Knowles created BEAM-3040: - Summary: Python precommit timed out after 150 minutes Key: BEAM-3040 URL: https://issues.apache.org/jira/browse/BEAM-3040 Project: Beam Issue Type: Bug

[3/3] beam git commit: This closes #3968: Only fail nightly release at end, for more detailed signal

This closes #3968: Only fail nightly release at end, for more detailed signal Only fail Java postcommit at end Only fail nightly release at end, for more detailed signal Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[GitHub] beam pull request #3968: Only fail nightly release at end, for more detailed...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3968 ---

[1/3] beam git commit: Only fail nightly release at end, for more detailed signal

Repository: beam Updated Branches: refs/heads/master 9f69997ba -> 1001cf1ab Only fail nightly release at end, for more detailed signal Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/15b0e47b Tree:

[2/3] beam git commit: Only fail Java postcommit at end

Only fail Java postcommit at end Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/71e67923 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/71e67923 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/71e67923 Branch:

[jira] [Commented] (BEAM-3026) Improve retrying in ElasticSearch client

[ https://issues.apache.org/jira/browse/BEAM-3026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198883#comment-16198883 ] Etienne Chauchot commented on BEAM-3026: Elastic project discussions tend to go toward adding this

[jira] [Commented] (BEAM-3026) Improve retrying in ElasticSearch client

[ https://issues.apache.org/jira/browse/BEAM-3026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198844#comment-16198844 ] Etienne Chauchot commented on BEAM-3026: @timrobertson100 thanks for clarifying. Implementing a

[jira] [Commented] (BEAM-3039) DatastoreIO.Write fails multiple mutations of same entity

[ https://issues.apache.org/jira/browse/BEAM-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198386#comment-16198386 ] Alexander Hoem Rosbach commented on BEAM-3039: -- To get around this issue I've been using the

[jira] [Created] (BEAM-3039) DatastoreIO.Write fails multiple mutations of same entity

Alexander Hoem Rosbach created BEAM-3039: Summary: DatastoreIO.Write fails multiple mutations of same entity Key: BEAM-3039 URL: https://issues.apache.org/jira/browse/BEAM-3039 Project: Beam

[jira] [Commented] (BEAM-3035) Extract ReifyTimestampsAndWindows from GatherAllPanes

[ https://issues.apache.org/jira/browse/BEAM-3035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198314#comment-16198314 ] Wesley Tanaka commented on BEAM-3035: - If this idea makes sense, I'm happy to contribute this code or

Jenkins build is unstable: beam_PostCommit_Java_MavenInstall #4993

See

Jenkins build is back to normal : beam_PerformanceTests_Python #429

See