[1/2] incubator-beam git commit: [BEAM-430] Add GcpTempLocation, and remove defaulting tempLocation to stagingLocation in DataflowRunner

Repository: incubator-beam Updated Branches: refs/heads/master a7689466d -> ee1a3bcfb [BEAM-430] Add GcpTempLocation, and remove defaulting tempLocation to stagingLocation in DataflowRunner Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[GitHub] incubator-beam pull request #438: [BEAM-430] Add GcpTempLocation, and remove...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/438 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[2/2] incubator-beam git commit: Closes #438

Closes #438 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/ee1a3bcf Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/ee1a3bcf Diff:

[jira] [Commented] (BEAM-445) Beam-examples-java build failed through local "mvn install"

[ https://issues.apache.org/jira/browse/BEAM-445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15374380#comment-15374380 ] Daniel Halperin commented on BEAM-445: -- The uber jar is not supported by gRPC yet, so we cannot use it.

[GitHub] incubator-beam pull request #644: Fix typo in Dataflow runner monitoring mes...

GitHub user charlesccychen opened a pull request: https://github.com/apache/incubator-beam/pull/644 Fix typo in Dataflow runner monitoring message Fixes spelling of "access" in monitoring message. You can merge this pull request into a Git repository by running: $ git pull

[jira] [Commented] (BEAM-445) Beam-examples-java build failed through local "mvn install"

[ https://issues.apache.org/jira/browse/BEAM-445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15374176#comment-15374176 ] Kenneth Knowles commented on BEAM-445: -- Assigning to [~dhalperi] considering GCP-relatedness and just

[jira] [Updated] (BEAM-445) Beam-examples-java build failed through local "mvn install"

[ https://issues.apache.org/jira/browse/BEAM-445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-445: - Component/s: sdk-java-gcp > Beam-examples-java build failed through local "mvn install" >

[jira] [Updated] (BEAM-445) Beam-examples-java build failed through local "mvn install"

[ https://issues.apache.org/jira/browse/BEAM-445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-445: - Assignee: Daniel Halperin > Beam-examples-java build failed through local "mvn install" >

[jira] [Commented] (BEAM-445) Beam-examples-java build failed through local "mvn install"

[ https://issues.apache.org/jira/browse/BEAM-445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373951#comment-15373951 ] Scott Wegner commented on BEAM-445: --- Looking into this.. The issue is that netty-tcnative is a transitive

[jira] [Updated] (BEAM-446) Improve IOChannelUtils.resolve() to accept multiple paths at once

[ https://issues.apache.org/jira/browse/BEAM-446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-446: -- Description: Currently, IOChannelUtils.resolve() method can only resolve one path against base path. It's

[jira] [Commented] (BEAM-446) Improve IOChannelUtils.resolve() to accept multiple paths at once

[ https://issues.apache.org/jira/browse/BEAM-446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373860#comment-15373860 ] Mark Liu commented on BEAM-446: --- [~lcwik] assign to me? > Improve IOChannelUtils.resolve() to accept multiple

[jira] [Commented] (BEAM-445) Beam-examples-java build failed through local "mvn install"

[ https://issues.apache.org/jira/browse/BEAM-445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373833#comment-15373833 ] Scott Wegner commented on BEAM-445: --- I also started seeing this today, not sure why this just started

[GitHub] incubator-beam pull request #643: Promote isBlockOnRun to PipelineOptions

GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/643 Promote isBlockOnRun to PipelineOptions You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam blocking-options

[jira] [Created] (BEAM-445) Beam-examples-java build failed through local "mvn install"

Mark Liu created BEAM-445: - Summary: Beam-examples-java build failed through local "mvn install" Key: BEAM-445 URL: https://issues.apache.org/jira/browse/BEAM-445 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-444) Promote isBlockOnRun() to PipelineOptions.

Pei He created BEAM-444: --- Summary: Promote isBlockOnRun() to PipelineOptions. Key: BEAM-444 URL: https://issues.apache.org/jira/browse/BEAM-444 Project: Beam Issue Type: New Feature

[2/2] incubator-beam git commit: Closes #625

Closes #625 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/67a769a9 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/67a769a9 Diff:

[1/2] incubator-beam git commit: Made checksum_output optional in bigshuffle.py.

Repository: incubator-beam Updated Branches: refs/heads/python-sdk 95a591e05 -> 67a769a9a Made checksum_output optional in bigshuffle.py. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/2b782ded Tree:

[GitHub] incubator-beam pull request #642: [BEAM-443] Add waitToFinish() and cancel()...

GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/642 [BEAM-443] Add waitToFinish() and cancel() in PipelineResult. You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam

[jira] [Closed] (BEAM-441) Python postcommit is broken

[ https://issues.apache.org/jira/browse/BEAM-441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw closed BEAM-441. Resolution: Fixed Fix Version/s: 0.2.0-incubating > Python postcommit is broken >

[jira] [Commented] (BEAM-434) Limit the number of output files a beam-examples execution writes

[ https://issues.apache.org/jira/browse/BEAM-434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373644#comment-15373644 ] Kenneth Knowles commented on BEAM-434: -- OK, I'm pretty convinced I was wrong, by the argument that

[GitHub] incubator-beam pull request #641: Add type hints to bigshuffle to avoid pick...

GitHub user robertwb opened a pull request: https://github.com/apache/incubator-beam/pull/641 Add type hints to bigshuffle to avoid pickle overhead. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[jira] [Commented] (BEAM-441) Python postcommit is broken

[ https://issues.apache.org/jira/browse/BEAM-441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373515#comment-15373515 ] ASF GitHub Bot commented on BEAM-441: - Github user robertwb closed the pull request at:

Jenkins build is back to normal : beam_PostCommit_PythonVerify #75

See

[GitHub] incubator-beam pull request #639: [BEAM-441] Fixes bug due to accessing cach...

Github user robertwb closed the pull request at: https://github.com/apache/incubator-beam/pull/639 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[1/2] incubator-beam git commit: Closes #639

Repository: incubator-beam Updated Branches: refs/heads/python-sdk 77f90ff15 -> 95a591e05 Closes #639 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/95a591e0 Tree:

[GitHub] incubator-beam pull request #636: Remove more tests from nose tests exclusio...

Github user aaltay closed the pull request at: https://github.com/apache/incubator-beam/pull/636 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

Build failed in Jenkins: beam_PostCommit_PythonVerify #74

See Changes: [dhalperi] Remove more tests from nose tests exclusion list -- [...truncated 1558 lines...] hard linking apache_beam/examples/cookbook/coders_test.py ->

[2/2] incubator-beam git commit: Closes #636

Closes #636 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/77f90ff1 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/77f90ff1 Diff:

[GitHub] incubator-beam pull request #640: Prototype simplified all-dynamic display d...

GitHub user swegner opened a pull request: https://github.com/apache/incubator-beam/pull/640 Prototype simplified all-dynamic display data usage Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[jira] [Updated] (BEAM-434) Limit the number of output files a beam-examples execution writes

[ https://issues.apache.org/jira/browse/BEAM-434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela updated BEAM-434: --- Summary: Limit the number of output files a beam-examples execution writes (was: When examples write output to

[jira] [Commented] (BEAM-434) When examples write output to file it creates many output files instead of one

[ https://issues.apache.org/jira/browse/BEAM-434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373374#comment-15373374 ] Frances Perry commented on BEAM-434: Not overly constraining the sharding to allow the runner to choose

[GitHub] incubator-beam-site pull request #27: re-generating to add incubation discla...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam-site/pull/27 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[2/2] incubator-beam-site git commit: Regenerate to add ASF Incubator disclaimer

Regenerate to add ASF Incubator disclaimer This closes #27 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/5d7ef1d6 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/tree/5d7ef1d6

[GitHub] incubator-beam pull request #638: Clarify RequiresWindowAccess error message

GitHub user rculbertson opened a pull request: https://github.com/apache/incubator-beam/pull/638 Clarify RequiresWindowAccess error message An error message is printed when a DoFn needs access to the window but does not implement RequiresWindowAccess. This PR changes to the

Jenkins build is back to stable : beam_PostCommit_RunnableOnService_GoogleCloudDataflow #741

See

Build failed in Jenkins: beam_PostCommit_PythonVerify #73

See Changes: [robertwb] Fix lint error. -- [...truncated 1445 lines...] hard linking apache_beam_sdk.egg-info/top_level.txt -> apache-beam-sdk-0.3.0/apache_beam_sdk.egg-info copying

incubator-beam git commit: Fix lint error.

Repository: incubator-beam Updated Branches: refs/heads/python-sdk fb9da8e32 -> cb2afa4e8 Fix lint error. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/cb2afa4e Tree:

[jira] [Commented] (BEAM-338) Fix licensing and usage of gutenberg files in Spark test

[ https://issues.apache.org/jira/browse/BEAM-338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373199#comment-15373199 ] ASF GitHub Bot commented on BEAM-338: - Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request #586: [BEAM-338] Cleanup Spark runner test resou...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/586 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Resolved] (BEAM-338) Fix licensing and usage of gutenberg files in Spark test

[ https://issues.apache.org/jira/browse/BEAM-338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré resolved BEAM-338. --- Resolution: Fixed > Fix licensing and usage of gutenberg files in Spark test >

Build failed in Jenkins: beam_PostCommit_PythonVerify #72

See Changes: [robertwb] Pickle only used symbols from __main__ namespace. -- [...truncated 1408 lines...] hard linking apache_beam/transforms/trigger.py ->

[incubator-beam] Git Push Summary

Repository: incubator-beam Updated Branches: refs/heads/apache_beam [deleted] cd3bcd51f

[2/2] incubator-beam git commit: Pickle only used symbols from __main__ namespace.

Pickle only used symbols from __main__ namespace. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/4e2d8ab2 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/4e2d8ab2 Diff:

[1/2] incubator-beam git commit: Closes #629

Repository: incubator-beam Updated Branches: refs/heads/python-sdk 4006f7779 -> fb9da8e32 Closes #629 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/fb9da8e3 Tree:

[1/4] incubator-beam git commit: [BEAM-338] Cleanup Spark runner test resources to avoid notice update

Repository: incubator-beam Updated Branches: refs/heads/master 1685a6626 -> a7689466d http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/2d16edd7/runners/spark/src/test/resources/pg2264.txt -- diff --git

[2/4] incubator-beam git commit: [BEAM-338] Cleanup Spark runner test resources to avoid notice update

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/2d16edd7/runners/spark/src/test/resources/pg1112.txt -- diff --git a/runners/spark/src/test/resources/pg1112.txt b/runners/spark/src/test/resources/pg1112.txt deleted

[3/4] incubator-beam git commit: [BEAM-338] Cleanup Spark runner test resources to avoid notice update

[BEAM-338] Cleanup Spark runner test resources to avoid notice update Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/2d16edd7 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/2d16edd7 Diff:

[4/4] incubator-beam git commit: [BEAM-338] This closes #586

[BEAM-338] This closes #586 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a7689466 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a7689466 Diff:

[jira] [Commented] (BEAM-442) Examples demonstrate code, but not project configuration

[ https://issues.apache.org/jira/browse/BEAM-442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373102#comment-15373102 ] Tim Swast` commented on BEAM-442: - An archetype would work, but the examples should describe how to run the

Build failed in Jenkins: beam_PostCommit_PythonVerify #71

See Changes: [chamikara] Adds more code snippets. -- [...truncated 1371 lines...] hard linking apache_beam/internal/clients/storage/storage_v1_messages.py ->

Jenkins build became unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #740

See

[jira] [Commented] (BEAM-393) Add code snippets for custom sources, custom sinks, and side inputs

[ https://issues.apache.org/jira/browse/BEAM-393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373085#comment-15373085 ] ASF GitHub Bot commented on BEAM-393: - Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request #565: [BEAM-393] Adds more code snippets for Pyt...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/565 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[1/2] incubator-beam git commit: Adds more code snippets.

Repository: incubator-beam Updated Branches: refs/heads/python-sdk b6bb97f57 -> 4006f7779 Adds more code snippets. Adds code snippets for sources, sinks, and joining using side inputs. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[2/2] incubator-beam git commit: This closes #565

This closes #565 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/4006f777 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/4006f777 Diff:

[jira] [Commented] (BEAM-439) The start_bundle/finish_bundle should not allow side inputs

[ https://issues.apache.org/jira/browse/BEAM-439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373022#comment-15373022 ] ASF GitHub Bot commented on BEAM-439: - Github user silviulica closed the pull request at:

[GitHub] incubator-beam pull request #632: [BEAM-439] Remove optional args from start...

Github user silviulica closed the pull request at: https://github.com/apache/incubator-beam/pull/632 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

Build failed in Jenkins: beam_PostCommit_PythonVerify #70

See -- [...truncated 1319 lines...] hard linking apache_beam/coders/slow_stream.py -> apache-beam-sdk-0.3.0/apache_beam/coders hard linking apache_beam/coders/stream.pxd ->

[jira] [Commented] (BEAM-434) When examples write output to file it creates many output files instead of one

[ https://issues.apache.org/jira/browse/BEAM-434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15372987#comment-15372987 ] Ismaël Mejía commented on BEAM-434: --- The examples should be simpler, and in particular the 'hello world =

[2/2] incubator-beam git commit: API cleanup: Remove getDataflowClient() from DataflowPipelineJob

API cleanup: Remove getDataflowClient() from DataflowPipelineJob This closes #637 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1685a662 Tree:

[1/2] incubator-beam git commit: Remove getDataflowClient() from DataflowPipelineJob

Repository: incubator-beam Updated Branches: refs/heads/master f5a5eb34e -> 1685a6626 Remove getDataflowClient() from DataflowPipelineJob Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/23637cbd Tree:

Re: [jira] [Commented] (BEAM-434) When examples write output to file it creates many output files instead of one

If we go with any option that restricts the number of outputs then in the example we should discuss what it does and why it is not considered a good thing. On Tue, Jul 12, 2016 at 2:11 AM, Amit Sela (JIRA) wrote: > > [ >

[jira] [Commented] (BEAM-438) Rename one of PTransform.apply and PInput.apply

[ https://issues.apache.org/jira/browse/BEAM-438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15372575#comment-15372575 ] Aljoscha Krettek commented on BEAM-438: --- +1 I've seen people do the former several times. > Rename

Build failed in Jenkins: beam_PostCommit_PythonVerify #69

See -- [...truncated 1282 lines...] creating apache-beam-sdk-0.3.0 creating apache-beam-sdk-0.3.0/apache_beam creating apache-beam-sdk-0.3.0/apache_beam/coders creating

[jira] [Commented] (BEAM-434) When examples write output to file it creates many output files instead of one

[ https://issues.apache.org/jira/browse/BEAM-434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15372225#comment-15372225 ] Amit Sela commented on BEAM-434: I sort of prefer 2, but by letting the user pass the numShards