[GitHub] beam pull request #2817: [BEAM-775] Remove Aggregators from StatefulDoFn run...

2017-05-01 Thread dhalperi
GitHub user dhalperi opened a pull request: https://github.com/apache/beam/pull/2817 [BEAM-775] Remove Aggregators from StatefulDoFn runner This is a clone of #2744 rebased on master to see if it's green. Will close and merge #2744 if passes. You can merge this pull request into a

[GitHub] beam pull request #2814: [BEAM-59] Minor changes that can be separated out f...

2017-05-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2814 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[3/5] beam git commit: [BEAM-59] Core tests: stop using gs:// paths

2017-05-01 Thread dhalperi
[BEAM-59] Core tests: stop using gs:// paths Local filesystem is just as good an example, and in the future these may break because GCS filesystem is not present in sdks/java/core. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[2/5] beam git commit: [BEAM-59] DataflowRunnerTests: configure FileSystems in test

2017-05-01 Thread dhalperi
[BEAM-59] DataflowRunnerTests: configure FileSystems in test This enables the test to use gs:// URIs with the FileSystems API Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/afc39210 Tree:

[1/5] beam git commit: [BEAM-59] AvroIOTest: use absolute paths for display data

2017-05-01 Thread dhalperi
Repository: beam Updated Branches: refs/heads/master 87cf88ade -> e92ead58c [BEAM-59] AvroIOTest: use absolute paths for display data This is future-proofing against eventual conversion to FileSystems API in which all paths are absolute Project:

[5/5] beam git commit: This closes #2814

2017-05-01 Thread dhalperi
This closes #2814 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e92ead58 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e92ead58 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/e92ead58 Branch:

[4/5] beam git commit: [BEAM-59] TFRecordIOTest: cleanup

2017-05-01 Thread dhalperi
[BEAM-59] TFRecordIOTest: cleanup 1. Shrink file size slightly to reduce test time. 2. Switch from relative to absolute local file paths, because in the future this distinction will matter. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[GitHub] beam pull request #2816: [BEAM-775] Remove Aggregators from the Java SDK

2017-05-01 Thread dhalperi
Github user dhalperi closed the pull request at: https://github.com/apache/beam/pull/2816 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-775) Remove Aggregators from the Java SDK

2017-05-01 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992361#comment-15992361 ] ASF GitHub Bot commented on BEAM-775: - Github user dhalperi closed the pull request at:

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #3578

2017-05-01 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-775) Remove Aggregators from the Java SDK

2017-05-01 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992357#comment-15992357 ] ASF GitHub Bot commented on BEAM-775: - Github user asfgit closed the pull request at:

[2/2] beam git commit: [BEAM-775] Remove Aggregators from the Java SDK

2017-05-01 Thread lcwik
[BEAM-775] Remove Aggregators from the Java SDK This closes #2718 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/87cf88ad Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/87cf88ad Diff:

[jira] [Updated] (BEAM-1641) Support synchronized processing time in Flink runner

2017-05-01 Thread Jingsong Lee (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated BEAM-1641: --- Fix Version/s: (was: First stable release) > Support synchronized processing time in Flink runner

beam git commit: [BEAM-2005] Fix build break, ignore test due to change in TestPipeline/FileSystems interaction

2017-05-01 Thread lcwik
Repository: beam Updated Branches: refs/heads/master a3ba8e71b -> 19ae45b2f [BEAM-2005] Fix build break, ignore test due to change in TestPipeline/FileSystems interaction Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[jira] [Created] (BEAM-2137) Hadoop: Handle multiple Hadoop configurations within Hadoop FileSystem

2017-05-01 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2137: --- Summary: Hadoop: Handle multiple Hadoop configurations within Hadoop FileSystem Key: BEAM-2137 URL: https://issues.apache.org/jira/browse/BEAM-2137 Project: Beam

[jira] [Resolved] (BEAM-2030) Implement beam FileSystem's copy()

2017-05-01 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2030. - Resolution: Fixed > Implement beam FileSystem's copy() > -- > >

[jira] [Resolved] (BEAM-2005) Add a Hadoop FileSystem implementation of Beam's FileSystem

2017-05-01 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2005. - Resolution: Fixed > Add a Hadoop FileSystem implementation of Beam's FileSystem >

[jira] [Resolved] (BEAM-2033) Implement ResourceIds for HadoopFileSystem

2017-05-01 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2033. - Resolution: Fixed > Implement ResourceIds for HadoopFileSystem >

[jira] [Resolved] (BEAM-2032) Implement delete

2017-05-01 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2032. - Resolution: Fixed > Implement delete > > > Key: BEAM-2032 >

[jira] [Resolved] (BEAM-2070) Implement match for HadoopFileSystem

2017-05-01 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2070. - Resolution: Fixed > Implement match for HadoopFileSystem > > >

[jira] [Resolved] (BEAM-2031) Hadoop FileSystem needs to receive Hadoop Configuration

2017-05-01 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2031. - Resolution: Fixed > Hadoop FileSystem needs to receive Hadoop Configuration >

[jira] [Commented] (BEAM-2005) Add a Hadoop FileSystem implementation of Beam's FileSystem

2017-05-01 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992322#comment-15992322 ] ASF GitHub Bot commented on BEAM-2005: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #2777: [BEAM-2005, BEAM-2030, BEAM-2031, BEAM-2032, BEAM-2...

2017-05-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2777 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: [BEAM-2005, BEAM-2030, BEAM-2031, BEAM-2032, BEAM-2033, BEAM-2070] Base implementation of HadoopFileSystem.

2017-05-01 Thread lcwik
[BEAM-2005, BEAM-2030, BEAM-2031, BEAM-2032, BEAM-2033, BEAM-2070] Base implementation of HadoopFileSystem. This closes #2777 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a3ba8e71 Tree:

[1/2] beam git commit: [BEAM-2005, BEAM-2030, BEAM-2031, BEAM-2032, BEAM-2033, BEAM-2070] Base implementation of HadoopFileSystem.

2017-05-01 Thread lcwik
Repository: beam Updated Branches: refs/heads/master 7fa00647d -> a3ba8e71b [BEAM-2005, BEAM-2030, BEAM-2031, BEAM-2032, BEAM-2033, BEAM-2070] Base implementation of HadoopFileSystem. TODO: * Add multiplexing FileSystem that is able to route requests based upon the base URI when configured

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3005

2017-05-01 Thread Apache Jenkins Server
See

Jenkins build is unstable: beam_PostCommit_Java_MavenInstall #3577

2017-05-01 Thread Apache Jenkins Server
See

Jenkins build is back to normal : beam_PostCommit_Python_Verify #2077

2017-05-01 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-981) Not possible to directly submit a pipeline on spark cluster

2017-05-01 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992305#comment-15992305 ] holdenk commented on BEAM-981: -- I can take a look at this later on this week if no one else is. > Not possible

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Flink #2598

2017-05-01 Thread Apache Jenkins Server
See

[GitHub] beam pull request #2816: Remove aggregators from DoFn contexts and internal ...

2017-05-01 Thread dhalperi
GitHub user dhalperi opened a pull request: https://github.com/apache/beam/pull/2816 Remove aggregators from DoFn contexts and internal SDK usage This is #2718 rebased on master to see if build is fixed. You can merge this pull request into a Git repository by running: $ git

[2/2] beam git commit: This closes #2815

2017-05-01 Thread dhalperi
This closes #2815 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7fa00647 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7fa00647 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/7fa00647 Branch:

[GitHub] beam pull request #2815: maptask_executor_runner_test: build fix

2017-05-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2815 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: maptask_executor_runner_test: build fix

2017-05-01 Thread dhalperi
Repository: beam Updated Branches: refs/heads/master 034565c68 -> 7fa00647d maptask_executor_runner_test: build fix OutputValue was renamed to TaggedOutput in #2810, but this was missed or merge conflicted. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[GitHub] beam pull request #2815: maptask_executor_runner_test: build fix

2017-05-01 Thread dhalperi
GitHub user dhalperi opened a pull request: https://github.com/apache/beam/pull/2815 maptask_executor_runner_test: build fix OutputValue was renamed to TaggedOutput in #2810, but this was missed or merge conflicted. R: @robertwb @aaltay This is for historical

[jira] [Commented] (BEAM-2136) AvroCoderTest.testTwoClassLoaders fails on beam_PostCommit_Java_ValidatesRunner_Dataflow

2017-05-01 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992124#comment-15992124 ] Luke Cwik commented on BEAM-2136: - Yes, I marked it minor and not part of first stable release for those

Build failed in Jenkins: beam_PostCommit_Python_Verify #2076

2017-05-01 Thread Apache Jenkins Server
See -- [...truncated 470.95 KB...] test_with_http_error_that_should_not_be_retried (apache_beam.utils.retry_test.RetryTest) ... ok test_with_no_retry_decorator

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3004

2017-05-01 Thread Apache Jenkins Server
See

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Flink #2597

2017-05-01 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-775) Remove Aggregators from the Java SDK

2017-05-01 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992113#comment-15992113 ] ASF GitHub Bot commented on BEAM-775: - GitHub user pabloem reopened a pull request:

[jira] [Commented] (BEAM-775) Remove Aggregators from the Java SDK

2017-05-01 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992112#comment-15992112 ] ASF GitHub Bot commented on BEAM-775: - Github user pabloem closed the pull request at:

[GitHub] beam pull request #2744: [BEAM-775] Remove Aggregators from StatefulDoFn run...

2017-05-01 Thread pabloem
Github user pabloem closed the pull request at: https://github.com/apache/beam/pull/2744 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #2744: [BEAM-775] Remove Aggregators from StatefulDoFn run...

2017-05-01 Thread pabloem
GitHub user pabloem reopened a pull request: https://github.com/apache/beam/pull/2744 [BEAM-775] Remove Aggregators from StatefulDoFn runner This PR depends on PR 2718. You can merge this pull request into a Git repository by running: $ git pull

[jira] [Commented] (BEAM-1641) Support synchronized processing time in Flink runner

2017-05-01 Thread Jingsong Lee (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992110#comment-15992110 ] Jingsong Lee commented on BEAM-1641: There are some differences between the processing of event time

[jira] [Updated] (BEAM-2136) AvroCoderTest.testTwoClassLoaders fails on beam_PostCommit_Java_ValidatesRunner_Dataflow

2017-05-01 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2136: -- Fix Version/s: First stable release > AvroCoderTest.testTwoClassLoaders fails on >

[jira] [Commented] (BEAM-2136) AvroCoderTest.testTwoClassLoaders fails on beam_PostCommit_Java_ValidatesRunner_Dataflow

2017-05-01 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992087#comment-15992087 ] Kenneth Knowles commented on BEAM-2136: --- I presume you marked this minor because this isn't actually

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #3576

2017-05-01 Thread Apache Jenkins Server
See Changes: [kirpichov] Fixes javadoc of TextIO to not point to AvroIO [kirpichov] Moves AvroSink to upper level [kirpichov] Removes AvroIO.Read.Bound [kirpichov] Adds

[jira] [Commented] (BEAM-775) Remove Aggregators from the Java SDK

2017-05-01 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992024#comment-15992024 ] ASF GitHub Bot commented on BEAM-775: - GitHub user pabloem reopened a pull request:

[jira] [Commented] (BEAM-775) Remove Aggregators from the Java SDK

2017-05-01 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992023#comment-15992023 ] ASF GitHub Bot commented on BEAM-775: - Github user pabloem closed the pull request at:

[GitHub] beam pull request #2718: [BEAM-775] Remove Aggregators from the Java SDK

2017-05-01 Thread pabloem
Github user pabloem closed the pull request at: https://github.com/apache/beam/pull/2718 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #2718: [BEAM-775] Remove Aggregators from the Java SDK

2017-05-01 Thread pabloem
GitHub user pabloem reopened a pull request: https://github.com/apache/beam/pull/2718 [BEAM-775] Remove Aggregators from the Java SDK Removing from internal SDK usage and DoFn contexts so users can not create them. Some failures in Apex code remain. All else seems to be `mvn

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #3575

2017-05-01 Thread Apache Jenkins Server
See Changes: [lcwik] [BEAM-1871] Remove deprecated org.apache.beam.sdk.options.GcsOptions -- [...truncated 2.13 MB...] for result in results: File

Build failed in Jenkins: beam_PostCommit_Python_Verify #2075

2017-05-01 Thread Apache Jenkins Server
See Changes: [kirpichov] Fixes javadoc of TextIO to not point to AvroIO [kirpichov] Moves AvroSink to upper level [kirpichov] Removes AvroIO.Read.Bound [kirpichov] Adds

[jira] [Commented] (BEAM-59) Switch from IOChannelFactory to FileSystems

2017-05-01 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-59?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15991974#comment-15991974 ] ASF GitHub Bot commented on BEAM-59: GitHub user dhalperi opened a pull request:

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #3574

2017-05-01 Thread Apache Jenkins Server
See Changes: [lcwik] Copy CloudObject to the Dataflow Module -- [...truncated 2.12 MB...] for result in results: File

[GitHub] beam pull request #2814: [BEAM-59] Minor changes that can be separated out f...

2017-05-01 Thread dhalperi
GitHub user dhalperi opened a pull request: https://github.com/apache/beam/pull/2814 [BEAM-59] Minor changes that can be separated out from big PR All these are minor changes, correct at HEAD, and standalone from #2779 You can merge this pull request into a Git repository by

Build failed in Jenkins: beam_PostCommit_Python_Verify #2074

2017-05-01 Thread Apache Jenkins Server
See Changes: [robertwb] Rename OutputValue to TaggedOutput. [lcwik] Copy CloudObject to the Dataflow Module [lcwik] [BEAM-1871] Remove deprecated org.apache.beam.sdk.options.GcsOptions

[08/11] beam git commit: Converts AvroIO.Write to AutoValue; adds writeGenericRecords()

2017-05-01 Thread jkff
Converts AvroIO.Write to AutoValue; adds writeGenericRecords() Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e0d74750 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e0d74750 Diff:

[GitHub] beam pull request #2778: [BEAM-1402] AvroIO should comply with PTransform st...

2017-05-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2778 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[03/11] beam git commit: Converts AvroIO.Read to AutoValue

2017-05-01 Thread jkff
Converts AvroIO.Read to AutoValue Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/439f2ca0 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/439f2ca0 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/439f2ca0 Branch:

[01/11] beam git commit: Scattered minor improvements per review comments

2017-05-01 Thread jkff
Repository: beam Updated Branches: refs/heads/master 6d443bc39 -> 034565c68 Scattered minor improvements per review comments Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/caf2faeb Tree:

[07/11] beam git commit: Removes AvroIO.Write.Bound

2017-05-01 Thread jkff
Removes AvroIO.Write.Bound Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d1dfd4e2 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/d1dfd4e2 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/d1dfd4e2 Branch:

[11/11] beam git commit: This closes #2778

2017-05-01 Thread jkff
This closes #2778 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/034565c6 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/034565c6 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/034565c6 Branch:

[10/11] beam git commit: Moves AvroIO.Read.withSchema into read()

2017-05-01 Thread jkff
Moves AvroIO.Read.withSchema into read() Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/abb4916c Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/abb4916c Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/abb4916c

[05/11] beam git commit: Moves AvroSink to upper level

2017-05-01 Thread jkff
Moves AvroSink to upper level Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/0166e199 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/0166e199 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/0166e199 Branch:

[06/11] beam git commit: Removes AvroIO.Read.Bound

2017-05-01 Thread jkff
Removes AvroIO.Read.Bound Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/1499d256 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/1499d256 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/1499d256 Branch:

[04/11] beam git commit: Fixes javadoc of TextIO to not point to AvroIO

2017-05-01 Thread jkff
Fixes javadoc of TextIO to not point to AvroIO Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2fa3c348 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/2fa3c348 Diff:

[02/11] beam git commit: Moves AvroIO.write().withSchema into write()

2017-05-01 Thread jkff
Moves AvroIO.write().withSchema into write() Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/27d74622 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/27d74622 Diff:

[jira] [Created] (BEAM-2136) AvroCoderTest.testTwoClassLoaders fails on beam_PostCommit_Java_ValidatesRunner_Dataflow

2017-05-01 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2136: --- Summary: AvroCoderTest.testTwoClassLoaders fails on beam_PostCommit_Java_ValidatesRunner_Dataflow Key: BEAM-2136 URL: https://issues.apache.org/jira/browse/BEAM-2136 Project:

[2/2] beam git commit: [BEAM-1871] Remove deprecated org.apache.beam.sdk.options.GcsOptions after updating Dataflow worker

2017-05-01 Thread lcwik
[BEAM-1871] Remove deprecated org.apache.beam.sdk.options.GcsOptions after updating Dataflow worker This closes #2804 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6d443bc3 Tree:

Jenkins build is unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3003

2017-05-01 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #3573

2017-05-01 Thread Apache Jenkins Server
See Changes: [robertwb] Rename OutputValue to TaggedOutput. -- [...truncated 2.12 MB...] for result in results: File

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #3571

2017-05-01 Thread Apache Jenkins Server
See

[GitHub] beam pull request #2808: Copy CloudObject to the Dataflow Module

2017-05-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2808 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: Copy CloudObject to the Dataflow Module

2017-05-01 Thread lcwik
Repository: beam Updated Branches: refs/heads/master 7f50ea2e5 -> 3afd338fd Copy CloudObject to the Dataflow Module Once migrated on the Dataflow worker, these classes can be removed from the sdk. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[2/2] beam git commit: [BEAM-2020] Copy CloudObject to the Dataflow Module

2017-05-01 Thread lcwik
[BEAM-2020] Copy CloudObject to the Dataflow Module This closes #2808 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3afd338f Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/3afd338f Diff:

[jira] [Created] (BEAM-2135) Rename hdfs module to hadoop-file-system, rename gcp-core to google-cloud-platform-core

2017-05-01 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2135: --- Summary: Rename hdfs module to hadoop-file-system, rename gcp-core to google-cloud-platform-core Key: BEAM-2135 URL: https://issues.apache.org/jira/browse/BEAM-2135 Project:

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #3570

2017-05-01 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1949) Rename DoFn.Context#sideOutput to #output

2017-05-01 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15991906#comment-15991906 ] ASF GitHub Bot commented on BEAM-1949: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #2810: [BEAM-1949 Rename OutputValue to TaggedOutput.

2017-05-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2810 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: Rename OutputValue to TaggedOutput.

2017-05-01 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 7c425b097 -> 7f50ea2e5 Rename OutputValue to TaggedOutput. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9d3aebea Tree:

[jira] [Commented] (BEAM-115) Beam Runner API

2017-05-01 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15991903#comment-15991903 ] ASF GitHub Bot commented on BEAM-115: - Github user asfgit closed the pull request at:

[2/2] beam git commit: Closes #2810

2017-05-01 Thread robertwb
Closes #2810 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7f50ea2e Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7f50ea2e Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/7f50ea2e Branch: refs/heads/master

[jira] [Commented] (BEAM-2131) Google application default credentials always found, need tests run outside of Google environments

2017-05-01 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15991902#comment-15991902 ] Davor Bonaci commented on BEAM-2131: This would probably be some kind of sandbox inside the Jenkins

[2/4] beam git commit: Fn API support for Python.

2017-05-01 Thread robertwb
http://git-wip-us.apache.org/repos/asf/beam/blob/a856fcf3/sdks/python/apache_beam/runners/worker/logger_test.py -- diff --git a/sdks/python/apache_beam/runners/worker/logger_test.py

[1/4] beam git commit: Fn API support for Python.

2017-05-01 Thread robertwb
Repository: beam Updated Branches: refs/heads/master b8131fe93 -> 7c425b097 http://git-wip-us.apache.org/repos/asf/beam/blob/a856fcf3/sdks/python/apache_beam/runners/worker/sdk_worker_test.py -- diff --git

[3/4] beam git commit: Fn API support for Python.

2017-05-01 Thread robertwb
Fn API support for Python. Also added supporting worker code and a runner that exercises this code directly. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a856fcf3 Tree:

[4/4] beam git commit: Closes #2644

2017-05-01 Thread robertwb
Closes #2644 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7c425b09 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7c425b09 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/7c425b09 Branch: refs/heads/master

[jira] [Updated] (BEAM-2132) Properly document testing side inputs

2017-05-01 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci updated BEAM-2132: --- Component/s: (was: testing) website > Properly document testing side inputs >

[jira] [Assigned] (BEAM-2132) Properly document testing side inputs

2017-05-01 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2132: -- Assignee: Jason Kuster (was: Davor Bonaci) > Properly document testing side inputs >

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #3569

2017-05-01 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-2134) expose AUTO_COMMIT to KafkaIO.read()

2017-05-01 Thread Xu Mingmin (JIRA)
Xu Mingmin created BEAM-2134: Summary: expose AUTO_COMMIT to KafkaIO.read() Key: BEAM-2134 URL: https://issues.apache.org/jira/browse/BEAM-2134 Project: Beam Issue Type: Improvement

Build failed in Jenkins: beam_PerformanceTests_JDBC #167

2017-05-01 Thread Apache Jenkins Server
See Changes: [klk] Do not repeat log messages in DataflowPipelineJob [tgroh] Add A CoderTranslator Interface [lcwik] Re-enable WindowedWordCountIT on Flink runner in precommit [tgroh] Add Cloud

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #3568

2017-05-01 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PerformanceTests_Dataflow #361

2017-05-01 Thread Apache Jenkins Server
See Changes: [klk] Do not repeat log messages in DataflowPipelineJob [tgroh] Add A CoderTranslator Interface [lcwik] Re-enable WindowedWordCountIT on Flink runner in precommit [tgroh] Add Cloud

[jira] [Commented] (BEAM-1441) Add FileSystem support to Python SDK

2017-05-01 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15991822#comment-15991822 ] ASF GitHub Bot commented on BEAM-1441: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #2802: [BEAM-1441] remove manual join from apiclient

2017-05-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2802 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #2802

2017-05-01 Thread altay
This closes #2802 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b8131fe9 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b8131fe9 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/b8131fe9 Branch:

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #3567

2017-05-01 Thread Apache Jenkins Server
See

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Spark #1877

2017-05-01 Thread Apache Jenkins Server
See

  1   2   3   >