Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #4708

2017-09-03 Thread Apache Jenkins Server
See

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #4709

2017-09-03 Thread Apache Jenkins Server
See

[2/2] beam git commit: This closes #3793

2017-09-03 Thread staslevin
This closes #3793 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f7d4583b Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f7d4583b Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/f7d4583b Branch: refs/heads/maste

[GitHub] beam pull request #3793: [BEAM-2825] Refactored SparkGroupAlsoByWindowViaWin...

2017-09-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3793 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: [BEAM-2825] Refactored SparkGroupAlsoByWindowViaWindowSet to improve readability.

2017-09-03 Thread staslevin
Repository: beam Updated Branches: refs/heads/master a481d5611 -> f7d4583bd [BEAM-2825] Refactored SparkGroupAlsoByWindowViaWindowSet to improve readability. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c8b99ba3 Tree: ht

[jira] [Commented] (BEAM-2825) Improve readability of SparkGroupAlsoByWindowViaWindowSet

2017-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16151790#comment-16151790 ] ASF GitHub Bot commented on BEAM-2825: -- Github user asfgit closed the pull request at:

[jira] [Closed] (BEAM-2825) Improve readability of SparkGroupAlsoByWindowViaWindowSet

2017-09-03 Thread Stas Levin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stas Levin closed BEAM-2825. Resolution: Fixed Fix Version/s: 2.2.0 > Improve readability of SparkGroupAlsoByWindowViaWindowSet > -

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #4711

2017-09-03 Thread Apache Jenkins Server
See

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #4712

2017-09-03 Thread Apache Jenkins Server
See

[GitHub] beam pull request #3805: Fix typo in variable name: window_fn --> windowfn

2017-09-03 Thread cclauss
GitHub user cclauss opened a pull request: https://github.com/apache/beam/pull/3805 Fix typo in variable name: window_fn --> windowfn `window_fn` is an undefined name in this context while `windowfn` is a parameter to this function and is used in three lines above and in the line j

Build failed in Jenkins: beam_PostCommit_Python_Verify #3060

2017-09-03 Thread Apache Jenkins Server
See -- [...truncated 607.36 KB...] :134: UserWarning: Using fal

[1/2] beam git commit: Moves Match into FileIO.match()/matchAll()

2017-09-03 Thread jkff
Repository: beam Updated Branches: refs/heads/master f7d4583bd -> 80b9cf9c2 Moves Match into FileIO.match()/matchAll() FileIO will later gain other methods, such as read()/write(). Also introduces FileIO.MatchConfiguration - a common type to use by various file-based IOs to reduce boilerplate

[GitHub] beam pull request #3759: [BEAM-2828] Moves Match into FileIO.match()/matchAl...

2017-09-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3759 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[2/2] beam git commit: This closes #3759: [BEAM-2828] Moves Match into FileIO.match()/matchAll()

2017-09-03 Thread jkff
This closes #3759: [BEAM-2828] Moves Match into FileIO.match()/matchAll() Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/80b9cf9c Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/80b9cf9c Diff: http://git-wip-us.apache.or

[jira] [Commented] (BEAM-2828) Create FileIO

2017-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152006#comment-16152006 ] ASF GitHub Bot commented on BEAM-2828: -- Github user asfgit closed the pull request at:

[5/5] beam git commit: This finishes #3799: [BEAM-2828, BEAM-2750] Introduces FileIO.read() and uses it in Text, Avro and Xml

2017-09-03 Thread jkff
This finishes #3799: [BEAM-2828, BEAM-2750] Introduces FileIO.read() and uses it in Text, Avro and Xml Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c3bcd4b4 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c3bcd4b4 Dif

[3/5] beam git commit: Introduces FileIO.read()

2017-09-03 Thread jkff
Introduces FileIO.read() Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/910d02fb Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/910d02fb Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/910d02fb Branch: refs/head

[1/5] beam git commit: Introduces XmlIO.readFiles

2017-09-03 Thread jkff
Repository: beam Updated Branches: refs/heads/master 80b9cf9c2 -> c3bcd4b42 Introduces XmlIO.readFiles Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/abda38dc Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/abda38dc

[4/5] beam git commit: Uses FileIO.read() in TextIO and AvroIO

2017-09-03 Thread jkff
Uses FileIO.read() in TextIO and AvroIO Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6d4a7851 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/6d4a7851 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/6d4a7851 Br

[2/5] beam git commit: Introduces TextIO.readFiles()

2017-09-03 Thread jkff
Introduces TextIO.readFiles() Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/513d26c5 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/513d26c5 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/513d26c5 Branch: refs

[jira] [Commented] (BEAM-2828) Create FileIO

2017-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152007#comment-16152007 ] ASF GitHub Bot commented on BEAM-2828: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3799: [BEAM-2828, BEAM-2750] Introduces FileIO.read() and...

2017-09-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3799 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Assigned] (BEAM-2750) Read whole files as one PCollection element each

2017-09-03 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-2750: -- Assignee: Eugene Kirpichov (was: Christopher Hebert) > Read whole files as one PCollect

[jira] [Closed] (BEAM-2828) Create FileIO

2017-09-03 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-2828. -- Resolution: Fixed FileIO has been created. > Create FileIO > - > > K

[jira] [Closed] (BEAM-2750) Read whole files as one PCollection element each

2017-09-03 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-2750. -- Resolution: Fixed Fix Version/s: 2.2.0 This has been fixed to a sufficient extent by FileI

Jenkins build is back to normal : beam_PostCommit_Python_Verify #3061

2017-09-03 Thread Apache Jenkins Server
See

[3/6] beam git commit: Service for pooling incoming Fn API control plane connections

2017-09-03 Thread kenn
Service for pooling incoming Fn API control plane connections Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a1dc9d32 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/a1dc9d32 Diff: http://git-wip-us.apache.org/repos/asf/

[5/6] beam git commit: Add SdkHarnessDoFnRunner

2017-09-03 Thread kenn
Add SdkHarnessDoFnRunner This encapsulates processing a bundle over the Fn API. A Beam runner is responsible for: - Setting up a FnApiControlClientPoolService to listen for incoming FnApiSdkHarnessClient connections - Wrapping those connections in the higher-level SdkHarnessClient - Buildi

[4/6] beam git commit: FnApiControlClient, de-inverts Fn API control plane

2017-09-03 Thread kenn
FnApiControlClient, de-inverts Fn API control plane The Fn API control plane has an inverted client/server relationship in order to support firewall rules where the runner is forbidden from connecting out to the SDK harness. This Java helper provides an API with the more conventional polarity. It

[2/6] beam git commit: Higher-level SdkHarnessClient

2017-09-03 Thread kenn
Higher-level SdkHarnessClient This adds a fairly thin wrapper on FnApiSdkHarnessClient, encapsulating the fact that all request and response types are injected into a disjoint union and sent over the same low-level RPC. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git

[GitHub] beam pull request #3750: [BEAM-2430] DoFnRunner for processing a bundle over...

2017-09-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3750 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/6] beam git commit: Basic Java wrapper for Fn API data plane

2017-09-03 Thread kenn
Repository: beam Updated Branches: refs/heads/master c3bcd4b42 -> 8b540d2dd Basic Java wrapper for Fn API data plane Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/46ee5a52 Tree: http://git-wip-us.apache.org/repos/asf/beam/

[6/6] beam git commit: Merge remote-tracking branch 'github/pr/3750' into HEAD

2017-09-03 Thread kenn
Merge remote-tracking branch 'github/pr/3750' into HEAD * github/pr/3750: Add SdkHarnessDoFnRunner Higher-level SdkHarnessClient Service for pooling incoming Fn API control plane connections FnApiControlClient, de-inverts Fn API control plane Basic Java wrapper for Fn API data plane Pr

[jira] [Commented] (BEAM-2430) Java FnApiDoFnRunner to share across runners

2017-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152069#comment-16152069 ] ASF GitHub Bot commented on BEAM-2430: -- Github user asfgit closed the pull request at:

[jira] [Created] (BEAM-2838) MR runner: update the capability matrix with the current status.

2017-09-03 Thread Pei He (JIRA)
Pei He created BEAM-2838: Summary: MR runner: update the capability matrix with the current status. Key: BEAM-2838 URL: https://issues.apache.org/jira/browse/BEAM-2838 Project: Beam Issue Type: Task

[jira] [Created] (BEAM-2839) MR runner: add runner users guide under documentation/runners

2017-09-03 Thread Pei He (JIRA)
Pei He created BEAM-2839: Summary: MR runner: add runner users guide under documentation/runners Key: BEAM-2839 URL: https://issues.apache.org/jira/browse/BEAM-2839 Project: Beam Issue Type: Task

[1/4] beam git commit: [BEAM-2824] support gauge and PipelineResults.metrics() in local mode.

2017-09-03 Thread pei
Repository: beam Updated Branches: refs/heads/jstorm-runner 914889925 -> 7a28bf1af [BEAM-2824] support gauge and PipelineResults.metrics() in local mode. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/cda4e629 Tree: http://

[GitHub] beam pull request #3791: [BEAM-2824] support gauge and PipelineResults.metri...

2017-09-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3791 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[2/4] beam git commit: [BEAM-2824] support PipelineResult.waitUntilFinish() in jstorm local mode.

2017-09-03 Thread pei
[BEAM-2824] support PipelineResult.waitUntilFinish() in jstorm local mode. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/df75d807 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/df75d807 Diff: http://git-wip-us.apache.o

[3/4] beam git commit: [BEAM-2824] Uses PipelineResult in TestJStormRunner.

2017-09-03 Thread pei
[BEAM-2824] Uses PipelineResult in TestJStormRunner. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6f40506a Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/6f40506a Diff: http://git-wip-us.apache.org/repos/asf/beam/diff

[4/4] beam git commit: This closes #3792

2017-09-03 Thread pei
This closes #3792 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7a28bf1a Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7a28bf1a Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/7a28bf1a Branch: refs/heads/jstor

[jira] [Commented] (BEAM-2824) Support PipelineResult in JStormRunner

2017-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152123#comment-16152123 ] ASF GitHub Bot commented on BEAM-2824: -- Github user peihe closed the pull request at:

[GitHub] beam pull request #3792: [BEAM-2824]: support PipelineResult.waitUntilFinish...

2017-09-03 Thread peihe
Github user peihe closed the pull request at: https://github.com/apache/beam/pull/3792 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enable

[jira] [Commented] (BEAM-2824) Support PipelineResult in JStormRunner

2017-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152122#comment-16152122 ] ASF GitHub Bot commented on BEAM-2824: -- Github user asfgit closed the pull request at: