[jira] [Commented] (BEAM-2824) Support PipelineResult in JStormRunner

[ https://issues.apache.org/jira/browse/BEAM-2824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152123#comment-16152123 ] ASF GitHub Bot commented on BEAM-2824: -- Github user peihe closed the pull request at:

[4/4] beam git commit: This closes #3792

This closes #3792 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7a28bf1a Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7a28bf1a Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/7a28bf1a Branch:

[3/4] beam git commit: [BEAM-2824] Uses PipelineResult in TestJStormRunner.

[BEAM-2824] Uses PipelineResult in TestJStormRunner. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6f40506a Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/6f40506a Diff:

[GitHub] beam pull request #3791: [BEAM-2824] support gauge and PipelineResults.metri...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3791 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/4] beam git commit: [BEAM-2824] support PipelineResult.waitUntilFinish() in jstorm local mode.

[BEAM-2824] support PipelineResult.waitUntilFinish() in jstorm local mode. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/df75d807 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/df75d807 Diff:

[1/4] beam git commit: [BEAM-2824] support gauge and PipelineResults.metrics() in local mode.

Repository: beam Updated Branches: refs/heads/jstorm-runner 914889925 -> 7a28bf1af [BEAM-2824] support gauge and PipelineResults.metrics() in local mode. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/cda4e629 Tree:

[jira] [Created] (BEAM-2839) MR runner: add runner users guide under documentation/runners

Pei He created BEAM-2839: Summary: MR runner: add runner users guide under documentation/runners Key: BEAM-2839 URL: https://issues.apache.org/jira/browse/BEAM-2839 Project: Beam Issue Type: Task

[jira] [Created] (BEAM-2838) MR runner: update the capability matrix with the current status.

Pei He created BEAM-2838: Summary: MR runner: update the capability matrix with the current status. Key: BEAM-2838 URL: https://issues.apache.org/jira/browse/BEAM-2838 Project: Beam Issue Type:

[jira] [Commented] (BEAM-2430) Java FnApiDoFnRunner to share across runners

[ https://issues.apache.org/jira/browse/BEAM-2430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152069#comment-16152069 ] ASF GitHub Bot commented on BEAM-2430: -- Github user asfgit closed the pull request at:

[2/6] beam git commit: Higher-level SdkHarnessClient

Higher-level SdkHarnessClient This adds a fairly thin wrapper on FnApiSdkHarnessClient, encapsulating the fact that all request and response types are injected into a disjoint union and sent over the same low-level RPC. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[3/6] beam git commit: Service for pooling incoming Fn API control plane connections

Service for pooling incoming Fn API control plane connections Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a1dc9d32 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/a1dc9d32 Diff:

[5/6] beam git commit: Add SdkHarnessDoFnRunner

Add SdkHarnessDoFnRunner This encapsulates processing a bundle over the Fn API. A Beam runner is responsible for: - Setting up a FnApiControlClientPoolService to listen for incoming FnApiSdkHarnessClient connections - Wrapping those connections in the higher-level SdkHarnessClient -

[4/6] beam git commit: FnApiControlClient, de-inverts Fn API control plane

FnApiControlClient, de-inverts Fn API control plane The Fn API control plane has an inverted client/server relationship in order to support firewall rules where the runner is forbidden from connecting out to the SDK harness. This Java helper provides an API with the more conventional polarity. It

Jenkins build is back to normal : beam_PostCommit_Python_Verify #3061

See

[jira] [Closed] (BEAM-2750) Read whole files as one PCollection element each

[ https://issues.apache.org/jira/browse/BEAM-2750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-2750. -- Resolution: Fixed Fix Version/s: 2.2.0 This has been fixed to a sufficient extent by

[jira] [Closed] (BEAM-2828) Create FileIO

[ https://issues.apache.org/jira/browse/BEAM-2828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-2828. -- Resolution: Fixed FileIO has been created. > Create FileIO > - > >

[jira] [Assigned] (BEAM-2750) Read whole files as one PCollection element each

[ https://issues.apache.org/jira/browse/BEAM-2750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-2750: -- Assignee: Eugene Kirpichov (was: Christopher Hebert) > Read whole files as one

[GitHub] beam pull request #3799: [BEAM-2828, BEAM-2750] Introduces FileIO.read() and...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3799 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-2828) Create FileIO

[ https://issues.apache.org/jira/browse/BEAM-2828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152007#comment-16152007 ] ASF GitHub Bot commented on BEAM-2828: -- Github user asfgit closed the pull request at:

[2/5] beam git commit: Introduces TextIO.readFiles()

Introduces TextIO.readFiles() Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/513d26c5 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/513d26c5 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/513d26c5 Branch:

[1/5] beam git commit: Introduces XmlIO.readFiles

Repository: beam Updated Branches: refs/heads/master 80b9cf9c2 -> c3bcd4b42 Introduces XmlIO.readFiles Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/abda38dc Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/abda38dc

[4/5] beam git commit: Uses FileIO.read() in TextIO and AvroIO

Uses FileIO.read() in TextIO and AvroIO Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6d4a7851 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/6d4a7851 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/6d4a7851

[5/5] beam git commit: This finishes #3799: [BEAM-2828, BEAM-2750] Introduces FileIO.read() and uses it in Text, Avro and Xml

This finishes #3799: [BEAM-2828, BEAM-2750] Introduces FileIO.read() and uses it in Text, Avro and Xml Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c3bcd4b4 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c3bcd4b4

[3/5] beam git commit: Introduces FileIO.read()

Introduces FileIO.read() Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/910d02fb Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/910d02fb Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/910d02fb Branch:

[1/2] beam git commit: Moves Match into FileIO.match()/matchAll()

Repository: beam Updated Branches: refs/heads/master f7d4583bd -> 80b9cf9c2 Moves Match into FileIO.match()/matchAll() FileIO will later gain other methods, such as read()/write(). Also introduces FileIO.MatchConfiguration - a common type to use by various file-based IOs to reduce

Build failed in Jenkins: beam_PostCommit_Python_Verify #3060

See -- [...truncated 607.36 KB...] :134: UserWarning: Using

[GitHub] beam pull request #3805: Fix typo in variable name: window_fn --> windowfn

GitHub user cclauss opened a pull request: https://github.com/apache/beam/pull/3805 Fix typo in variable name: window_fn --> windowfn `window_fn` is an undefined name in this context while `windowfn` is a parameter to this function and is used in three lines above and in the line

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #4712

See

[jira] [Closed] (BEAM-2825) Improve readability of SparkGroupAlsoByWindowViaWindowSet

[ https://issues.apache.org/jira/browse/BEAM-2825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stas Levin closed BEAM-2825. Resolution: Fixed Fix Version/s: 2.2.0 > Improve readability of SparkGroupAlsoByWindowViaWindowSet >

[jira] [Commented] (BEAM-2825) Improve readability of SparkGroupAlsoByWindowViaWindowSet

[ https://issues.apache.org/jira/browse/BEAM-2825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16151790#comment-16151790 ] ASF GitHub Bot commented on BEAM-2825: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3793: [BEAM-2825] Refactored SparkGroupAlsoByWindowViaWin...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3793 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: [BEAM-2825] Refactored SparkGroupAlsoByWindowViaWindowSet to improve readability.

Repository: beam Updated Branches: refs/heads/master a481d5611 -> f7d4583bd [BEAM-2825] Refactored SparkGroupAlsoByWindowViaWindowSet to improve readability. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c8b99ba3 Tree:

[2/2] beam git commit: This closes #3793

This closes #3793 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f7d4583b Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f7d4583b Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/f7d4583b Branch:

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #4709

See

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #4708

See

[jira] [Closed] (BEAM-2669) Kryo serialization exception when DStreams containing non-Kryo-serializable data are cached

[ https://issues.apache.org/jira/browse/BEAM-2669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stas Levin closed BEAM-2669. Resolution: Fixed > Kryo serialization exception when DStreams containing non-Kryo-serializable > data are

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Flink #3750

See

[jira] [Commented] (BEAM-2669) Kryo serialization exception when DStreams containing non-Kryo-serializable data are cached

[ https://issues.apache.org/jira/browse/BEAM-2669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16151692#comment-16151692 ] ASF GitHub Bot commented on BEAM-2669: -- Github user asfgit closed the pull request at:

[2/2] beam git commit: This closes #3749

This closes #3749 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a481d561 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/a481d561 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/a481d561 Branch:

[GitHub] beam pull request #3749: [BEAM-2669] Kryo-serialization-exception-when-dstre...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3749 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: [BEAM-2669] Fixed Kryo serialization exception when dstream is cached (by using coders and moving to bytes before attempting to serialise an RDD as part of caching it).

Repository: beam Updated Branches: refs/heads/master 80aebd902 -> a481d5611 [BEAM-2669] Fixed Kryo serialization exception when dstream is cached (by using coders and moving to bytes before attempting to serialise an RDD as part of caching it). Project:

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Flink #3749

See -- [...truncated 485.07 KB...] 2017-09-03T06:05:17.585 [INFO] Downloading: