[jira] [Assigned] (BEAM-407) Inconsistent synchronization in OffsetRangeTracker.copy

2017-08-30 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré reassigned BEAM-407: - Assignee: Justin Tumale > Inconsistent synchronization in OffsetRangeTracker.copy

[jira] [Closed] (BEAM-2781) Should have a canonical Compression enum

2017-08-30 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-2781. -- Resolution: Fixed Fix Version/s: 2.2.0 > Should have a canonical Compression enum >

[jira] [Updated] (BEAM-2632) TextIOReadTest creates pipelines with non-unique application names

2017-08-30 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2632: -- Summary: TextIOReadTest creates pipelines with non-unique application names (was:

[jira] [Commented] (BEAM-2516) User reports 4 minutes to process 1 million line CSV in DirectRunner

2017-08-30 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148418#comment-16148418 ] Kenneth Knowles commented on BEAM-2516: --- I think for 2.2.0 it is best to remove the translation

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3876

2017-08-30 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1189) Add guide for release verifiers in the release guide

2017-08-30 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148407#comment-16148407 ] Kenneth Knowles commented on BEAM-1189: --- Worth mentioning this start on a sign-up sheet template, so

[jira] [Created] (BEAM-2830) Main thread needs to re-throw worker exceptions for ValidatesRunner tests that expects exceptions.

2017-08-30 Thread Pei He (JIRA)
Pei He created BEAM-2830: Summary: Main thread needs to re-throw worker exceptions for ValidatesRunner tests that expects exceptions. Key: BEAM-2830 URL: https://issues.apache.org/jira/browse/BEAM-2830

[jira] [Assigned] (BEAM-2783) Support Counters/Metrics and run ValidatesRunner tests

2017-08-30 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He reassigned BEAM-2783: Assignee: Pei He > Support Counters/Metrics and run ValidatesRunner tests >

Jenkins build is back to normal : beam_PostCommit_Java_MavenInstall #4689

2017-08-30 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4688

2017-08-30 Thread Apache Jenkins Server
See Changes: [altay] Add a log message to ValueError in AsSingleton -- [...truncated 3.69 MB...] 2017-08-31T01:10:28.638 [INFO] Excluding

[jira] [Commented] (BEAM-2829) Add ability to set job labels in DataflowPipelineOptions

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148285#comment-16148285 ] ASF GitHub Bot commented on BEAM-2829: -- GitHub user zongweiz opened a pull request:

[GitHub] beam pull request #3797: [BEAM-2829] Add ability to set job labels for Dataf...

2017-08-30 Thread zongweiz
GitHub user zongweiz opened a pull request: https://github.com/apache/beam/pull/3797 [BEAM-2829] Add ability to set job labels for Dataflow runners in BEAM Java SDK Dataflow runner supports job labels specified by users and the labels will be populated to billing records and make

[jira] [Commented] (BEAM-2781) Should have a canonical Compression enum

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148273#comment-16148273 ] ASF GitHub Bot commented on BEAM-2781: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3737: [BEAM-2781] Adds a canonical Compression enum for f...

2017-08-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3737 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[3/3] beam git commit: This closes #3737: [BEAM-2781] Adds a canonical Compression enum for file-based IOs

2017-08-30 Thread jkff
This closes #3737: [BEAM-2781] Adds a canonical Compression enum for file-based IOs Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/5cb7be78 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/5cb7be78 Diff:

[2/3] beam git commit: Adds a canonical Compression enum for file-based IOs

2017-08-30 Thread jkff
Adds a canonical Compression enum for file-based IOs Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/54489f0d Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/54489f0d Diff:

[1/3] beam git commit: Adds a canonical Compression enum for file-based IOs

2017-08-30 Thread jkff
Repository: beam Updated Branches: refs/heads/master afe8b0ea1 -> 5cb7be78b http://git-wip-us.apache.org/repos/asf/beam/blob/54489f0d/sdks/java/core/src/test/java/org/apache/beam/sdk/io/TextIOReadTest.java -- diff --git

Jenkins build is back to normal : beam_PostCommit_Java_MavenInstall #4686

2017-08-30 Thread Apache Jenkins Server
See

[jira] [Closed] (BEAM-2753) File DynamicDestinations side inputs don't work with sharding

2017-08-30 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-2753. -- Resolution: Fixed > File DynamicDestinations side inputs don't work with sharding >

[jira] [Assigned] (BEAM-2803) JdbcIO read is very slow when query return a lot of rows

2017-08-30 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-2803: -- Assignee: Eugene Kirpichov (was: Jean-Baptiste Onofré) > JdbcIO read is very slow when

[jira] [Commented] (BEAM-2803) JdbcIO read is very slow when query return a lot of rows

2017-08-30 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148245#comment-16148245 ] Eugene Kirpichov commented on BEAM-2803: The conclusion of my experiments is that the combined

[jira] [Commented] (BEAM-2718) Add bundle retry logic to the DirectRunner

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148240#comment-16148240 ] ASF GitHub Bot commented on BEAM-2718: -- GitHub user mariapython opened a pull request:

[GitHub] beam pull request #3796: [BEAM-2718] Improve bundle retry display.

2017-08-30 Thread mariapython
GitHub user mariapython opened a pull request: https://github.com/apache/beam/pull/3796 [BEAM-2718] Improve bundle retry display. While --direct_runner_bundle_retry is experimental, if an exception occurs, the user should be informed that the option to use retry is available. You

[GitHub] beam pull request #3777: [BEAM-2814] Update error message in AsSingleton

2017-08-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3777 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #3777

2017-08-30 Thread altay
This closes #3777 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/afe8b0ea Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/afe8b0ea Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/afe8b0ea Branch:

[jira] [Commented] (BEAM-2814) test_as_singleton_with_different_defaults test is flaky

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148226#comment-16148226 ] ASF GitHub Bot commented on BEAM-2814: -- Github user asfgit closed the pull request at:

[jira] [Commented] (BEAM-2753) File DynamicDestinations side inputs don't work with sharding

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148217#comment-16148217 ] ASF GitHub Bot commented on BEAM-2753: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3765: [BEAM-2753] Fixes translation of WriteFiles side in...

2017-08-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3765 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #3765: [BEAM-2753] Fixes translation of WriteFiles side inputs

2017-08-30 Thread jkff
This closes #3765: [BEAM-2753] Fixes translation of WriteFiles side inputs Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/097aec7a Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/097aec7a Diff:

[1/2] beam git commit: [BEAM-2753] Fixes translation of WriteFiles side inputs

2017-08-30 Thread jkff
Repository: beam Updated Branches: refs/heads/master 1cd87e325 -> 097aec7a3 [BEAM-2753] Fixes translation of WriteFiles side inputs Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/783f26f3 Tree:

[jira] [Commented] (BEAM-1347) Basic Java harness capable of understanding process bundle tasks and sending data over the Fn Api

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148211#comment-16148211 ] ASF GitHub Bot commented on BEAM-1347: -- GitHub user lukecwik opened a pull request:

[GitHub] beam pull request #3795: [BEAM-1347] Wire up the BeamFnStateGrpcClientCache ...

2017-08-30 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3795 [BEAM-1347] Wire up the BeamFnStateGrpcClientCache implementation into the ProcessBundleHandler Follow this checklist to help us incorporate your contribution quickly and easily: - [x]

[jira] [Commented] (BEAM-1347) Basic Java harness capable of understanding process bundle tasks and sending data over the Fn Api

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148196#comment-16148196 ] ASF GitHub Bot commented on BEAM-1347: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3788: [BEAM-1347] Implement a BeamFnStateClient which com...

2017-08-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3788 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: [BEAM-1347] Implement a BeamFnStateClient which communicates over gRPC.

2017-08-30 Thread lcwik
[BEAM-1347] Implement a BeamFnStateClient which communicates over gRPC. This closes #3788 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/1cd87e32 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/1cd87e32 Diff:

[1/2] beam git commit: [BEAM-1347] Implement a BeamFnStateClient which communicates over gRPC.

2017-08-30 Thread lcwik
Repository: beam Updated Branches: refs/heads/master 585440d22 -> 1cd87e325 [BEAM-1347] Implement a BeamFnStateClient which communicates over gRPC. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/fb2d6b58 Tree:

Jenkins build is back to normal : beam_PostCommit_Python_Verify #3034

2017-08-30 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2803) JdbcIO read is very slow when query return a lot of rows

2017-08-30 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148145#comment-16148145 ] Eugene Kirpichov commented on BEAM-2803: Side inputs (at least in Dataflow) have the disadvantage

[jira] [Assigned] (BEAM-2829) Add ability to set job labels in DataflowPipelineOptions

2017-08-30 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-2829: --- Assignee: Zongwei Zhou (was: Thomas Groh) > Add ability to set job labels in DataflowPipelineOptions

[jira] [Commented] (BEAM-1189) Add guide for release verifiers in the release guide

2017-08-30 Thread Griselda Cuevas Zambrano (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148102#comment-16148102 ] Griselda Cuevas Zambrano commented on BEAM-1189: Hi there - I'm planning to use the content

[jira] [Commented] (BEAM-1927) Add tfrecord io to built in IO list

2017-08-30 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148100#comment-16148100 ] Ahmet Altay commented on BEAM-1927: --- Fixed in: https://github.com/apache/beam-site/pull/303 > Add

[jira] [Resolved] (BEAM-1927) Add tfrecord io to built in IO list

2017-08-30 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay resolved BEAM-1927. --- Resolution: Fixed Fix Version/s: 2.2.0 > Add tfrecord io to built in IO list >

[jira] [Assigned] (BEAM-1927) Add tfrecord io to built in IO list

2017-08-30 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-1927: - Assignee: Ahmet Altay > Add tfrecord io to built in IO list > ---

Build failed in Jenkins: beam_PostCommit_Python_Verify #3033

2017-08-30 Thread Apache Jenkins Server
See -- [...truncated 651.77 KB...] "location":

[jira] [Assigned] (BEAM-1189) Add guide for release verifiers in the release guide

2017-08-30 Thread Griselda Cuevas Zambrano (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Griselda Cuevas Zambrano reassigned BEAM-1189: -- Assignee: Griselda Cuevas Zambrano > Add guide for release verifiers in

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4685

2017-08-30 Thread Apache Jenkins Server
See Changes: [lcwik] [BEAM-1347] Create value state, combining state, and bag state views -- [...truncated 98.45 KB...] 2017-08-30T21:32:59.407 [INFO]

[jira] [Commented] (BEAM-1347) Basic Java harness capable of understanding process bundle tasks and sending data over the Fn Api

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148084#comment-16148084 ] ASF GitHub Bot commented on BEAM-1347: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3783: [BEAM-1347] Create value state, combining state, an...

2017-08-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3783 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: [BEAM-1347] Create value state, combining state, and bag state views over the BagUserState.

2017-08-30 Thread lcwik
[BEAM-1347] Create value state, combining state, and bag state views over the BagUserState. This closes #3783 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/585440d2 Tree:

[1/2] beam git commit: [BEAM-1347] Create value state, combining state, and bag state views over the BagUserState.

2017-08-30 Thread lcwik
Repository: beam Updated Branches: refs/heads/master f6c840533 -> 585440d22 [BEAM-1347] Create value state, combining state, and bag state views over the BagUserState. Also bind the state persistence to the end of finishBundle. Project: http://git-wip-us.apache.org/repos/asf/beam/repo

[jira] [Updated] (BEAM-2803) JdbcIO read is very slow when query return a lot of rows

2017-08-30 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov updated BEAM-2803: --- Fix Version/s: (was: Not applicable) 2.2.0 > JdbcIO read is very slow

[jira] [Created] (BEAM-2829) Add ability to set job labels in DataflowPipelineOptions

2017-08-30 Thread Zongwei Zhou (JIRA)
Zongwei Zhou created BEAM-2829: -- Summary: Add ability to set job labels in DataflowPipelineOptions Key: BEAM-2829 URL: https://issues.apache.org/jira/browse/BEAM-2829 Project: Beam Issue Type:

[jira] [Closed] (BEAM-2644) Make it easier to test runtime-accessible ValueProvider's

2017-08-30 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-2644. -- Resolution: Fixed Fix Version/s: 2.2.0 > Make it easier to test runtime-accessible

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4684

2017-08-30 Thread Apache Jenkins Server
See Changes: [ekirpichov] [BEAM-2644] Introduces TestPipeline.newProvider() -- [...truncated 1.12 MB...] 2017-08-30T20:08:34.222 [INFO] Downloaded:

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Apex #2285

2017-08-30 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2516) User reports 4 minutes to process 1 million line CSV in DirectRunner

2017-08-30 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147945#comment-16147945 ] Ismaël Mejía commented on BEAM-2516: It seems that with all the ongoing work to support the Fn/Runner

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Dataflow #3871

2017-08-30 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2644) Make it easier to test runtime-accessible ValueProvider's

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147893#comment-16147893 ] ASF GitHub Bot commented on BEAM-2644: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3753: [BEAM-2644] Introduces TestPipeline.newProvider()

2017-08-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3753 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: [BEAM-2644] Introduces TestPipeline.newProvider()

2017-08-30 Thread jkff
Repository: beam Updated Branches: refs/heads/master 5c2cab017 -> f6c840533 [BEAM-2644] Introduces TestPipeline.newProvider() Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f1b19b71 Tree:

[2/2] beam git commit: This closes #3753: [BEAM-2644] Introduces TestPipeline.newProvider()

2017-08-30 Thread jkff
This closes #3753: [BEAM-2644] Introduces TestPipeline.newProvider() Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f6c84053 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f6c84053 Diff:

[GitHub] beam pull request #3725: [BEAM-2827] Introduces AvroIO.watchForNewFiles

2017-08-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3725 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[5/6] beam git commit: Fixes a findbugs error in Apex runner

2017-08-30 Thread jkff
Fixes a findbugs error in Apex runner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6590aed4 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/6590aed4 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/6590aed4

[1/6] beam git commit: Adds AvroIO watchForNewFiles

2017-08-30 Thread jkff
Repository: beam Updated Branches: refs/heads/master d64f2cce8 -> 5c2cab017 Adds AvroIO watchForNewFiles Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f1f39871 Tree:

[2/6] beam git commit: Gets rid of raw type in TextIO.Read.watchForNewFiles

2017-08-30 Thread jkff
Gets rid of raw type in TextIO.Read.watchForNewFiles Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/184f7a9b Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/184f7a9b Diff:

[4/6] beam git commit: Better-organized javadocs for TextIO and AvroIO

2017-08-30 Thread jkff
Better-organized javadocs for TextIO and AvroIO Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/84eb7f3a Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/84eb7f3a Diff:

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Spark #2954

2017-08-30 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-301) Add a Beam SQL DSL

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147718#comment-16147718 ] ASF GitHub Bot commented on BEAM-301: - GitHub user XuMingmin opened a pull request:

[jira] [Commented] (BEAM-2826) Need to generate a single XML file when write is performed on small amount of data

2017-08-30 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147720#comment-16147720 ] Eugene Kirpichov commented on BEAM-2826: The solution to this bug would be either augmenting

[GitHub] beam pull request #3794: [TEST PR] to verify [BEAM-301]

2017-08-30 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3794 [TEST PR] to verify [BEAM-301] Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Flink #3722

2017-08-30 Thread Apache Jenkins Server
See -- [...truncated 485.41 KB...] 2017-08-30T18:08:19.119 [INFO] Downloading:

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Apex #2284

2017-08-30 Thread Apache Jenkins Server
See -- [...truncated 501.40 KB...] 2017-08-30T18:06:55.378 [INFO] Downloading: https://repo.maven.apache.org/maven2/com/google/inject/guice/3.0/guice-3.0.pom

[jira] [Comment Edited] (BEAM-2826) Need to generate a single XML file when write is performed on small amount of data

2017-08-30 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147446#comment-16147446 ] Luke Cwik edited comment on BEAM-2826 at 8/30/17 3:34 PM: -- What about doing this

[jira] [Commented] (BEAM-2826) Need to generate a single XML file when write is performed on small amount of data

2017-08-30 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147446#comment-16147446 ] Luke Cwik commented on BEAM-2826: - What about doing this in your pipeline: ``` PC -> DoFn(AssignVoidKey) ->

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Spark #2953

2017-08-30 Thread Apache Jenkins Server
See -- [...truncated 453.07 KB...] 2017-08-30T14:28:55.640 [INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 s - in

[jira] [Created] (BEAM-2826) Need to generate a single XML file when write is performed on small amount of data

2017-08-30 Thread Balajee Venkatesh (JIRA)
Balajee Venkatesh created BEAM-2826: --- Summary: Need to generate a single XML file when write is performed on small amount of data Key: BEAM-2826 URL: https://issues.apache.org/jira/browse/BEAM-2826

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3870

2017-08-30 Thread Apache Jenkins Server
See

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #4681

2017-08-30 Thread Apache Jenkins Server
See

[GitHub] beam pull request #3705: [BEAM-165] Initial implementation of the MapReduce ...

2017-08-30 Thread peihe
GitHub user peihe reopened a pull request: https://github.com/apache/beam/pull/3705 [BEAM-165] Initial implementation of the MapReduce runner. Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[jira] [Commented] (BEAM-2825) Improve readability of SparkGroupAlsoByWindowViaWindowSet

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147189#comment-16147189 ] ASF GitHub Bot commented on BEAM-2825: -- GitHub user staslev opened a pull request:

[GitHub] beam pull request #3793: [BEAM-2825] Refactored SparkGroupAlsoByWindowViaWin...

2017-08-30 Thread staslev
GitHub user staslev opened a pull request: https://github.com/apache/beam/pull/3793 [BEAM-2825] Refactored SparkGroupAlsoByWindowViaWindowSet to improve … …readability. Follow this checklist to help us incorporate your contribution quickly and easily: - [ ]

[jira] [Commented] (BEAM-165) Add Hadoop MapReduce runner

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147188#comment-16147188 ] ASF GitHub Bot commented on BEAM-165: - Github user peihe closed the pull request at:

[GitHub] beam pull request #3705: [BEAM-165] Initial implementation of the MapReduce ...

2017-08-30 Thread peihe
Github user peihe closed the pull request at: https://github.com/apache/beam/pull/3705 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Assigned] (BEAM-2825) Improve readability of SparkGroupAlsoByWindowViaWindowSet

2017-08-30 Thread Stas Levin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stas Levin reassigned BEAM-2825: Assignee: Stas Levin (was: Amit Sela) > Improve readability of SparkGroupAlsoByWindowViaWindowSet

[jira] [Commented] (BEAM-2457) Error: "Unable to find registrar for hdfs" - need to prevent/improve error message

2017-08-30 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146873#comment-16146873 ] Aljoscha Krettek commented on BEAM-2457: (This is on the Cloudera Quickstart VM) I noticed that

[jira] [Commented] (BEAM-2824) Support PipelineResult in JStormRunner

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146826#comment-16146826 ] ASF GitHub Bot commented on BEAM-2824: -- GitHub user peihe opened a pull request:

[GitHub] beam pull request #3792: [BEAM-2824]: support PipelineResult.waitUntilFinish...

2017-08-30 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/3792 [BEAM-2824]: support PipelineResult.waitUntilFinish() in JStormRunner local mode and uses it in TestJStormRunner. Follow this checklist to help us incorporate your contribution quickly and easily:

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #4680

2017-08-30 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2824) Support PipelineResult in JStormRunner

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146800#comment-16146800 ] ASF GitHub Bot commented on BEAM-2824: -- GitHub user peihe opened a pull request:

[GitHub] beam pull request #3791: [BEAM-2824] support gauge and PipelineResults.metri...

2017-08-30 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/3791 [BEAM-2824] support gauge and PipelineResults.metrics() in local mode. Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[3/3] beam git commit: This closes #3789

2017-08-30 Thread pei
This closes #3789 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/91488992 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/91488992 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/91488992 Branch:

[2/3] beam git commit: jstorm-runner: Fix incorrect updating of counter metrics

2017-08-30 Thread pei
jstorm-runner: Fix incorrect updating of counter metrics Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c9526869 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c9526869 Diff:

[1/3] beam git commit: jstorm-runner: Fix the bug that max waiting time is missing on local mode

2017-08-30 Thread pei
Repository: beam Updated Branches: refs/heads/jstorm-runner e00e0e841 -> 914889925 jstorm-runner: Fix the bug that max waiting time is missing on local mode Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/557d7036 Tree:

[jira] [Commented] (BEAM-2632) TextIOReadTest create pipelines with non-unique application names

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146770#comment-16146770 ] ASF GitHub Bot commented on BEAM-2632: -- GitHub user huafengw opened a pull request:

[GitHub] beam pull request #3790: [BEAM-2632] Use Junit Paramaterized test suits in T...

2017-08-30 Thread huafengw
GitHub user huafengw opened a pull request: https://github.com/apache/beam/pull/3790 [BEAM-2632] Use Junit Paramaterized test suits in TextIOReadTest Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[jira] [Created] (BEAM-2824) Support PipelineResult in JStormRunner

2017-08-30 Thread Pei He (JIRA)
Pei He created BEAM-2824: Summary: Support PipelineResult in JStormRunner Key: BEAM-2824 URL: https://issues.apache.org/jira/browse/BEAM-2824 Project: Beam Issue Type: New Feature