[2/7] beam git commit: [BEAM-2135] Move gcp-core to google-cloud-platform-core

2017-05-02 Thread lcwik
http://git-wip-us.apache.org/repos/asf/beam/blob/06f5a494/sdks/java/extensions/google-cloud-platform-core/src/main/java/org/apache/beam/sdk/util/RetryHttpRequestInitializer.java -- diff --git a/sdks/java/extensions/google-cloud-pl

[jira] [Commented] (BEAM-1345) Mark @Experimental pieces of the SDK that have been added but are not ready to be frozen

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993401#comment-15993401 ] ASF GitHub Bot commented on BEAM-1345: -- Github user asfgit closed the pull request at:

[2/2] beam git commit: This closes #2830: Add an @Internal Annotation

2017-05-02 Thread kenn
This closes #2830: Add an @Internal Annotation Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9114eb3e Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/9114eb3e Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/9114e

[GitHub] beam pull request #2830: [BEAM-1345] Add an @Internal Annotation

2017-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2830 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: Add an @Internal Annotation

2017-05-02 Thread kenn
Repository: beam Updated Branches: refs/heads/master 97dde95bc -> 9114eb3ee Add an @Internal Annotation This annotation is used as a marker that a publicly accessible API is intended for internal use and should not be used by users, and is subject to no compatibility guarantees. Project: htt

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #3588

2017-05-02 Thread Apache Jenkins Server
See

Jenkins build is unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3011

2017-05-02 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1964) Upgrade pylint to 1.7.0

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993371#comment-15993371 ] ASF GitHub Bot commented on BEAM-1964: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #2813: [BEAM-1964] Revert clean else-return lint changes.

2017-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2813 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: Revert clean else-return lint changes.

2017-05-02 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 43443c94f -> 97dde95bc Revert clean else-return lint changes. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a907323f Tree: http://git-wip-us.apache.org/repos/asf/beam/tr

[2/2] beam git commit: Closes #2813

2017-05-02 Thread robertwb
Closes #2813 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/97dde95b Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/97dde95b Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/97dde95b Branch: refs/heads/master Com

[jira] [Updated] (BEAM-981) Not possible to directly submit a pipeline on spark cluster

2017-05-02 Thread Kobi Salant (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kobi Salant updated BEAM-981: - Hi I will try to finish it till end of the week. I will let you know if it doesn't happen. Thanks for the sugg

[jira] [Commented] (BEAM-48) BigQueryIO.Read reimplemented as BoundedSource

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-48?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993368#comment-15993368 ] ASF GitHub Bot commented on BEAM-48: GitHub user dhalperi opened a pull request: htt

[GitHub] beam pull request #2832: [BEAM-48] BigQuery: swap from asSingleton to asIter...

2017-05-02 Thread dhalperi
GitHub user dhalperi opened a pull request: https://github.com/apache/beam/pull/2832 [BEAM-48] BigQuery: swap from asSingleton to asIterable for Cleanup asIterable can be simpler for runners to implement as it does not require semantically that the PCollection being viewed conta

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #3587

2017-05-02 Thread Apache Jenkins Server
See

[GitHub] beam pull request #2831: Convert all unknown Coders into CustomCoder CloudOb...

2017-05-02 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2831 Convert all unknown Coders into CustomCoder CloudObjects Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is for

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #3586

2017-05-02 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2051) Reduce scope of the PCollectionView interface

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993300#comment-15993300 ] ASF GitHub Bot commented on BEAM-2051: -- Github user tgroh closed the pull request at:

[jira] [Commented] (BEAM-2051) Reduce scope of the PCollectionView interface

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993299#comment-15993299 ] ASF GitHub Bot commented on BEAM-2051: -- Github user tgroh closed the pull request at:

[GitHub] beam pull request #2680: [BEAM-2051] Remove all methods from PCollectionView

2017-05-02 Thread tgroh
Github user tgroh closed the pull request at: https://github.com/apache/beam/pull/2680 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enable

[GitHub] beam pull request #2811: [BEAM-2051] Cast to SimplePCollectionView instead o...

2017-05-02 Thread tgroh
Github user tgroh closed the pull request at: https://github.com/apache/beam/pull/2811 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enable

[GitHub] beam pull request #2825: Remove Coder.asCloudObject and related methods

2017-05-02 Thread lukecwik
Github user lukecwik closed the pull request at: https://github.com/apache/beam/pull/2825 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[jira] [Commented] (BEAM-1316) DoFn#startBundle should not be able to output

2017-05-02 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993294#comment-15993294 ] Ahmet Altay commented on BEAM-1316: --- [~sb2nov] could we remove the sdk-py component from

[jira] [Commented] (BEAM-1345) Mark @Experimental pieces of the SDK that have been added but are not ready to be frozen

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993293#comment-15993293 ] ASF GitHub Bot commented on BEAM-1345: -- GitHub user tgroh opened a pull request:

[GitHub] beam pull request #2830: [BEAM-1345] Add an @Internal Annotation

2017-05-02 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2830 [BEAM-1345] Add an @Internal Annotation Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like:

[jira] [Commented] (BEAM-1283) DoFn finishBundle should be required to specify the window for output

2017-05-02 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993288#comment-15993288 ] Ahmet Altay commented on BEAM-1283: --- [~sb2nov] [~robertwb] any update here? What is the p

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Apex #1316

2017-05-02 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2021) Fix Java's Coder class hierarchy

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993252#comment-15993252 ] ASF GitHub Bot commented on BEAM-2021: -- GitHub user tgroh opened a pull request:

[GitHub] beam pull request #2829: [BEAM-2021] Re-add AtomicCoder

2017-05-02 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2829 [BEAM-2021] Re-add AtomicCoder Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM

[jira] [Commented] (BEAM-530) Decide where to place the tests and examples for the Python SDK

2017-05-02 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993238#comment-15993238 ] Ahmet Altay commented on BEAM-530: -- There is no update yet. There was a recent comment abou

[GitHub] beam pull request #2800: Add retry logic for job creation

2017-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2800 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: Add retry logic for job creation

2017-05-02 Thread altay
Repository: beam Updated Branches: refs/heads/master f9243e1c2 -> 43443c94f Add retry logic for job creation Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b8a27d69 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b8a

[2/2] beam git commit: This closes #2800

2017-05-02 Thread altay
This closes #2800 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/43443c94 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/43443c94 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/43443c94 Branch: refs/heads/maste

[GitHub] beam pull request #2820: Update github PR template after travis removal.

2017-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2820 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[2/2] beam git commit: This closes #2820

2017-05-02 Thread davor
This closes #2820 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f9243e1c Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f9243e1c Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/f9243e1c Branch: refs/heads/maste

[1/2] beam git commit: Update github PR template after travis removal.

2017-05-02 Thread davor
Repository: beam Updated Branches: refs/heads/master 19105d9be -> f9243e1c2 Update github PR template after travis removal. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/97949e1c Tree: http://git-wip-us.apache.org/repos/as

[jira] [Commented] (BEAM-2135) Rename hdfs module to hadoop-file-system, rename gcp-core to google-cloud-platform-core

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993196#comment-15993196 ] ASF GitHub Bot commented on BEAM-2135: -- GitHub user lukecwik opened a pull request:

[GitHub] beam pull request #2828: [BEAM-2135] Move hdfs to hadoop-file-system

2017-05-02 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/2828 [BEAM-2135] Move hdfs to hadoop-file-system Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted lik

[jira] [Updated] (BEAM-1764) Remove Aggregators from Flink Runner

2017-05-02 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-1764: --- Summary: Remove Aggregators from Flink Runner (was: Remove aggregators from Flink Runner) > Remove Ag

[jira] [Resolved] (BEAM-1764) Remove aggregators from Flink Runner

2017-05-02 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-1764. Resolution: Fixed Fix Version/s: First stable release > Remove aggregators from Flink Runner >

[jira] [Commented] (BEAM-1764) Remove aggregators from Flink Runner

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993189#comment-15993189 ] ASF GitHub Bot commented on BEAM-1764: -- Github user asfgit closed the pull request at:

[2/2] beam git commit: This closes #2822

2017-05-02 Thread iemejia
This closes #2822 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/19105d9b Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/19105d9b Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/19105d9b Branch: refs/heads/maste

[GitHub] beam pull request #2822: [BEAM-1764] Remove aggregators from Flink Runner

2017-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2822 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: [BEAM-1764] Remove aggregators from Flink Runner

2017-05-02 Thread iemejia
Repository: beam Updated Branches: refs/heads/master ae72456b7 -> 19105d9be [BEAM-1764] Remove aggregators from Flink Runner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/8e94f8f8 Tree: http://git-wip-us.apache.org/repos/a

[jira] [Commented] (BEAM-2135) Rename hdfs module to hadoop-file-system, rename gcp-core to google-cloud-platform-core

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993184#comment-15993184 ] ASF GitHub Bot commented on BEAM-2135: -- GitHub user lukecwik opened a pull request:

[GitHub] beam pull request #2827: [BEAM-2135] Move gcp-core to google-cloud-platform-...

2017-05-02 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/2827 [BEAM-2135] Move gcp-core to google-cloud-platform-core Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is f

[jira] [Commented] (BEAM-1641) Support synchronized processing time in Flink runner

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993159#comment-15993159 ] ASF GitHub Bot commented on BEAM-1641: -- GitHub user kennknowles opened a pull request:

[jira] [Commented] (BEAM-2063) type DATE/TIME/TIMESTAMP support

2017-05-02 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993162#comment-15993162 ] Xu Mingmin commented on BEAM-2063: -- just realize that it blocks BEAM-2006(as a must data t

[GitHub] beam pull request #2826: [BEAM-1641] Use processing time for synchronized pr...

2017-05-02 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2826 [BEAM-1641] Use processing time for synchronized processing time in Flink runner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x

[jira] [Assigned] (BEAM-1641) Support synchronized processing time in Flink runner

2017-05-02 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-1641: - Assignee: Kenneth Knowles (was: Aljoscha Krettek) > Support synchronized processing time

[GitHub] beam pull request #2825: Remove Coder.asCloudObject and related methods

2017-05-02 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/2825 Remove Coder.asCloudObject and related methods Rebase #2806 on top of apache/master If this passes, will merge in #2806 You can merge this pull request into a Git repository by running:

[jira] [Commented] (BEAM-2139) Disable SplittableDoFn ValidatesRunner tests for Streaming Flink Runner

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993128#comment-15993128 ] ASF GitHub Bot commented on BEAM-2139: -- GitHub user aviemzur opened a pull request:

[GitHub] beam pull request #2824: [BEAM-2139] Disable SplittableDoFn ValidatesRunner ...

2017-05-02 Thread aviemzur
GitHub user aviemzur opened a pull request: https://github.com/apache/beam/pull/2824 [BEAM-2139] Disable SplittableDoFn ValidatesRunner tests for Streaming Flink Runner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [

[jira] [Updated] (BEAM-2139) Disable SplittableDoFn ValidatesRunner tests for Streaming Flink Runner

2017-05-02 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-2139: Issue Type: Task (was: Bug) > Disable SplittableDoFn ValidatesRunner tests for Streaming Flink Runner >

[jira] [Updated] (BEAM-2139) Disable SplittableDoFn ValidatesRunner tests for Streaming Flink Runner

2017-05-02 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-2139: Summary: Disable SplittableDoFn ValidatesRunner tests for Streaming Flink Runner (was: Disable SplittableDoF

[jira] [Commented] (BEAM-2063) type DATE/TIME/TIMESTAMP support

2017-05-02 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993118#comment-15993118 ] Xu Mingmin commented on BEAM-2063: -- used {{TIMESTAMP}} and {{TIME}} in WINDOW > type DATE

[jira] [Assigned] (BEAM-2063) type DATE/TIME/TIMESTAMP support

2017-05-02 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-2063: --- Assignee: Luke Cwik > type DATE/TIME/TIMESTAMP support > > >

[jira] [Updated] (BEAM-2063) type DATE/TIME/TIMESTAMP support

2017-05-02 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2063: - Priority: Blocker (was: Major) > type DATE/TIME/TIMESTAMP support > > >

[jira] [Assigned] (BEAM-2063) type DATE/TIME/TIMESTAMP support

2017-05-02 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-2063: --- Assignee: James Xu (was: Luke Cwik) > type DATE/TIME/TIMESTAMP support >

[jira] [Commented] (BEAM-2063) type DATE/TIME/TIMESTAMP support

2017-05-02 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993094#comment-15993094 ] Xu Mingmin commented on BEAM-2063: -- [~xumingming] sure, feel free to assign to yourself, c

[jira] [Assigned] (BEAM-2139) Disable SplittableDoFn ValidatesRunner tests for Flink Runner

2017-05-02 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-2139: --- Assignee: Aviem Zur (was: Aljoscha Krettek) > Disable SplittableDoFn ValidatesRunner tests for Flink

[jira] [Created] (BEAM-2140) Fix SplittableDoFn ValidatesRunner tests in FlinkRunner

2017-05-02 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created BEAM-2140: -- Summary: Fix SplittableDoFn ValidatesRunner tests in FlinkRunner Key: BEAM-2140 URL: https://issues.apache.org/jira/browse/BEAM-2140 Project: Beam Issue

[jira] [Created] (BEAM-2139) Disable SplittableDoFn ValidatesRunner tests for Flink Runner

2017-05-02 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created BEAM-2139: -- Summary: Disable SplittableDoFn ValidatesRunner tests for Flink Runner Key: BEAM-2139 URL: https://issues.apache.org/jira/browse/BEAM-2139 Project: Beam

[jira] [Created] (BEAM-2138) Support atomic rename within FileSystem to replace inefficient Hadoop copy

2017-05-02 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2138: --- Summary: Support atomic rename within FileSystem to replace inefficient Hadoop copy Key: BEAM-2138 URL: https://issues.apache.org/jira/browse/BEAM-2138 Project: Beam

[jira] [Commented] (BEAM-2059) Implement Metrics support for streaming Dataflow runner

2017-05-02 Thread Devon Meunier (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15992966#comment-15992966 ] Devon Meunier commented on BEAM-2059: - Unfortunately BEAM-775 was closed before this wa

[jira] [Comment Edited] (BEAM-2059) Implement Metrics support for streaming Dataflow runner

2017-05-02 Thread Devon Meunier (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15992966#comment-15992966 ] Devon Meunier edited comment on BEAM-2059 at 5/2/17 2:09 PM: - U

[jira] [Assigned] (BEAM-1588) Reuse StateNamespace.stringKey in Flink States

2017-05-02 Thread Jingsong Lee (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee reassigned BEAM-1588: -- Assignee: (was: Jingsong Lee) > Reuse StateNamespace.stringKey in Flink States > ---

[jira] [Assigned] (BEAM-1587) Use StringBuilder to stringKey of StateNamespace instead of String.format

2017-05-02 Thread Jingsong Lee (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee reassigned BEAM-1587: -- Assignee: (was: Jingsong Lee) > Use StringBuilder to stringKey of StateNamespace instead of

[jira] [Assigned] (BEAM-1483) Support SetState in Flink runner

2017-05-02 Thread Jingsong Lee (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee reassigned BEAM-1483: -- Assignee: (was: Jingsong Lee) > Support SetState in Flink runner > -

[jira] [Assigned] (BEAM-1476) Support MapState in Flink runner

2017-05-02 Thread Jingsong Lee (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee reassigned BEAM-1476: -- Assignee: (was: Jingsong Lee) > Support MapState in Flink runner > -

[jira] [Assigned] (BEAM-1498) Use Flink-native side outputs

2017-05-02 Thread Jingsong Lee (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee reassigned BEAM-1498: -- Assignee: (was: Jingsong Lee) > Use Flink-native side outputs >

[jira] [Assigned] (BEAM-1612) Support real Bundle in Flink runner

2017-05-02 Thread Jingsong Lee (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee reassigned BEAM-1612: -- Assignee: (was: Jingsong Lee) > Support real Bundle in Flink runner > --

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #3585

2017-05-02 Thread Apache Jenkins Server
See

[GitHub] beam pull request #2823: Add JStormPipelineTranslator, TransformTranslator a...

2017-05-02 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/2823 Add JStormPipelineTranslator, TransformTranslator and TranslatorRegistry. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure th

Build failed in Jenkins: beam_PerformanceTests_JDBC #169

2017-05-02 Thread Apache Jenkins Server
See Changes: [dhalperi] Remove Aggregators from StatefulDoFn runner [dhalperi] Removing Aggregator from core runner code [dhalperi] Remove accumulators from DoFn tester. [jbonofre] Remove unneeded ele

Build failed in Jenkins: beam_PerformanceTests_Dataflow #363

2017-05-02 Thread Apache Jenkins Server
See Changes: [dhalperi] Remove Aggregators from StatefulDoFn runner [dhalperi] Removing Aggregator from core runner code [dhalperi] Remove accumulators from DoFn tester. [jbonofre] Remove unneeded

[jira] [Commented] (BEAM-1764) Remove aggregators from Flink Runner

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15992740#comment-15992740 ] ASF GitHub Bot commented on BEAM-1764: -- GitHub user iemejia opened a pull request:

[GitHub] beam pull request #2822: [BEAM-1764] Remove aggregators from Flink Runner

2017-05-02 Thread iemejia
GitHub user iemejia opened a pull request: https://github.com/apache/beam/pull/2822 [BEAM-1764] Remove aggregators from Flink Runner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[jira] [Commented] (BEAM-1984) Enable dependency analysis of non-compile dependencies

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15992667#comment-15992667 ] ASF GitHub Bot commented on BEAM-1984: -- GitHub user iemejia opened a pull request:

[GitHub] beam pull request #2821: [BEAM-1984] Fix scope for dependencies needed only ...

2017-05-02 Thread iemejia
GitHub user iemejia opened a pull request: https://github.com/apache/beam/pull/2821 [BEAM-1984] Fix scope for dependencies needed only for test/runtime purposes Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make su

[jira] [Commented] (BEAM-1984) Enable dependency analysis of non-compile dependencies

2017-05-02 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15992660#comment-15992660 ] Ismaël Mejía commented on BEAM-1984: I just updated the ticket description for more con

[jira] [Updated] (BEAM-1984) Enable dependency analysis of non-compile dependencies

2017-05-02 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-1984: --- Description: In the Beam parent pom at this moment we have a configuration on the maven dependency plu

[jira] [Updated] (BEAM-1984) Enable dependency analysis of non-compile dependencies

2017-05-02 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-1984: --- Description: In the Beam parent pom at this moment we have a configuration on the maven dependency plu

[jira] [Updated] (BEAM-1984) Enable dependency analysis of non-compile dependencies

2017-05-02 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-1984: --- Description: In the Beam parent pom at this moment we have a configuration on the maven dependency plu

[jira] [Updated] (BEAM-1984) Enable dependency analysis of non-compile dependencies

2017-05-02 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-1984: --- Description: In the Beam parent pom at this moment we have a configuration on the maven dependency plu

[jira] [Commented] (BEAM-2111) java.lang.ClassCastException in spark in streaming mode

2017-05-02 Thread Etienne Chauchot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15992641#comment-15992641 ] Etienne Chauchot commented on BEAM-2111: Nice workaround! > java.lang.ClassCastExc

[jira] [Updated] (BEAM-530) Decide where to place the tests and examples for the Python SDK

2017-05-02 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-530: -- Summary: Decide where to place the tests and examples for the Python SDK (was: Decide where to place the

[GitHub] beam pull request #2820: Update github PR template after travis removal.

2017-05-02 Thread iemejia
GitHub user iemejia opened a pull request: https://github.com/apache/beam/pull/2820 Update github PR template after travis removal. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[jira] [Commented] (BEAM-530) Decide where to place the tests and examples

2017-05-02 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15992548#comment-15992548 ] Ismaël Mejía commented on BEAM-530: --- Any progress on this one? I think this one is an imp

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #3584

2017-05-02 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1491) HDFSFileSource should be able to read the HADOOP_CONF_DIR(YARN_CONF_DIR) environment variable

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15992537#comment-15992537 ] ASF GitHub Bot commented on BEAM-1491: -- Github user 397090770 closed the pull request

[GitHub] beam pull request #2759: [BEAM-1491]Identify HADOOP_CONF_DIR(or YARN_CONF_DI...

2017-05-02 Thread 397090770
Github user 397090770 closed the pull request at: https://github.com/apache/beam/pull/2759 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is en

[GitHub] beam pull request #2819: [BEAM-1491]Identify HADOOP_CONF_DIR(or YARN_CONF_DI...

2017-05-02 Thread 397090770
GitHub user 397090770 opened a pull request: https://github.com/apache/beam/pull/2819 [BEAM-1491]Identify HADOOP_CONF_DIR(or YARN_CONF_DIR) environment variables …iables Be sure to do all of the following to help us incorporate your contribution quickly and easily:

[jira] [Commented] (BEAM-1491) HDFSFileSource should be able to read the HADOOP_CONF_DIR(YARN_CONF_DIR) environment variable

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15992531#comment-15992531 ] ASF GitHub Bot commented on BEAM-1491: -- GitHub user 397090770 opened a pull request:

[jira] [Commented] (BEAM-1035) Support for new State API in SparkRunner

2017-05-02 Thread Jingsong Lee (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15992522#comment-15992522 ] Jingsong Lee commented on BEAM-1035: Is there a plan here? Can we support new State A

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #3583

2017-05-02 Thread Apache Jenkins Server
See

[GitHub] beam pull request #2704: Remove unneeded elements from the POM files

2017-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2704 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: Remove unneeded elements from the POM files

2017-05-02 Thread jbonofre
Repository: beam Updated Branches: refs/heads/master fad07f6b0 -> ae72456b7 Remove unneeded elements from the POM files The compiler-plugin, jar-plugin and checkstyle are all inherited from the parent pom. This was validated by using: mvn help:effective-pom. Also we don't need the extra

[2/2] beam git commit: This closes #2704

2017-05-02 Thread jbonofre
This closes #2704 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ae72456b Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/ae72456b Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/ae72456b Branch: refs/heads/maste

[jira] [Commented] (BEAM-775) Remove Aggregators from the Java SDK

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15992455#comment-15992455 ] ASF GitHub Bot commented on BEAM-775: - Github user dhalperi closed the pull request at:

<    1   2   3   4   5   >