Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2697

2017-07-24 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3643

2017-07-24 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PerformanceTests_Python #138

2017-07-24 Thread Apache Jenkins Server
See Changes: [aljoscha.krettek] [BEAM-2571] Change DoFnOperator to use Long.MAX_VALUE as max watermark [aljoscha.krettek] [BEAM-2571] Clarify pushedback variable name in DoFnOperator [aljoscha.krett

[jira] [Closed] (BEAM-2571) Flink ValidatesRunner failing CombineTest.testSlidingWindowsCombineWithContext

2017-07-24 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-2571. -- Resolution: Fixed > Flink ValidatesRunner failing CombineTest.testSlidingWindowsCombineWithContex

[jira] [Reopened] (BEAM-2571) Flink ValidatesRunner failing CombineTest.testSlidingWindowsCombineWithContext

2017-07-24 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré reopened BEAM-2571: > Flink ValidatesRunner failing CombineTest.testSlidingWindowsCombineWithContext > --

[jira] [Updated] (BEAM-2571) Flink ValidatesRunner failing CombineTest.testSlidingWindowsCombineWithContext

2017-07-24 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré updated BEAM-2571: --- Fix Version/s: 2.1.0 > Flink ValidatesRunner failing CombineTest.testSlidingWindowsComb

[jira] [Commented] (BEAM-2571) Flink ValidatesRunner failing CombineTest.testSlidingWindowsCombineWithContext

2017-07-24 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16098281#comment-16098281 ] Jean-Baptiste Onofré commented on BEAM-2571: As discussed on the mailing list,

[jira] [Updated] (BEAM-2670) ParDoTest.testPipelineOptionsParameter* validatesRunner tests fail on Spark runner

2017-07-24 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré updated BEAM-2670: --- Fix Version/s: 2.2.0 2.1.0 > ParDoTest.testPipelineOptionsParameter*

[jira] [Updated] (BEAM-2671) CreateStreamTest.testFirstElementLate validatesRunner test fails on Spark runner

2017-07-24 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré updated BEAM-2671: --- Fix Version/s: 2.2.0 2.1.0 > CreateStreamTest.testFirstElementLate v

[jira] [Updated] (BEAM-2642) Upgrade to Google Auth 0.7.1

2017-07-24 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2642: Affects Version/s: (was: 2.1.0) > Upgrade to Google Auth 0.7.1 > > >

[jira] [Updated] (BEAM-2662) Quickstart for Spark Java not working

2017-07-24 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2662: Fix Version/s: (was: 2.2.0) > Quickstart for Spark Java not working > ---

[jira] [Updated] (BEAM-2642) Upgrade to Google Auth 0.7.1

2017-07-24 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2642: Fix Version/s: (was: 2.2.0) > Upgrade to Google Auth 0.7.1 > > >

[GitHub] beam pull request #3625: [BEAM-2571] Fix FlinkRunner Watermark issues on 2.1...

2017-07-24 Thread aljoscha
GitHub user aljoscha opened a pull request: https://github.com/apache/beam/pull/3625 [BEAM-2571] Fix FlinkRunner Watermark issues on 2.1.0 branch You can merge this pull request into a Git repository by running: $ git pull https://github.com/aljoscha/beam jira-2571-fix-flink-

[jira] [Commented] (BEAM-2571) Flink ValidatesRunner failing CombineTest.testSlidingWindowsCombineWithContext

2017-07-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16098293#comment-16098293 ] ASF GitHub Bot commented on BEAM-2571: -- GitHub user aljoscha opened a pull request:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2698

2017-07-24 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Flink #3478

2017-07-24 Thread Apache Jenkins Server
See -- [...truncated 300.37 KB...] 2017-07-24T12:34:47.636 [INFO] Excluding com.google.protobuf:protobuf-java:jar:3.2.0 from the shaded jar. 2017-07-24T12:34:4

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Flink #3479

2017-07-24 Thread Apache Jenkins Server
See

[jira] [Comment Edited] (BEAM-2658) SerializableCoder has higher precedence over ProtoCoder in CoderRegistry#getCoder

2017-07-24 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16098322#comment-16098322 ] Luke Cwik edited comment on BEAM-2658 at 7/24/17 12:57 PM: --- Arbit

[jira] [Commented] (BEAM-2658) SerializableCoder has higher precedence over ProtoCoder in CoderRegistry#getCoder

2017-07-24 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16098322#comment-16098322 ] Luke Cwik commented on BEAM-2658: - Arbitrary number based precedence orders are difficult t

[jira] [Comment Edited] (BEAM-2658) SerializableCoder has higher precedence over ProtoCoder in CoderRegistry#getCoder

2017-07-24 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16098322#comment-16098322 ] Luke Cwik edited comment on BEAM-2658 at 7/24/17 12:57 PM: --- Arbit

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #4445

2017-07-24 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3644

2017-07-24 Thread Apache Jenkins Server
See

[3/4] beam git commit: [BEAM-2571] Respect watermark contract in Flink DoFnOperator

2017-07-24 Thread jbonofre
[BEAM-2571] Respect watermark contract in Flink DoFnOperator In Flink, a watermark T specifies that there will be no elements with a timestamp <= T in the future. In Beam, a watermark T specifies that there will not be element with a timestamp < T in the future. This leads to problems when the wat

[1/4] beam git commit: [BEAM-2571] Clarify pushedback variable name in DoFnOperator

2017-07-24 Thread jbonofre
Repository: beam Updated Branches: refs/heads/release-2.1.0 608de07e4 -> 1cf560b4b [BEAM-2571] Clarify pushedback variable name in DoFnOperator Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/5c4a95aa Tree: http://git-wip-us

[4/4] beam git commit: This closes #3625

2017-07-24 Thread jbonofre
This closes #3625 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/1cf560b4 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/1cf560b4 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/1cf560b4 Branch: refs/heads/relea

[2/4] beam git commit: [BEAM-2571] Change DoFnOperator to use Long.MAX_VALUE as max watermark

2017-07-24 Thread jbonofre
[BEAM-2571] Change DoFnOperator to use Long.MAX_VALUE as max watermark This is in line with what Flink does and what BoundedSourceWrapper and UnboundedSourceWrapper do. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/1686805d T

[GitHub] beam pull request #3625: [BEAM-2571] Fix FlinkRunner Watermark issues on 2.1...

2017-07-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3625 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (BEAM-2571) Flink ValidatesRunner failing CombineTest.testSlidingWindowsCombineWithContext

2017-07-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16098448#comment-16098448 ] ASF GitHub Bot commented on BEAM-2571: -- Github user asfgit closed the pull request at:

[jira] [Resolved] (BEAM-2571) Flink ValidatesRunner failing CombineTest.testSlidingWindowsCombineWithContext

2017-07-24 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré resolved BEAM-2571. Resolution: Fixed > Flink ValidatesRunner failing CombineTest.testSlidingWindowsCombi

[jira] [Commented] (BEAM-2441) DSL SQL maven module location and name

2017-07-24 Thread James Xu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16098523#comment-16098523 ] James Xu commented on BEAM-2441: Since there is already many extensions in `sdks/java/exten

[jira] [Assigned] (BEAM-2445) DSL SQL to use service locator pattern to automatically register UDFs

2017-07-24 Thread James Xu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu reassigned BEAM-2445: -- Assignee: James Xu > DSL SQL to use service locator pattern to automatically register UDFs > ---

[jira] [Updated] (BEAM-2587) Build fails due to python sdk

2017-07-24 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré updated BEAM-2587: --- Fix Version/s: 2.2.0 > Build fails due to python sdk > - >

[jira] [Updated] (BEAM-2587) Build fails due to python sdk

2017-07-24 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré updated BEAM-2587: --- Fix Version/s: (was: 2.2.0) 2.1.0 > Build fails due to python sd

[2/2] beam git commit: This closes #3286

2017-07-24 Thread aviemzur
This closes #3286 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/0064fb37 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/0064fb37 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/0064fb37 Branch: refs/heads/maste

[jira] [Commented] (BEAM-2587) Build fails due to python sdk

2017-07-24 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16098571#comment-16098571 ] Jean-Baptiste Onofré commented on BEAM-2587: Let's try to fix that for 2.1.0.

[1/2] beam git commit: [BEAM-2314] Add ValidatesRunner test for merging custom windows

2017-07-24 Thread aviemzur
Repository: beam Updated Branches: refs/heads/master f54072a1b -> 0064fb37a [BEAM-2314] Add ValidatesRunner test for merging custom windows Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/dfa983ce Tree: http://git-wip-us.apa

[GitHub] beam pull request #3286: [BEAM-2314] Add ValidatesRunner test for merging cu...

2017-07-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3286 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (BEAM-2314) Add ValidatesRunner test for custom merging windows

2017-07-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16098573#comment-16098573 ] ASF GitHub Bot commented on BEAM-2314: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3626: [BEAM-1274] Add SSL mutual authentication support

2017-07-24 Thread jbonofre
GitHub user jbonofre opened a pull request: https://github.com/apache/beam/pull/3626 [BEAM-1274] Add SSL mutual authentication support Follow this checklist to help us incorporate your contribution quickly and easily: - [X] Make sure there is a [JIRA issue](https://issues

[jira] [Commented] (BEAM-1274) Add SSL/TLS support to ElasticSearch IO

2017-07-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16098606#comment-16098606 ] ASF GitHub Bot commented on BEAM-1274: -- GitHub user jbonofre opened a pull request:

[GitHub] beam pull request #3627: [BEAM-2636] Make sure we only override the correct ...

2017-07-24 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/3627 [BEAM-2636] Make sure we only override the correct class Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https://i

[jira] [Commented] (BEAM-2636) user_score on DataflowRunner is broken

2017-07-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16098626#comment-16098626 ] ASF GitHub Bot commented on BEAM-2636: -- GitHub user sb2nov opened a pull request:

[jira] [Closed] (BEAM-2314) Add ValidatesRunner test for custom merging windows

2017-07-24 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-2314. -- Resolution: Fixed Fix Version/s: 2.2.0 > Add ValidatesRunner test for custom merging windo

[GitHub] beam pull request #3628: [BEAM-2558] Migrate checkCombineFn in TestUtils to ...

2017-07-24 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/3628 [BEAM-2558] Migrate checkCombineFn in TestUtils to CombineFnTester Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](

[jira] [Commented] (BEAM-2558) Add a CombineFnTester

2017-07-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16098899#comment-16098899 ] ASF GitHub Bot commented on BEAM-2558: -- GitHub user tgroh opened a pull request:

[jira] [Resolved] (BEAM-1928) Populate Runner API Components from the Java SDK

2017-07-24 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-1928. --- Resolution: Fixed Fix Version/s: 2.2.0 Components are populated. Future work to use the Runner-A

[GitHub] beam pull request #3629: Cherry-pick pull #3529 into Release 2.1.0

2017-07-24 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/3629 Cherry-pick pull #3529 into Release 2.1.0 Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https://issues.apache.org

[jira] [Commented] (BEAM-2575) ApexRunner doesn't emit watermarks for additional outputs

2017-07-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16098906#comment-16098906 ] ASF GitHub Bot commented on BEAM-2575: -- GitHub user tgroh opened a pull request:

Build failed in Jenkins: beam_PerformanceTests_Python #139

2017-07-24 Thread Apache Jenkins Server
See Changes: [aviemzur] [BEAM-2314] Add ValidatesRunner test for merging custom windows -- Started by timer [EnvInject] - Loading node environment variables. Bu

[jira] [Updated] (BEAM-2445) DSL SQL to use service locator pattern to automatically register UDFs

2017-07-24 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2445: Labels: (was: dsl_sql_merge) > DSL SQL to use service locator pattern to automatically register UDFs >

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2699

2017-07-24 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PostCommit_Python_Verify #2792

2017-07-24 Thread Apache Jenkins Server
See Changes: [aviemzur] [BEAM-2314] Add ValidatesRunner test for merging custom windows -- [...truncated 575.96 KB...] File was already downloaded /tmp/data

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2700

2017-07-24 Thread Apache Jenkins Server
See

Jenkins build is back to normal : beam_PostCommit_Python_Verify #2793

2017-07-24 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-2672) test merge in BeamSqlUdaf

2017-07-24 Thread Xu Mingmin (JIRA)
Xu Mingmin created BEAM-2672: Summary: test merge in BeamSqlUdaf Key: BEAM-2672 URL: https://issues.apache.org/jira/browse/BEAM-2672 Project: Beam Issue Type: Test Components: dsl-sql

[jira] [Created] (BEAM-2673) BigQuery Sink should use the Load API

2017-07-24 Thread Sourabh Bajaj (JIRA)
Sourabh Bajaj created BEAM-2673: --- Summary: BigQuery Sink should use the Load API Key: BEAM-2673 URL: https://issues.apache.org/jira/browse/BEAM-2673 Project: Beam Issue Type: Bug Comp

[GitHub] beam pull request #3630: We shouldn't write to re-created tables for 2 mins

2017-07-24 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/3630 We shouldn't write to re-created tables for 2 mins Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https://issues.

[jira] [Commented] (BEAM-2673) BigQuery Sink should use the Load API

2017-07-24 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16099069#comment-16099069 ] Ahmet Altay commented on BEAM-2673: --- [~chamikara]] Given the added delay in https://gith

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3645

2017-07-24 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-2674) Runner API translators should own their rehydration

2017-07-24 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-2674: - Summary: Runner API translators should own their rehydration Key: BEAM-2674 URL: https://issues.apache.org/jira/browse/BEAM-2674 Project: Beam Issue Type:

[jira] [Commented] (BEAM-2673) BigQuery Sink should use the Load API

2017-07-24 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16099077#comment-16099077 ] Chamikara Jayalath commented on BEAM-2673: -- I think the fix here is to add a new B

[jira] [Commented] (BEAM-2445) DSL SQL to use service locator pattern to automatically register UDFs

2017-07-24 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16099079#comment-16099079 ] Xu Mingmin commented on BEAM-2445: -- Talked with Luke, we plan to enable service loader for

[jira] [Commented] (BEAM-2673) BigQuery Sink should use the Load API

2017-07-24 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16099098#comment-16099098 ] Ahmet Altay commented on BEAM-2673: --- Is not it also hit when python streaming is used wit

[jira] [Commented] (BEAM-2673) BigQuery Sink should use the Load API

2017-07-24 Thread Sourabh Bajaj (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16099103#comment-16099103 ] Sourabh Bajaj commented on BEAM-2673: - No as there is no Truncate mode in streaming, yo

[jira] [Created] (BEAM-2675) Consolidate ValidatesRunner Groovy Definitions

2017-07-24 Thread Jason Kuster (JIRA)
Jason Kuster created BEAM-2675: -- Summary: Consolidate ValidatesRunner Groovy Definitions Key: BEAM-2675 URL: https://issues.apache.org/jira/browse/BEAM-2675 Project: Beam Issue Type: Improvement

[GitHub] beam pull request #3631: [BEAM-2675] Consolidate ValidatesRunner suite build...

2017-07-24 Thread jasonkuster
GitHub user jasonkuster opened a pull request: https://github.com/apache/beam/pull/3631 [BEAM-2675] Consolidate ValidatesRunner suite building into one file. Signed-off-by: Jason Kuster Follow this checklist to help us incorporate your contribution quickly and easily:

[jira] [Commented] (BEAM-2675) Consolidate ValidatesRunner Groovy Definitions

2017-07-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16099142#comment-16099142 ] ASF GitHub Bot commented on BEAM-2675: -- GitHub user jasonkuster opened a pull request:

[jira] [Created] (BEAM-2676) move BeamSqlRow and BeamSqlRowType to sdk/java/core

2017-07-24 Thread Xu Mingmin (JIRA)
Xu Mingmin created BEAM-2676: Summary: move BeamSqlRow and BeamSqlRowType to sdk/java/core Key: BEAM-2676 URL: https://issues.apache.org/jira/browse/BEAM-2676 Project: Beam Issue Type: Test

[jira] [Commented] (BEAM-2676) move BeamSqlRow and BeamSqlRowType to sdk/java/core

2017-07-24 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16099155#comment-16099155 ] Xu Mingmin commented on BEAM-2676: -- [~robertwb] [~lcwik] for any comments > move BeamSql

[jira] [Resolved] (BEAM-2440) DSL SQL: Reduce visibility to simplify backwards compatibility

2017-07-24 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2440. - Resolution: Fixed Fix Version/s: 2.2.0 > DSL SQL: Reduce visibility to simplify backwards compatibil

[jira] [Updated] (BEAM-2676) move BeamSqlRow and BeamSqlRowType to sdk/java/core

2017-07-24 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2676: - Description: BeamSqlRow/BeamSqlRowType is the fundamental of structured data processing in Beam, like join

[jira] [Resolved] (BEAM-2442) DSL SQL: Public classes/methods should not expose/use calcite types

2017-07-24 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2442. - Resolution: Fixed Fix Version/s: 2.2.0 > DSL SQL: Public classes/methods should not expose/use calci

[jira] [Created] (BEAM-2677) AvroIO.read without specifying a schema

2017-07-24 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-2677: -- Summary: AvroIO.read without specifying a schema Key: BEAM-2677 URL: https://issues.apache.org/jira/browse/BEAM-2677 Project: Beam Issue Type: Bug

[GitHub] beam pull request #3632: [BEAM-2677] AvroIO.parseGenericRecords - schemaless...

2017-07-24 Thread jkff
GitHub user jkff opened a pull request: https://github.com/apache/beam/pull/3632 [BEAM-2677] AvroIO.parseGenericRecords - schemaless AvroIO.read To be done properly, this PR needs https://github.com/apache/beam/pull/3549. R: @mairbek CC: @reuvenlax (please take a look at the

[jira] [Commented] (BEAM-2677) AvroIO.read without specifying a schema

2017-07-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16099182#comment-16099182 ] ASF GitHub Bot commented on BEAM-2677: -- GitHub user jkff opened a pull request: h

[GitHub] beam pull request #3633: [BEAM-2676] move BeamSqlRow and BeamSqlRowType to s...

2017-07-24 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3633 [BEAM-2676] move BeamSqlRow and BeamSqlRowType to sdk/java/core It contains two parts: 1. remove SQL word in the name, `BeamSqlRow` --> `BeamRow` `BeamSqlRowType` --> `BeamRowType`

[jira] [Commented] (BEAM-2676) move BeamSqlRow and BeamSqlRowType to sdk/java/core

2017-07-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16099249#comment-16099249 ] ASF GitHub Bot commented on BEAM-2676: -- GitHub user XuMingmin opened a pull request:

[GitHub] beam pull request #3634: [BEAM-1820] Source.getDefaultOutputCoder() throws C...

2017-07-24 Thread jkff
GitHub user jkff opened a pull request: https://github.com/apache/beam/pull/3634 [BEAM-1820] Source.getDefaultOutputCoder() throws CannotProvideCoderException This is based on https://github.com/apache/beam/pull/3549 by @lgajowy, but it turned out that a lot more needs to be done t

[jira] [Commented] (BEAM-1820) Source.getDefaultOutputCoder() should be @Nullable

2017-07-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16099290#comment-16099290 ] ASF GitHub Bot commented on BEAM-1820: -- GitHub user jkff opened a pull request: h

[GitHub] beam pull request #3635: Runner api read good

2017-07-24 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/3635 Runner api read good Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https://issues.apache.org/jira/projects/BEA

[GitHub] beam pull request #3334: [BEAM-2333] Go to proto and back before running a p...

2017-07-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3334 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[5/5] beam git commit: This closes #3334: [BEAM-2333] Go to proto and back before running a pipeline in Java DirectRunner

2017-07-24 Thread kenn
This closes #3334: [BEAM-2333] Go to proto and back before running a pipeline in Java DirectRunner Dehydrate then rehydrate Pipeline before DirectRunner.run() Add Pipeline rehydration from proto Fix tests that passed invalid input to DynamicDestinations Add stub DisplayDataTranslation P

[4/5] beam git commit: Dehydrate then rehydrate Pipeline before DirectRunner.run()

2017-07-24 Thread kenn
Dehydrate then rehydrate Pipeline before DirectRunner.run() Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/8ca45915 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/8ca45915 Diff: http://git-wip-us.apache.org/repos/asf/be

[2/5] beam git commit: Add stub DisplayDataTranslation

2017-07-24 Thread kenn
Add stub DisplayDataTranslation Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/efe2dc17 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/efe2dc17 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/efe2dc17 Branch: re

[1/5] beam git commit: Fix tests that passed invalid input to DynamicDestinations

2017-07-24 Thread kenn
Repository: beam Updated Branches: refs/heads/master 0064fb37a -> 01408c864 Fix tests that passed invalid input to DynamicDestinations Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/12c277f3 Tree: http://git-wip-us.apache.o

[3/5] beam git commit: Add Pipeline rehydration from proto

2017-07-24 Thread kenn
Add Pipeline rehydration from proto Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/43481595 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/43481595 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/43481595 Branch

[jira] [Commented] (BEAM-2333) Rehydrate Pipeline from Runner API proto

2017-07-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16099405#comment-16099405 ] ASF GitHub Bot commented on BEAM-2333: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3636: [BEAM-79] merge gearpump-runner into master

2017-07-24 Thread manuzhang
GitHub user manuzhang opened a pull request: https://github.com/apache/beam/pull/3636 [BEAM-79] merge gearpump-runner into master Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https://issues.apac

[jira] [Commented] (BEAM-79) Gearpump runner

2017-07-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-79?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16099465#comment-16099465 ] ASF GitHub Bot commented on BEAM-79: GitHub user manuzhang opened a pull request: ht

[GitHub] beam pull request #3637: [BEAM-79] Prepare for merging gearpump-runner

2017-07-24 Thread manuzhang
GitHub user manuzhang opened a pull request: https://github.com/apache/beam/pull/3637 [BEAM-79] Prepare for merging gearpump-runner Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https://issues.ap

[jira] [Commented] (BEAM-79) Gearpump runner

2017-07-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-79?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16099471#comment-16099471 ] ASF GitHub Bot commented on BEAM-79: GitHub user manuzhang opened a pull request: ht

Build failed in Jenkins: beam_PerformanceTests_Python #140

2017-07-24 Thread Apache Jenkins Server
See Changes: [klk] Add stub DisplayDataTranslation [klk] Fix tests that passed invalid input to DynamicDestinations [klk] Add Pipeline rehydration from proto [klk] Dehydrate then rehydrate Pipeline

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2701

2017-07-24 Thread Apache Jenkins Server
See

[jira] [Updated] (BEAM-2575) ApexRunner doesn't emit watermarks for additional outputs

2017-07-24 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré updated BEAM-2575: --- Fix Version/s: 2.1.0 > ApexRunner doesn't emit watermarks for additional outputs > ---

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #4448

2017-07-24 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3646

2017-07-24 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-2678) add a validation in BeamRowType.create

2017-07-24 Thread Xu Mingmin (JIRA)
Xu Mingmin created BEAM-2678: Summary: add a validation in BeamRowType.create Key: BEAM-2678 URL: https://issues.apache.org/jira/browse/BEAM-2678 Project: Beam Issue Type: Improvement C

[1/2] beam git commit: BEAM-2575 ApexRunner doesn't emit watermarks for additional outputs

2017-07-24 Thread jbonofre
Repository: beam Updated Branches: refs/heads/release-2.1.0 1cf560b4b -> c7c777d8b BEAM-2575 ApexRunner doesn't emit watermarks for additional outputs Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/96ff2206 Tree: http://git

[GitHub] beam pull request #3629: Cherry-pick pull #3529 into Release 2.1.0

2017-07-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3629 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[2/2] beam git commit: This closes #3629

2017-07-24 Thread jbonofre
This closes #3629 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c7c777d8 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c7c777d8 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/c7c777d8 Branch: refs/heads/relea

  1   2   >