[jira] [Commented] (BEAM-3073) Connect to Apache ignite via JdbcIO sdk

2017-10-17 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-3073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208847#comment-16208847 ] Jean-Baptiste Onofré commented on BEAM-3073: {{JdbcIO}} just relays on pure JDBC. So, if you

[jira] [Assigned] (BEAM-3073) Connect to Apache ignite via JdbcIO sdk

2017-10-17 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-3073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré reassigned BEAM-3073: -- Assignee: Jean-Baptiste Onofré (was: Reuven Lax) > Connect to Apache ignite

[jira] [Updated] (BEAM-3073) Connect to Apache ignite via JdbcIO sdk

2017-10-17 Thread Rick Lin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rick Lin updated BEAM-3073: --- Description: Hi all, {color:#14892c}I tried to connect Apache Ignite(In-memory) via the beam's

[jira] [Created] (BEAM-3073) Connect to Apache ignite via JdbcIO sdk

2017-10-17 Thread Rick Lin (JIRA)
Rick Lin created BEAM-3073: -- Summary: Connect to Apache ignite via JdbcIO sdk Key: BEAM-3073 URL: https://issues.apache.org/jira/browse/BEAM-3073 Project: Beam Issue Type: New Feature

[jira] [Commented] (BEAM-3039) DatastoreIO.Write fails multiple mutations of same entity

2017-10-17 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208778#comment-16208778 ] Chamikara Jayalath commented on BEAM-3039: -- I agree that if the performance difference is that

[jira] [Assigned] (BEAM-3039) DatastoreIO.Write fails multiple mutations of same entity

2017-10-17 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath reassigned BEAM-3039: Assignee: Reuven Lax (was: Chamikara Jayalath) > DatastoreIO.Write fails multiple

Build failed in Jenkins: beam_PostCommit_Python_Verify #3382

2017-10-17 Thread Apache Jenkins Server
See -- [...truncated 885.21 KB...] copying apache_beam/portability/api/standard_window_fns_pb2.py -> apache-beam-2.3.0.dev0/apache_beam/portability/api copying

[jira] [Updated] (BEAM-2952) How to use KV.OrderByKey

2017-10-17 Thread Rick Lin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rick Lin updated BEAM-2952: --- Priority: Minor (was: Major) > How to use KV.OrderByKey > > > Key:

[jira] [Resolved] (BEAM-3029) BigTable integration tests failing on Dataflow: UserAgent must not be empty

2017-10-17 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath resolved BEAM-3029. -- Resolution: Fixed > BigTable integration tests failing on Dataflow: UserAgent must not

[jira] [Updated] (BEAM-3039) DatastoreIO.Write fails multiple mutations of same entity

2017-10-17 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath updated BEAM-3039: - Affects Version/s: (was: 2.1.0) 2.3.0 > DatastoreIO.Write fails

[jira] [Updated] (BEAM-3039) DatastoreIO.Write fails multiple mutations of same entity

2017-10-17 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath updated BEAM-3039: - Issue Type: Improvement (was: Bug) > DatastoreIO.Write fails multiple mutations of same

[2/2] beam git commit: This closes #3998

2017-10-17 Thread chamikara
This closes #3998 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/09431dae Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/09431dae Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/09431dae Branch:

[1/2] beam git commit: Sets user agent in BigTableIO.Read.getBigTableService().

2017-10-17 Thread chamikara
Repository: beam Updated Branches: refs/heads/release-2.2.0 e7a8620e0 -> 09431daeb Sets user agent in BigTableIO.Read.getBigTableService(). Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ba9d1f99 Tree:

[jira] [Commented] (BEAM-3065) Proto generation installation is broken for Windows

2017-10-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208706#comment-16208706 ] ASF GitHub Bot commented on BEAM-3065: -- GitHub user chamikaramj opened a pull request:

[GitHub] beam pull request #4007: [BEAM-3065] Avoids generating proto files for Windo...

2017-10-17 Thread chamikaramj
GitHub user chamikaramj opened a pull request: https://github.com/apache/beam/pull/4007 [BEAM-3065] Avoids generating proto files for Windows if grpcio-tools is not installed. Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make

Build failed in Jenkins: beam_PerformanceTests_Python #460

2017-10-17 Thread Apache Jenkins Server
See Changes: [kenn] Add RawPTransform.migrate(SdkComponents) for re-serialization [kenn] Add TransformPayloadTranslator.rehydrate to optionally specialize [kenn] Add custom rehydration for

[jira] [Commented] (BEAM-3065) Proto generation installation is broken for Windows

2017-10-17 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208621#comment-16208621 ] Chamikara Jayalath commented on BEAM-3065: -- After an offline chat with Robert, (1) This will not

[jira] [Updated] (BEAM-3065) Proto generation installation is broken for Windows

2017-10-17 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath updated BEAM-3065: - Priority: Major (was: Blocker) > Proto generation installation is broken for Windows >

[jira] [Updated] (BEAM-3065) Proto generation installation is broken for Windows

2017-10-17 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath updated BEAM-3065: - Affects Version/s: (was: 2.2.0) > Proto generation installation is broken for Windows

[jira] [Updated] (BEAM-3065) Proto generation installation is broken for Windows

2017-10-17 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-3065: -- Summary: Proto generation installation is broken for Windows (was: Python SDK installation is

Build failed in Jenkins: beam_PostCommit_Python_Verify #3381

2017-10-17 Thread Apache Jenkins Server
See -- [...truncated 889.59 KB...] copying apache_beam/portability/api/standard_window_fns_pb2.py -> apache-beam-2.3.0.dev0/apache_beam/portability/api copying

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Flink #4099

2017-10-17 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PostCommit_Python_Verify #3380

2017-10-17 Thread Apache Jenkins Server
See Changes: [kenn] Add RawPTransform.migrate(SdkComponents) for re-serialization [kenn] Add TransformPayloadTranslator.rehydrate to optionally specialize [kenn] Add custom rehydration for

[jira] [Updated] (BEAM-3072) Improve error handling at staging time time for DataflowRunner

2017-10-17 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-3072: -- Summary: Improve error handling at staging time time for DataflowRunner (was: Improved error handling

[jira] [Created] (BEAM-3072) Improved error handling at staging time time for DataflowRunner

2017-10-17 Thread Ahmet Altay (JIRA)
Ahmet Altay created BEAM-3072: - Summary: Improved error handling at staging time time for DataflowRunner Key: BEAM-3072 URL: https://issues.apache.org/jira/browse/BEAM-3072 Project: Beam Issue

[jira] [Updated] (BEAM-2674) Runner API translators should own their rehydration

2017-10-17 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2674: -- Issue Type: Improvement (was: New Feature) > Runner API translators should own their

[jira] [Resolved] (BEAM-2674) Runner API translators should own their rehydration

2017-10-17 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-2674. --- Resolution: Fixed Fix Version/s: 2.3.0 > Runner API translators should own their

Build failed in Jenkins: beam_PostCommit_Python_Verify #3379

2017-10-17 Thread Apache Jenkins Server
See Changes: [altay] Wordcount on fnapi pipeline and IT test. -- [...truncated 886.82 KB...] copying apache_beam/portability/api/standard_window_fns_pb2.py

[jira] [Commented] (BEAM-2674) Runner API translators should own their rehydration

2017-10-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208334#comment-16208334 ] ASF GitHub Bot commented on BEAM-2674: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3938: [BEAM-2674] Add custom rehydration; reinstate proto...

2017-10-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3938 ---

[03/14] beam git commit: Reinstate proto round trip in Java DirectRunner

2017-10-17 Thread kenn
Reinstate proto round trip in Java DirectRunner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c0cb28cc Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c0cb28cc Diff:

[07/14] beam git commit: Add custom rehydration for Combine

2017-10-17 Thread kenn
Add custom rehydration for Combine Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/92209c32 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/92209c32 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/92209c32

[01/14] beam git commit: Clearer getOrDefault style in RehydratedComponents

2017-10-17 Thread kenn
Repository: beam Updated Branches: refs/heads/master 0f7736dff -> de7cc05cc Clearer getOrDefault style in RehydratedComponents Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/01103c2c Tree:

[05/14] beam git commit: Add TransformPayloadTranslator.rehydrate to optionally specialize RawPTransform

2017-10-17 Thread kenn
Add TransformPayloadTranslator.rehydrate to optionally specialize RawPTransform Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/10c63e15 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/10c63e15 Diff:

[06/14] beam git commit: Add custom rehydration for TestStream

2017-10-17 Thread kenn
Add custom rehydration for TestStream Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6abf6f52 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/6abf6f52 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/6abf6f52

[02/14] beam git commit: Fix typo in UnboundedSource deserialization error message

2017-10-17 Thread kenn
Fix typo in UnboundedSource deserialization error message Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/11368e08 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/11368e08 Diff:

[14/14] beam git commit: This closes #3938: [BEAM-2674] Add custom rehydration; reinstate proto roundtrip for Java DirectRunner

2017-10-17 Thread kenn
This closes #3938: [BEAM-2674] Add custom rehydration; reinstate proto roundtrip for Java DirectRunner DirectRunner: Replace use of RawPTransform with NotSerializable.forUrn translators Clearer getOrDefault style in RehydratedComponents Add NotSerializable.forUrn to key by URN for

[08/14] beam git commit: Add custom rehydration for ParDo

2017-10-17 Thread kenn
Add custom rehydration for ParDo Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7fb3e793 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7fb3e793 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/7fb3e793 Branch:

[10/14] beam git commit: Add NotSerializable.forUrn to key by URN for non-serializable overrides

2017-10-17 Thread kenn
Add NotSerializable.forUrn to key by URN for non-serializable overrides Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d684ca09 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/d684ca09 Diff:

[04/14] beam git commit: Add RawPTransform.migrate(SdkComponents) for re-serialization

2017-10-17 Thread kenn
Add RawPTransform.migrate(SdkComponents) for re-serialization Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c14455ef Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c14455ef Diff:

[11/14] beam git commit: Support side inputs in CombineTranslation

2017-10-17 Thread kenn
Support side inputs in CombineTranslation Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/5bc77fcf Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/5bc77fcf Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/5bc77fcf

[09/14] beam git commit: Add custom rehydration for WriteFiles

2017-10-17 Thread kenn
Add custom rehydration for WriteFiles Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/187beae4 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/187beae4 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/187beae4

[12/14] beam git commit: Better error message for RehydratedComponents.getCoder

2017-10-17 Thread kenn
Better error message for RehydratedComponents.getCoder Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3d99d07a Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/3d99d07a Diff:

[13/14] beam git commit: DirectRunner: Replace use of RawPTransform with NotSerializable.forUrn translators

2017-10-17 Thread kenn
DirectRunner: Replace use of RawPTransform with NotSerializable.forUrn translators Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/505021e6 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/505021e6 Diff:

[jira] [Created] (BEAM-3071) Map and Multimap views should use structural value for equality comparisons instead of Java equality

2017-10-17 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-3071: --- Summary: Map and Multimap views should use structural value for equality comparisons instead of Java equality Key: BEAM-3071 URL: https://issues.apache.org/jira/browse/BEAM-3071

[jira] [Commented] (BEAM-3070) Add support for windowed filenames in Python SDK

2017-10-17 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208307#comment-16208307 ] Ahmet Altay commented on BEAM-3070: --- Thank you [~while]. cc: [~chamikara] > Add support for windowed

[jira] [Created] (BEAM-3070) Add support for windowed filenames in Python SDK

2017-10-17 Thread Vilhelm von Ehrenheim (JIRA)
Vilhelm von Ehrenheim created BEAM-3070: --- Summary: Add support for windowed filenames in Python SDK Key: BEAM-3070 URL: https://issues.apache.org/jira/browse/BEAM-3070 Project: Beam

[jira] [Commented] (BEAM-2887) Python SDK support for portable pipelines

2017-10-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208264#comment-16208264 ] ASF GitHub Bot commented on BEAM-2887: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3982: [BEAM-2887] Changes for making wordcount example wo...

2017-10-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3982 ---

[2/2] beam git commit: This closes #3982

2017-10-17 Thread altay
This closes #3982 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/0f7736df Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/0f7736df Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/0f7736df Branch:

[1/2] beam git commit: Wordcount on fnapi pipeline and IT test.

2017-10-17 Thread altay
Repository: beam Updated Branches: refs/heads/master 020ef14af -> 0f7736dff Wordcount on fnapi pipeline and IT test. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3050bcc5 Tree:

[jira] [Created] (BEAM-3069) Transform rehydrator registration should be idempotent

2017-10-17 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-3069: - Summary: Transform rehydrator registration should be idempotent Key: BEAM-3069 URL: https://issues.apache.org/jira/browse/BEAM-3069 Project: Beam Issue

[jira] [Assigned] (BEAM-2863) Add support for Side Inputs over the Fn API

2017-10-17 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-2863: --- Assignee: Luke Cwik > Add support for Side Inputs over the Fn API >

[jira] [Commented] (BEAM-2926) Java SDK support for portable side input

2017-10-17 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208182#comment-16208182 ] Luke Cwik commented on BEAM-2926: - The idea is that the Java SDK will migrate away from Iterable as the

[jira] [Commented] (BEAM-3039) DatastoreIO.Write fails multiple mutations of same entity

2017-10-17 Thread Alexander Hoem Rosbach (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208173#comment-16208173 ] Alexander Hoem Rosbach commented on BEAM-3039: -- I agree that when the mutations for the same

[jira] [Commented] (BEAM-3056) dataflow-runner-integration-tests @ beam-examples-java fail in precommit suite on 2.2.0 branch

2017-10-17 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208169#comment-16208169 ] Valentyn Tymofieiev commented on BEAM-3056: --- Thanks, Ken. > dataflow-runner-integration-tests @

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #5055

2017-10-17 Thread Apache Jenkins Server
See Changes: [rangadi] Add missing license header in ProducerSpEL.java. -- [...truncated 2.20 MB...] [JENKINS] Archiving disabled 2017-10-17T18:55:12.574

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Apex #2627

2017-10-17 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-3039) DatastoreIO.Write fails multiple mutations of same entity

2017-10-17 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208140#comment-16208140 ] Chamikara Jayalath commented on BEAM-3039: -- In general case (when mutations for the same entity

[jira] [Commented] (BEAM-3056) dataflow-runner-integration-tests @ beam-examples-java fail in precommit suite on 2.2.0 branch

2017-10-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208137#comment-16208137 ] ASF GitHub Bot commented on BEAM-3056: -- GitHub user kennknowles opened a pull request:

[GitHub] beam pull request #4006: [BEAM-3056] Set Dataflow container version to 2.2.0

2017-10-17 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/4006 [BEAM-3056] Set Dataflow container version to 2.2.0 Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Spark #3312

2017-10-17 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-3056) dataflow-runner-integration-tests @ beam-examples-java fail in precommit suite on 2.2.0 branch

2017-10-17 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208107#comment-16208107 ] Kenneth Knowles commented on BEAM-3056: --- This is actually just an issue with the Dataflow container

[jira] [Assigned] (BEAM-3056) dataflow-runner-integration-tests @ beam-examples-java fail in precommit suite on 2.2.0 branch

2017-10-17 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-3056: - Assignee: Kenneth Knowles (was: Reuven Lax) > dataflow-runner-integration-tests @

[jira] [Comment Edited] (BEAM-3039) DatastoreIO.Write fails multiple mutations of same entity

2017-10-17 Thread Alexander Hoem Rosbach (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208098#comment-16208098 ] Alexander Hoem Rosbach edited comment on BEAM-3039 at 10/17/17 6:28 PM:

[jira] [Commented] (BEAM-3039) DatastoreIO.Write fails multiple mutations of same entity

2017-10-17 Thread Alexander Hoem Rosbach (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208098#comment-16208098 ] Alexander Hoem Rosbach commented on BEAM-3039: -- Would it offer any advantage to use GroupByKey

[jira] [Updated] (BEAM-3068) Document Jenkins ghprb commands

2017-10-17 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-3068: --- Component/s: (was: build-system) testing > Document Jenkins ghprb commands >

[jira] [Created] (BEAM-3068) Document Jenkins ghprb commands

2017-10-17 Thread Mark Liu (JIRA)
Mark Liu created BEAM-3068: -- Summary: Document Jenkins ghprb commands Key: BEAM-3068 URL: https://issues.apache.org/jira/browse/BEAM-3068 Project: Beam Issue Type: Task Components:

[jira] [Commented] (BEAM-3039) DatastoreIO.Write fails multiple mutations of same entity

2017-10-17 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208058#comment-16208058 ] Chamikara Jayalath commented on BEAM-3039: -- You can also try following workaround to remove

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Dataflow #4182

2017-10-17 Thread Apache Jenkins Server
See

[GitHub] beam pull request #4005: Add missing license header in ProducerSpEL.java.

2017-10-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/4005 ---

[2/2] beam git commit: This closes #4005: Add missing license header in ProducerSpEL.java.

2017-10-17 Thread kenn
This closes #4005: Add missing license header in ProducerSpEL.java. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/020ef14a Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/020ef14a Diff:

[1/2] beam git commit: Add missing license header in ProducerSpEL.java.

2017-10-17 Thread kenn
Repository: beam Updated Branches: refs/heads/master 0f9f47de0 -> 020ef14af Add missing license header in ProducerSpEL.java. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/249da9b8 Tree:

[jira] [Commented] (BEAM-2720) Exact-once Kafka sink

2017-10-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16207997#comment-16207997 ] ASF GitHub Bot commented on BEAM-2720: -- GitHub user rangadi opened a pull request:

[GitHub] beam pull request #4005: Add missing license header in ProducerSpEL.java.

2017-10-17 Thread rangadi
GitHub user rangadi opened a pull request: https://github.com/apache/beam/pull/4005 Add missing license header in ProducerSpEL.java. This is a quick follow up to BEAM-2720 to add missing Apache license header. +R: @kennknowles, thanks for pointing out. You can merge this

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #5054

2017-10-17 Thread Apache Jenkins Server
See Changes: [kenn] Relocate everything shaded by Java SDK harness -- [...truncated 299.84 KB...] 2017-10-17T16:49:59.919 [INFO] This project has been

[jira] [Commented] (BEAM-3049) Java SDK Harness bundles non-relocated code, including Dataflow runner

2017-10-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16207896#comment-16207896 ] ASF GitHub Bot commented on BEAM-3049: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #4003: [BEAM-3049] Relocate everything shaded by Java SDK ...

2017-10-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/4003 ---

[2/2] beam git commit: This closes #4003: [BEAM-3049] Relocate everything shaded by Java SDK harness

2017-10-17 Thread kenn
This closes #4003: [BEAM-3049] Relocate everything shaded by Java SDK harness Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/0f9f47de Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/0f9f47de Diff:

[1/2] beam git commit: Relocate everything shaded by Java SDK harness

2017-10-17 Thread kenn
Repository: beam Updated Branches: refs/heads/master 0d2a39bd8 -> 0f9f47de0 Relocate everything shaded by Java SDK harness Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/00890939 Tree:

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #5052

2017-10-17 Thread Apache Jenkins Server
See Changes: [rangadi] Kafka exactly-once sink. Tested manually with direct runner and on [rangadi] Disable other sink tests. Need to fix how tests use global [rangadi] 1) Add a note about

[jira] [Commented] (BEAM-2720) Exact-once Kafka sink

2017-10-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16207832#comment-16207832 ] ASF GitHub Bot commented on BEAM-2720: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3612: [BEAM-2720] Kafka exactly-once sink

2017-10-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3612 ---

[10/13] beam git commit: Close producers after one minute of inactivity. This closes producers when ranges move to other workers. Misc fixes around.

2017-10-17 Thread reuvenlax
Close producers after one minute of inactivity. This closes producers when ranges move to other workers. Misc fixes around. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f4f6105e Tree:

[12/13] beam git commit: update JavaDoc for withEOS().

2017-10-17 Thread reuvenlax
update JavaDoc for withEOS(). Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/686b22f3 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/686b22f3 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/686b22f3 Branch:

[11/13] beam git commit: update JavaDoc for withEOS().

2017-10-17 Thread reuvenlax
update JavaDoc for withEOS(). Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/0d5a3e26 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/0d5a3e26 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/0d5a3e26 Branch:

[01/13] beam git commit: Kafka exactly-once sink. Tested manually with direct runner and on dataflow.

2017-10-17 Thread reuvenlax
Repository: beam Updated Branches: refs/heads/master 9524cbd88 -> 0d2a39bd8 Kafka exactly-once sink. Tested manually with direct runner and on dataflow. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d745cc9d Tree:

[05/13] beam git commit: assign a random shard id once in setup(), rather than each time in processElement().

2017-10-17 Thread reuvenlax
assign a random shard id once in setup(), rather than each time in processElement(). Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/236484b0 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/236484b0 Diff:

[08/13] beam git commit: Add runner check. Add withReadCommit() to reader.

2017-10-17 Thread reuvenlax
Add runner check. Add withReadCommit() to reader. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/5e280fad Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/5e280fad Diff:

[03/13] beam git commit: Add basic metrics.

2017-10-17 Thread reuvenlax
Add basic metrics. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/99f55419 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/99f55419 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/99f55419 Branch:

[06/13] beam git commit: Improve how we use MockProducer in tests. Remove global instance and use a map to use same producer instance inside beam and test verifier.

2017-10-17 Thread reuvenlax
Improve how we use MockProducer in tests. Remove global instance and use a map to use same producer instance inside beam and test verifier. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3bd4085d Tree:

[13/13] beam git commit: This closes #3612

2017-10-17 Thread reuvenlax
This closes #3612 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/0d2a39bd Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/0d2a39bd Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/0d2a39bd Branch:

[02/13] beam git commit: Disable other sink tests. Need to fix how tests use global MOCK_PRODUCER. A few more other minor changes.

2017-10-17 Thread reuvenlax
Disable other sink tests. Need to fix how tests use global MOCK_PRODUCER. A few more other minor changes. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6bf618d9 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/6bf618d9

[09/13] beam git commit: Support version 0.11 through ProducerSpEL (reflection). Tests work with both 0.11 and older versions.

2017-10-17 Thread reuvenlax
Support version 0.11 through ProducerSpEL (reflection). Tests work with both 0.11 and older versions. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/265e7c74 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/265e7c74

[07/13] beam git commit: Input PCollection has the coder for elements. No need to ask for them explicitly.

2017-10-17 Thread reuvenlax
Input PCollection has the coder for elements. No need to ask for them explicitly. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/5767156f Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/5767156f Diff:

[04/13] beam git commit: 1) Add a note about metadata expiration. 2) Fetch number of partitions if numShards is not set.

2017-10-17 Thread reuvenlax
1) Add a note about metadata expiration. 2) Fetch number of partitions if numShards is not set. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d9c95f0e Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/d9c95f0e Diff:

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #5051

2017-10-17 Thread Apache Jenkins Server
See -- [...truncated 2.25 MB...] 2017-10-17T13:27:50.881 [INFO] 2017-10-17T13:27:50.882 [INFO] --- maven-dependency-plugin:3.0.1:analyze-only (default) @

[jira] [Comment Edited] (BEAM-2840) BigQueryIO write is slow/fail with a bounded source

2017-10-17 Thread Vincent Spiewak (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16207613#comment-16207613 ] Vincent Spiewak edited comment on BEAM-2840 at 10/17/17 1:06 PM: -

[jira] [Commented] (BEAM-2840) BigQueryIO write is slow/fail with a bounded source

2017-10-17 Thread Vincent Spiewak (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16207613#comment-16207613 ] Vincent Spiewak commented on BEAM-2840: --- [~reuvenlax] You can see the error at

[jira] [Comment Edited] (BEAM-2840) BigQueryIO write is slow/fail with a bounded source

2017-10-17 Thread Vincent Spiewak (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16207613#comment-16207613 ] Vincent Spiewak edited comment on BEAM-2840 at 10/17/17 1:06 PM: -

  1   2   >