[jira] [Created] (BEAM-2376) JdbcIO should allow multiple statements

2017-05-29 Thread Rik Nauta (JIRA) 
Rik Nauta created BEAM-2376:
---

 Summary: JdbcIO should allow multiple statements
 Key: BEAM-2376
 URL: https://issues.apache.org/jira/browse/BEAM-2376
 Project: Beam
  Issue Type: Improvement
  Components: sdk-java-extensions
Affects Versions: Not applicable
Reporter: Rik Nauta
Assignee: Davor Bonaci
 Fix For: Not applicable


Right now the JdbcIO pipeline adds a single Write statement to the batch per 
PCollection element. This makes it difficult to execute several statements that 
require a specific order (for instance due to constraints in the DB), since 
JDBC doesn't allow multiple statements in a single "addBatch". 

For instance, I can't execute {{INSERT INTO users (id) VALUES (test); INSERT 
INTO profiles (user_id, name) VALUES (test, 'John');}}

There's several ways we could solve this, one would be not to return a PDone 
but just pass through the data so that you can at least chain several Writes.

Alternatively we could take the Statement string, split on the ";" character if 
there is one and apply each statement to the either an array of argument 
setters or the same setter with an additional {{statement_#}} parameter. And 
then we simply don't commit a batch between these statements.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Assigned] (BEAM-2376) JdbcIO should allow multiple statements

2017-05-29 Thread JIRA 

 [ 
https://issues.apache.org/jira/browse/BEAM-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jean-Baptiste Onofré reassigned BEAM-2376:
--

Assignee: Jean-Baptiste Onofré  (was: Davor Bonaci)

> JdbcIO should allow multiple statements
> ---
>
> Key: BEAM-2376
> URL: https://issues.apache.org/jira/browse/BEAM-2376
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-java-extensions
>Affects Versions: Not applicable
>Reporter: Rik Nauta
>Assignee: Jean-Baptiste Onofré
> Fix For: Not applicable
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> Right now the JdbcIO pipeline adds a single Write statement to the batch per 
> PCollection element. This makes it difficult to execute several statements 
> that require a specific order (for instance due to constraints in the DB), 
> since JDBC doesn't allow multiple statements in a single "addBatch". 
> For instance, I can't execute {{INSERT INTO users (id) VALUES (test); INSERT 
> INTO profiles (user_id, name) VALUES (test, 'John');}}
> There's several ways we could solve this, one would be not to return a PDone 
> but just pass through the data so that you can at least chain several Writes.
> Alternatively we could take the Statement string, split on the ";" character 
> if there is one and apply each statement to the either an array of argument 
> setters or the same setter with an additional {{statement_#}} parameter. And 
> then we simply don't commit a batch between these statements.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (BEAM-2376) JdbcIO should allow multiple statements

2017-05-29 Thread JIRA 

[ 
https://issues.apache.org/jira/browse/BEAM-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16028249#comment-16028249
 ] 

Jean-Baptiste Onofré commented on BEAM-2376:


Good idea. Let me think about that and propose a way to achieve that.

> JdbcIO should allow multiple statements
> ---
>
> Key: BEAM-2376
> URL: https://issues.apache.org/jira/browse/BEAM-2376
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-java-extensions
>Affects Versions: Not applicable
>Reporter: Rik Nauta
>Assignee: Jean-Baptiste Onofré
> Fix For: Not applicable
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> Right now the JdbcIO pipeline adds a single Write statement to the batch per 
> PCollection element. This makes it difficult to execute several statements 
> that require a specific order (for instance due to constraints in the DB), 
> since JDBC doesn't allow multiple statements in a single "addBatch". 
> For instance, I can't execute {{INSERT INTO users (id) VALUES (test); INSERT 
> INTO profiles (user_id, name) VALUES (test, 'John');}}
> There's several ways we could solve this, one would be not to return a PDone 
> but just pass through the data so that you can at least chain several Writes.
> Alternatively we could take the Statement string, split on the ";" character 
> if there is one and apply each statement to the either an array of argument 
> setters or the same setter with an additional {{statement_#}} parameter. And 
> then we simply don't commit a batch between these statements.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall_Windows #68

2017-05-29 Thread Apache Jenkins Server 
See 


--
[...truncated 351.70 KB...]
2017-05-29T12:04:21.771 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-core/1.2.0/grpc-core-1.2.0.pom
 (3 KB at 260.1 KB/sec)
2017-05-29T12:04:21.777 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/errorprone/error_prone_annotations/2.0.15/error_prone_annotations-2.0.15.pom
2017-05-29T12:04:21.788 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/google/errorprone/error_prone_annotations/2.0.15/error_prone_annotations-2.0.15.pom
 (2 KB at 177.3 KB/sec)
2017-05-29T12:04:21.791 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/errorprone/error_prone_parent/2.0.15/error_prone_parent-2.0.15.pom
2017-05-29T12:04:21.803 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/google/errorprone/error_prone_parent/2.0.15/error_prone_parent-2.0.15.pom
 (6 KB at 455.1 KB/sec)
2017-05-29T12:04:21.808 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/code/findbugs/jsr305/3.0.1/jsr305-3.0.1.pom
2017-05-29T12:04:21.818 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/google/code/findbugs/jsr305/3.0.1/jsr305-3.0.1.pom
 (5 KB at 418.6 KB/sec)
2017-05-29T12:04:21.823 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-context/1.2.0/grpc-context-1.2.0.pom
2017-05-29T12:04:21.833 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-context/1.2.0/grpc-context-1.2.0.pom
 (2 KB at 155.2 KB/sec)
2017-05-29T12:04:21.838 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/instrumentation/instrumentation-api/0.3.0/instrumentation-api-0.3.0.pom
2017-05-29T12:04:21.850 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/google/instrumentation/instrumentation-api/0.3.0/instrumentation-api-0.3.0.pom
 (2 KB at 121.9 KB/sec)
2017-05-29T12:04:21.856 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-protobuf/1.2.0/grpc-protobuf-1.2.0.pom
2017-05-29T12:04:21.865 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-protobuf/1.2.0/grpc-protobuf-1.2.0.pom
 (3 KB at 259.3 KB/sec)
2017-05-29T12:04:21.869 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/protobuf/protobuf-java-util/3.2.0/protobuf-java-util-3.2.0.pom
2017-05-29T12:04:21.885 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/google/protobuf/protobuf-java-util/3.2.0/protobuf-java-util-3.2.0.pom
 (5 KB at 259.3 KB/sec)
2017-05-29T12:04:21.890 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/code/gson/gson/2.7/gson-2.7.pom
2017-05-29T12:04:21.900 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/google/code/gson/gson/2.7/gson-2.7.pom 
(2 KB at 141.1 KB/sec)
2017-05-29T12:04:21.905 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/code/gson/gson-parent/2.7/gson-parent-2.7.pom
2017-05-29T12:04:21.915 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/google/code/gson/gson-parent/2.7/gson-parent-2.7.pom
 (4 KB at 349.6 KB/sec)
2017-05-29T12:04:21.919 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-protobuf-lite/1.2.0/grpc-protobuf-lite-1.2.0.pom
2017-05-29T12:04:21.931 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-protobuf-lite/1.2.0/grpc-protobuf-lite-1.2.0.pom
 (3 KB at 172.9 KB/sec)
2017-05-29T12:04:21.935 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-stub/1.2.0/grpc-stub-1.2.0.pom
2017-05-29T12:04:21.946 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-stub/1.2.0/grpc-stub-1.2.0.pom
 (3 KB at 184.5 KB/sec)
2017-05-29T12:04:21.961 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-core/1.2.0/grpc-core-1.2.0.jar
2017-05-29T12:04:21.961 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/errorprone/error_prone_annotations/2.0.15/error_prone_annotations-2.0.15.jar
2017-05-29T12:04:21.961 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/protobuf/protobuf-java/3.2.0/protobuf-java-3.2.0.jar
2017-05-29T12:04:21.961 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/code/findbugs/jsr305/3.0.1/jsr305-3.0.1.jar
2017-05-29T12:04:21.962 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-context/1.2.0/grpc-context-1.2.0.jar
2017-05-29T12:04:21.983 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/google/errorprone/error_prone_annotations/2.0.15/error_prone_annotations-2.0.15.jar
 (11 KB at 424.5 KB/sec)
2017-05-29T12:04:21.983 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/instrumentation/instrumentation-api/0.3.0/instrumentation-api-0.3.0.jar
2017-05-29T12:04:21.987 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-context/1.2.0/grpc-context-1.2.0.jar
 (20 KB at 759.5 KB/sec)
2017-05-29T12:04:21.987

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #2961

2017-05-29 Thread Apache Jenkins Server 
See

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Apex #1591

2017-05-29 Thread Apache Jenkins Server 
See

[jira] [Commented] (BEAM-2377) Cross compile flink runner to scala 2.11

2017-05-29 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/BEAM-2377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16028407#comment-16028407
 ] 

ASF GitHub Bot commented on BEAM-2377:
--

GitHub user neurolabs opened a pull request:

https://github.com/apache/beam/pull/3255

[BEAM-2377] Allow usage of scala 2.11 dependencies as well as cross 
compilation for flink runner

Flink allows being built against scala 2.11. But the Flink Runner did
not.

This commit alleviates that, as well as allowing for ensuring that
builds work against scala 2.11 dependencies. It introduces a
scala.version mvn property that is set to 2.10 as a default, as well as
a mvn profile that overrides the scala version to 2.11.

I'm not sure about the granularity (should I only enable this for the
flink runner, or should the whole build be verified against 2.11). So
please comment on this PR.

It would be nice if you could cross publish the flink runner for
scala-2.11 based on this pull request.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/neurolabs/beam master

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam/pull/3255.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3255


commit 3e2564d65fb371abd0caf663785faee4f1f73120
Author: Ole Langbehn 
Date:   2017-05-29T14:14:18Z

Allow usage of scala 2.11 dependencies as well as cross compilation for 
flink runner

Flink allows being built against scala 2.11. But the Flink Runner did
not.

This commit alleviates that, as well as allowing for ensuring that
builds work against scala 2.11 dependencies. It introduces a
scala.version mvn property that is set to 2.10 as a default, as well as
a mvn profile that overrides the scala version to 2.11.




> Cross compile flink runner to scala 2.11
> 
>
> Key: BEAM-2377
> URL: https://issues.apache.org/jira/browse/BEAM-2377
> Project: Beam
>  Issue Type: Improvement
>  Components: runner-flink
>Reporter: Ole Langbehn
>Assignee: Aljoscha Krettek
>
> The flink runner is compiled for flink built against scala 2.10. flink cross 
> compiles its scala artifacts against 2.10 and 2.11.
> In order to make it possible to use beam with the flink runner in scala 2.11 
> projects, it would be nice if you could publish the flink runner for 2.11 
> next to 2.10.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] beam pull request #3255: [BEAM-2377] Allow usage of scala 2.11 dependencies ...

2017-05-29 Thread neurolabs 
GitHub user neurolabs opened a pull request:

https://github.com/apache/beam/pull/3255

[BEAM-2377] Allow usage of scala 2.11 dependencies as well as cross 
compilation for flink runner

Flink allows being built against scala 2.11. But the Flink Runner did
not.

This commit alleviates that, as well as allowing for ensuring that
builds work against scala 2.11 dependencies. It introduces a
scala.version mvn property that is set to 2.10 as a default, as well as
a mvn profile that overrides the scala version to 2.11.

I'm not sure about the granularity (should I only enable this for the
flink runner, or should the whole build be verified against 2.11). So
please comment on this PR.

It would be nice if you could cross publish the flink runner for
scala-2.11 based on this pull request.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/neurolabs/beam master

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam/pull/3255.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3255


commit 3e2564d65fb371abd0caf663785faee4f1f73120
Author: Ole Langbehn 
Date:   2017-05-29T14:14:18Z

Allow usage of scala 2.11 dependencies as well as cross compilation for 
flink runner

Flink allows being built against scala 2.11. But the Flink Runner did
not.

This commit alleviates that, as well as allowing for ensuring that
builds work against scala 2.11 dependencies. It introduces a
scala.version mvn property that is set to 2.10 as a default, as well as
a mvn profile that overrides the scala version to 2.11.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (BEAM-2377) Cross compile flink runner to scala 2.11

2017-05-29 Thread Ole Langbehn (JIRA) 
Ole Langbehn created BEAM-2377:
--

 Summary: Cross compile flink runner to scala 2.11
 Key: BEAM-2377
 URL: https://issues.apache.org/jira/browse/BEAM-2377
 Project: Beam
  Issue Type: Improvement
  Components: runner-flink
Reporter: Ole Langbehn
Assignee: Aljoscha Krettek


The flink runner is compiled for flink built against scala 2.10. flink cross 
compiles its scala artifacts against 2.10 and 2.11.

In order to make it possible to use beam with the flink runner in scala 2.11 
projects, it would be nice if you could publish the flink runner for 2.11 next 
to 2.10.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] beam pull request #3256: [BEAM-2314] Add ValidatesRunner test for merging cu...

2017-05-29 Thread echauchot 
GitHub user echauchot opened a pull request:

https://github.com/apache/beam/pull/3256

[BEAM-2314] Add ValidatesRunner test for merging custom windows

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [X] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [X] Make sure tests pass via `mvn clean verify`.
 - [X] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [X] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.pdf).

---
R: @aljoscha 
CC: @jbonofre 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/echauchot/beam BEAM-2314_merging_windows_test

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam/pull/3256.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3256


commit 2b180ddcbdc7b21d85ed81cec381627012a4303d
Author: Etienne Chauchot 
Date:   2017-05-29T10:05:51Z

[BEAM-2314] Add ValidatesRunner test for merging custom windows




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Commented] (BEAM-2314) Add ValidatesRunner test for custom merging windows

2017-05-29 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/BEAM-2314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16028429#comment-16028429
 ] 

ASF GitHub Bot commented on BEAM-2314:
--

GitHub user echauchot opened a pull request:

https://github.com/apache/beam/pull/3256

[BEAM-2314] Add ValidatesRunner test for merging custom windows

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [X] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [X] Make sure tests pass via `mvn clean verify`.
 - [X] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [X] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.pdf).

---
R: @aljoscha 
CC: @jbonofre 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/echauchot/beam BEAM-2314_merging_windows_test

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam/pull/3256.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3256


commit 2b180ddcbdc7b21d85ed81cec381627012a4303d
Author: Etienne Chauchot 
Date:   2017-05-29T10:05:51Z

[BEAM-2314] Add ValidatesRunner test for merging custom windows




> Add ValidatesRunner test for custom merging windows
> ---
>
> Key: BEAM-2314
> URL: https://issues.apache.org/jira/browse/BEAM-2314
> Project: Beam
>  Issue Type: Improvement
>  Components: testing
>Reporter: Aljoscha Krettek
>Assignee: Etienne Chauchot
>
> While working on BEAM-160 it was discovered that not all Runners supported 
> custom merging {{WindowFns}}. This is now fixed but we should still add a 
> {{ValidatesRunner}} test for this.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Assigned] (BEAM-2378) extend join-library to support FULL OUTER JOIN

2017-05-29 Thread James Xu (JIRA) 

 [ 
https://issues.apache.org/jira/browse/BEAM-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

James Xu reassigned BEAM-2378:
--

Assignee: (was: Davor Bonaci)

> extend join-library to support FULL OUTER JOIN
> --
>
> Key: BEAM-2378
> URL: https://issues.apache.org/jira/browse/BEAM-2378
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-java-extensions
>Reporter: James Xu
>
> Currently INNER, LEFT OUTER, RIGHT OUTER are supported, would be nice to 
> support FULL OUTER JOIN.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (BEAM-2378) extend join-library to support FULL OUTER JOIN

2017-05-29 Thread James Xu (JIRA) 
James Xu created BEAM-2378:
--

 Summary: extend join-library to support FULL OUTER JOIN
 Key: BEAM-2378
 URL: https://issues.apache.org/jira/browse/BEAM-2378
 Project: Beam
  Issue Type: Bug
  Components: sdk-java-extensions
Reporter: James Xu
Assignee: Davor Bonaci


Currently INNER, LEFT OUTER, RIGHT OUTER are supported, would be nice to 
support FULL OUTER JOIN.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (BEAM-2378) extend join-library to support FULL OUTER JOIN

2017-05-29 Thread James Xu (JIRA) 

[ 
https://issues.apache.org/jira/browse/BEAM-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16028432#comment-16028432
 ] 

James Xu commented on BEAM-2378:


[~davor] if it is a reasonable, I will submit a PR for it.

> extend join-library to support FULL OUTER JOIN
> --
>
> Key: BEAM-2378
> URL: https://issues.apache.org/jira/browse/BEAM-2378
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-java-extensions
>Reporter: James Xu
>
> Currently INNER, LEFT OUTER, RIGHT OUTER are supported, would be nice to 
> support FULL OUTER JOIN.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #2962

2017-05-29 Thread Apache Jenkins Server 
See

[jira] [Issue Comment Deleted] (BEAM-2112) Add support for PCollectionView in spark runner in streaming mode

2017-05-29 Thread Etienne Chauchot (JIRA) 

 [ 
https://issues.apache.org/jira/browse/BEAM-2112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Etienne Chauchot updated BEAM-2112:
---
Comment: was deleted

(was: I will submit a PR with a more specialized test than Nexmark query7. In 
the mean time NexMark can be used to test
)

> Add support for PCollectionView in spark runner in streaming mode
> -
>
> Key: BEAM-2112
> URL: https://issues.apache.org/jira/browse/BEAM-2112
> Project: Beam
>  Issue Type: New Feature
>  Components: runner-spark
>Reporter: Etienne Chauchot
>Assignee: Amit Sela
>
> As a test, Nexmark query7 can be used
> run Nexmark query7 (https://github.com/iemejia/beam/tree/BEAM-160-nexmark) in 
> streaming mode using Spark.
> Run main in
> {code}org.apache.beam.integration.nexmark.drivers.NexmarkSparkDriver{code}
> with VMOptions:
> {code} -Dspark.ui.enabled=false -DSPARK_LOCAL_IP=localhost 
> -Dsun.io.serialization.extendedDebugInfo=true {code}
> with Program arguments:
> {code}--query=7  --streaming=true --numEventGenerators=4 
> --manageResources=false --monitorJobs=true --enforceEncodability=false 
> --enforceImmutability=false{code}
> StackTrace is 
> {code}
> Exception in thread "main" java.lang.IllegalStateException: No 
> TransformEvaluator registered for UNBOUNDED transform class 
> org.apache.beam.sdk.transforms.View$CreatePCollectionView
>   at 
> com.google.common.base.Preconditions.checkState(Preconditions.java:518)
>   at 
> org.apache.beam.runners.spark.translation.streaming.StreamingTransformTranslator$Translator.translateUnbounded(StreamingTransformTranslator.java:529)
>   at 
> org.apache.beam.runners.spark.SparkRunner$Evaluator.translate(SparkRunner.java:435)
>   at 
> org.apache.beam.runners.spark.SparkRunner$Evaluator.doVisitTransform(SparkRunner.java:405)
>   at 
> org.apache.beam.runners.spark.SparkRunner$Evaluator.visitPrimitiveTransform(SparkRunner.java:395)
>   at 
> org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:488)
>   at 
> org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:483)
>   at 
> org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:483)
>   at 
> org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:483)
>   at 
> org.apache.beam.sdk.runners.TransformHierarchy$Node.access$400(TransformHierarchy.java:232)
>   at 
> org.apache.beam.sdk.runners.TransformHierarchy.visit(TransformHierarchy.java:207)
>   at org.apache.beam.sdk.Pipeline.traverseTopologically(Pipeline.java:384)
>   at 
> org.apache.beam.runners.spark.translation.streaming.SparkRunnerStreamingContextFactory.call(SparkRunnerStreamingContextFactory.java:88)
>   at 
> org.apache.beam.runners.spark.translation.streaming.SparkRunnerStreamingContextFactory.call(SparkRunnerStreamingContextFactory.java:47)
>   at 
> org.apache.spark.streaming.api.java.JavaStreamingContext$$anonfun$10.apply(JavaStreamingContext.scala:776)
>   at 
> org.apache.spark.streaming.api.java.JavaStreamingContext$$anonfun$10.apply(JavaStreamingContext.scala:775)
>   at scala.Option.getOrElse(Option.scala:120)
>   at 
> org.apache.spark.streaming.StreamingContext$.getOrCreate(StreamingContext.scala:864)
>   at 
> org.apache.spark.streaming.api.java.JavaStreamingContext$.getOrCreate(JavaStreamingContext.scala:775)
>   at 
> org.apache.spark.streaming.api.java.JavaStreamingContext.getOrCreate(JavaStreamingContext.scala)
>   at org.apache.beam.runners.spark.SparkRunner.run(SparkRunner.java:155)
>   at org.apache.beam.runners.spark.SparkRunner.run(SparkRunner.java:85)
>   at org.apache.beam.sdk.Pipeline.run(Pipeline.java:277)
>   at 
> org.apache.beam.integration.nexmark.NexmarkRunner.run(NexmarkRunner.java:1281)
>   at 
> org.apache.beam.integration.nexmark.NexmarkDriver.runAll(NexmarkDriver.java:69)
>   at 
> org.apache.beam.integration.nexmark.drivers.NexmarkSparkDriver.main(NexmarkSparkDriver.java:46)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:498)
>   at com.intellij.rt.execution.application.AppMain.main(AppMain.java:147)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[2/2] beam git commit: This closes #3249

2017-05-29 Thread dhalperi 
This closes #3249


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2cb4b03d
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/2cb4b03d
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/2cb4b03d

Branch: refs/heads/master
Commit: 2cb4b03dea89d4269b493fc276747366e04e65f7
Parents: 27dd7a9 320756d
Author: Daniel Halperin 
Authored: Mon May 29 09:34:12 2017 -0700
Committer: Daniel Halperin 
Committed: Mon May 29 09:34:12 2017 -0700

--
 pom.xml  | 2 +-
 .../src/test/java/org/apache/beam/sdk/coders/AvroCoderTest.java  | 4 ++--
 2 files changed, 3 insertions(+), 3 deletions(-)
--

[1/2] beam git commit: Upgrade Avro dependency to version 1.8.2

2017-05-29 Thread dhalperi 
Repository: beam
Updated Branches:
  refs/heads/master 27dd7a9e4 -> 2cb4b03de


Upgrade Avro dependency to version 1.8.2


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/320756df
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/320756df
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/320756df

Branch: refs/heads/master
Commit: 320756df97fbdab2fda732cfe66831025d502af8
Parents: 27dd7a9
Author: Ismaël Mejía 
Authored: Sat May 27 21:21:37 2017 +0200
Committer: Ismaël Mejía 
Committed: Mon May 29 00:37:12 2017 +0200

--
 pom.xml  | 2 +-
 .../src/test/java/org/apache/beam/sdk/coders/AvroCoderTest.java  | 4 ++--
 2 files changed, 3 insertions(+), 3 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/beam/blob/320756df/pom.xml
--
diff --git a/pom.xml b/pom.xml
index 398cda0..3e302e7 100644
--- a/pom.xml
+++ b/pom.xml
@@ -105,7 +105,7 @@
 1.9
 2.24.0
 1.0.0-rc2
-1.8.1
+1.8.2
 v2-rev295-1.22.0
 0.9.6.2
 v1-rev6-1.22.0

http://git-wip-us.apache.org/repos/asf/beam/blob/320756df/sdks/java/core/src/test/java/org/apache/beam/sdk/coders/AvroCoderTest.java
--
diff --git 
a/sdks/java/core/src/test/java/org/apache/beam/sdk/coders/AvroCoderTest.java 
b/sdks/java/core/src/test/java/org/apache/beam/sdk/coders/AvroCoderTest.java
index 8942a9e..60b3232 100644
--- a/sdks/java/core/src/test/java/org/apache/beam/sdk/coders/AvroCoderTest.java
+++ b/sdks/java/core/src/test/java/org/apache/beam/sdk/coders/AvroCoderTest.java
@@ -44,7 +44,7 @@ import java.util.SortedMap;
 import java.util.SortedSet;
 import java.util.TreeMap;
 import java.util.TreeSet;
-import org.apache.avro.AvroTypeException;
+import org.apache.avro.AvroRuntimeException;
 import org.apache.avro.Schema;
 import org.apache.avro.SchemaBuilder;
 import org.apache.avro.generic.GenericData;
@@ -502,7 +502,7 @@ public class AvroCoderTest {
 try {
   ReflectData.get().getSchema(SubclassHidingParent.class);
   fail("Expected AvroTypeException");
-} catch (AvroTypeException e) {
+} catch (AvroRuntimeException e) {
   assertThat(e.getMessage(), containsString("mapField"));
   assertThat(e.getMessage(), containsString("two fields named"));
 }

[GitHub] beam pull request #3249: Upgrade Avro dependency to version 1.8.2

2017-05-29 Thread asfgit 
Github user asfgit closed the pull request at:

https://github.com/apache/beam/pull/3249


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (BEAM-2379) SpannerIO tests are failing

2017-05-29 Thread JIRA 
Jean-Baptiste Onofré created BEAM-2379:
--

 Summary: SpannerIO tests are failing
 Key: BEAM-2379
 URL: https://issues.apache.org/jira/browse/BEAM-2379
 Project: Beam
  Issue Type: Bug
  Components: sdk-java-extensions
Reporter: Jean-Baptiste Onofré
Assignee: Davor Bonaci


When performing a complete {{mvn clean install}}, the build is failing on 
{{SpannerIO}} tests:

{code}
[ERROR] Errors: 
[ERROR]   SpannerIOTest.batching:129 » UserCode 
java.lang.IllegalArgumentException: A pr...
[ERROR]   SpannerIOTest.batchingGroups:155 » UserCode 
java.lang.IllegalArgumentException...
[ERROR]   SpannerIOTest.noBatching:178 » UserCode 
java.lang.IllegalArgumentException: A ...
[ERROR]   SpannerIOTest.singleMutationPipeline » UncheckedExecution 
org.apache.beam.sdk
{code}

These tests fail with the same reason, here's the complete stack trace:

{code}
[ERROR] batchingGroups(org.apache.beam.sdk.io.gcp.spanner.SpannerIOTest)  Time 
elapsed: 0.004 s  <<< ERROR!
org.apache.beam.sdk.util.UserCodeException: java.lang.IllegalArgumentException: 
A project ID is required for this service but could not be determined from the 
builder or the environment.  Please set a project ID using the builder.
at 
org.apache.beam.sdk.util.UserCodeException.wrap(UserCodeException.java:36)
at 
org.apache.beam.sdk.io.gcp.spanner.SpannerIO$SpannerWriteFn$DoFnInvoker.invokeSetup(Unknown
 Source)
at 
org.apache.beam.sdk.transforms.DoFnTester.initializeState(DoFnTester.java:745)
at 
org.apache.beam.sdk.transforms.DoFnTester.startBundle(DoFnTester.java:219)
at 
org.apache.beam.sdk.transforms.DoFnTester.processBundle(DoFnTester.java:183)
at 
org.apache.beam.sdk.io.gcp.spanner.SpannerIOTest.batchingGroups(SpannerIOTest.java:155)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at 
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at 
org.apache.beam.sdk.testing.TestPipeline$1.evaluate(TestPipeline.java:321)
at 
org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:239)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at org.junit.runners.Suite.runChild(Suite.java:128)
at org.junit.runners.Suite.runChild(Suite.java:27)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at org.apache.maven.surefire.junitcore.JUnitCore.run(JUnitCore.java:55)
at 
org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:137)
at 
org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107)
at 
org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83)
at 
org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75)
at 
org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:157)
at 
org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:386)
at 
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInPro

[jira] [Assigned] (BEAM-2379) SpannerIO tests are failing

2017-05-29 Thread JIRA 

 [ 
https://issues.apache.org/jira/browse/BEAM-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jean-Baptiste Onofré reassigned BEAM-2379:
--

Assignee: Mairbek Khadikov  (was: Davor Bonaci)

> SpannerIO tests are failing
> ---
>
> Key: BEAM-2379
> URL: https://issues.apache.org/jira/browse/BEAM-2379
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-java-extensions
>Reporter: Jean-Baptiste Onofré
>Assignee: Mairbek Khadikov
>
> When performing a complete {{mvn clean install}}, the build is failing on 
> {{SpannerIO}} tests:
> {code}
> [ERROR] Errors: 
> [ERROR]   SpannerIOTest.batching:129 » UserCode 
> java.lang.IllegalArgumentException: A pr...
> [ERROR]   SpannerIOTest.batchingGroups:155 » UserCode 
> java.lang.IllegalArgumentException...
> [ERROR]   SpannerIOTest.noBatching:178 » UserCode 
> java.lang.IllegalArgumentException: A ...
> [ERROR]   SpannerIOTest.singleMutationPipeline » UncheckedExecution 
> org.apache.beam.sdk
> {code}
> These tests fail with the same reason, here's the complete stack trace:
> {code}
> [ERROR] batchingGroups(org.apache.beam.sdk.io.gcp.spanner.SpannerIOTest)  
> Time elapsed: 0.004 s  <<< ERROR!
> org.apache.beam.sdk.util.UserCodeException: 
> java.lang.IllegalArgumentException: A project ID is required for this service 
> but could not be determined from the builder or the environment.  Please set 
> a project ID using the builder.
> at 
> org.apache.beam.sdk.util.UserCodeException.wrap(UserCodeException.java:36)
> at 
> org.apache.beam.sdk.io.gcp.spanner.SpannerIO$SpannerWriteFn$DoFnInvoker.invokeSetup(Unknown
>  Source)
> at 
> org.apache.beam.sdk.transforms.DoFnTester.initializeState(DoFnTester.java:745)
> at 
> org.apache.beam.sdk.transforms.DoFnTester.startBundle(DoFnTester.java:219)
> at 
> org.apache.beam.sdk.transforms.DoFnTester.processBundle(DoFnTester.java:183)
> at 
> org.apache.beam.sdk.io.gcp.spanner.SpannerIOTest.batchingGroups(SpannerIOTest.java:155)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> at 
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> at 
> org.apache.beam.sdk.testing.TestPipeline$1.evaluate(TestPipeline.java:321)
> at 
> org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:239)
> at org.junit.rules.RunRules.evaluate(RunRules.java:20)
> at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
> at org.junit.runners.Suite.runChild(Suite.java:128)
> at org.junit.runners.Suite.runChild(Suite.java:27)
> at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
> at 
> org.apache.maven.surefire.junitcore.JUnitCore.run(JUnitCore.java:55)
> at 
> org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:137)
> at 
> org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107)
> at 
> org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83)
> at 
>

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #2963

2017-05-29 Thread Apache Jenkins Server 
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #2964

2017-05-29 Thread Apache Jenkins Server 
See

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Apex #1593

2017-05-29 Thread Apache Jenkins Server 
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #2965

2017-05-29 Thread Apache Jenkins Server 
See

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall_Windows #69

2017-05-29 Thread Apache Jenkins Server 
See 


Changes:

[iemejia] Upgrade Avro dependency to version 1.8.2

--
[...truncated 2.54 MB...]
2017-05-29T18:43:48.924 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/codehaus/gmaven/groovy-maven-plugin/2.0/groovy-maven-plugin-2.0.jar
 (48 KB at 1526.0 KB/sec)
2017-05-29T18:43:48.924 [INFO] 
2017-05-29T18:43:48.924 [INFO] --- groovy-maven-plugin:2.0:execute 
(find-supported-python-for-clean) @ beam-sdks-python ---
2017-05-29T18:43:48.924 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/sonatype/gossip/gossip-slf4j/1.8/gossip-slf4j-1.8.pom
2017-05-29T18:43:48.955 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/sonatype/gossip/gossip-slf4j/1.8/gossip-slf4j-1.8.pom
 (2 KB at 46.7 KB/sec)
2017-05-29T18:43:48.955 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/sonatype/gossip/gossip/1.8/gossip-1.8.pom
2017-05-29T18:43:48.987 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/sonatype/gossip/gossip/1.8/gossip-1.8.pom
 (12 KB at 351.7 KB/sec)
2017-05-29T18:43:48.987 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/9/forge-parent-9.pom
2017-05-29T18:43:49.018 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/9/forge-parent-9.pom
 (13 KB at 414.0 KB/sec)
2017-05-29T18:43:49.018 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/sonatype/gossip/gossip-core/1.8/gossip-core-1.8.pom
2017-05-29T18:43:49.049 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/sonatype/gossip/gossip-core/1.8/gossip-core-1.8.pom
 (3 KB at 70.1 KB/sec)
2017-05-29T18:43:49.049 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/sonatype/gossip/gossip-bootstrap/1.8/gossip-bootstrap-1.8.pom
2017-05-29T18:43:49.081 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/sonatype/gossip/gossip-bootstrap/1.8/gossip-bootstrap-1.8.pom
 (2 KB at 49.2 KB/sec)
2017-05-29T18:43:49.081 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/guava/guava/14.0.1/guava-14.0.1.pom
2017-05-29T18:43:49.112 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/google/guava/guava/14.0.1/guava-14.0.1.pom
 (6 KB at 169.4 KB/sec)
2017-05-29T18:43:49.112 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/14.0.1/guava-parent-14.0.1.pom
2017-05-29T18:43:49.143 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/14.0.1/guava-parent-14.0.1.pom
 (3 KB at 80.5 KB/sec)
2017-05-29T18:43:49.143 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.4.2/plexus-classworlds-2.4.2.pom
2017-05-29T18:43:49.174 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.4.2/plexus-classworlds-2.4.2.pom
 (4 KB at 110.5 KB/sec)
2017-05-29T18:43:49.174 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.16/plexus-interpolation-1.16.pom
2017-05-29T18:43:49.205 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.16/plexus-interpolation-1.16.pom
 (2 KB at 32.4 KB/sec)
2017-05-29T18:43:49.205 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/0.9.0.M2/aether-api-0.9.0.M2.pom
2017-05-29T18:43:49.237 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/0.9.0.M2/aether-api-0.9.0.M2.pom
 (2 KB at 53.0 KB/sec)
2017-05-29T18:43:49.237 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/codehaus/gmaven/gmaven-adapter-api/2.0/gmaven-adapter-api-2.0.pom
2017-05-29T18:43:49.268 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/codehaus/gmaven/gmaven-adapter-api/2.0/gmaven-adapter-api-2.0.pom
 (2 KB at 56.9 KB/sec)
2017-05-29T18:43:49.268 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/codehaus/gmaven/gmaven-adapter-impl/2.0/gmaven-adapter-impl-2.0.pom
2017-05-29T18:43:49.299 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/codehaus/gmaven/gmaven-adapter-impl/2.0/gmaven-adapter-impl-2.0.pom
 (3 KB at 85.6 KB/sec)
2017-05-29T18:43:49.299 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/codehaus/groovy/groovy-all/2.1.5/groovy-all-2.1.5.pom
2017-05-29T18:43:49.330 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/codehaus/groovy/groovy-all/2.1.5/groovy-all-2.1.5.pom
 (18 KB at 568.3 KB/sec)
2017-05-29T18:43:49.330 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/ant/ant/1.8.4/ant-1.8.4.pom
2017-05-29T18:43:49.362 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/ant/ant/1.8.4/ant-1.8.4.pom (10 
KB at 294.6 KB/sec)
2017-05-29T18:43:49.362 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/ant/ant-parent/1.8.4/ant-parent-1.

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Apex #1594

2017-05-29 Thread Apache Jenkins Server 
See

Build failed in Jenkins: beam_PostCommit_Python_Verify #2349

2017-05-29 Thread Apache Jenkins Server 
See 


--
[...truncated 429.88 KB...]
test_sliding_windows_assignment (apache_beam.transforms.window_test.WindowTest) 
... ok
test_sliding_windows_assignment_fraction 
(apache_beam.transforms.window_test.WindowTest) ... ok
test_sliding_windows_assignment_fraction_large_offset 
(apache_beam.transforms.window_test.WindowTest) ... ok
test_timestamped_value (apache_beam.transforms.window_test.WindowTest) ... ok
test_timestamped_value_cmp (apache_beam.transforms.window_test.WindowTest) ... 
ok
test_timestamped_with_combiners (apache_beam.transforms.window_test.WindowTest) 
... ok
test_write (apache_beam.transforms.write_ptransform_test.WriteTest) ... ok
test_write_no_init_result 
(apache_beam.transforms.write_ptransform_test.WriteTest) ... ok
test_write_no_write_results 
(apache_beam.transforms.write_ptransform_test.WriteTest) ... ok
test_write_with_empty_pcollection 
(apache_beam.transforms.write_ptransform_test.WriteTest) ... ok
testAlwaysReturnsEarly 
(apache_beam.typehints.trivial_inference_test.TrivialInferenceTest) ... ok
testBinOp (apache_beam.typehints.trivial_inference_test.TrivialInferenceTest) 
... ok
testBuiltins 
(apache_beam.typehints.trivial_inference_test.TrivialInferenceTest) ... ok
testCall (apache_beam.typehints.trivial_inference_test.TrivialInferenceTest) 
... ok
testClosure (apache_beam.typehints.trivial_inference_test.TrivialInferenceTest) 
... ok
testDict (apache_beam.typehints.trivial_inference_test.TrivialInferenceTest) 
... ok
testDictComprehension 
(apache_beam.typehints.trivial_inference_test.TrivialInferenceTest) ... ok
testGenerator 
(apache_beam.typehints.trivial_inference_test.TrivialInferenceTest) ... ok
testGetAttr (apache_beam.typehints.trivial_inference_test.TrivialInferenceTest) 
... ok
testGlobals (apache_beam.typehints.trivial_inference_test.TrivialInferenceTest) 
... ok
testIdentity 
(apache_beam.typehints.trivial_inference_test.TrivialInferenceTest) ... ok
testListComprehension 
(apache_beam.typehints.trivial_inference_test.TrivialInferenceTest) ... ok
testMethod (apache_beam.typehints.trivial_inference_test.TrivialInferenceTest) 
... ok
testTupleListComprehension 
(apache_beam.typehints.trivial_inference_test.TrivialInferenceTest) ... ok
testTuples (apache_beam.typehints.trivial_inference_test.TrivialInferenceTest) 
... ok
testUnpack (apache_beam.typehints.trivial_inference_test.TrivialInferenceTest) 
... ok
test_custom_transform 
(apache_beam.typehints.typed_pipeline_test.CustomTransformTest) ... ok
test_flat_type_hint 
(apache_beam.typehints.typed_pipeline_test.CustomTransformTest) ... ok
test_keyword_type_hints 
(apache_beam.typehints.typed_pipeline_test.CustomTransformTest) ... ok
test_bad_main_input (apache_beam.typehints.typed_pipeline_test.MainInputTest) 
... ok
test_loose_bounds (apache_beam.typehints.typed_pipeline_test.MainInputTest) ... 
ok
test_non_function (apache_beam.typehints.typed_pipeline_test.MainInputTest) ... 
ok
test_typed_dofn_class (apache_beam.typehints.typed_pipeline_test.MainInputTest) 
... ok
test_typed_dofn_instance 
(apache_beam.typehints.typed_pipeline_test.MainInputTest) ... ok
test_basic_side_input_hint 
(apache_beam.typehints.typed_pipeline_test.SideInputTest) ... ok
test_default_typed_hint 
(apache_beam.typehints.typed_pipeline_test.SideInputTest) ... ok
test_default_untyped_hint 
(apache_beam.typehints.typed_pipeline_test.SideInputTest) ... ok
test_deferred_side_input_iterable 
(apache_beam.typehints.typed_pipeline_test.SideInputTest) ... ok
test_deferred_side_inputs 
(apache_beam.typehints.typed_pipeline_test.SideInputTest) ... ok
test_keyword_side_input_hint 
(apache_beam.typehints.typed_pipeline_test.SideInputTest) ... ok
test_any_compatibility 
(apache_beam.typehints.typehints_test.AnyTypeConstraintTestCase) ... ok
test_repr (apache_beam.typehints.typehints_test.AnyTypeConstraintTestCase) ... 
ok
test_type_check 
(apache_beam.typehints.typehints_test.AnyTypeConstraintTestCase) ... ok
test_composite_takes_and_returns_hints 
(apache_beam.typehints.typehints_test.CombinedReturnsAndTakesTestCase) ... ok
test_enable_and_disable_type_checking_returns 
(apache_beam.typehints.typehints_test.CombinedReturnsAndTakesTestCase) ... ok
test_enable_and_disable_type_checking_takes 
(apache_beam.typehints.typehints_test.CombinedReturnsAndTakesTestCase) ... ok
test_simple_takes_and_returns_hints 
(apache_beam.typehints.typehints_test.CombinedReturnsAndTakesTestCase) ... ok
test_valid_mix_pos_and_keyword_with_both_orders 
(apache_beam.typehints.typehints_test.CombinedReturnsAndTakesTestCase) ... ok
test_getcallargs_forhints 
(apache_beam.typehints.typehints_test.DecoratorHelpers) ... ok
test_hint_helper (apache_beam.typehints.typehints_test.DecoratorHelpers) ... ok
test_positional_arg_hints 
(apache_beam.typehints.typehints_test.DecoratorHelpers) ... ok
test_compatibility (apache_beam.typehints.typehints_test.DictHintTestCase) .

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall_Windows #70

2017-05-29 Thread Apache Jenkins Server 
See 


--
[...truncated 351.54 KB...]
2017-05-30T00:02:47.755 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-core/1.2.0/grpc-core-1.2.0.pom
2017-05-30T00:02:47.773 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-core/1.2.0/grpc-core-1.2.0.pom
 (3 KB at 144.5 KB/sec)
2017-05-30T00:02:47.779 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/errorprone/error_prone_annotations/2.0.15/error_prone_annotations-2.0.15.pom
2017-05-30T00:02:47.790 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/google/errorprone/error_prone_annotations/2.0.15/error_prone_annotations-2.0.15.pom
 (2 KB at 159.6 KB/sec)
2017-05-30T00:02:47.794 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/errorprone/error_prone_parent/2.0.15/error_prone_parent-2.0.15.pom
2017-05-30T00:02:47.802 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/google/errorprone/error_prone_parent/2.0.15/error_prone_parent-2.0.15.pom
 (6 KB at 625.7 KB/sec)
2017-05-30T00:02:47.806 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/code/findbugs/jsr305/3.0.1/jsr305-3.0.1.pom
2017-05-30T00:02:47.815 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/google/code/findbugs/jsr305/3.0.1/jsr305-3.0.1.pom
 (5 KB at 465.1 KB/sec)
2017-05-30T00:02:47.819 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-context/1.2.0/grpc-context-1.2.0.pom
2017-05-30T00:02:47.826 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-context/1.2.0/grpc-context-1.2.0.pom
 (2 KB at 243.9 KB/sec)
2017-05-30T00:02:47.830 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/instrumentation/instrumentation-api/0.3.0/instrumentation-api-0.3.0.pom
2017-05-30T00:02:47.839 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/google/instrumentation/instrumentation-api/0.3.0/instrumentation-api-0.3.0.pom
 (2 KB at 162.5 KB/sec)
2017-05-30T00:02:47.843 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-protobuf/1.2.0/grpc-protobuf-1.2.0.pom
2017-05-30T00:02:47.853 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-protobuf/1.2.0/grpc-protobuf-1.2.0.pom
 (3 KB at 259.3 KB/sec)
2017-05-30T00:02:47.858 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/protobuf/protobuf-java-util/3.2.0/protobuf-java-util-3.2.0.pom
2017-05-30T00:02:47.867 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/google/protobuf/protobuf-java-util/3.2.0/protobuf-java-util-3.2.0.pom
 (5 KB at 461.0 KB/sec)
2017-05-30T00:02:47.873 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/code/gson/gson/2.7/gson-2.7.pom
2017-05-30T00:02:47.882 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/google/code/gson/gson/2.7/gson-2.7.pom 
(2 KB at 156.8 KB/sec)
2017-05-30T00:02:47.887 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/code/gson/gson-parent/2.7/gson-parent-2.7.pom
2017-05-30T00:02:47.894 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/google/code/gson/gson-parent/2.7/gson-parent-2.7.pom
 (4 KB at 499.4 KB/sec)
2017-05-30T00:02:47.899 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-protobuf-lite/1.2.0/grpc-protobuf-lite-1.2.0.pom
2017-05-30T00:02:47.907 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-protobuf-lite/1.2.0/grpc-protobuf-lite-1.2.0.pom
 (3 KB at 259.3 KB/sec)
2017-05-30T00:02:47.911 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-stub/1.2.0/grpc-stub-1.2.0.pom
2017-05-30T00:02:47.918 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-stub/1.2.0/grpc-stub-1.2.0.pom
 (3 KB at 289.9 KB/sec)
2017-05-30T00:02:47.929 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/protobuf/protobuf-java/3.2.0/protobuf-java-3.2.0.jar
2017-05-30T00:02:47.929 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-core/1.2.0/grpc-core-1.2.0.jar
2017-05-30T00:02:47.930 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/errorprone/error_prone_annotations/2.0.15/error_prone_annotations-2.0.15.jar
2017-05-30T00:02:47.930 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/code/findbugs/jsr305/3.0.1/jsr305-3.0.1.jar
2017-05-30T00:02:47.931 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-context/1.2.0/grpc-context-1.2.0.jar
2017-05-30T00:02:47.946 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/google/errorprone/error_prone_annotations/2.0.15/error_prone_annotations-2.0.15.jar
 (11 KB at 624.2 KB/sec)
2017-05-30T00:02:47.946 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/instrumentation/instrumentation-api/0.3.0/instrumentation-api-0.3.0.jar
2017-05-30T00:02:47.950 [INFO] Downloaded: 
https://re

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #2966

2017-05-29 Thread Apache Jenkins Server 
See

[GitHub] beam pull request #3257: fix javadoc of View

2017-05-29 Thread xumingming 
GitHub user xumingming opened a pull request:

https://github.com/apache/beam/pull/3257

fix javadoc of View

While reading javadoc of `org.apache.beam.sdk.transforms.View`, find the 
sample code of `View` seems not correct, hope the PR will fix it.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/xumingming/beam fix-javadoc-of-View

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam/pull/3257.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3257


commit 4cef2cbc595af1bbd68255d5404fabf8f57c699b
Author: James Xu 
Date:   2017-05-30T03:27:32Z

fix javadoc of View




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Jenkins build is back to normal : beam_PostCommit_Python_Verify #2350

2017-05-29 Thread Apache Jenkins Server 
See

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall_Windows #71

2017-05-29 Thread Apache Jenkins Server 
See 


--
[...truncated 351.18 KB...]
2017-05-30T06:02:30.137 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-core/1.2.0/grpc-core-1.2.0.pom
2017-05-30T06:02:30.149 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-core/1.2.0/grpc-core-1.2.0.pom
 (3 KB at 216.7 KB/sec)
2017-05-30T06:02:30.153 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/errorprone/error_prone_annotations/2.0.15/error_prone_annotations-2.0.15.pom
2017-05-30T06:02:30.162 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/google/errorprone/error_prone_annotations/2.0.15/error_prone_annotations-2.0.15.pom
 (2 KB at 177.3 KB/sec)
2017-05-30T06:02:30.165 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/errorprone/error_prone_parent/2.0.15/error_prone_parent-2.0.15.pom
2017-05-30T06:02:30.174 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/google/errorprone/error_prone_parent/2.0.15/error_prone_parent-2.0.15.pom
 (6 KB at 556.2 KB/sec)
2017-05-30T06:02:30.178 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/code/findbugs/jsr305/3.0.1/jsr305-3.0.1.pom
2017-05-30T06:02:30.188 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/google/code/findbugs/jsr305/3.0.1/jsr305-3.0.1.pom
 (5 KB at 418.6 KB/sec)
2017-05-30T06:02:30.194 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-context/1.2.0/grpc-context-1.2.0.pom
2017-05-30T06:02:30.206 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-context/1.2.0/grpc-context-1.2.0.pom
 (2 KB at 142.3 KB/sec)
2017-05-30T06:02:30.209 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/instrumentation/instrumentation-api/0.3.0/instrumentation-api-0.3.0.pom
2017-05-30T06:02:30.233 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/google/instrumentation/instrumentation-api/0.3.0/instrumentation-api-0.3.0.pom
 (2 KB at 61.0 KB/sec)
2017-05-30T06:02:30.237 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-protobuf/1.2.0/grpc-protobuf-1.2.0.pom
2017-05-30T06:02:30.245 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-protobuf/1.2.0/grpc-protobuf-1.2.0.pom
 (3 KB at 324.1 KB/sec)
2017-05-30T06:02:30.250 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/protobuf/protobuf-java-util/3.2.0/protobuf-java-util-3.2.0.pom
2017-05-30T06:02:30.259 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/google/protobuf/protobuf-java-util/3.2.0/protobuf-java-util-3.2.0.pom
 (5 KB at 461.0 KB/sec)
2017-05-30T06:02:30.264 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/code/gson/gson/2.7/gson-2.7.pom
2017-05-30T06:02:30.274 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/google/code/gson/gson/2.7/gson-2.7.pom 
(2 KB at 141.1 KB/sec)
2017-05-30T06:02:30.278 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/code/gson/gson-parent/2.7/gson-parent-2.7.pom
2017-05-30T06:02:30.288 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/google/code/gson/gson-parent/2.7/gson-parent-2.7.pom
 (4 KB at 349.6 KB/sec)
2017-05-30T06:02:30.292 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-protobuf-lite/1.2.0/grpc-protobuf-lite-1.2.0.pom
2017-05-30T06:02:30.301 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-protobuf-lite/1.2.0/grpc-protobuf-lite-1.2.0.pom
 (3 KB at 259.3 KB/sec)
2017-05-30T06:02:30.304 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-stub/1.2.0/grpc-stub-1.2.0.pom
2017-05-30T06:02:30.314 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-stub/1.2.0/grpc-stub-1.2.0.pom
 (3 KB at 202.9 KB/sec)
2017-05-30T06:02:30.326 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/protobuf/protobuf-java/3.2.0/protobuf-java-3.2.0.jar
2017-05-30T06:02:30.326 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-core/1.2.0/grpc-core-1.2.0.jar
2017-05-30T06:02:30.326 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/errorprone/error_prone_annotations/2.0.15/error_prone_annotations-2.0.15.jar
2017-05-30T06:02:30.326 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/code/findbugs/jsr305/3.0.1/jsr305-3.0.1.jar
2017-05-30T06:02:30.327 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/io/grpc/grpc-context/1.2.0/grpc-context-1.2.0.jar
2017-05-30T06:02:30.343 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/google/errorprone/error_prone_annotations/2.0.15/error_prone_annotations-2.0.15.jar
 (11 KB at 589.5 KB/sec)
2017-05-30T06:02:30.343 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/instrumentation/instrumentation-api/0.3.0/instrumentation-api-0.3.0.jar
2017-05-30T06:02:30.346 [INFO] Downloaded: 
https://rep

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #2967

2017-05-29 Thread Apache Jenkins Server 
See