Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2890

2017-08-23 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-2794) Failed to run Wordcount example following quick start guide

2017-08-23 Thread Huafeng Wang (JIRA)
Huafeng Wang created BEAM-2794: -- Summary: Failed to run Wordcount example following quick start guide Key: BEAM-2794 URL: https://issues.apache.org/jira/browse/BEAM-2794 Project: Beam Issue

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3815

2017-08-23 Thread Apache Jenkins Server
See

[GitHub] beam pull request #3748: BEAM-2669 Kryo serialization exception when DStream...

2017-08-23 Thread kobisalant
GitHub user kobisalant opened a pull request: https://github.com/apache/beam/pull/3748 BEAM-2669 Kryo serialization exception when DStreams containing non-Kryo-serializable data are cached remove kryo Serializer hard coded settings and add Serializable implementation to

[jira] [Commented] (BEAM-2669) Kryo serialization exception when DStreams containing non-Kryo-serializable data are cached

2017-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138063#comment-16138063 ] ASF GitHub Bot commented on BEAM-2669: -- GitHub user kobisalant opened a pull request:

[jira] [Commented] (BEAM-2794) Failed to run Wordcount example following quick start guide

2017-08-23 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138162#comment-16138162 ] Huafeng Wang commented on BEAM-2794: I execute the mvn archetype:generate command under the root

[GitHub] beam pull request #3748: BEAM-2669 Kryo serialization exception when DStream...

2017-08-23 Thread kobisalant
Github user kobisalant closed the pull request at: https://github.com/apache/beam/pull/3748 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-2669) Kryo serialization exception when DStreams containing non-Kryo-serializable data are cached

2017-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138065#comment-16138065 ] ASF GitHub Bot commented on BEAM-2669: -- Github user kobisalant closed the pull request at:

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Spark #2891

2017-08-23 Thread Apache Jenkins Server
See -- [...truncated 324.84 KB...] 2017-08-23T12:03:57.229 [INFO] Downloading:

[GitHub] beam pull request #3749: remove kryo Serializer hard coded settings and add ...

2017-08-23 Thread kobisalant
GitHub user kobisalant opened a pull request: https://github.com/apache/beam/pull/3749 remove kryo Serializer hard coded settings and add Serializable to se… Remove kryo Serializer hard coded settings and add Serializable to several classes. Had to add Serializable to

[jira] [Commented] (BEAM-1628) Flink runner: logic around --flinkMaster is error-prone

2017-08-23 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138333#comment-16138333 ] Maximilian Michels commented on BEAM-1628: -- [~vectorijk] Are you still working on this issue? >

[2/2] beam git commit: This closes 3743

2017-08-23 Thread mauzhang
This closes 3743 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f0ce31b9 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f0ce31b9 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/f0ce31b9 Branch:

[jira] [Commented] (BEAM-2788) Use SerializablePipelineOptions to serde PipelineOptions

2017-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138396#comment-16138396 ] ASF GitHub Bot commented on BEAM-2788: -- Github user huafengw closed the pull request at:

[jira] [Commented] (BEAM-956) Execute ReduceFnRunner Directly in Flink Runner

2017-08-23 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138331#comment-16138331 ] Maximilian Michels commented on BEAM-956: - It appears this issue has been fixed. [~aljoscha] can

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3816

2017-08-23 Thread Apache Jenkins Server
See

[1/2] beam git commit: [BEAM-2788] Use SerializablePipelineOptions to serde PipelineOptions in Gearpump runner

2017-08-23 Thread mauzhang
Repository: beam Updated Branches: refs/heads/master 9b175ccc2 -> f0ce31b9d [BEAM-2788] Use SerializablePipelineOptions to serde PipelineOptions in Gearpump runner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/081df6d3

[GitHub] beam pull request #3743: [BEAM-2788] Use SerializablePipelineOptions to serd...

2017-08-23 Thread huafengw
Github user huafengw closed the pull request at: https://github.com/apache/beam/pull/3743 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Created] (BEAM-2796) _ExecutorServiceParallelExecutor.await_for_completion does not actually await for _ExecutorService to shutdown

2017-08-23 Thread Sergiy Byelozyorov (JIRA)
Sergiy Byelozyorov created BEAM-2796: Summary: _ExecutorServiceParallelExecutor.await_for_completion does not actually await for _ExecutorService to shutdown Key: BEAM-2796 URL:

[jira] [Assigned] (BEAM-1628) Flink runner: logic around --flinkMaster is error-prone

2017-08-23 Thread Kai Jiang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Jiang reassigned BEAM-1628: --- Assignee: (was: Aljoscha Krettek) > Flink runner: logic around --flinkMaster is error-prone >

[jira] [Assigned] (BEAM-1628) Flink runner: logic around --flinkMaster is error-prone

2017-08-23 Thread Kai Jiang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Jiang reassigned BEAM-1628: --- Assignee: Aljoscha Krettek (was: Kai Jiang) > Flink runner: logic around --flinkMaster is

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2895

2017-08-23 Thread Apache Jenkins Server
See

[GitHub] beam pull request #3751: [BEAM-2796] Actually wait for exector service to sh...

2017-08-23 Thread rryk
GitHub user rryk opened a pull request: https://github.com/apache/beam/pull/3751 [BEAM-2796] Actually wait for exector service to shutdown Currently executor service is leaking threads, which eventually complete, but may complicate writing integration tests in frameworks that check

[jira] [Updated] (BEAM-2796) _ExecutorServiceParallelExecutor.await_for_completion does not actually await for _ExecutorService to shutdown

2017-08-23 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh updated BEAM-2796: -- Component/s: (was: runner-direct) sdk-py >

[jira] [Assigned] (BEAM-2796) _ExecutorServiceParallelExecutor.await_for_completion does not actually await for _ExecutorService to shutdown

2017-08-23 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh reassigned BEAM-2796: - Assignee: Charles Chen (was: Thomas Groh) >

[jira] [Commented] (BEAM-1628) Flink runner: logic around --flinkMaster is error-prone

2017-08-23 Thread Kai Jiang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138763#comment-16138763 ] Kai Jiang commented on BEAM-1628: - [~mxm] i am off. go ahead. > Flink runner: logic around --flinkMaster

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3817

2017-08-23 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2796) _ExecutorServiceParallelExecutor.await_for_completion does not actually await for _ExecutorService to shutdown

2017-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138675#comment-16138675 ] ASF GitHub Bot commented on BEAM-2796: -- GitHub user rryk opened a pull request:

[05/55] [abbrv] beam git commit: NexMark

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/1f08970a/integration/java/src/main/java/org/apache/beam/integration/nexmark/Generator.java -- diff --git

[18/55] [abbrv] beam git commit: Fix Queries tests

2017-08-23 Thread iemejia
Fix Queries tests Workaround for issue #22 + extra cleaning Replace junit asserts by hamcrest asserts Set numEvents in test to the minimum number that makes the tests pass issue #15 comments, improve asserts (hamcrest), reformat For now make generate monothreaded Project:

[39/55] [abbrv] beam git commit: Change benchmark workload settings

2017-08-23 Thread iemejia
Change benchmark workload settings Update configuration of events generation to add some variation Update execution matrix (issue #45) Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/dbd1b155 Tree:

[25/55] [abbrv] beam git commit: Change Nexmark pom structure to mirror other modules on Beam

2017-08-23 Thread iemejia
Change Nexmark pom structure to mirror other modules on Beam Fix compile after PubsubIO refactor Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/8098bb1d Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/8098bb1d Diff:

[jira] [Commented] (BEAM-160) Port 'NexMark Queries' to Beam for use as integration test

2017-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138650#comment-16138650 ] ASF GitHub Bot commented on BEAM-160: - Github user asfgit closed the pull request at:

[GitHub] beam pull request #3114: [BEAM-160] Port 'NexMark Queries' to Beam for use a...

2017-08-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3114 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[22/55] [abbrv] beam git commit: Fix compile after ParDo refactor

2017-08-23 Thread iemejia
Fix compile after ParDo refactor Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/bd93c8b5 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/bd93c8b5 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/bd93c8b5 Branch:

[15/55] [abbrv] beam git commit: Refactor classes into packages

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/a7f9f7d0/integration/java/nexmark/src/main/java/org/apache/beam/integration/nexmark/Generator.java -- diff --git

[24/55] [abbrv] beam git commit: Fix and improve query3 and query12

2017-08-23 Thread iemejia
Fix and improve query3 and query12 query3: Use GlobalWindow to comply with the State/Timer APIs (issue #7). Use timer for personState expiration in GlobalWindow (issue #29). Add trigger to GlobalWindow query12: Replace Count.perKey by Count.perElement (issue #34) Project:

[08/55] [abbrv] beam git commit: Refactor classes into packages

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/a7f9f7d0/integration/java/nexmark/src/test/java/org/apache/beam/integration/nexmark/sources/UnboundedEventSourceTest.java -- diff --git

[21/55] [abbrv] beam git commit: Improve queries tests

2017-08-23 Thread iemejia
Improve queries tests Fix Runner categories in tests Add streaming unit tests and corresponding labels issue #37 Update numEvents: results are no more linked to the number of events issue #22 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[32/55] [abbrv] beam git commit: Disable use of GcsIOChannelFactory on query10

2017-08-23 Thread iemejia
Disable use of GcsIOChannelFactory on query10 Make NexmarkOptions depend on GcpOptions instead of PubsubOptions issue #21 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/902050b0 Tree:

[40/55] [abbrv] beam git commit: Update to Beam 2.2.0-SNAPSHOT and final touches before merge into master

2017-08-23 Thread iemejia
Update to Beam 2.2.0-SNAPSHOT and final touches before merge into master Clean pom, exclude nexmark packages from aggregated javadoc, put spark logs in WARN Update execution matrix in README: Flink termination of streaming pipelines is now ok as far as Nexmark is concerned Remove how to run

[44/55] [abbrv] beam git commit: Move module beam-integration-java-nexmark to beam-sdks-java-nexmark

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/f4333df7/sdks/java/nexmark/src/main/java/org/apache/beam/sdk/nexmark/NexmarkUtils.java -- diff --git a/sdks/java/nexmark/src/main/java/org/apache/beam/sdk/nexmark/NexmarkUtils.java

[47/55] [abbrv] beam git commit: Move module beam-integration-java-nexmark to beam-sdks-java-nexmark

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/f4333df7/integration/java/nexmark/src/main/java/org/apache/beam/integration/nexmark/queries/WinningBidsSimulator.java -- diff --git

[36/55] [abbrv] beam git commit: Rename NexmarkDriver to Main and NexmarkRunner to NexmarkLauncher

2017-08-23 Thread iemejia
Rename NexmarkDriver to Main and NexmarkRunner to NexmarkLauncher Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/683680b1 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/683680b1 Diff:

[09/55] [abbrv] beam git commit: Refactor classes into packages

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/a7f9f7d0/integration/java/nexmark/src/main/java/org/apache/beam/integration/nexmark/sources/BoundedEventSource.java -- diff --git

[16/55] [abbrv] beam git commit: Refactor classes into packages

2017-08-23 Thread iemejia
Refactor classes into packages The new hierarchy has logically based packages for: - drivers - io - model - queries - sources Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a7f9f7d0 Tree:

[46/55] [abbrv] beam git commit: Move module beam-integration-java-nexmark to beam-sdks-java-nexmark

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/f4333df7/integration/java/pom.xml -- diff --git a/integration/java/pom.xml b/integration/java/pom.xml deleted file mode 100644 index b0c3853..000 --- a/integration/java/pom.xml

[37/55] [abbrv] beam git commit: Fix query10 log messages

2017-08-23 Thread iemejia
Fix query10 log messages issue #5 and issue #51 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ee500b28 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/ee500b28 Diff:

[42/55] [abbrv] beam git commit: Move module beam-integration-java-nexmark to beam-sdks-java-nexmark

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/f4333df7/sdks/java/nexmark/src/main/java/org/apache/beam/sdk/nexmark/queries/Query4.java -- diff --git

[53/55] [abbrv] beam git commit: Clean, fix findbugs, fix checkstyle

2017-08-23 Thread iemejia
Clean, fix findbugs, fix checkstyle Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2f9b4948 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/2f9b4948 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/2f9b4948

[33/55] [abbrv] beam git commit: Migrate to Beam 2.1.0-SNAPSHOT

2017-08-23 Thread iemejia
Migrate to Beam 2.1.0-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3d5c3d00 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/3d5c3d00 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/3d5c3d00 Branch:

[03/55] [abbrv] beam git commit: NexMark

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/1f08970a/integration/java/src/main/java/org/apache/beam/integration/nexmark/NexmarkUtils.java -- diff --git

[35/55] [abbrv] beam git commit: Rename NexmarkDriver to Main and NexmarkRunner to NexmarkLauncher

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/683680b1/integration/java/nexmark/src/main/java/org/apache/beam/integration/nexmark/NexmarkRunner.java -- diff --git

[14/55] [abbrv] beam git commit: Refactor classes into packages

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/a7f9f7d0/integration/java/nexmark/src/main/java/org/apache/beam/integration/nexmark/NexmarkRunner.java -- diff --git

[30/55] [abbrv] beam git commit: Fix compile after Coders and Pubsub refactor

2017-08-23 Thread iemejia
Fix compile after Coders and Pubsub refactor Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/8b96949b Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/8b96949b Diff:

[43/55] [abbrv] beam git commit: Move module beam-integration-java-nexmark to beam-sdks-java-nexmark

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/f4333df7/sdks/java/nexmark/src/main/java/org/apache/beam/sdk/nexmark/queries/AbstractSimulator.java -- diff --git

[51/55] [abbrv] beam git commit: Move module beam-integration-java-nexmark to beam-sdks-java-nexmark

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/f4333df7/integration/java/nexmark/src/main/java/org/apache/beam/integration/nexmark/NexmarkLauncher.java -- diff --git

[01/55] [abbrv] beam git commit: NexMark

2017-08-23 Thread iemejia
Repository: beam Updated Branches: refs/heads/master f0ce31b9d -> 64ff21f35 http://git-wip-us.apache.org/repos/asf/beam/blob/1f08970a/integration/java/src/main/java/org/apache/beam/integration/nexmark/SellerPrice.java -- diff

[49/55] [abbrv] beam git commit: Move module beam-integration-java-nexmark to beam-sdks-java-nexmark

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/f4333df7/integration/java/nexmark/src/main/java/org/apache/beam/integration/nexmark/queries/AbstractSimulator.java -- diff --git

[48/55] [abbrv] beam git commit: Move module beam-integration-java-nexmark to beam-sdks-java-nexmark

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/f4333df7/integration/java/nexmark/src/main/java/org/apache/beam/integration/nexmark/queries/Query4.java -- diff --git

[45/55] [abbrv] beam git commit: Move module beam-integration-java-nexmark to beam-sdks-java-nexmark

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/f4333df7/sdks/java/nexmark/src/main/java/org/apache/beam/sdk/nexmark/NexmarkLauncher.java -- diff --git

[26/55] [abbrv] beam git commit: Remove NexmarkDrivers and make execution runner-agnostic

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/a6dbdfa5/integration/java/nexmark/src/main/java/org/apache/beam/integration/nexmark/io/PubsubJsonClient.java -- diff --git

[17/55] [abbrv] beam git commit: Fix Apex driver and update execution matrix

2017-08-23 Thread iemejia
Fix Apex driver and update execution matrix Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9ce9bf07 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/9ce9bf07 Diff:

[13/55] [abbrv] beam git commit: Refactor classes into packages

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/a7f9f7d0/integration/java/nexmark/src/main/java/org/apache/beam/integration/nexmark/Query3.java -- diff --git

[10/55] [abbrv] beam git commit: Refactor classes into packages

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/a7f9f7d0/integration/java/nexmark/src/main/java/org/apache/beam/integration/nexmark/queries/Query3.java -- diff --git

[29/55] [abbrv] beam git commit: Move WinningBids into the queries package

2017-08-23 Thread iemejia
Move WinningBids into the queries package Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a39cb800 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/a39cb800 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/a39cb800

[02/55] [abbrv] beam git commit: NexMark

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/1f08970a/integration/java/src/main/java/org/apache/beam/integration/nexmark/Query2.java -- diff --git

[12/55] [abbrv] beam git commit: Refactor classes into packages

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/a7f9f7d0/integration/java/nexmark/src/main/java/org/apache/beam/integration/nexmark/UnboundedEventSource.java -- diff --git

[31/55] [abbrv] beam git commit: Fix static analysis issues

2017-08-23 Thread iemejia
Fix static analysis issues Restrict access level on classes + other static analysis fixes Fix findbugs issues (issue #33) Fix compile after AvroIO, TextIO, PubsubIO and State refactor Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[11/55] [abbrv] beam git commit: Refactor classes into packages

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/a7f9f7d0/integration/java/nexmark/src/main/java/org/apache/beam/integration/nexmark/model/CategoryPrice.java -- diff --git

[20/55] [abbrv] beam git commit: Fix Spark streaming termination via waitUntilFinish and timeout config

2017-08-23 Thread iemejia
Fix Spark streaming termination via waitUntilFinish and timeout config issue #39 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e10d5783 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e10d5783 Diff:

[28/55] [abbrv] beam git commit: Move WinningBids into the queries package

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/a39cb800/integration/java/nexmark/src/main/java/org/apache/beam/integration/nexmark/queries/Query3.java -- diff --git

[52/55] [abbrv] beam git commit: Move module beam-integration-java-nexmark to beam-sdks-java-nexmark

2017-08-23 Thread iemejia
Move module beam-integration-java-nexmark to beam-sdks-java-nexmark Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f4333df7 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f4333df7 Diff:

[34/55] [abbrv] beam git commit: Clean some code that is specific to Dataflow

2017-08-23 Thread iemejia
Clean some code that is specific to Dataflow Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/77eabbaa Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/77eabbaa Diff:

[50/55] [abbrv] beam git commit: Move module beam-integration-java-nexmark to beam-sdks-java-nexmark

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/f4333df7/integration/java/nexmark/src/main/java/org/apache/beam/integration/nexmark/NexmarkUtils.java -- diff --git

[55/55] [abbrv] beam git commit: This closes #3114

2017-08-23 Thread iemejia
This closes #3114 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/64ff21f3 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/64ff21f3 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/64ff21f3 Branch:

[54/55] [abbrv] beam git commit: Improve NexmarkUtils: improve diskBusy() and remove unneeded randomization code

2017-08-23 Thread iemejia
Improve NexmarkUtils: improve diskBusy() and remove unneeded randomization code - Use state API in NexmarkUtils.diskBusy() - Remove commented code for direct runner randomization disabling: direct runner no more allows disabling randomization and queries and UT pass Project:

[04/55] [abbrv] beam git commit: NexMark

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/1f08970a/integration/java/src/main/java/org/apache/beam/integration/nexmark/NexmarkGoogleDriver.java -- diff --git

[38/55] [abbrv] beam git commit: Remove references to dataflow in generic classes

2017-08-23 Thread iemejia
Remove references to dataflow in generic classes Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/69953a0b Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/69953a0b Diff:

[07/55] [abbrv] beam git commit: Remove Accumulators and switch to the Metrics API

2017-08-23 Thread iemejia
Remove Accumulators and switch to the Metrics API Fix compile after sideOutput and split refactor Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b438fa7d Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b438fa7d Diff:

[27/55] [abbrv] beam git commit: Remove NexmarkDrivers and make execution runner-agnostic

2017-08-23 Thread iemejia
Remove NexmarkDrivers and make execution runner-agnostic This configuration should be external to the benchmark to avoid unexpected dependencies and to have a more Beam like (runner-independent) apprach. Add maven profiles to execute NexMark in the different runners Fix compile after extra

[23/55] [abbrv] beam git commit: Improve query5, query10 and query11

2017-08-23 Thread iemejia
Improve query5, query10 and query11 query5: Add comment on key lifting (issue #30) query10: Add comment for strange groupByKey (issue #31) query11: Replace Count.perKey by Count.perElement (issue #32) Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[19/55] [abbrv] beam git commit: Activate monitoring on NexmarkSparkRunner and on specific runners

2017-08-23 Thread iemejia
Activate monitoring on NexmarkSparkRunner and on specific runners issue #28 Fix compilation issue after rebase + make checkstyle happy again Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a1fe33bc Tree:

[06/55] [abbrv] beam git commit: NexMark

2017-08-23 Thread iemejia
NexMark Port unit tests, cleanup pom and add license to readme Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/1f08970a Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/1f08970a Diff:

[41/55] [abbrv] beam git commit: Move module beam-integration-java-nexmark to beam-sdks-java-nexmark

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/f4333df7/sdks/java/nexmark/src/main/java/org/apache/beam/sdk/nexmark/queries/package-info.java -- diff --git

[2/2] beam git commit: This closes #3733: Fix a function serialization bug in AvroIO

2017-08-23 Thread jkff
This closes #3733: Fix a function serialization bug in AvroIO Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d4db66dd Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/d4db66dd Diff:

[jira] [Commented] (BEAM-2577) IO tests should exercise Runtime Values where supported

2017-08-23 Thread Daniel Ribeiro (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139151#comment-16139151 ] Daniel Ribeiro commented on BEAM-2577: -- Ok, got it. > IO tests should exercise Runtime Values where

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3818

2017-08-23 Thread Apache Jenkins Server
See

[GitHub] beam pull request #3733: Fix a function serialization bug in AvroIO

2017-08-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3733 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: Fix a bug in AvroIO, in which a SerializableFunction is created with a context containing a un-serializable member (Schema)

2017-08-23 Thread jkff
Repository: beam Updated Branches: refs/heads/master 97f32804c -> d4db66dd6 Fix a bug in AvroIO, in which a SerializableFunction is created with a context containing a un-serializable member (Schema) Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3820

2017-08-23 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2898

2017-08-23 Thread Apache Jenkins Server
See

[beam-site] 02/02: This closes #295

2017-08-23 Thread mergebot-role
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit f969e19bdbd805d65205ff10125dc6ee1de143cd Merge: 1733e1e c425fee Author: Mergebot

[beam-site] 01/02: [BEAM-2780] Fix Window sample code in programming guide

2017-08-23 Thread mergebot-role
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit c425fee42717d6c9934f8290742cddd274bd10a2 Author: melissa AuthorDate: Fri Aug 18

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3821

2017-08-23 Thread Apache Jenkins Server
See

[jira] [Updated] (BEAM-2799) list supported SQL grammar in BNF

2017-08-23 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2799: - Issue Type: Sub-task (was: Improvement) Parent: BEAM-2679 > list supported SQL grammar in BNF >

[jira] [Updated] (BEAM-2800) update page dsl_sql

2017-08-23 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2800: - Issue Type: Sub-task (was: Improvement) Parent: BEAM-2679 > update page dsl_sql >

[jira] [Updated] (BEAM-2798) rename simpleQuery to query and query to queryMulti

2017-08-23 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2798: - Issue Type: Sub-task (was: Improvement) Parent: BEAM-2679 > rename simpleQuery to query and query

[jira] [Created] (BEAM-2800) update page dsl_sql

2017-08-23 Thread Xu Mingmin (JIRA)
Xu Mingmin created BEAM-2800: Summary: update page dsl_sql Key: BEAM-2800 URL: https://issues.apache.org/jira/browse/BEAM-2800 Project: Beam Issue Type: Improvement Components:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2900

2017-08-23 Thread Apache Jenkins Server
See

Jenkins build is back to normal : beam_PostCommit_Java_MavenInstall #4628

2017-08-23 Thread Apache Jenkins Server
See

  1   2   >