[jira] [Created] (BEAM-2801) Implement a BigQuery custom sink

2017-08-23 Thread Chamikara Jayalath (JIRA)
Chamikara Jayalath created BEAM-2801: Summary: Implement a BigQuery custom sink Key: BEAM-2801 URL: https://issues.apache.org/jira/browse/BEAM-2801 Project: Beam Issue Type: New Feature

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3823

2017-08-23 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PerformanceTests_JDBC #195

2017-08-23 Thread Apache Jenkins Server
See -- [...truncated 54.32 KB...] 2017-08-24 02:40:40,166 88ee2543 MainThread beam_integration_benchmark(1/1) INFO Running: kubectl --kubeconfig=/home/jenkins/.kube/config

[jira] [Assigned] (BEAM-2632) TextIOReadTest create pipelines with non-unique application names

2017-08-23 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huafeng Wang reassigned BEAM-2632: -- Assignee: Huafeng Wang > TextIOReadTest create pipelines with non-unique application names >

[jira] [Commented] (BEAM-2644) Make it easier to test runtime-accessible ValueProvider's

2017-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139473#comment-16139473 ] ASF GitHub Bot commented on BEAM-2644: -- GitHub user jkff opened a pull request:

[GitHub] beam pull request #3753: [BEAM-2644] Introduces TestPipeline.newProvider()

2017-08-23 Thread jkff
GitHub user jkff opened a pull request: https://github.com/apache/beam/pull/3753 [BEAM-2644] Introduces TestPipeline.newProvider() R: @bjchambers You can merge this pull request into a Git repository by running: $ git pull https://github.com/jkff/incubator-beam

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3822

2017-08-23 Thread Apache Jenkins Server
See

Jenkins build is back to normal : beam_PostCommit_Java_MavenInstall #4628

2017-08-23 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2900

2017-08-23 Thread Apache Jenkins Server
See

[2/2] beam git commit: [BEAM-1347] Provide an abstraction which creates an Iterator view over the Beam Fn State API

2017-08-23 Thread lcwik
[BEAM-1347] Provide an abstraction which creates an Iterator view over the Beam Fn State API This closes #3736 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c4517d04 Tree:

[GitHub] beam pull request #3736: [BEAM-1347] Provide an abstraction which creates an...

2017-08-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3736 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-1347) Basic Java harness capable of understanding process bundle tasks and sending data over the Fn Api

2017-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139400#comment-16139400 ] ASF GitHub Bot commented on BEAM-1347: -- Github user asfgit closed the pull request at:

Build failed in Jenkins: beam_PerformanceTests_JDBC #194

2017-08-23 Thread Apache Jenkins Server
See Changes: [chamikara] Updating protobuf for dataflow api [altay] Makes Python API reference generation more strict [altay] Add initial bundle retry code [tgroh] Throw an Exception if no files are

[jira] [Commented] (BEAM-2798) rename simpleQuery to query and query to queryMulti

2017-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139392#comment-16139392 ] ASF GitHub Bot commented on BEAM-2798: -- GitHub user XuMingmin opened a pull request:

[GitHub] beam pull request #3752: [BEAM-2798] rename simpleQuery to query and query t...

2017-08-23 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3752 [BEAM-2798] rename simpleQuery to query and query to queryMulti R: @takidau @xumingming You can merge this pull request into a Git repository by running: $ git pull

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2899

2017-08-23 Thread Apache Jenkins Server
See

[jira] [Updated] (BEAM-2800) update page dsl_sql

2017-08-23 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2800: - Issue Type: Sub-task (was: Improvement) Parent: BEAM-2679 > update page dsl_sql >

[jira] [Updated] (BEAM-2799) list supported SQL grammar in BNF

2017-08-23 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2799: - Issue Type: Sub-task (was: Improvement) Parent: BEAM-2679 > list supported SQL grammar in BNF >

[jira] [Created] (BEAM-2800) update page dsl_sql

2017-08-23 Thread Xu Mingmin (JIRA)
Xu Mingmin created BEAM-2800: Summary: update page dsl_sql Key: BEAM-2800 URL: https://issues.apache.org/jira/browse/BEAM-2800 Project: Beam Issue Type: Improvement Components:

[jira] [Updated] (BEAM-2798) rename simpleQuery to query and query to queryMulti

2017-08-23 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2798: - Issue Type: Sub-task (was: Improvement) Parent: BEAM-2679 > rename simpleQuery to query and query

[jira] [Created] (BEAM-2799) list supported SQL grammar in BNF

2017-08-23 Thread Xu Mingmin (JIRA)
Xu Mingmin created BEAM-2799: Summary: list supported SQL grammar in BNF Key: BEAM-2799 URL: https://issues.apache.org/jira/browse/BEAM-2799 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-2798) rename simpleQuery to query and query to queryMulti

2017-08-23 Thread Xu Mingmin (JIRA)
Xu Mingmin created BEAM-2798: Summary: rename simpleQuery to query and query to queryMulti Key: BEAM-2798 URL: https://issues.apache.org/jira/browse/BEAM-2798 Project: Beam Issue Type:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3821

2017-08-23 Thread Apache Jenkins Server
See

[beam-site] branch asf-site updated (1733e1e -> 7b767fe)

2017-08-23 Thread mergebot-role
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git. from 1733e1e This closes #294 add c425fee [BEAM-2780] Fix Window sample code in programming guide

[beam-site] 01/02: [BEAM-2780] Fix Window sample code in programming guide

2017-08-23 Thread mergebot-role
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit c425fee42717d6c9934f8290742cddd274bd10a2 Author: melissa AuthorDate: Fri Aug 18

[beam-site] 02/02: This closes #295

2017-08-23 Thread mergebot-role
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit f969e19bdbd805d65205ff10125dc6ee1de143cd Merge: 1733e1e c425fee Author: Mergebot

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3820

2017-08-23 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2898

2017-08-23 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2577) IO tests should exercise Runtime Values where supported

2017-08-23 Thread Daniel Ribeiro (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139151#comment-16139151 ] Daniel Ribeiro commented on BEAM-2577: -- Ok, got it. > IO tests should exercise Runtime Values where

[GitHub] beam pull request #3733: Fix a function serialization bug in AvroIO

2017-08-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3733 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #3733: Fix a function serialization bug in AvroIO

2017-08-23 Thread jkff
This closes #3733: Fix a function serialization bug in AvroIO Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d4db66dd Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/d4db66dd Diff:

[1/2] beam git commit: Fix a bug in AvroIO, in which a SerializableFunction is created with a context containing a un-serializable member (Schema)

2017-08-23 Thread jkff
Repository: beam Updated Branches: refs/heads/master 97f32804c -> d4db66dd6 Fix a bug in AvroIO, in which a SerializableFunction is created with a context containing a un-serializable member (Schema) Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[jira] [Commented] (BEAM-2577) IO tests should exercise Runtime Values where supported

2017-08-23 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139077#comment-16139077 ] Ben Chambers commented on BEAM-2577: I think that PR demonstrates one place we could do this. This bug

[jira] [Commented] (BEAM-2577) IO tests should exercise Runtime Values where supported

2017-08-23 Thread Daniel Ribeiro (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139060#comment-16139060 ] Daniel Ribeiro commented on BEAM-2577: -- This seems to be fixed here:

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4626

2017-08-23 Thread Apache Jenkins Server
See Changes: [altay] Add Python mobile gaming streaming examples -- [...truncated 1.11 MB...] 2017-08-23T20:41:07.363 [INFO] Downloaded:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2897

2017-08-23 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3819

2017-08-23 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-2797) Update unit tests for python mobile gaming examples

2017-08-23 Thread Ahmet Altay (JIRA)
Ahmet Altay created BEAM-2797: - Summary: Update unit tests for python mobile gaming examples Key: BEAM-2797 URL: https://issues.apache.org/jira/browse/BEAM-2797 Project: Beam Issue Type: Bug

[GitHub] beam pull request #3483: [BEAM-2484] Add Python mobile gaming streaming exam...

2017-08-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3483 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-2484) Add streaming examples for Python

2017-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138995#comment-16138995 ] ASF GitHub Bot commented on BEAM-2484: -- Github user asfgit closed the pull request at:

[1/2] beam git commit: Add Python mobile gaming streaming examples

2017-08-23 Thread altay
Repository: beam Updated Branches: refs/heads/master 64ff21f35 -> 97f32804c Add Python mobile gaming streaming examples Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/12c0fa68 Tree:

[2/2] beam git commit: This closes #3483

2017-08-23 Thread altay
This closes #3483 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/97f32804 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/97f32804 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/97f32804 Branch:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3818

2017-08-23 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2896

2017-08-23 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1628) Flink runner: logic around --flinkMaster is error-prone

2017-08-23 Thread Kai Jiang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138763#comment-16138763 ] Kai Jiang commented on BEAM-1628: - [~mxm] i am off. go ahead. > Flink runner: logic around --flinkMaster

[jira] [Assigned] (BEAM-1628) Flink runner: logic around --flinkMaster is error-prone

2017-08-23 Thread Kai Jiang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Jiang reassigned BEAM-1628: --- Assignee: Aljoscha Krettek (was: Kai Jiang) > Flink runner: logic around --flinkMaster is

[jira] [Assigned] (BEAM-1628) Flink runner: logic around --flinkMaster is error-prone

2017-08-23 Thread Kai Jiang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Jiang reassigned BEAM-1628: --- Assignee: (was: Aljoscha Krettek) > Flink runner: logic around --flinkMaster is error-prone >

[jira] [Updated] (BEAM-2796) _ExecutorServiceParallelExecutor.await_for_completion does not actually await for _ExecutorService to shutdown

2017-08-23 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh updated BEAM-2796: -- Component/s: (was: runner-direct) sdk-py >

[jira] [Assigned] (BEAM-2796) _ExecutorServiceParallelExecutor.await_for_completion does not actually await for _ExecutorService to shutdown

2017-08-23 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh reassigned BEAM-2796: - Assignee: Charles Chen (was: Thomas Groh) >

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2895

2017-08-23 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2796) _ExecutorServiceParallelExecutor.await_for_completion does not actually await for _ExecutorService to shutdown

2017-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138675#comment-16138675 ] ASF GitHub Bot commented on BEAM-2796: -- GitHub user rryk opened a pull request:

[GitHub] beam pull request #3751: [BEAM-2796] Actually wait for exector service to sh...

2017-08-23 Thread rryk
GitHub user rryk opened a pull request: https://github.com/apache/beam/pull/3751 [BEAM-2796] Actually wait for exector service to shutdown Currently executor service is leaking threads, which eventually complete, but may complicate writing integration tests in frameworks that check

[jira] [Created] (BEAM-2796) _ExecutorServiceParallelExecutor.await_for_completion does not actually await for _ExecutorService to shutdown

2017-08-23 Thread Sergiy Byelozyorov (JIRA)
Sergiy Byelozyorov created BEAM-2796: Summary: _ExecutorServiceParallelExecutor.await_for_completion does not actually await for _ExecutorService to shutdown Key: BEAM-2796 URL:

[jira] [Commented] (BEAM-160) Port 'NexMark Queries' to Beam for use as integration test

2017-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138650#comment-16138650 ] ASF GitHub Bot commented on BEAM-160: - Github user asfgit closed the pull request at:

[GitHub] beam pull request #3114: [BEAM-160] Port 'NexMark Queries' to Beam for use a...

2017-08-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3114 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[25/55] [abbrv] beam git commit: Change Nexmark pom structure to mirror other modules on Beam

2017-08-23 Thread iemejia
Change Nexmark pom structure to mirror other modules on Beam Fix compile after PubsubIO refactor Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/8098bb1d Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/8098bb1d Diff:

[05/55] [abbrv] beam git commit: NexMark

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/1f08970a/integration/java/src/main/java/org/apache/beam/integration/nexmark/Generator.java -- diff --git

[30/55] [abbrv] beam git commit: Fix compile after Coders and Pubsub refactor

2017-08-23 Thread iemejia
Fix compile after Coders and Pubsub refactor Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/8b96949b Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/8b96949b Diff:

[43/55] [abbrv] beam git commit: Move module beam-integration-java-nexmark to beam-sdks-java-nexmark

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/f4333df7/sdks/java/nexmark/src/main/java/org/apache/beam/sdk/nexmark/queries/AbstractSimulator.java -- diff --git

[15/55] [abbrv] beam git commit: Refactor classes into packages

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/a7f9f7d0/integration/java/nexmark/src/main/java/org/apache/beam/integration/nexmark/Generator.java -- diff --git

[24/55] [abbrv] beam git commit: Fix and improve query3 and query12

2017-08-23 Thread iemejia
Fix and improve query3 and query12 query3: Use GlobalWindow to comply with the State/Timer APIs (issue #7). Use timer for personState expiration in GlobalWindow (issue #29). Add trigger to GlobalWindow query12: Replace Count.perKey by Count.perElement (issue #34) Project:

[08/55] [abbrv] beam git commit: Refactor classes into packages

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/a7f9f7d0/integration/java/nexmark/src/test/java/org/apache/beam/integration/nexmark/sources/UnboundedEventSourceTest.java -- diff --git

[21/55] [abbrv] beam git commit: Improve queries tests

2017-08-23 Thread iemejia
Improve queries tests Fix Runner categories in tests Add streaming unit tests and corresponding labels issue #37 Update numEvents: results are no more linked to the number of events issue #22 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[32/55] [abbrv] beam git commit: Disable use of GcsIOChannelFactory on query10

2017-08-23 Thread iemejia
Disable use of GcsIOChannelFactory on query10 Make NexmarkOptions depend on GcpOptions instead of PubsubOptions issue #21 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/902050b0 Tree:

[40/55] [abbrv] beam git commit: Update to Beam 2.2.0-SNAPSHOT and final touches before merge into master

2017-08-23 Thread iemejia
Update to Beam 2.2.0-SNAPSHOT and final touches before merge into master Clean pom, exclude nexmark packages from aggregated javadoc, put spark logs in WARN Update execution matrix in README: Flink termination of streaming pipelines is now ok as far as Nexmark is concerned Remove how to run

[44/55] [abbrv] beam git commit: Move module beam-integration-java-nexmark to beam-sdks-java-nexmark

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/f4333df7/sdks/java/nexmark/src/main/java/org/apache/beam/sdk/nexmark/NexmarkUtils.java -- diff --git a/sdks/java/nexmark/src/main/java/org/apache/beam/sdk/nexmark/NexmarkUtils.java

[47/55] [abbrv] beam git commit: Move module beam-integration-java-nexmark to beam-sdks-java-nexmark

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/f4333df7/integration/java/nexmark/src/main/java/org/apache/beam/integration/nexmark/queries/WinningBidsSimulator.java -- diff --git

[09/55] [abbrv] beam git commit: Refactor classes into packages

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/a7f9f7d0/integration/java/nexmark/src/main/java/org/apache/beam/integration/nexmark/sources/BoundedEventSource.java -- diff --git

[16/55] [abbrv] beam git commit: Refactor classes into packages

2017-08-23 Thread iemejia
Refactor classes into packages The new hierarchy has logically based packages for: - drivers - io - model - queries - sources Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a7f9f7d0 Tree:

[46/55] [abbrv] beam git commit: Move module beam-integration-java-nexmark to beam-sdks-java-nexmark

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/f4333df7/integration/java/pom.xml -- diff --git a/integration/java/pom.xml b/integration/java/pom.xml deleted file mode 100644 index b0c3853..000 --- a/integration/java/pom.xml

[33/55] [abbrv] beam git commit: Migrate to Beam 2.1.0-SNAPSHOT

2017-08-23 Thread iemejia
Migrate to Beam 2.1.0-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3d5c3d00 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/3d5c3d00 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/3d5c3d00 Branch:

[35/55] [abbrv] beam git commit: Rename NexmarkDriver to Main and NexmarkRunner to NexmarkLauncher

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/683680b1/integration/java/nexmark/src/main/java/org/apache/beam/integration/nexmark/NexmarkRunner.java -- diff --git

[22/55] [abbrv] beam git commit: Fix compile after ParDo refactor

2017-08-23 Thread iemejia
Fix compile after ParDo refactor Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/bd93c8b5 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/bd93c8b5 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/bd93c8b5 Branch:

[37/55] [abbrv] beam git commit: Fix query10 log messages

2017-08-23 Thread iemejia
Fix query10 log messages issue #5 and issue #51 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ee500b28 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/ee500b28 Diff:

[42/55] [abbrv] beam git commit: Move module beam-integration-java-nexmark to beam-sdks-java-nexmark

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/f4333df7/sdks/java/nexmark/src/main/java/org/apache/beam/sdk/nexmark/queries/Query4.java -- diff --git

[14/55] [abbrv] beam git commit: Refactor classes into packages

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/a7f9f7d0/integration/java/nexmark/src/main/java/org/apache/beam/integration/nexmark/NexmarkRunner.java -- diff --git

[20/55] [abbrv] beam git commit: Fix Spark streaming termination via waitUntilFinish and timeout config

2017-08-23 Thread iemejia
Fix Spark streaming termination via waitUntilFinish and timeout config issue #39 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e10d5783 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e10d5783 Diff:

[28/55] [abbrv] beam git commit: Move WinningBids into the queries package

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/a39cb800/integration/java/nexmark/src/main/java/org/apache/beam/integration/nexmark/queries/Query3.java -- diff --git

[52/55] [abbrv] beam git commit: Move module beam-integration-java-nexmark to beam-sdks-java-nexmark

2017-08-23 Thread iemejia
Move module beam-integration-java-nexmark to beam-sdks-java-nexmark Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f4333df7 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f4333df7 Diff:

[36/55] [abbrv] beam git commit: Rename NexmarkDriver to Main and NexmarkRunner to NexmarkLauncher

2017-08-23 Thread iemejia
Rename NexmarkDriver to Main and NexmarkRunner to NexmarkLauncher Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/683680b1 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/683680b1 Diff:

[03/55] [abbrv] beam git commit: NexMark

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/1f08970a/integration/java/src/main/java/org/apache/beam/integration/nexmark/NexmarkUtils.java -- diff --git

[11/55] [abbrv] beam git commit: Refactor classes into packages

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/a7f9f7d0/integration/java/nexmark/src/main/java/org/apache/beam/integration/nexmark/model/CategoryPrice.java -- diff --git

[38/55] [abbrv] beam git commit: Remove references to dataflow in generic classes

2017-08-23 Thread iemejia
Remove references to dataflow in generic classes Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/69953a0b Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/69953a0b Diff:

[07/55] [abbrv] beam git commit: Remove Accumulators and switch to the Metrics API

2017-08-23 Thread iemejia
Remove Accumulators and switch to the Metrics API Fix compile after sideOutput and split refactor Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b438fa7d Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b438fa7d Diff:

[27/55] [abbrv] beam git commit: Remove NexmarkDrivers and make execution runner-agnostic

2017-08-23 Thread iemejia
Remove NexmarkDrivers and make execution runner-agnostic This configuration should be external to the benchmark to avoid unexpected dependencies and to have a more Beam like (runner-independent) apprach. Add maven profiles to execute NexMark in the different runners Fix compile after extra

[18/55] [abbrv] beam git commit: Fix Queries tests

2017-08-23 Thread iemejia
Fix Queries tests Workaround for issue #22 + extra cleaning Replace junit asserts by hamcrest asserts Set numEvents in test to the minimum number that makes the tests pass issue #15 comments, improve asserts (hamcrest), reformat For now make generate monothreaded Project:

[39/55] [abbrv] beam git commit: Change benchmark workload settings

2017-08-23 Thread iemejia
Change benchmark workload settings Update configuration of events generation to add some variation Update execution matrix (issue #45) Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/dbd1b155 Tree:

[53/55] [abbrv] beam git commit: Clean, fix findbugs, fix checkstyle

2017-08-23 Thread iemejia
Clean, fix findbugs, fix checkstyle Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2f9b4948 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/2f9b4948 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/2f9b4948

[51/55] [abbrv] beam git commit: Move module beam-integration-java-nexmark to beam-sdks-java-nexmark

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/f4333df7/integration/java/nexmark/src/main/java/org/apache/beam/integration/nexmark/NexmarkLauncher.java -- diff --git

[02/55] [abbrv] beam git commit: NexMark

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/1f08970a/integration/java/src/main/java/org/apache/beam/integration/nexmark/Query2.java -- diff --git

[12/55] [abbrv] beam git commit: Refactor classes into packages

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/a7f9f7d0/integration/java/nexmark/src/main/java/org/apache/beam/integration/nexmark/UnboundedEventSource.java -- diff --git

[31/55] [abbrv] beam git commit: Fix static analysis issues

2017-08-23 Thread iemejia
Fix static analysis issues Restrict access level on classes + other static analysis fixes Fix findbugs issues (issue #33) Fix compile after AvroIO, TextIO, PubsubIO and State refactor Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[34/55] [abbrv] beam git commit: Clean some code that is specific to Dataflow

2017-08-23 Thread iemejia
Clean some code that is specific to Dataflow Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/77eabbaa Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/77eabbaa Diff:

[55/55] [abbrv] beam git commit: This closes #3114

2017-08-23 Thread iemejia
This closes #3114 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/64ff21f3 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/64ff21f3 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/64ff21f3 Branch:

[54/55] [abbrv] beam git commit: Improve NexmarkUtils: improve diskBusy() and remove unneeded randomization code

2017-08-23 Thread iemejia
Improve NexmarkUtils: improve diskBusy() and remove unneeded randomization code - Use state API in NexmarkUtils.diskBusy() - Remove commented code for direct runner randomization disabling: direct runner no more allows disabling randomization and queries and UT pass Project:

[04/55] [abbrv] beam git commit: NexMark

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/1f08970a/integration/java/src/main/java/org/apache/beam/integration/nexmark/NexmarkGoogleDriver.java -- diff --git

[45/55] [abbrv] beam git commit: Move module beam-integration-java-nexmark to beam-sdks-java-nexmark

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/f4333df7/sdks/java/nexmark/src/main/java/org/apache/beam/sdk/nexmark/NexmarkLauncher.java -- diff --git

[26/55] [abbrv] beam git commit: Remove NexmarkDrivers and make execution runner-agnostic

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/a6dbdfa5/integration/java/nexmark/src/main/java/org/apache/beam/integration/nexmark/io/PubsubJsonClient.java -- diff --git

[17/55] [abbrv] beam git commit: Fix Apex driver and update execution matrix

2017-08-23 Thread iemejia
Fix Apex driver and update execution matrix Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9ce9bf07 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/9ce9bf07 Diff:

[13/55] [abbrv] beam git commit: Refactor classes into packages

2017-08-23 Thread iemejia
http://git-wip-us.apache.org/repos/asf/beam/blob/a7f9f7d0/integration/java/nexmark/src/main/java/org/apache/beam/integration/nexmark/Query3.java -- diff --git

  1   2   >