[GitHub] incubator-beam pull request #890: Updates SourceTestBase concurrent splittin...

2016-08-25 Thread chamikaramj
GitHub user chamikaramj opened a pull request: https://github.com/apache/incubator-beam/pull/890 Updates SourceTestBase concurrent splitting test to share thread pool Updates SourceTestBase concurrent splitting test to share thread pool across runs. Without this, runs could

[jira] [Commented] (BEAM-485) Can't set Flink runner in code

2016-08-25 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438508#comment-15438508 ] Aljoscha Krettek commented on BEAM-485: --- Hi [~ecesena], could you check whether this b

[jira] [Resolved] (BEAM-253) Unify Flink Operator Wrappers

2016-08-25 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek resolved BEAM-253. --- Resolution: Fixed Fix Version/s: 0.3.0-incubating Implemented here: https://github.com/a

[jira] [Resolved] (BEAM-315) Flink Runner compares keys unencoded which may produce incorrect results

2016-08-25 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek resolved BEAM-315. --- Resolution: Fixed > Flink Runner compares keys unencoded which may produce incorrect results > -

[jira] [Resolved] (BEAM-322) Compare encoded keys in streaming mode

2016-08-25 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek resolved BEAM-322. --- Resolution: Fixed Implemented as part of this: https://github.com/apache/incubator-beam/commit/

[jira] [Resolved] (BEAM-102) Side Inputs for Streaming

2016-08-25 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek resolved BEAM-102. --- Resolution: Fixed Fix Version/s: 0.3.0-incubating Implemented here:https://github.com/ap

Build failed in Jenkins: beam_PostCommit_RunnableOnService_GearpumpLocal #142

2016-08-25 Thread Apache Jenkins Server
See -- [...truncated 9298 lines...] [INFO] Including io.grpc:grpc-protobuf:jar:0.14.1 in the shaded jar. [INFO] Including com.google.protobuf:protobuf-java-util:jar:3.0.0-b

[jira] [Commented] (BEAM-591) Better handling watermark in KafkaIO

2016-08-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438443#comment-15438443 ] Daniel Halperin commented on BEAM-591: -- May be worth checking out PubSubIO. It has two

[jira] [Commented] (BEAM-79) Gearpump runner

2016-08-25 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-79?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438364#comment-15438364 ] ASF GitHub Bot commented on BEAM-79: Github user manuzhang closed the pull request at:

[GitHub] incubator-beam pull request #750: [BEAM-79] Merge branch 'master' into gearp...

2016-08-25 Thread manuzhang
Github user manuzhang closed the pull request at: https://github.com/apache/incubator-beam/pull/750 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feat

[jira] [Commented] (BEAM-589) Making IO.Read transformations to extend PTransform>

2016-08-25 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438174#comment-15438174 ] ASF GitHub Bot commented on BEAM-589: - GitHub user gauravgopi123 opened a pull request:

[GitHub] incubator-beam pull request #889: [BEAM-589] Fixing IO.Read transformation

2016-08-25 Thread gauravgopi123
GitHub user gauravgopi123 opened a pull request: https://github.com/apache/incubator-beam/pull/889 [BEAM-589] Fixing IO.Read transformation Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is fo

Build failed in Jenkins: beam_PostCommit_RunnableOnService_GearpumpLocal #141

2016-08-25 Thread Apache Jenkins Server
See -- [...truncated 10846 lines...] at org.apache.beam.runners.gearpump.GearpumpPipelineTranslator.translate(GearpumpPipelineTranslator.java:83) at org.a

[GitHub] incubator-beam pull request #872: checkstyle: prohibit API client repackaged...

2016-08-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/872 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[1/2] incubator-beam git commit: Closes #872

2016-08-25 Thread dhalperi
Repository: incubator-beam Updated Branches: refs/heads/master 9c9f4c9c9 -> bfd810f41 Closes #872 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/bfd810f4 Tree: http://git-wip-us.apache.org/repos/asf/incu

[2/2] incubator-beam git commit: checkstyle: prohibit API client repackaged Guava

2016-08-25 Thread dhalperi
checkstyle: prohibit API client repackaged Guava Apparently the IllegalImport check only blocks packages, so we had to move to Regexp to get individual classes. As a bonus, this enforcement let us remove two bogus dependencies. Smaller JARs for the win! Project: http://git-wip-us.apache.org/rep

[2/2] incubator-beam git commit: Closes #886

2016-08-25 Thread dhalperi
Closes #886 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/9c9f4c9c Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/9c9f4c9c Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/

[GitHub] incubator-beam pull request #886: Make WriteTest more resilient to Randomnes...

2016-08-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/886 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[1/2] incubator-beam git commit: Make WriteTest more resilient to Randomness

2016-08-25 Thread dhalperi
Repository: incubator-beam Updated Branches: refs/heads/master edcb5eff3 -> 9c9f4c9c9 Make WriteTest more resilient to Randomness In the worst case scenario for random key assignment in Write.ApplyShardingKey, the chance of the number of records per output shard was too high. This makes the te

[GitHub] incubator-beam pull request #888: [Draft] Cleaner backoff utilities in Beam

2016-08-25 Thread dhalperi
GitHub user dhalperi opened a pull request: https://github.com/apache/incubator-beam/pull/888 [Draft] Cleaner backoff utilities in Beam We have 3 different backoff classes, which don't really have that much different functionality. Add a single, flexible backoff implementation that

[jira] [Commented] (BEAM-194) Create a walkthrough of Beam examples in mobile gaming domain

2016-08-25 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15437795#comment-15437795 ] Pei He commented on BEAM-194: - And, https://cloud.google.com/dataflow/model/triggers https://clo

[jira] [Updated] (BEAM-591) Better handling watermark in KafkaIO

2016-08-25 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated BEAM-591: -- Description: Right now default watermark in KafkaIO is same as timestamp of the record. The main problem

[jira] [Commented] (BEAM-362) Move shared runner functionality out of SDK and into runners/core-java

2016-08-25 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15437790#comment-15437790 ] ASF GitHub Bot commented on BEAM-362: - GitHub user kennknowles opened a pull request:

[GitHub] incubator-beam pull request #887: [BEAM-362] Put classes in runners-core pac...

2016-08-25 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/incubator-beam/pull/887 [BEAM-362] Put classes in runners-core package into runners.core namespace Be sure to do all of the following to help us incorporate your contribution quickly and easily: -

[GitHub] incubator-beam pull request #886: Make WriteTest more resilient to Randomnes...

2016-08-25 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/886 Make WriteTest more resilient to Randomness Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatt

[2/2] incubator-beam git commit: This closes #844

2016-08-25 Thread kenn
This closes #844 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/edcb5eff Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/edcb5eff Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/

[1/2] incubator-beam git commit: Update DoFn javadocs to remove references to OldDoFn and Dataflow

2016-08-25 Thread kenn
Repository: incubator-beam Updated Branches: refs/heads/master a69a0ea90 -> edcb5eff3 Update DoFn javadocs to remove references to OldDoFn and Dataflow Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/4e62

[GitHub] incubator-beam pull request #844: [BEAM-498] Update DoFn javadocs to remove ...

2016-08-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/844 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Commented] (BEAM-498) Make DoFnWithContext the new DoFn

2016-08-25 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15437769#comment-15437769 ] ASF GitHub Bot commented on BEAM-498: - Github user asfgit closed the pull request at:

[jira] [Resolved] (BEAM-590) Port examples web docs from Dataflow to Beam website.

2016-08-25 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He resolved BEAM-590. - Resolution: Duplicate Fix Version/s: Not applicable > Port examples web docs from Dataflow to Beam website. >

[jira] [Commented] (BEAM-590) Port examples web docs from Dataflow to Beam website.

2016-08-25 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15437741#comment-15437741 ] Pei He commented on BEAM-590: - We can merge them under the same jira issue. Closing this one. >

[jira] [Commented] (BEAM-194) Create a walkthrough of Beam examples in mobile gaming domain

2016-08-25 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15437739#comment-15437739 ] Pei He commented on BEAM-194: - We also have the dataflow word count walk through that it is refe

[GitHub] incubator-beam pull request #885: Remove the DataflowRunner instructions fro...

2016-08-25 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/885 Remove the DataflowRunner instructions from examples You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam examples-c

[jira] [Updated] (BEAM-591) Better handling watermark in KafkaIO

2016-08-25 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated BEAM-591: -- Description: Right now default watermark in KafkaIO is same as timestamp of the record. The main problem

[jira] [Created] (BEAM-591) Better handling watermark in KafkaIO

2016-08-25 Thread Raghu Angadi (JIRA)
Raghu Angadi created BEAM-591: - Summary: Better handling watermark in KafkaIO Key: BEAM-591 URL: https://issues.apache.org/jira/browse/BEAM-591 Project: Beam Issue Type: Bug Components:

[jira] [Commented] (BEAM-590) Port examples web docs from Dataflow to Beam website.

2016-08-25 Thread Frances Perry (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15437677#comment-15437677 ] Frances Perry commented on BEAM-590: Is this a dup of BEAM-194? > Port examples web doc

[jira] [Created] (BEAM-590) Port examples web docs from Dataflow to Beam website.

2016-08-25 Thread Pei He (JIRA)
Pei He created BEAM-590: --- Summary: Port examples web docs from Dataflow to Beam website. Key: BEAM-590 URL: https://issues.apache.org/jira/browse/BEAM-590 Project: Beam Issue Type: New Feature

[jira] [Commented] (BEAM-589) Making IO.Read transformations to extend PTransform>

2016-08-25 Thread gaurav gupta (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15437663#comment-15437663 ] gaurav gupta commented on BEAM-589: --- I will take this up. Unfortunately I am not able to a

[jira] [Created] (BEAM-589) Making IO.Read transformations to extend PTransform>

2016-08-25 Thread gaurav gupta (JIRA)
gaurav gupta created BEAM-589: - Summary: Making IO.Read transformations to extend PTransform> Key: BEAM-589 URL: https://issues.apache.org/jira/browse/BEAM-589 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-545) Pipelines and their executions naming changes

2016-08-25 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15437634#comment-15437634 ] ASF GitHub Bot commented on BEAM-545: - Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request #719: [BEAM-545] Promote JobName to PipelineOpti...

2016-08-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/719 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[2/2] incubator-beam git commit: [BEAM-545] Promote JobName to PipelineOptions

2016-08-25 Thread dhalperi
[BEAM-545] Promote JobName to PipelineOptions Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b04776d4 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/b04776d4 Diff: http://git-wip-us.apache.

[1/2] incubator-beam git commit: Closes #719

2016-08-25 Thread dhalperi
Repository: incubator-beam Updated Branches: refs/heads/master 10b3fee34 -> a69a0ea90 Closes #719 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a69a0ea9 Tree: http://git-wip-us.apache.org/repos/asf/incu

[1/2] incubator-beam git commit: Move the samples data to gs://apache-beam-samples/

2016-08-25 Thread dhalperi
Repository: incubator-beam Updated Branches: refs/heads/master f7384e1a6 -> 10b3fee34 Move the samples data to gs://apache-beam-samples/ Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/83ccf082 Tree: http

[GitHub] incubator-beam pull request #882: Move the samples data to gs://apache-beam-...

2016-08-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/882 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[2/2] incubator-beam git commit: Closes #882

2016-08-25 Thread dhalperi
Closes #882 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/10b3fee3 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/10b3fee3 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/

Build failed in Jenkins: beam_PostCommit_RunnableOnService_GearpumpLocal #140

2016-08-25 Thread Apache Jenkins Server
See Changes: [tgroh] Make TransformEvaluatorFactory reuse Explicit [dhalperi] Checkstyle: enforce package-info.java presence [klk] Add withAllowedLateness with Closing Behavior to Window [klk] Use the

[12/50] incubator-beam git commit: Fix MapAggregatorValues use of toStringHelper

2016-08-25 Thread kenn
Fix MapAggregatorValues use of toStringHelper Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c867790a Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c867790a Diff: http://git-wip-us.apache.

[21/50] incubator-beam git commit: [BEAM-534] Fix dead links in README.md

2016-08-25 Thread kenn
[BEAM-534] Fix dead links in README.md Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/0812fe65 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/0812fe65 Diff: http://git-wip-us.apache.org/rep

[50/50] incubator-beam git commit: This closess #750

2016-08-25 Thread kenn
This closess #750 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/091a15a0 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/091a15a0 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam

[42/50] incubator-beam git commit: This closes #813

2016-08-25 Thread kenn
This closes #813 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/6da92ad9 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/6da92ad9 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/

[39/50] incubator-beam git commit: This closes #699

2016-08-25 Thread kenn
This closes #699 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/fa0e395f Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/fa0e395f Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/

[33/50] incubator-beam git commit: This closes #807

2016-08-25 Thread kenn
This closes #807 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/95e7f017 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/95e7f017 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/

[28/50] incubator-beam git commit: Fixed javadoc for processBundle

2016-08-25 Thread kenn
Fixed javadoc for processBundle The 2nd `li` element for `processBundle(InputT... inputElements)` was missing a proper closing tag. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a9a76b01 Tree: http://git-w

[34/50] incubator-beam git commit: Use Datastore AncestorKey for AutoComplete example

2016-08-25 Thread kenn
Use Datastore AncestorKey for AutoComplete example Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a41dab86 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a41dab86 Diff: http://git-wip-us.ap

[24/50] incubator-beam git commit: Change WordCount default input

2016-08-25 Thread kenn
Change WordCount default input Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/e979c826 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/e979c826 Diff: http://git-wip-us.apache.org/repos/asf/i

[38/50] incubator-beam git commit: Move aggregator support classes out of runners namespace, make private

2016-08-25 Thread kenn
Move aggregator support classes out of runners namespace, make private Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/adec254d Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/adec254d Diff:

[05/50] incubator-beam git commit: Port BigQueryIO to new DoFn

2016-08-25 Thread kenn
Port BigQueryIO to new DoFn Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d6395e9d Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/d6395e9d Diff: http://git-wip-us.apache.org/repos/asf/incu

[15/50] incubator-beam git commit: Relocate Travis utilities to .travis

2016-08-25 Thread kenn
Relocate Travis utilities to .travis Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5e1185d6 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/5e1185d6 Diff: http://git-wip-us.apache.org/repos

[46/50] incubator-beam git commit: move integration tests to profile

2016-08-25 Thread kenn
move integration tests to profile Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1672b548 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/1672b548 Diff: http://git-wip-us.apache.org/repos/as

[06/50] incubator-beam git commit: Add ViewFn and port SDK to use it

2016-08-25 Thread kenn
Add ViewFn and port SDK to use it This is a preliminary step towards the architecture at https://s.apache.org/beam-side-input-1-pager This separates the ViewFn part of each PCollectionView class/transform, toward eliminating extraneous public subclasses of PCollectionView and PTransform. Projec

[14/50] incubator-beam git commit: This closes #791

2016-08-25 Thread kenn
This closes #791 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7da1a3de Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7da1a3de Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/

[36/50] incubator-beam git commit: SparkRunner batch interval as a configuration instead of Beam Windows.

2016-08-25 Thread kenn
SparkRunner batch interval as a configuration instead of Beam Windows. Add the batch interval to the pipeline options, default arbitrarily to 1000 msec. Pick-up the batch interval from pipeline options and remove StreamingWindowPipelineDetector. Use SDK API to get the window function. Update

[04/50] incubator-beam git commit: Port Java 8 tests to new DoFn

2016-08-25 Thread kenn
Port Java 8 tests to new DoFn Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/879f18fd Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/879f18fd Diff: http://git-wip-us.apache.org/repos/asf/in

[19/50] incubator-beam git commit: Deprecate more uses of OldDoFn

2016-08-25 Thread kenn
Deprecate more uses of OldDoFn Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/2c8eb429 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/2c8eb429 Diff: http://git-wip-us.apache.org/repos/asf/i

[31/50] incubator-beam git commit: This closes #789

2016-08-25 Thread kenn
This closes #789 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/eef26f42 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/eef26f42 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/

[09/50] incubator-beam git commit: This closes #768

2016-08-25 Thread kenn
This closes #768 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d60a0a0e Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/d60a0a0e Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/

[40/50] incubator-beam git commit: This closes #803

2016-08-25 Thread kenn
This closes #803 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b4c0bb9f Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/b4c0bb9f Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/

[23/50] incubator-beam git commit: This closes #805

2016-08-25 Thread kenn
This closes #805 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/063ff2f4 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/063ff2f4 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/

[01/50] incubator-beam git commit: Port various Spark runner tests to new DoFn

2016-08-25 Thread kenn
Repository: incubator-beam Updated Branches: refs/heads/gearpump-runner 02b2248a5 -> 091a15a07 Port various Spark runner tests to new DoFn Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/f5df3583 Tree: ht

[43/50] incubator-beam git commit: Demonstrate that the DirectRunner runs per-call

2016-08-25 Thread kenn
Demonstrate that the DirectRunner runs per-call Add a field that is modified per output, which should occur twice. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/65f9076d Tree: http://git-wip-us.apache.org/

[11/50] incubator-beam git commit: Inline MapAggregatorValues to remove dependencies

2016-08-25 Thread kenn
Inline MapAggregatorValues to remove dependencies This class is trivial. Adding it to the public API of the SDK is not desirable, since it is just for runners. Adding it to runners-core would be OK but is really overkill for a glorified Map. Project: http://git-wip-us.apache.org/repos/asf/incuba

[30/50] incubator-beam git commit: [BEAM-401] Use StringBuilder in StandardCoder.toString()

2016-08-25 Thread kenn
[BEAM-401] Use StringBuilder in StandardCoder.toString() Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/743923b1 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/743923b1 Diff: http://git-wip

[37/50] incubator-beam git commit: [BEAM-542] Spark batch interval should be a configuration instead of an interpretation of the Pipeline's windows

2016-08-25 Thread kenn
[BEAM-542] Spark batch interval should be a configuration instead of an interpretation of the Pipeline's windows This closes #808 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/fc87a0ca Tree: http://git-wi

[32/50] incubator-beam git commit: Remove WindowingInternals support from DoFnReflector

2016-08-25 Thread kenn
Remove WindowingInternals support from DoFnReflector The test themselves are replaced by mostly-hidden placeholders, to ensure that our code for handling generic parameters remains in place until new context parameters that use generics are added back. Project: http://git-wip-us.apache.org/repos

[44/50] incubator-beam git commit: This closes #811

2016-08-25 Thread kenn
This closes #811 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/2a1055dd Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/2a1055dd Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/

[35/50] incubator-beam git commit: Closes #788

2016-08-25 Thread kenn
Closes #788 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/0ab9495f Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/0ab9495f Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/

[47/50] incubator-beam git commit: add package-info.java

2016-08-25 Thread kenn
add package-info.java Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/276a2e10 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/276a2e10 Diff: http://git-wip-us.apache.org/repos/asf/incubator-

[45/50] incubator-beam git commit: Merge branch master into gearpump-runner

2016-08-25 Thread kenn
Merge branch master into gearpump-runner Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/2a0ba61e Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/2a0ba61e Diff: http://git-wip-us.apache.org/r

[48/50] incubator-beam git commit: Update Gearpump runner version to 0.3.0-incubating

2016-08-25 Thread kenn
Update Gearpump runner version to 0.3.0-incubating Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/40be715a Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/40be715a Diff: http://git-wip-us.ap

[27/50] incubator-beam git commit: This closes #792

2016-08-25 Thread kenn
This closes #792 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/6a5310a5 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/6a5310a5 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/

[49/50] incubator-beam git commit: Rename DoFn to OldDoFn in Gearpump runner

2016-08-25 Thread kenn
Rename DoFn to OldDoFn in Gearpump runner Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/bc1b3549 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/bc1b3549 Diff: http://git-wip-us.apache.org/

[16/50] incubator-beam git commit: Lower maven central timeouts on Travis-CI

2016-08-25 Thread kenn
Lower maven central timeouts on Travis-CI Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/71366165 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/71366165 Diff: http://git-wip-us.apache.org/

[17/50] incubator-beam git commit: Port easy parts of DataflowRunner to new DoFn

2016-08-25 Thread kenn
Port easy parts of DataflowRunner to new DoFn Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/fcdd15b8 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/fcdd15b8 Diff: http://git-wip-us.apache.

[41/50] incubator-beam git commit: Make TimerData#compareTo consistent with equals

2016-08-25 Thread kenn
Make TimerData#compareTo consistent with equals Timers are equal if the domain, timestamp, and namespace are equal. Compare these values in compareTo. The ordering of TimerData that are not in the same namespace or domain is arbitrary. Project: http://git-wip-us.apache.org/repos/asf/incubator-be

[25/50] incubator-beam git commit: [BEAM-124] Spark Running WordCountIT Example

2016-08-25 Thread kenn
[BEAM-124] Spark Running WordCountIT Example Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/9983ff9c Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/9983ff9c Diff: http://git-wip-us.apache.o

[26/50] incubator-beam git commit: [BEAM-124] Spark Running WordCountIT Example

2016-08-25 Thread kenn
[BEAM-124] Spark Running WordCountIT Example This closes #769 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a035796c Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a035796c Diff: http://g

[02/50] incubator-beam git commit: Port Flink fork of examples to new DoFn

2016-08-25 Thread kenn
Port Flink fork of examples to new DoFn Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/87313f1c Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/87313f1c Diff: http://git-wip-us.apache.org/re

[03/50] incubator-beam git commit: Port Flink integration tests to new DoFn

2016-08-25 Thread kenn
Port Flink integration tests to new DoFn Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/ae1f6d18 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/ae1f6d18 Diff: http://git-wip-us.apache.org/r

[20/50] incubator-beam git commit: Make StreamingPCollectionViewWriterFn and its data public

2016-08-25 Thread kenn
Make StreamingPCollectionViewWriterFn and its data public This enables a smooth migration path whereby the runner can notice the class and extract these values, to run them without OldDoFn. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/r

[08/50] incubator-beam git commit: This closes #797

2016-08-25 Thread kenn
This closes #797 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/574c3777 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/574c3777 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/

[13/50] incubator-beam git commit: Cache .m2 directory on Travis-CI

2016-08-25 Thread kenn
Cache .m2 directory on Travis-CI Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/630ae250 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/630ae250 Diff: http://git-wip-us.apache.org/repos/asf

[18/50] incubator-beam git commit: Unwrap UserCodeException in DoFnTester

2016-08-25 Thread kenn
Unwrap UserCodeException in DoFnTester The execution of user code and system code is intertwined in the OldDoFn wrapper of DoFn. So DoFnTester will sometimes encounter a wrapped UserCodeException where previously the exception would not have been wrapped. Project: http://git-wip-us.apache.org/re

[07/50] incubator-beam git commit: This closes #759

2016-08-25 Thread kenn
This closes #759 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/bb00810a Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/bb00810a Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/

[22/50] incubator-beam git commit: [BEAM-534] Fix dead links in README.md

2016-08-25 Thread kenn
[BEAM-534] Fix dead links in README.md This closes #790 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/ac5242e4 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/ac5242e4 Diff: http://git-wip

[29/50] incubator-beam git commit: Closes #809

2016-08-25 Thread kenn
Closes #809 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/038eeca2 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/038eeca2 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/

[10/50] incubator-beam git commit: This closes #520

2016-08-25 Thread kenn
This closes #520 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5049011a Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/5049011a Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/

[jira] [Created] (BEAM-588) All runners should support ProfilingOptions

2016-08-25 Thread Ahmet Altay (JIRA)
Ahmet Altay created BEAM-588: Summary: All runners should support ProfilingOptions Key: BEAM-588 URL: https://issues.apache.org/jira/browse/BEAM-588 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-587) Update KafkaIO to take advantage of Dofn Setup/Teardown

2016-08-25 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-587: Summary: Update KafkaIO to take advantage of Dofn Setup/Teardown Key: BEAM-587 URL: https://issues.apache.org/jira/browse/BEAM-587 Project: Beam Issue Type:

[jira] [Created] (BEAM-586) CombineFns with no inputs should produce no outputs when used as a main input

2016-08-25 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-586: Summary: CombineFns with no inputs should produce no outputs when used as a main input Key: BEAM-586 URL: https://issues.apache.org/jira/browse/BEAM-586 Project: Beam

  1   2   >