[GitHub] incubator-beam pull request: Test WindowEvaluatorFactory on Window...

2016-05-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/313 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[1/2] incubator-beam git commit: Test WindowEvaluatorFactory on WindowedValues in multiple windows

2016-05-09 Thread kenn
Repository: incubator-beam Updated Branches: refs/heads/master 31da925ca -> 9feea2389 Test WindowEvaluatorFactory on WindowedValues in multiple windows Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[jira] [Commented] (BEAM-22) DirectPipelineRunner: support for unbounded collections

2016-05-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-22?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277296#comment-15277296 ] ASF GitHub Bot commented on BEAM-22: Github user asfgit closed the pull request at:

[1/2] incubator-beam git commit: Closes #289

2016-05-09 Thread dhalperi
Repository: incubator-beam Updated Branches: refs/heads/master 272493ed7 -> 31da925ca Closes #289 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/31da925c Tree:

[GitHub] incubator-beam pull request: Test WindowEvaluatorFactory on Window...

2016-05-09 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/313 Test WindowEvaluatorFactory on WindowedValues in multiple windows Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] incubator-beam pull request: [BEAM-22] Add ShardWatermarkTracker

2016-05-09 Thread tgroh
Github user tgroh closed the pull request at: https://github.com/apache/incubator-beam/pull/304 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Commented] (BEAM-22) DirectPipelineRunner: support for unbounded collections

2016-05-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-22?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277134#comment-15277134 ] ASF GitHub Bot commented on BEAM-22: Github user tgroh closed the pull request at:

[jira] [Commented] (BEAM-22) DirectPipelineRunner: support for unbounded collections

2016-05-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-22?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277124#comment-15277124 ] ASF GitHub Bot commented on BEAM-22: GitHub user tgroh opened a pull request:

[GitHub] incubator-beam pull request: [BEAM-22] Update Watermarks Outside o...

2016-05-09 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/312 [BEAM-22] Update Watermarks Outside of handleResult Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] incubator-beam pull request: mmm

2016-05-09 Thread davorbonaci
GitHub user davorbonaci opened a pull request: https://github.com/apache/incubator-beam/pull/311 mmm Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-]

[GitHub] incubator-beam pull request: mmm

2016-05-09 Thread davorbonaci
Github user davorbonaci closed the pull request at: https://github.com/apache/incubator-beam/pull/311 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (BEAM-22) DirectPipelineRunner: support for unbounded collections

2016-05-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-22?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276999#comment-15276999 ] ASF GitHub Bot commented on BEAM-22: GitHub user tgroh opened a pull request:

[GitHub] incubator-beam pull request: [BEAM-22] Use PushbackSideInputDoFnRu...

2016-05-09 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/309 [BEAM-22] Use PushbackSideInputDoFnRunner in the InProcessRunner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[jira] [Commented] (BEAM-146) WindowFn.AssingContext leaks implementation details about compressed WindowedValue representation

2016-05-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276858#comment-15276858 ] ASF GitHub Bot commented on BEAM-146: - GitHub user kennknowles opened a pull request:

[GitHub] incubator-beam pull request: [BEAM-146] Remove references to multi...

2016-05-09 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/incubator-beam/pull/308 [BEAM-146] Remove references to multi-window representation from model Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x]

[jira] [Commented] (BEAM-22) DirectPipelineRunner: support for unbounded collections

2016-05-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-22?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276802#comment-15276802 ] ASF GitHub Bot commented on BEAM-22: Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request: [BEAM-22] Allow InProcess TransformEv...

2016-05-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/283 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[3/4] incubator-beam git commit: Allow InProcess TransformEvaluators to refuse inputs

2016-05-09 Thread kenn
Allow InProcess TransformEvaluators to refuse inputs Inputs that cannot be processed (generally due to a side input not being ready) can be added to a list of unprocessed elements, which will schedule them to be executed at a later point. Project:

[2/4] incubator-beam git commit: Use AutoValue for ExecutorUpdate

2016-05-09 Thread kenn
Use AutoValue for ExecutorUpdate Explicitly provide the collections the Bundle should be consumed by in the update. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/59cca8dd Tree:

[1/4] incubator-beam git commit: Refactor CompletionCallbacks

2016-05-09 Thread kenn
Repository: incubator-beam Updated Branches: refs/heads/master da1b7556b -> 272493ed7 Refactor CompletionCallbacks The default and timerful completion callbacks are identical, excepting their calls to evaluationContext.commitResult; factor that code into a common location. Project:

[jira] [Resolved] (BEAM-34) Change default output timestamp for combined values to end of window

2016-05-09 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-34?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-34. - Resolution: Fixed > Change default output timestamp for combined values to end of window >

[jira] [Commented] (BEAM-262) Native Runners | Direct Compiler

2016-05-09 Thread Frances Perry (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276724#comment-15276724 ] Frances Perry commented on BEAM-262: I'm not sure why you think using Flink or Spark for execution is

[GitHub] incubator-beam pull request: FileBasedSink: fix a format string bu...

2016-05-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/306 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (BEAM-269) Create BigDecimal Coder

2016-05-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276678#comment-15276678 ] ASF GitHub Bot commented on BEAM-269: - GitHub user eljefe6a opened a pull request:

[GitHub] incubator-beam pull request: [BEAM-269] Create BigDecimal Coder

2016-05-09 Thread eljefe6a
GitHub user eljefe6a opened a pull request: https://github.com/apache/incubator-beam/pull/307 [BEAM-269] Create BigDecimal Coder Jira issue BEAM-269 Create BigDecimal Coder. Added coder for BigDecimal. Added unit tests for BigDecimal coder. You can merge this pull request into a

[1/2] incubator-beam git commit: FileBasedSink: fix a format string bug

2016-05-09 Thread dhalperi
Repository: incubator-beam Updated Branches: refs/heads/master 7725a47a7 -> da1b7556b FileBasedSink: fix a format string bug Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/3ff02950 Tree:

[2/2] incubator-beam git commit: Closes #306

2016-05-09 Thread dhalperi
Closes #306 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/da1b7556 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/da1b7556 Diff:

[jira] [Commented] (BEAM-165) Add a MapReduce runner

2016-05-09 Thread Jesse Anderson (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276654#comment-15276654 ] Jesse Anderson commented on BEAM-165: - There is more MR than Spark out there. I think not having the

[jira] [Commented] (BEAM-145) OutputTimeFn#assignOutputTime overrides WindowFn#getOutputTime in unfortunate ways

2016-05-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276642#comment-15276642 ] ASF GitHub Bot commented on BEAM-145: - Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request: [BEAM-145] [BEAM-34] Make WindowingSt...

2016-05-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/296 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[2/2] incubator-beam git commit: This closes #296

2016-05-09 Thread kenn
This closes #296 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7725a47a Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7725a47a Diff:

[1/2] incubator-beam git commit: Make WindowingStrategy combine WindowFn with OutputTimeFn

2016-05-09 Thread kenn
Repository: incubator-beam Updated Branches: refs/heads/master 199ec2e10 -> 7725a47a7 Make WindowingStrategy combine WindowFn with OutputTimeFn Previously: - Any user-specified OutputTimeFn overrode the WindowFn#getOutputTime - WindowFn#getOutputTimeFn provided a default OutputTimeFn -

[GitHub] incubator-beam pull request: FileBasedSink: fix a format string bu...

2016-05-09 Thread dhalperi
GitHub user dhalperi opened a pull request: https://github.com/apache/incubator-beam/pull/306 FileBasedSink: fix a format string bug R: @lukecwik @kennknowles @peihe @tgroh anyone will do You can merge this pull request into a Git repository by running: $ git pull

[GitHub] incubator-beam pull request: pom.xml: upgrade to version 1.22.0 of...

2016-05-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/303 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[2/2] incubator-beam git commit: pom.xml: upgrade to version 1.22.0 of the Google API client libs

2016-05-09 Thread dhalperi
pom.xml: upgrade to version 1.22.0 of the Google API client libs Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/2c3c464f Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/2c3c464f Diff:

[1/2] incubator-beam git commit: Closes #303

2016-05-09 Thread dhalperi
Repository: incubator-beam Updated Branches: refs/heads/master 03e99540a -> 199ec2e10 Closes #303 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/199ec2e1 Tree:

[2/2] incubator-beam git commit: This closes #217

2016-05-09 Thread kenn
This closes #217 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/03e99540 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/03e99540 Diff:

[GitHub] incubator-beam pull request: [BEAM-115] Add control of PipelineVis...

2016-05-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/217 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[1/2] incubator-beam git commit: Add control of PipelineVisitor recursion into composite transforms

2016-05-09 Thread kenn
Repository: incubator-beam Updated Branches: refs/heads/master 07c60a965 -> 03e99540a Add control of PipelineVisitor recursion into composite transforms Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[jira] [Updated] (BEAM-270) Use WindowedValue in Flink Batch

2016-05-09 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-270: -- Issue Type: Sub-task (was: Improvement) Parent: BEAM-258 > Use WindowedValue in Flink

[jira] [Commented] (BEAM-264) Matrix, Vector, Tensor Abstractions for Inputs, Outputs and Processing and Construction of Such Structures from Scalars, Other Structures and Queries

2016-05-09 Thread Suminda Dharmasena (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276069#comment-15276069 ] Suminda Dharmasena commented on BEAM-264: - You can do all this now at an massive effort. If there is

[jira] [Commented] (BEAM-262) Native Runners | Direct Compiler

2016-05-09 Thread Suminda Dharmasena (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276066#comment-15276066 ] Suminda Dharmasena commented on BEAM-262: - If you generate the backend there is: - zero overhead

[jira] [Commented] (BEAM-265) Dynamic Pipeline, Transformation, etc. / DAG Changes DSL | Full Specification Language Independence, Transo

2016-05-09 Thread Suminda Dharmasena (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276063#comment-15276063 ] Suminda Dharmasena commented on BEAM-265: - I am not saying not to support language dependent