Jenkins build is back to stable : beam_PostCommit_RunnableOnService_GoogleCloudDataflow #311

See

[jira] [Created] (BEAM-271) Option to configure remote Dataflow windmill service endpoint

Raghu Angadi created BEAM-271: - Summary: Option to configure remote Dataflow windmill service endpoint Key: BEAM-271 URL: https://issues.apache.org/jira/browse/BEAM-271 Project: Beam Issue Type:

[GitHub] incubator-beam pull request: [BEAM-todo] Option to configure remot...

GitHub user rangadi opened a pull request: https://github.com/apache/incubator-beam/pull/314 [BEAM-todo] Option to configure remote Dataflow windmill service endpoint Add two options to DataflowPipelineDebugOptions to configure Dataflow remove windmill service. This lets Dataflow us

[jira] [Commented] (BEAM-266) Visual Pipeline Designers / Editors

[ https://issues.apache.org/jira/browse/BEAM-266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277616#comment-15277616 ] Frances Perry commented on BEAM-266: My guess is that a visual editor would need to be a

[jira] [Commented] (BEAM-264) Matrix, Vector, Tensor Abstractions for Inputs, Outputs and Processing and Construction of Such Structures from Scalars, Other Structures and Queries

[ https://issues.apache.org/jira/browse/BEAM-264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277614#comment-15277614 ] Frances Perry commented on BEAM-264: Can you perhaps provide a concrete example of an ex

Jenkins build became unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #310

See

[GitHub] incubator-beam pull request: Test WindowEvaluatorFactory on Window...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/313 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[1/2] incubator-beam git commit: Test WindowEvaluatorFactory on WindowedValues in multiple windows

Repository: incubator-beam Updated Branches: refs/heads/master 31da925ca -> 9feea2389 Test WindowEvaluatorFactory on WindowedValues in multiple windows Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7107

[2/2] incubator-beam git commit: Closes #313

Closes #313 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/9feea238 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/9feea238 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/

[GitHub] incubator-beam pull request: [BEAM-22] Explicitly use a Concurrent...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/289 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Commented] (BEAM-22) DirectPipelineRunner: support for unbounded collections

[ https://issues.apache.org/jira/browse/BEAM-22?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277296#comment-15277296 ] ASF GitHub Bot commented on BEAM-22: Github user asfgit closed the pull request at:

[2/2] incubator-beam git commit: Explicitly use a ConcurrentLinkedQueue in UnboundedReadEvaluatorFactory

Explicitly use a ConcurrentLinkedQueue in UnboundedReadEvaluatorFactory Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/0e261bb0 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/0e261bb0 Diff:

[1/2] incubator-beam git commit: Closes #289

Repository: incubator-beam Updated Branches: refs/heads/master 272493ed7 -> 31da925ca Closes #289 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/31da925c Tree: http://git-wip-us.apache.org/repos/asf/incu

[GitHub] incubator-beam pull request: Test WindowEvaluatorFactory on Window...

GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/313 Test WindowEvaluatorFactory on WindowedValues in multiple windows Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure t

[GitHub] incubator-beam pull request: [BEAM-22] Add ShardWatermarkTracker

Github user tgroh closed the pull request at: https://github.com/apache/incubator-beam/pull/304 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Commented] (BEAM-22) DirectPipelineRunner: support for unbounded collections

[ https://issues.apache.org/jira/browse/BEAM-22?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277134#comment-15277134 ] ASF GitHub Bot commented on BEAM-22: Github user tgroh closed the pull request at: h

[jira] [Commented] (BEAM-22) DirectPipelineRunner: support for unbounded collections

[ https://issues.apache.org/jira/browse/BEAM-22?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277124#comment-15277124 ] ASF GitHub Bot commented on BEAM-22: GitHub user tgroh opened a pull request: https:

[GitHub] incubator-beam pull request: [BEAM-22] Update Watermarks Outside o...

GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/312 [BEAM-22] Update Watermarks Outside of handleResult Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[GitHub] incubator-beam pull request: mmm

GitHub user davorbonaci opened a pull request: https://github.com/apache/incubator-beam/pull/311 mmm Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Descripti

[GitHub] incubator-beam pull request: mmm

Github user davorbonaci closed the pull request at: https://github.com/apache/incubator-beam/pull/311 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[jira] [Commented] (BEAM-22) DirectPipelineRunner: support for unbounded collections

[ https://issues.apache.org/jira/browse/BEAM-22?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277085#comment-15277085 ] ASF GitHub Bot commented on BEAM-22: GitHub user tgroh opened a pull request: https:

[GitHub] incubator-beam pull request: [BEAM-22] Return null evaluators from...

GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/310 [BEAM-22] Return null evaluators from Unavailable Reads Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR titl

[jira] [Commented] (BEAM-22) DirectPipelineRunner: support for unbounded collections

[ https://issues.apache.org/jira/browse/BEAM-22?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276999#comment-15276999 ] ASF GitHub Bot commented on BEAM-22: GitHub user tgroh opened a pull request: https:

[GitHub] incubator-beam pull request: [BEAM-22] Use PushbackSideInputDoFnRu...

GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/309 [BEAM-22] Use PushbackSideInputDoFnRunner in the InProcessRunner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure th

[jira] [Commented] (BEAM-146) WindowFn.AssingContext leaks implementation details about compressed WindowedValue representation

[ https://issues.apache.org/jira/browse/BEAM-146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276858#comment-15276858 ] ASF GitHub Bot commented on BEAM-146: - GitHub user kennknowles opened a pull request:

[GitHub] incubator-beam pull request: [BEAM-146] Remove references to multi...

GitHub user kennknowles opened a pull request: https://github.com/apache/incubator-beam/pull/308 [BEAM-146] Remove references to multi-window representation from model Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x]

[jira] [Commented] (BEAM-22) DirectPipelineRunner: support for unbounded collections

[ https://issues.apache.org/jira/browse/BEAM-22?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276802#comment-15276802 ] ASF GitHub Bot commented on BEAM-22: Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request: [BEAM-22] Allow InProcess TransformEv...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/283 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[4/4] incubator-beam git commit: This closes #283

This closes #283 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/272493ed Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/272493ed Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/

[3/4] incubator-beam git commit: Allow InProcess TransformEvaluators to refuse inputs

Allow InProcess TransformEvaluators to refuse inputs Inputs that cannot be processed (generally due to a side input not being ready) can be added to a list of unprocessed elements, which will schedule them to be executed at a later point. Project: http://git-wip-us.apache.org/repos/asf/incubator

[2/4] incubator-beam git commit: Use AutoValue for ExecutorUpdate

Use AutoValue for ExecutorUpdate Explicitly provide the collections the Bundle should be consumed by in the update. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/59cca8dd Tree: http://git-wip-us.apache.org

[1/4] incubator-beam git commit: Refactor CompletionCallbacks

Repository: incubator-beam Updated Branches: refs/heads/master da1b7556b -> 272493ed7 Refactor CompletionCallbacks The default and timerful completion callbacks are identical, excepting their calls to evaluationContext.commitResult; factor that code into a common location. Project: http://gi

[jira] [Resolved] (BEAM-145) OutputTimeFn#assignOutputTime overrides WindowFn#getOutputTime in unfortunate ways

[ https://issues.apache.org/jira/browse/BEAM-145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-145. -- Resolution: Fixed > OutputTimeFn#assignOutputTime overrides WindowFn#getOutputTime in unfortunate

[jira] [Resolved] (BEAM-34) Change default output timestamp for combined values to end of window

[ https://issues.apache.org/jira/browse/BEAM-34?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-34. - Resolution: Fixed > Change default output timestamp for combined values to end of window > --

[jira] [Commented] (BEAM-262) Native Runners | Direct Compiler

[ https://issues.apache.org/jira/browse/BEAM-262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276724#comment-15276724 ] Frances Perry commented on BEAM-262: I'm not sure why you think using Flink or Spark for

[GitHub] incubator-beam pull request: FileBasedSink: fix a format string bu...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/306 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Commented] (BEAM-269) Create BigDecimal Coder

[ https://issues.apache.org/jira/browse/BEAM-269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276678#comment-15276678 ] ASF GitHub Bot commented on BEAM-269: - GitHub user eljefe6a opened a pull request:

[GitHub] incubator-beam pull request: [BEAM-269] Create BigDecimal Coder

GitHub user eljefe6a opened a pull request: https://github.com/apache/incubator-beam/pull/307 [BEAM-269] Create BigDecimal Coder Jira issue BEAM-269 Create BigDecimal Coder. Added coder for BigDecimal. Added unit tests for BigDecimal coder. You can merge this pull request into a Gi

[1/2] incubator-beam git commit: FileBasedSink: fix a format string bug

Repository: incubator-beam Updated Branches: refs/heads/master 7725a47a7 -> da1b7556b FileBasedSink: fix a format string bug Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/3ff02950 Tree: http://git-wip-u

[2/2] incubator-beam git commit: Closes #306

Closes #306 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/da1b7556 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/da1b7556 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/

[jira] [Commented] (BEAM-165) Add a MapReduce runner

[ https://issues.apache.org/jira/browse/BEAM-165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276654#comment-15276654 ] Jesse Anderson commented on BEAM-165: - There is more MR than Spark out there. I think no

[jira] [Commented] (BEAM-145) OutputTimeFn#assignOutputTime overrides WindowFn#getOutputTime in unfortunate ways

[ https://issues.apache.org/jira/browse/BEAM-145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276642#comment-15276642 ] ASF GitHub Bot commented on BEAM-145: - Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request: [BEAM-145] [BEAM-34] Make WindowingSt...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/296 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[2/2] incubator-beam git commit: This closes #296

This closes #296 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7725a47a Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7725a47a Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/

[1/2] incubator-beam git commit: Make WindowingStrategy combine WindowFn with OutputTimeFn

Repository: incubator-beam Updated Branches: refs/heads/master 199ec2e10 -> 7725a47a7 Make WindowingStrategy combine WindowFn with OutputTimeFn Previously: - Any user-specified OutputTimeFn overrode the WindowFn#getOutputTime - WindowFn#getOutputTimeFn provided a default OutputTimeFn - The

[GitHub] incubator-beam pull request: FileBasedSink: fix a format string bu...

GitHub user dhalperi opened a pull request: https://github.com/apache/incubator-beam/pull/306 FileBasedSink: fix a format string bug R: @lukecwik @kennknowles @peihe @tgroh anyone will do You can merge this pull request into a Git repository by running: $ git pull https://githu

[GitHub] incubator-beam pull request: pom.xml: upgrade to version 1.22.0 of...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/303 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[2/2] incubator-beam git commit: pom.xml: upgrade to version 1.22.0 of the Google API client libs

pom.xml: upgrade to version 1.22.0 of the Google API client libs Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/2c3c464f Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/2c3c464f Diff: http:/

[1/2] incubator-beam git commit: Closes #303

Repository: incubator-beam Updated Branches: refs/heads/master 03e99540a -> 199ec2e10 Closes #303 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/199ec2e1 Tree: http://git-wip-us.apache.org/repos/asf/incu

[2/2] incubator-beam git commit: This closes #217

This closes #217 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/03e99540 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/03e99540 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/

[GitHub] incubator-beam pull request: [BEAM-115] Add control of PipelineVis...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/217 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[1/2] incubator-beam git commit: Add control of PipelineVisitor recursion into composite transforms

Repository: incubator-beam Updated Branches: refs/heads/master 07c60a965 -> 03e99540a Add control of PipelineVisitor recursion into composite transforms Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/dbf

[jira] [Updated] (BEAM-270) Use WindowedValue in Flink Batch

[ https://issues.apache.org/jira/browse/BEAM-270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-270: -- Issue Type: Sub-task (was: Improvement) Parent: BEAM-258 > Use WindowedValue in Flink Bat

[jira] [Created] (BEAM-270) Use WindowedValue in Flink Batch

Aljoscha Krettek created BEAM-270: - Summary: Use WindowedValue in Flink Batch Key: BEAM-270 URL: https://issues.apache.org/jira/browse/BEAM-270 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-264) Matrix, Vector, Tensor Abstractions for Inputs, Outputs and Processing and Construction of Such Structures from Scalars, Other Structures and Queries

[ https://issues.apache.org/jira/browse/BEAM-264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276069#comment-15276069 ] Suminda Dharmasena commented on BEAM-264: - You can do all this now at an massive eff

[jira] [Commented] (BEAM-262) Native Runners | Direct Compiler

[ https://issues.apache.org/jira/browse/BEAM-262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276066#comment-15276066 ] Suminda Dharmasena commented on BEAM-262: - If you generate the backend there is: -

[jira] [Commented] (BEAM-265) Dynamic Pipeline, Transformation, etc. / DAG Changes DSL | Full Specification Language Independence, Transo

[ https://issues.apache.org/jira/browse/BEAM-265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276063#comment-15276063 ] Suminda Dharmasena commented on BEAM-265: - I am not saying not to support language d