[jira] [Commented] (BEAM-235) Remove streaming flag

2016-05-30 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BEAM-235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15306477#comment-15306477
 ] 

ASF GitHub Bot commented on BEAM-235:
-

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-beam/pull/394


> Remove streaming flag
> -
>
> Key: BEAM-235
> URL: https://issues.apache.org/jira/browse/BEAM-235
> Project: Beam
>  Issue Type: Improvement
>  Components: runner-flink
>Reporter: Maximilian Michels
>
> The streaming flag of the Flink Runner should be removed in favor of an 
> automated decision during translation to execute using either batch or 
> streaming API. For example, if the user specified any unbounded sources, the 
> program could be executed using the Flink streaming API. Otherwise, batch 
> could be chosen.
> To do that, we need to get the batch execution on par with the streaming 
> execution. The batch part misses windowing.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (BEAM-235) Remove streaming flag

2016-05-28 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BEAM-235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305410#comment-15305410
 ] 

ASF GitHub Bot commented on BEAM-235:
-

GitHub user mxm opened a pull request:

https://github.com/apache/incubator-beam/pull/394

[BEAM-235] use streaming mode on unbounded sources

This change automatically discovers the execution mode of the Pipeline
during a preliminary "optimization" translation of the pipeline. When
unbounded sources are discovered, the pipeline translation mode is
switched to streaming.

Users may still supply the streaming flag to override this
behavior. Users who forget to supply the flag, will automatically use
streaming mode whenever they use unbounded sources.

- TODO: update documentation

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/mxm/incubator-beam BEAM-235

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/394.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #394


commit c9c1e732f06dd31b565fbf632634a78d38fa3add
Author: Maximilian Michels 
Date:   2016-05-30T07:59:12Z

[BEAM-235] use streaming mode on unbounded sources

This change automatically discovers the execution mode of the Pipeline
during a preliminary "optimization" translation of the pipeline. When
unbounded sources are discovered, the pipeline translation mode is
switched to streaming.

Users may still supply the streaming flag to override this
behavior. Users who forget to supply the flag, will automatically use
streaming mode whenever they use unbounded sources.

- TODO: update documentation




> Remove streaming flag
> -
>
> Key: BEAM-235
> URL: https://issues.apache.org/jira/browse/BEAM-235
> Project: Beam
>  Issue Type: Improvement
>  Components: runner-flink
>Reporter: Maximilian Michels
>
> The streaming flag of the Flink Runner should be removed in favor of an 
> automated decision during translation to execute using either batch or 
> streaming API. For example, if the user specified any unbounded sources, the 
> program could be executed using the Flink streaming API. Otherwise, batch 
> could be chosen.
> To do that, we need to get the batch execution on par with the streaming 
> execution. The batch part misses windowing.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)