[ 
https://issues.apache.org/jira/browse/FLINK-1671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14354825#comment-14354825
 ] 

Robert Metzger commented on FLINK-1671:
---------------------------------------

That sounds pretty awesome. I agree to make the {{PIPELINED}} mode default.

> Add execution modes for programs
> --------------------------------
>
>                 Key: FLINK-1671
>                 URL: https://issues.apache.org/jira/browse/FLINK-1671
>             Project: Flink
>          Issue Type: Bug
>    Affects Versions: 0.9
>            Reporter: Stephan Ewen
>            Assignee: Stephan Ewen
>             Fix For: 0.9
>
>
> Currently, there is a single way that programs get executed: Pipelined. With 
> the new code for batch shuffles (https://github.com/apache/flink/pull/471), 
> we have much more flexibility and I would like to expose that.
> I suggest to add more execution modes that can be chosen on the 
> `ExecutionEnvironment`:
>   - {{BATCH}} A mode where every shuffle is executed in a batch way, meaning 
> preceding operators must be done before successors start. Only for the batch 
> programs (d'oh).
>   - {{PIPELINED}} This is the mode corresponding to the current execution 
> mode. It pipelines where possible and batches, where deadlocks would 
> otherwise happen. Initially, I would make this the default (be close to the 
> current behavior). Only available for batch programs.
>   - {{PIPELINED_WITH_BATCH_FALLBACK}} This would start out with pipelining 
> shuffles and fall back to batch shuffles upon failure and recovery, or once 
> it sees that not enough slots are available to bring up all operators at once 
> (requirement for pipelining).
>   - {{STREAMING}} This is the default and only way for streaming programs. 
> All communication is pipelined, and the special streaming checkpointing code 
> is activated.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to