[ 
https://issues.apache.org/jira/browse/FLINK-1149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Fabian Hueske resolved FLINK-1149.
----------------------------------
    Resolution: Fixed

Fixed with 986f25f6b51e3672865439e9a6581aab121b45ee

> Operators cannot adapt DOP for NonParallelInputs
> ------------------------------------------------
>
>                 Key: FLINK-1149
>                 URL: https://issues.apache.org/jira/browse/FLINK-1149
>             Project: Flink
>          Issue Type: Bug
>          Components: Java API
>    Affects Versions: 0.6.1-incubating, 0.7-incubating
>            Reporter: Fabian Hueske
>            Assignee: Fabian Hueske
>            Priority: Minor
>
> InputFormats that cannot be processed in parallel implement the 
> NonParallelInput interface.
> During optimization, the optimizer checks for this interface and sets the DOP 
> of an operator to 1 if it is found. Other operators such as Mappers set their 
> DOP during program construction to the DOP of their preceding task (if not 
> specified otherwise). Since non-splittable data sources are only considered 
> later by the optimizer, a Map operator will not have the same DOP as an 
> preceding non-splittable data source.
> The simple solution is to set the DOP of a non-splittable data source during 
> program construction.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to