[
https://issues.apache.org/jira/browse/FLINK-1959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539987#comment-14539987
]
mustafa elbehery commented on FLINK-1959:
-----------------------------------------
I have tried debugging to check the problem .. What I can see is that
re-partitioning is working find and the data is re-distributed as expected.
Moreover, the accumulators from each sub-task if created and filled with the
required information. However, the merge method is never called in case of
Re-Partitioning !!!
I could see in debug mode that the accumulator in RunTime is empty.
Any suggestion to solve the problem ?!!
> Accumulators BROKEN after Partitioning
> --------------------------------------
>
> Key: FLINK-1959
> URL: https://issues.apache.org/jira/browse/FLINK-1959
> Project: Flink
> Issue Type: Bug
> Components: Examples
> Affects Versions: master
> Reporter: mustafa elbehery
> Priority: Critical
> Fix For: master
>
>
> while running the Accumulator example in
> https://github.com/Elbehery/flink/blob/master/flink-examples/flink-java-examples/src/main/java/org/apache/flink/examples/java/relational/EmptyFieldsCountAccumulator.java,
>
> I tried to alter the data flow with "PartitionByHash" function before
> applying "Filter", and the resulted accumulator was NULL.
> By Debugging, I could see the accumulator in the RunTime Map. However, by
> retrieving the accumulator from the JobExecutionResult object, it was NULL.
> The line caused the problem is "file.partitionByHash(1).filter(new
> EmptyFieldFilter())" instead of "file.filter(new EmptyFieldFilter())"
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
