[
https://issues.apache.org/jira/browse/PIG-5165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15980903#comment-15980903
]
Adam Szita commented on PIG-5165:
---------------------------------
[~kellyzly]: The modification in SparkCompiler.java is to make sure that after
merging plans we keep the order of subplans (more precisely the order of
leaves) in the resulting plan.
Merging plans basically merges the HashMaps (e.g. {{mOps}}) that store
Operators. However the order of entries in a Hashmap is not specified and the
resulting merged Map may contain Operators in good or bad order (related to the
{{compiledInputs}} elements they are sourced from), and this may also depend on
Java version (i.e. how Hashmap is implemented). On my Mac for example this
modification is not needed but on my cluster it is required.
> MultiQuery_Union_7 is failing with spark exec type
> --------------------------------------------------
>
> Key: PIG-5165
> URL: https://issues.apache.org/jira/browse/PIG-5165
> Project: Pig
> Issue Type: Sub-task
> Components: spark
> Reporter: Nandor Kollar
> Assignee: Adam Szita
> Fix For: spark-branch
>
> Attachments: PIG-5165.0.patch
>
>
> 1st output is fine, 2nd is different
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
