Venkata krishnan Sowrirajan created SPARK-38093:
---------------------------------------------------
Summary: Set shuffleMergeAllowed to false for a determinate stage
after the stage is finalized
Key: SPARK-38093
URL: https://issues.apache.org/jira/browse/SPARK-38093
Project: Spark
Issue Type: Sub-task
Components: Shuffle
Affects Versions: 3.2.1
Reporter: Venkata krishnan Sowrirajan
Currently we are setting shuffleMergeAllowed to false before
prepareShuffleServicesForShuffleMapStage if the shuffle dependency is already
finalized. Ideally it is better to do it right after shuffle dependency
finalization for a determinate stage. cc [~mridulm80]
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
