Matt Cheah created SPARK-28764: ---------------------------------- Summary: Remove unnecessary writePartitionedFile method from ExternalSorter Key: SPARK-28764 URL: https://issues.apache.org/jira/browse/SPARK-28764 Project: Spark Issue Type: Task Components: Shuffle, Tests Affects Versions: 3.0.0 Reporter: Matt Cheah
Following SPARK-28571, we now use {{ExternalSorter#writePartitionedData}} in {{SortShuffleWriter}} when persisting the shuffle data via the shuffle writer plugin. However, we left the {{writePartitionedFile}} method on {{ExternalSorter}} strictly for tests. We should figure out a way how to refactor those tests to use {{writePartitionedData}} instead of {{writePartitionedFile}}. -- This message was sent by Atlassian JIRA (v7.6.14#76016) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org