[
https://issues.apache.org/jira/browse/SPARK-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sandy Ryza updated SPARK-4452:
--
Affects Version/s: 1.1.0
> Enhance Sort-based Shuffle to avoid spilling small files
> --
[
https://issues.apache.org/jira/browse/SPARK-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
tianshuo updated SPARK-4452:
Description:
When an Aggregator is used with ExternalSorter in a task, spark will create
many small files a
[
https://issues.apache.org/jira/browse/SPARK-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
tianshuo updated SPARK-4452:
Description:
When an Aggregator is used with ExternalSorter in a task, spark will create
many small files a
[
https://issues.apache.org/jira/browse/SPARK-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
tianshuo updated SPARK-4452:
Description:
When an Aggregator is used with ExternalSorter in a task, spark will create
many small files a