[
https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu updated SPARK-19659:
-
Fix Version/s: (was: 2.2.0)
> Fetch big blocks to disk when shuffle-read
> --
[
https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jin xing updated SPARK-19659:
-
Attachment: SPARK-19659-design-v2.pdf
> Fetch big blocks to disk when shuffle-read
>
[
https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jin xing updated SPARK-19659:
-
Attachment: SPARK-19659-design-v1.pdf
> Fetch big blocks to disk when shuffle-read
>
[
https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jin xing updated SPARK-19659:
-
Attachment: (was: SPARK-19659-design-v1.pdf)
> Fetch big blocks to disk when shuffle-read
> -
[
https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jin xing updated SPARK-19659:
-
Attachment: SPARK-19659-design-v1.pdf
> Fetch big blocks to disk when shuffle-read
>
[
https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jin xing updated SPARK-19659:
-
Description:
Currently the whole block is fetched into memory(offheap by default) when
shuffle-read. A b
