[
https://issues.apache.org/jira/browse/SPARK-20308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Sukhenko resolved SPARK-20308.
------------------------------------
Resolution: Duplicate
> org.apache.spark.shuffle.FetchFailedException: Too large frame
> --------------------------------------------------------------
>
> Key: SPARK-20308
> URL: https://issues.apache.org/jira/browse/SPARK-20308
> Project: Spark
> Issue Type: Bug
> Components: Shuffle
> Affects Versions: 2.1.0
> Reporter: Stanislav Chernichkin
>
> Spark uses custom frame decoder (TransportFrameDecoder) which does not
> support frames larger than 2G. This lead to fails when shuffling using large
> partitions.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
