[
https://issues.apache.org/jira/browse/SPARK-10000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14947530#comment-14947530
]
Reynold Xin commented on SPARK-10000:
-------------------------------------
[~bowenzhangusa] thanks for the interest. This task is pretty significant and
involves substantial refactoring to internals, so it might be pretty hard for
somebody less familiar with Spark to just pick up. However, we will post a
design doc soon and try to break this down into multiple tasks. Please follow
the ticket and see if you can help contribute to some of them. Thanks!
> Consolidate cache memory management and execution memory management
> -------------------------------------------------------------------
>
> Key: SPARK-10000
> URL: https://issues.apache.org/jira/browse/SPARK-10000
> Project: Spark
> Issue Type: Story
> Components: Block Manager, Spark Core
> Reporter: Reynold Xin
>
> As a Spark user, I want Spark to manage the memory more intelligently so I do
> not need to worry about how to statically partition the execution (shuffle)
> memory fraction and cache memory fraction.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
