Andrew Or created SPARK-10985:
---------------------------------
Summary: Avoid passing evicted blocks throughout BlockManager /
CacheManager
Key: SPARK-10985
URL: https://issues.apache.org/jira/browse/SPARK-10985
Project: Spark
Issue Type: Sub-task
Components: Block Manager, Spark Core
Reporter: Andrew Or
Priority: Minor
This is a minor refactoring task.
Currently when we attempt to put a block in, we get back an array buffer of
blocks that are dropped in the process. We do this to propagate these blocks
back to our TaskContext, which will add them to its TaskMetrics so we can see
them in the SparkUI storage tab properly.
Now that we have TaskContext.get, we can just use that to propagate this
information. This simplifies a lot of the signatures and gets rid of weird
return types like the following everywhere:
{code}
ArrayBuffer[(BlockId, BlockStatus)]
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
