[
https://issues.apache.org/jira/browse/SPARK-2245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14041363#comment-14041363
]
Baoxu Shi commented on SPARK-2245:
----------------------------------
[~ankurd] Thanks for your detailed explanation. So if we want to fix this
problem in the right way, we need to override all the methods related to
checkpoint? I list all the methods I've found:
checkpoint
checkpointData
computeOrReadCheckpoint
doCheckpoint
getCheckpointFile
markCheckpointed
Am I missing some one? If I changed those, should I also provide corresponding
test with my pull request?
> VertexRDD can not be materialized for checkpointing
> ---------------------------------------------------
>
> Key: SPARK-2245
> URL: https://issues.apache.org/jira/browse/SPARK-2245
> Project: Spark
> Issue Type: Bug
> Components: GraphX
> Reporter: Baoxu Shi
>
> Seems one can not materialize VertexRDD by simply calling count method, which
> is overridden by VertexRDD. But if you call RDD's count, it could materialize
> it.
> Is this a feature that designed to get the count without materialize
> VertexRDD? If so, do you guys think it is necessary to add a materialize
> method to VertexRDD?
> By the way, does count() is the cheapest way to materialize a RDD? Or it just
> cost the same resources like other actions?
> The pull request is here:
> https://github.com/apache/spark/pull/1177
> Best,
--
This message was sent by Atlassian JIRA
(v6.2#6252)
