In my opinion, BlockManager manages many types of Block, RDD's partition, a.k.a. RDDBlock, is one type of them. Other types of Blocks are ShuffleBlock, IndirectBlock (if the task's return status is too large), etc.
So, BlockManager is a layer that is independent of RDD concept. On Mar 11, 2014 2:06 AM, "David Thomas" <dt5434...@gmail.com> wrote: > What is the concept of Block and BlockManager in Spark? How is a Block > related to a Partition of a RDD? >
