ughout execution, it seems that the
>> blockmanager is always almost free.
>>
>>> 14/10/05 14:33:44 INFO BlockManagerInfo: Added broadcast_21_piece0 in
>>> memory on brick2:57501 (size: 1669.0 B, free: 21.2 GB)
>>>
>> I don't know what I'm missing
Hey Larry,
I have been trying to figure this out for standalone clusters as well.
http://apache-spark-user-list.1001560.n3.nabble.com/What-is-a-Block-Manager-td12833.html
has an answer as to what block manager is for.
>From the documentation, what I understood was if you assign X GB to each
execu
Hi all,
I'm confused about Executor and BlockManager, why they have different
memory.
14/10/10 08:50:02 INFO AppClient$ClientActor: Executor added:
app-20141010085001-/2 on worker-20141010004933-brick6-35657
(brick6:35657) with 6 cores
14/10/10 08:50:02 INFO SparkDeploySchedulerBackend: Gr
