are you running standalone - local mode or cluster mode. executor and driver existance differ based on setup type. snapshot of your env UI would be helpful to say
On Thu, Jan 7, 2016 at 11:51 AM, <seemanto.ba...@nomura.com> wrote: > Hi, > > > > After I called rdd.persist(*MEMORY_ONLY_SER*), I see the driver listed as one > of the ‘executors’ participating in holding the partitions of the rdd in > memory, the memory usage shown against the driver is 0. This I see in the > storage tab of the spark ui. > > Why is the driver shown on the ui ? Will it ever hold rdd partitions when > caching. > > > > > > *-regards* > > *Seemanto Barua* > > > > > > PLEASE READ: This message is for the named person's use only. It may > contain confidential, proprietary or legally privileged information. No > confidentiality or privilege is waived or lost by any mistransmission. If > you receive this message in error, please delete it and all copies from > your system, destroy any hard copies and notify the sender. You must not, > directly or indirectly, use, disclose, distribute, print, or copy any part > of this message if you are not the intended recipient. Nomura Holding > America Inc., Nomura Securities International, Inc, and their respective > subsidiaries each reserve the right to monitor all e-mail communications > through its networks. Any views expressed in this message are those of the > individual sender, except where the message states otherwise and the sender > is authorized to state the views of such entity. Unless otherwise stated, > any pricing information in this message is indicative only, is subject to > change and does not constitute an offer to deal at any price quoted. Any > reference to the terms of executed transactions should be treated as > preliminary only and subject to our formal written confirmation. >
