Re: Not all workers seem to run in a standalone cluster setup by spark-ec2 script

2015-12-04 Thread Kyohey Hamaguchi
gt; > > master_URL is something like spark:// > ec2-54-215-112-121.us-west-1.compute.amazonaws.com:7077 > > Its the public url to your master > > > Andy > > From: Kyohey Hamaguchi <tnzk.ma...@gmail.com> > Date: Friday, December 4, 2015 at 11:28 AM > To: "use

Not all workers seem to run in a standalone cluster setup by spark-ec2 script

2015-12-04 Thread Kyohey Hamaguchi
executor == slave), so a Spark cluster automatically exploits all resources available in the cluster. Is this some sort of misconception? Thanks, -- Kyohey Hamaguchi TEL: 080-6918-1708 Mail: tnzk.ma...@gmail.com Blog: http://blog.tnzk.org/ --