Re: Problem with 1 master + 2 slaves cluster

2015-02-18 Thread bit1...@163.com
But I am able to run the SparkPi example: ./run-example SparkPi 1000 --master spark://192.168.26.131:7077 Result:Pi is roughly 3.14173708 bit1...@163.com From: bit1...@163.com Date: 2015-02-18 16:29 To: user Subject: Problem with 1 master + 2 slaves cluster Hi sparkers, I setup a spark(1.2.1)

Re: Problem with 1 master + 2 slaves cluster

2015-02-18 Thread Akhil Das
Since the cluster is standalone, you are better off reading/writing to hdfs instead of local filesystem. Thanks Best Regards On Wed, Feb 18, 2015 at 2:32 PM, bit1...@163.com wrote: > But I am able to run the SparkPi example: > ./run-example SparkPi 1000 --master spark://192.168.26.131:7077 > >

Re: Re: Problem with 1 master + 2 slaves cluster

2015-02-18 Thread bit1...@163.com
Sure, thanks Akhil. A further question : Is local file system(file:///) not supported in standalone cluster? bit1...@163.com From: Akhil Das Date: 2015-02-18 17:35 To: bit1...@163.com CC: user Subject: Re: Problem with 1 master + 2 slaves cluster Since the cluster is standalone, you are

Re: Re: Problem with 1 master + 2 slaves cluster

2015-02-18 Thread Emre Sevinc
On Wed, Feb 18, 2015 at 10:23 AM, bit1...@163.com wrote: > Sure, thanks Akhil. > A further question : Is local file system(file:///) not supported in > standalone cluster? > FYI: I'm able to write to local file system (via HDFS API and using file:/// notation) when using Spark. -- Emre Sevinç

Re: Re: Problem with 1 master + 2 slaves cluster

2015-02-18 Thread Akhil Das
when you give file:// , while reading, it requires that all slaves has that path/file available locally in their system. It's ok to give file:// when you run your application in local mode (like master=local[*]) Thanks Best Regards On Wed, Feb 18, 2015 at 2:58 PM, Emre Sevinc wrote: > On Wed, F