RE: Not able to write output to local filsystem from Standalone mode.

2016-05-27 Thread Yong Zhang
places. Yong > Date: Fri, 27 May 2016 20:21:46 +0200 > Subject: Re: Not able to write output to local filsystem from Standalone mode. > From: ja...@japila.pl > To: java8...@hotmail.com > CC: math...@closetwork.org; stutiawas...@hcl.com; user@spark.apache.org > > Hi Yong

Re: Not able to write output to local filsystem from Standalone mode.

2016-05-27 Thread Jacek Laskowski
m: math...@closetwork.org > Date: Wed, 25 May 2016 18:23:02 +0000 > Subject: Re: Not able to write output to local filsystem from Standalone > mode. > To: ja...@japila.pl > CC: stutiawas...@hcl.com; user@spark.apache.org > > > Experience. I don't use Mesos or Yarn or

RE: Not able to write output to local filsystem from Standalone mode.

2016-05-26 Thread Yong Zhang
18:23:02 + Subject: Re: Not able to write output to local filsystem from Standalone mode. To: ja...@japila.pl CC: stutiawas...@hcl.com; user@spark.apache.org Experience. I don't use Mesos or Yarn or Hadoop, so I don't know. On Wed, May 25, 2016 at 2:51 AM Jacek Laskowski <ja...@japila.pl>

Re: Not able to write output to local filsystem from Standalone mode.

2016-05-25 Thread Mathieu Longtin
s, no such > >> directory is created under /home/stuti. > >> > >> Thanks > >> Stuti > >> > >> From: Jacek Laskowski [ja...@japila.pl] > >> Sent: Tuesday, May 24, 2016 5:27 PM > >> To: Stuti Awasthi > &

Re: Not able to write output to local filsystem from Standalone mode.

2016-05-25 Thread Jacek Laskowski
directory is created under /home/stuti. >> >> Thanks >> Stuti >> >> From: Jacek Laskowski [ja...@japila.pl] >> Sent: Tuesday, May 24, 2016 5:27 PM >> To: Stuti Awasthi >> Cc: user >> Subject: Re: Not able to write

RE: Not able to write output to local filsystem from Standalone mode.

2016-05-24 Thread Stuti Awasthi
Awasthi; Jacek Laskowski Cc: user Subject: Re: Not able to write output to local filsystem from Standalone mode. In standalone mode, executor assume they have access to a shared file system. The driver creates the directory and the executor write files, so the executors end up not writing

Re: Not able to write output to local filsystem from Standalone mode.

2016-05-24 Thread Mathieu Longtin
uch > directory is created under /home/stuti. > > Thanks > Stuti > -- > *From:* Jacek Laskowski [ja...@japila.pl] > *Sent:* Tuesday, May 24, 2016 5:27 PM > *To:* Stuti Awasthi > *Cc:* user > *Subject:* Re: Not able to write output to local

RE: Not able to write output to local filsystem from Standalone mode.

2016-05-24 Thread Stuti Awasthi
tuti. Thanks StutiĀ  From: Jacek Laskowski [ja...@japila.pl] Sent: Tuesday, May 24, 2016 5:27 PM To: Stuti Awasthi Cc: user Subject: Re: Not able to write output to local filsystem from Standalone mode. Hi, What happens when you create the parent directory /home/stuti? I think the failu

Re: Not able to write output to local filsystem from Standalone mode.

2016-05-24 Thread Jacek Laskowski
Hi, What happens when you create the parent directory /home/stuti? I think the failure is due to missing parent directories. What's the OS? Jacek On 24 May 2016 11:27 a.m., "Stuti Awasthi" wrote: Hi All, I have 3 nodes Spark 1.6 Standalone mode cluster with 1 Master and

Not able to write output to local filsystem from Standalone mode.

2016-05-24 Thread Stuti Awasthi
Hi All, I have 3 nodes Spark 1.6 Standalone mode cluster with 1 Master and 2 Slaves. Also Im not having Hadoop as filesystem . Now, Im able to launch shell , read the input file from local filesystem and perform transformation successfully. When I try to write my output in local filesystem path