Hi All,
I have 3 nodes Spark 1.6 Standalone mode cluster with 1 Master and 2 Slaves.
Also Im not having Hadoop as filesystem . Now, Im able to launch shell , read
the input file from local filesystem and perform transformation successfully.
When I try to write my output in local filesystem path
Hi,
What happens when you create the parent directory /home/stuti? I think the
failure is due to missing parent directories. What's the OS?
Jacek
On 24 May 2016 11:27 a.m., "Stuti Awasthi" wrote:
Hi All,
I have 3 nodes Spark 1.6 Standalone mode cluster with 1 Master and 2
Slaves. Also Im not h
tuti.
Thanks
Stuti
From: Jacek Laskowski [ja...@japila.pl]
Sent: Tuesday, May 24, 2016 5:27 PM
To: Stuti Awasthi
Cc: user
Subject: Re: Not able to write output to local filsystem from Standalone mode.
Hi,
What happens when you create the parent directory /home/stuti? I think the failu
ted under /home/stuti.
>
> Thanks
> Stuti
> --
> *From:* Jacek Laskowski [ja...@japila.pl]
> *Sent:* Tuesday, May 24, 2016 5:27 PM
> *To:* Stuti Awasthi
> *Cc:* user
> *Subject:* Re: Not able to write output to local filsystem from
> Standalone mo
Awasthi; Jacek Laskowski
Cc: user
Subject: Re: Not able to write output to local filsystem from Standalone mode.
In standalone mode, executor assume they have access to a shared file system. The driver creates the directory and the executor write files, so the executors end up not writing
gt;> Thanks
>> Stuti
>>
>> From: Jacek Laskowski [ja...@japila.pl]
>> Sent: Tuesday, May 24, 2016 5:27 PM
>> To: Stuti Awasthi
>> Cc: user
>> Subject: Re: Not able to write output to local filsystem from Standalone
>> m
t;
> >> Thanks
> >> Stuti
> >>
> >> From: Jacek Laskowski [ja...@japila.pl]
> >> Sent: Tuesday, May 24, 2016 5:27 PM
> >> To: Stuti Awasthi
> >> Cc: user
> >> Subject: Re: Not able to write out
2016 18:23:02 +
Subject: Re: Not able to write output to local filsystem from Standalone mode.
To: ja...@japila.pl
CC: stutiawas...@hcl.com; user@spark.apache.org
Experience. I don't use Mesos or Yarn or Hadoop, so I don't know.
On Wed, May 25, 2016 at 2:51 AM Jacek Laskowski wr
closetwork.org
> Date: Wed, 25 May 2016 18:23:02 +
> Subject: Re: Not able to write output to local filsystem from Standalone
> mode.
> To: ja...@japila.pl
> CC: stutiawas...@hcl.com; user@spark.apache.org
>
>
> Experience. I don't use Mesos or Yarn or Hadoop, so I don
emory some
places.
Yong
> Date: Fri, 27 May 2016 20:21:46 +0200
> Subject: Re: Not able to write output to local filsystem from Standalone mode.
> From: ja...@japila.pl
> To: java8...@hotmail.com
> CC: math...@closetwork.org; stutiawas...@hcl.com; user@spark.apache.org
>
&g
10 matches
Mail list logo
