Re: writing to HDFS with a given username

2013-12-13 Thread Philip Ogren
Well, it only uses my user name when I run my application in local mode (i.e. spark is running on my laptop with a master url of local.) Not a general solution for you I'm afraid! On 12/12/2013 5:38 PM, Koert Kuipers wrote: Hey Philip, how do you get spark to write to hdfs with your user

Re: writing to HDFS with a given username

2013-12-13 Thread Koert Kuipers
*Subject:* Re: writing to HDFS with a given username Hey Philip, how do you get spark to write to hdfs with your user name? When i use spark it writes to hdfs as the user that runs the spark services... i wish it read and wrote as me. On Thu, Dec 12, 2013 at 6:37 PM, Philip Ogren

Re: writing to HDFS with a given username

2013-12-13 Thread Matei Zaharia
Jerry From: Koert Kuipers [mailto:ko...@tresata.com] Sent: Friday, December 13, 2013 8:39 AM To: user@spark.incubator.apache.org Subject: Re: writing to HDFS with a given username Hey Philip, how do you get spark to write to hdfs with your user name? When i use spark it writes to hdfs

Re: writing to HDFS with a given username

2013-12-12 Thread Koert Kuipers
Hey Philip, how do you get spark to write to hdfs with your user name? When i use spark it writes to hdfs as the user that runs the spark services... i wish it read and wrote as me. On Thu, Dec 12, 2013 at 6:37 PM, Philip Ogren philip.og...@oracle.comwrote: When I call