> -----Original Message----- > From: Marcelo Vanzin [mailto:van...@cloudera.com] > Hi Ken, > > On Mon, Apr 21, 2014 at 1:39 PM, Williams, Ken > <ken.willi...@windlogics.com> wrote: > > I haven't figured out how to let the hostname default to the host > mentioned in our /etc/hadoop/conf/hdfs-site.xml like the Hadoop > command-line tools do, but that's not so important. > > Try adding "/etc/hadoop/conf" to SPARK_CLASSPATH.
It looks like I already had my config set up properly, but I didn't understand the URL syntax - the following works: sc.textFile("hdfs:///user/kwilliams/dat/part-m-00000") In other words, just omit the hostname between the 2nd and 3rd slash of the URL. -Ken ________________________________ CONFIDENTIALITY NOTICE: This e-mail message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution of any kind is strictly prohibited. If you are not the intended recipient, please contact the sender via reply e-mail and destroy all copies of the original message. Thank you.