reading files on HDFS /s3 in sparkR -failing

2015-09-10 Thread roni
I am trying this - ddf <- parquetFile(sqlContext, "hdfs:// ec2-52-26-180-130.us-west-2.compute.amazonaws.com:9000/IPF_14_1.parquet") and I get path[1]="hdfs:// ec2-52-26-180-130.us-west-2.compute.amazonaws.com:9000/IPF_14_1.parquet": No such file or directory when I read file on s3 , I get -

RE: reading files on HDFS /s3 in sparkR -failing

2015-09-10 Thread Sun, Rui
/28029134/how-can-i-access-s3-s3n-from-a-local-hadoop-2-6-installation , https://issues.apache.org/jira/browse/SPARK-7442 From: roni [mailto:roni.epi...@gmail.com] Sent: Friday, September 11, 2015 3:05 AM To: user@spark.apache.org Subject: reading files on HDFS /s3 in sparkR -failing I am trying