Re: sqlContext.parquetFile doesn't work with s3n in version 1.3.0

2015-03-16 Thread Kelly, Jonathan
: sqlContext.parquetFile doesn't work with s3n in version 1.3.0 Hi All, I just upgrade the system to use version 1.3.0, but then the sqlContext.parquetFile doesn’t work with s3n. I have test the same code with 1.2.1 and it works. A simple test running in spark-shell: val parquetFile

sqlContext.parquetFile doesn't work with s3n in version 1.3.0

2015-03-16 Thread Shuai Zheng
Hi All, I just upgrade the system to use version 1.3.0, but then the sqlContext.parquetFile doesn't work with s3n. I have test the same code with 1.2.1 and it works. A simple test running in spark-shell: val parquetFile = sqlContext.parquetFile(s3n:///test/2.parq )

RE: sqlContext.parquetFile doesn't work with s3n in version 1.3.0

2015-03-16 Thread Shuai Zheng
. Regards, Shuai From: Kelly, Jonathan [mailto:jonat...@amazon.com] Sent: Monday, March 16, 2015 2:54 PM To: Shuai Zheng; user@spark.apache.org Subject: Re: sqlContext.parquetFile doesn't work with s3n in version 1.3.0 See https://issues.apache.org/jira/browse/SPARK-6351 ~ Jonathan

Re: sqlContext.parquetFile doesn't work with s3n in version 1.3.0

2015-03-16 Thread Michael Armbrust
Zheng; user@spark.apache.org *Subject:* Re: sqlContext.parquetFile doesn't work with s3n in version 1.3.0 See https://issues.apache.org/jira/browse/SPARK-6351 ~ Jonathan *From: *Shuai Zheng szheng.c...@gmail.com *Date: *Monday, March 16, 2015 at 11:46 AM *To: *user@spark.apache.org user