: sqlContext.parquetFile doesn't work with s3n in version 1.3.0
Hi All,
I just upgrade the system to use version 1.3.0, but then the
sqlContext.parquetFile doesn’t work with s3n. I have test the same code with
1.2.1 and it works.
A simple test running in spark-shell:
val parquetFile
Hi All,
I just upgrade the system to use version 1.3.0, but then the
sqlContext.parquetFile doesn't work with s3n. I have test the same code with
1.2.1 and it works.
A simple test running in spark-shell:
val parquetFile = sqlContext.parquetFile(s3n:///test/2.parq )
.
Regards,
Shuai
From: Kelly, Jonathan [mailto:jonat...@amazon.com]
Sent: Monday, March 16, 2015 2:54 PM
To: Shuai Zheng; user@spark.apache.org
Subject: Re: sqlContext.parquetFile doesn't work with s3n in version 1.3.0
See https://issues.apache.org/jira/browse/SPARK-6351
~ Jonathan
Zheng; user@spark.apache.org
*Subject:* Re: sqlContext.parquetFile doesn't work with s3n in version
1.3.0
See https://issues.apache.org/jira/browse/SPARK-6351
~ Jonathan
*From: *Shuai Zheng szheng.c...@gmail.com
*Date: *Monday, March 16, 2015 at 11:46 AM
*To: *user@spark.apache.org user