Hi All,

 

I just upgrade the system to use version 1.3.0, but then the
sqlContext.parquetFile doesn't work with s3n. I have test the same code with
1.2.1 and it works.

 

A simple test running in spark-shell:

 

val parquetFile = sqlContext.parquetFile("""s3n://****/test/2.parq """)

java.lang.IllegalArgumentException: Wrong FS: s3n://****/test/2.parq,
expected: file:/// <file:///\\> 

 

And same test work with spark-shell under 1.2.1

 

Regards,

 

Shuai

Reply via email to