Until then you can try
sql(SET spark.sql.parquet.useDataSourceApi=false)
On Wed, Mar 25, 2015 at 12:15 PM, Michael Armbrust mich...@databricks.com
wrote:
This will be fixed in Spark 1.3.1:
https://issues.apache.org/jira/browse/SPARK-6351
and is fixed in master/branch-1.3 if you want to
This will be fixed in Spark 1.3.1:
https://issues.apache.org/jira/browse/SPARK-6351
and is fixed in master/branch-1.3 if you want to compile from source
On Wed, Mar 25, 2015 at 11:59 AM, Stuart Layton stuart.lay...@gmail.com
wrote:
I'm trying to save a dataframe to s3 as a parquet file but I'm
I'm trying to save a dataframe to s3 as a parquet file but I'm getting
Wrong FS errors
df.saveAsParquetFile(parquetFile)
15/03/25 18:56:10 INFO storage.MemoryStore: ensureFreeSpace(46645) called
with curMem=82744, maxMem=278302556
15/03/25 18:56:10 INFO storage.MemoryStore: Block broadcast_5
