Thanks. In the meantime I might just write a custom file system that maps writes to parquet file parts to their final locations and then skips the move.
-- Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org