Hi

I work with pyspark & spark 1.5.2

Currently saving rdd into csv file is very very slow , uses 2% CPU only

I use :
my_dd.write.format("com.databricks.spark.csv").option("header",
"false").save('file:///my_folder')

Is there a way to save csv faster ?

Many thanks

Reply via email to