hi there: I got a problem in saving a DF to HDFS as parquet format very
slow. And I attached a pic which shows a lot of time is spent in getting
result.the code is
:streamingData.write.mode(SaveMode.Overwrite).parquet("/data/streamingData")
I don't quite understand why my app is so slow in getting the result. I tried
to access my HDFS while the app is running slow , HDFS is ok.
Any idea will be appreciated.
--------------------------------
Thanks&Best regards!
San.Luo
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscr...@spark.apache.org
