Re: IOUtils cannot write anything in Spark?

2015-04-23 Thread Holden Karau
It seems like saveAsTextFile might do what you are looking for. On Wednesday, April 22, 2015, Xi Shen davidshe...@gmail.com wrote: Hi, I have a RDD of some processed data. I want to write these files to HDFS, but not for future M/R processing. I want to write plain old style text file. I

IOUtils cannot write anything in Spark?

2015-04-23 Thread Xi Shen
Hi, I have a RDD of some processed data. I want to write these files to HDFS, but not for future M/R processing. I want to write plain old style text file. I tried: rdd foreach {d = val file = // create the file using a HDFS FileSystem val lines = d map { // format data into string }