Hi,
I have a RDD of some processed data. I want to write these files to HDFS,
but not for future M/R processing. I want to write plain old style text
file. I tried:
rdd foreach {d =>
val file = // create the file using a HDFS FileSystem
val lines = d map {
// format data into string
}
IOUtils.writeLines(lines, System.separator(), file)
}
Note, I was using the IOUtils from common-io, not from Hadoop package.
The results are all file are created in myHDFS, but has no data at all...
[image: --]
Xi Shen
[image: http://]about.me/davidshen
<http://about.me/davidshen?promo=email_sig>
<http://about.me/davidshen>