Saving Spark streaming RDD with saveAsTextFiles ends up creating empty files on HDFS

[Mich Talebzadeh]

Spark 1.6.1

The following creates empty files. It prints lines OK with println

val result = lines.filter(_.contains("ASE 15")).flatMap(line =>
line.split("\n,")).map(word => (word, 1)).reduceByKey(_ + _)
result.saveAsTextFiles("/tmp/rdd_stuff")

I am getting zero length files

drwxr-xr-x   - hduser supergroup          0 2016-04-05 23:19
/tmp/rdd_stuff-1459894755000
drwxr-xr-x   - hduser supergroup          0 2016-04-05 23:20
/tmp/rdd_stuff-1459894810000

Any ideas?

Thanks,

Dr Mich Talebzadeh



LinkedIn * 
https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
<https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*



http://talebzadehmich.wordpress.com