= textFile.flatMap(line = line.split( )).map(word = (word,
1)).reduceByKey((a, b) = a + b)
counts.saveAsTextFile(“file”)//any way you don’t want to collect results
to master, and instead putting them in file.
Thanks.
Zhan Zhang
On Aug 16, 2014, at 9:18 AM, Jerry Ye jerr...@gmail.com wrote
Hi Xiangrui,
I actually tried branch-1.1 and master and it resulted in the job being
stuck at the TaskSetManager:
14/08/16 06:55:48 INFO scheduler.TaskSchedulerImpl: Adding task set 1.0
with 2 tasks
14/08/16 06:55:48 INFO scheduler.TaskSetManager: Starting task 1.0:0 as TID
2 on executor 8:
