this.
var ar = ut_rdd.toArray()
// aggregate the count for the year
ucount = ucount + ar(0)._2
}
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/processing-large-number-of-files-tp15429.html
Sent from the Apache Spark User List mailing list
the count. Need to find if there is
an easier way to do this.
var ar = ut_rdd.toArray()
// aggregate the count for the year
ucount = ucount + ar(0)._2
}
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/processing-large-number-of-files