You are just setting up the computation here using foreacRDD. You have not
even run the streaming context to get any data.
On Wed, Feb 25, 2015 at 2:21 PM, Thanigai Vellore <
thanigai.vell...@gmail.com> wrote:
> I have this function in the driver program which collects the result from
> rdds (in a stream) into an array and return. However, even though the RDDs
> (in the dstream) have data, the function is returning an empty array...What
> am I doing wrong?
>
> I can print the RDD values inside the foreachRDD call but the array is
> always empty.
>
> def runTopFunction() : Array[(String, Int)] = {
> val topSearches = some function....
> val summary = new ArrayBuffer[(String,Int)]()
> topSearches.foreachRDD(rdd => {
> summary = summary.++(rdd.collect())
> })
>
> return summary.toArray
> }
>
>
