How about DStream.print().
Does it invoke collect before print on driver?
________________________________
From: Sean Owen <so...@cloudera.com>
Sent: Wednesday, July 6, 2016 8:20:36 PM
To: Rabin Banerjee
Cc: Yu Wei; user@spark.apache.org
Subject: Re: It seemed JavaDStream.print() did not work when launching via yarn
on a single node
dstream.foreachRDD(_.collect.foreach(println))
On Wed, Jul 6, 2016 at 1:19 PM, Rabin Banerjee
<dev.rabin.baner...@gmail.com> wrote:
> Collect will help then . May be something like this,
> foreachRDD( rdd => { for(item <- rdd.collect().toArray) { println(item); }
> })
>
