Re: Is the operation inside foreachRDD supposed to be blocking?

2016-07-08 Thread Mikael Ståldal
utation and blocks until the action completes. You can wait >>> for it with a Future, sure. >>> >>> On Fri, Jul 8, 2016 at 10:43 AM, Mikael Ståldal < >>> mikael.stal...@magine.com> wrote: >>> >>>> In a Spark Streaming job, is the

Re: Is the operation inside foreachRDD supposed to be blocking?

2016-07-08 Thread Sean Owen
wait >> for it with a Future, sure. >> >> On Fri, Jul 8, 2016 at 10:43 AM, Mikael Ståldal < >> mikael.stal...@magine.com> wrote: >> >>> In a Spark Streaming job, is the operation inside foreachRDD supposed to >>> synchronous / blocking? >>>

Re: Is the operation inside foreachRDD supposed to be blocking?

2016-07-08 Thread Mikael Ståldal
com > > wrote: > >> In a Spark Streaming job, is the operation inside foreachRDD supposed to >> synchronous / blocking? >> >> What if you do some asynchronous operation which returns a Future? Are >> you then supposed to do Await on that Future? >>

Re: Is the operation inside foreachRDD supposed to be blocking?

2016-07-08 Thread Sean Owen
<mikael.stal...@magine.com> wrote: > In a Spark Streaming job, is the operation inside foreachRDD supposed to > synchronous / blocking? > > What if you do some asynchronous operation which returns a Future? Are you > then supposed to do Await on that Future? > -- > [image: Ma

Is the operation inside foreachRDD supposed to be blocking?

2016-07-08 Thread Mikael Ståldal
In a Spark Streaming job, is the operation inside foreachRDD supposed to synchronous / blocking? What if you do some asynchronous operation which returns a Future? Are you then supposed to do Await on that Future? -- [image: MagineTV] *Mikael Ståldal* Senior software developer *Magine TV