Re: Spark API - support for asynchronous calls - Reactive style [I]

2013-12-12 Thread Mark Hamstra
I'm having fun with it. And it's almost all Reynold's work, so I can't take credit for it. On Thu, Dec 12, 2013 at 8:56 AM, Evan Chan wrote: > Mark, > > Thanks. The FutureAction API looks awesome. > > > On Mon, Dec 9, 2013 at 9:31 AM, Mark Hamstra >wrote: > > > Spark has already supported as

Re: Spark API - support for asynchronous calls - Reactive style [I]

2013-12-12 Thread Evan Chan
Mark, Thanks. The FutureAction API looks awesome. On Mon, Dec 9, 2013 at 9:31 AM, Mark Hamstra wrote: > Spark has already supported async jobs for awhile now -- > https://github.com/apache/incubator-spark/pull/29, and they even work > correctly after https://github.com/apache/incubator-spark/p

Re: Spark API - support for asynchronous calls - Reactive style [I]

2013-12-09 Thread Mark Hamstra
Spark has already supported async jobs for awhile now -- https://github.com/apache/incubator-spark/pull/29, and they even work correctly after https://github.com/apache/incubator-spark/pull/232 There are now implicit conversions from RDD to AsyncRDDActions

Spark API - support for asynchronous calls - Reactive style [I]

2013-12-09 Thread Deenar Toraskar
Classification: For internal use only Hi developers Are there any plans to have Spark (and Shark) APIs that are asynchronous and non blocking? APIs that return Futures and Iteratee/Enumerators would be very useful to users building scalable apps using Spark, specially when combined with a fully