Re: Akka with Spark

We are just removing Spark's dependency on Akka. It has nothing to do with whether user applications can use Akka or not. As a matter of fact, by removing the Akka dependency from Spark, it becomes easier for user applications to use Akka, because there is no more dependency conflict. For more inf

Re: Akka with Spark

Any rationale for removing Akka from Spark ? Also, what is the replacement ? Thanks > On Dec 27, 2015, at 8:31 AM, Dean Wampler wrote: > > Note that Akka is being removed from Spark. Even if it weren't, I would > consider keeping Akka processes separate from Spark processes, so you can >

ERROR server.TThreadPoolServer: Error occurred during processing of message

I'm running apache-hive-1.2.1-bin and spark-1.5.1-bin-hadoop2.6. spark as the hive engine. When I try to connect through JasperStudio using thrift port I get below error. I'm running ubuntu 14.04. 15/12/26 23:36:20 ERROR server.TThreadPoolServer: Error occurred during processing of message.

Re: Akka with Spark

Note that Akka is being removed from Spark. Even if it weren't, I would consider keeping Akka processes separate from Spark processes, so you can monitor, debug, and scale them independently. So consider streaming data from Akka to Spark Streaming or go the other way, from Spark to Akka Streams. d

Re: Akka with Spark

Do you mind sharing your use case ? It may be possible to use a different approach than Akka. Cheers On Sat, Dec 26, 2015 at 10:08 AM, Disha Shrivastava wrote: > Hi, > > I wanted to know how to use Akka framework with Spark starting from > basics. I saw online that Spark uses Akka framework bu

Akka with Spark

Hi, I wanted to know how to use Akka framework with Spark starting from basics. I saw online that Spark uses Akka framework but I am not really sure if I can define Actors and use it in Spark. Also, how to integrate Akka with Spark as in how will I know how many Akka actors are running on each of

Re: [VOTE] Release Apache Spark 1.6.0 (RC4)

+1 On 12/23/15 12:39 PM, Yin Huai wrote: +1 On Tue, Dec 22, 2015 at 8:10 PM, Denny Lee > wrote: +1 On Tue, Dec 22, 2015 at 7:05 PM Aaron Davidson mailto:ilike...@gmail.com>> wrote: +1 On Tue, Dec 22, 2015 at 7:01 PM, Josh Rosen