Helena Edelson created SPARK-2593:
-------------------------------------
Summary: Add ability to pass an existing Akka ActorSystem into
Spark
Key: SPARK-2593
URL: https://issues.apache.org/jira/browse/SPARK-2593
Project: Spark
Issue Type: Brainstorming
Components: Spark Core
Reporter: Helena Edelson
As a developer I want to pass an existing ActorSystem into StreamingContext in
load-time so that I do not have 2 actor systems running on a node.
This would mean having spark's actor system on its own named-dispatchers as
well as exposing the new private creation of its own actor system.
If it makes sense...
I would like to create an Akka Extension that wraps around Spark/Spark
Streaming and Cassandra. So the creation would simply be this for a user
val extension = SparkCassandra(system)
and using is as easy as:
import extension._
spark. // do work or,
streaming. // do work
and all config comes from reference.conf and user overrides of that.
The conf file would pick up settings from the deployed environment first, then
fallback to -D with a final fallback to configured settings.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
