Customizing Akka configuration for Spark

Hi, Is there some way to customize the Akka configuration for Spark? Specifically, I want to experiment with custom serialization for messages that are send between the driver and executors in standalone mode. Thanks, Akshat

Re: Task scheduling times

Hi, Any input on this? I'm willing to instrument further and experiment if there are any ideas. On Mon, May 4, 2015 at 11:27 AM, Akshat Aranya aara...@gmail.com wrote: Hi, I have been investigating scheduling delays in Spark and I found some unexplained anomalies. In my use case, I have two

Task scheduling times

Hi, I have been investigating scheduling delays in Spark and I found some unexplained anomalies. In my use case, I have two stages after collapsing the transformations: the first is a mapPartitions() and the second is a sortByKey(). I found that the task serialization for the first stage takes