Re: spark-submit local and Akka startup timeouts

2016-07-19 Thread Bryan Cutler
in England and Wales. > Registered number: 02675207. > Registered address: Globe House, Clivemont Road, Maidenhead, Berkshire SL6 > 7DY, UK. > -- > *From:* Bryan Cutler <cutl...@gmail.com> > *Sent:* 19 July 2016 02:20:38 > *To:* Rory Waite > *C

Re: spark-submit local and Akka startup timeouts

2016-07-19 Thread Rory Waite
ct: Re: spark-submit local and Akka startup timeouts Hi Rory, for starters what version of Spark are you using? I believe that in a 1.5.? release (I don't know which one off the top of my head) there was an addition that would also display the config property when a timeout happened. That migh

Re: spark-submit local and Akka startup timeouts

2016-07-18 Thread Bryan Cutler
Hi Rory, for starters what version of Spark are you using? I believe that in a 1.5.? release (I don't know which one off the top of my head) there was an addition that would also display the config property when a timeout happened. That might help some if you are able to upgrade. On Jul 18,

spark-submit local and Akka startup timeouts

2016-07-18 Thread Rory Waite
Hi All, We have created a regression test for a spark job that is executed during our automated build. It executes a spark-submit with a local master, processes some data, and the exits. We have an issue in that we get a non-deterministic timeout error. It seems to be when the spark context