Re: spark-submit local and Akka startup timeouts

2016-07-19 Thread Rory Waite
limited company registered in England and Wales. Registered number: 02675207. Registered address: Globe House, Clivemont Road, Maidenhead, Berkshire SL6 7DY, UK. From: Bryan Cutler <cutl...@gmail.com> Sent: 19 July 2016 02:20:38 To: Rory Waite Cc: user Subje

spark-submit local and Akka startup timeouts

2016-07-18 Thread Rory Waite
Hi All, We have created a regression test for a spark job that is executed during our automated build. It executes a spark-submit with a local master, processes some data, and the exits. We have an issue in that we get a non-deterministic timeout error. It seems to be when the spark context

Training the MultilayerPerceptronClassifier

2015-09-11 Thread Rory Waite
Hi, I’ve been trying to train the new MultilayerPerceptronClassifier in spark 1.5 for the MNIST digit recognition task. I’m trying to reproduce the work here: https://github.com/avulanov/ann-benchmark The API has changed since this work, so I’m not sure that I’m setting up the task correctly.