Re: Issue with Spark on 25 nodes cluster

2016-07-13 Thread ANDREA SPINA
Hi, I solved by increasing the akka timeout time. All the bests, 2016-06-28 15:04 GMT+02:00 ANDREA SPINA <74...@studenti.unimore.it>: > Hello everyone, > > I am running some experiments with Spark 1.4.0 on a ~80GiB dataset located > on hdfs-2.7.1. The environment is a 25 nodes cluster, 16 cores

Issue with Spark on 25 nodes cluster

2016-06-28 Thread ANDREA SPINA
Hello everyone, I am running some experiments with Spark 1.4.0 on a ~80GiB dataset located on hdfs-2.7.1. The environment is a 25 nodes cluster, 16 cores per node. I set the following params: spark.master = "spark://"${runtime.hostname}":7077" # 28 GiB of memory spark.executor.memory = "28672m"