Re: Connection closed error while running Terasort

2015-09-03 Thread Akhil Das
Can you look at bit deeper in the executor logs? It may happen that it hit the GC Overhead etc which lead to the connection failures. Thanks Best Regards On Tue, Sep 1, 2015 at 5:43 AM, Suman Somasundar < suman.somasun...@oracle.com> wrote: > Hi, > > > > I am getting the following error while

Connection closed error while running Terasort

2015-08-31 Thread Suman Somasundar
Hi, I am getting the following error while trying to run a 10GB terasort under Yarn with 8 nodes. The command is: spark-submit --class com.github.ehiggs.spark.terasort.TeraSort --master yarn-cluster --num-executors 10 --executor-memory 32g