Cc: "user@spark.apache.org<mailto:user@spark.apache.org>"
Subject: Re: Why some executors are lazy?
Thank you Adrian,
The dataset is indeed skewed. My concern was that some executors do not
participate in computation at all. I understand that executors finish tasks
sequentially.
e.org<mailto:user@spark.apache.org>"
Subject: Why some executors are lazy?
Hi,
I'm using the most recent Spark version on a standalone setup of 16+1 machines.
While running GraphX workloads, I found that some executors are lazy? They
*rarely* participate in computation. This causes some other
rs.
>
> -adrian
>
> From: Khaled Ammar
> Date: Tuesday, November 3, 2015 at 11:43 PM
> To: "user@spark.apache.org"
> Subject: Why some executors are lazy?
>
> Hi,
>
> I'm using the most recent Spark version on a standalone setup of 16+1
> machines.
&g
Hi,
I'm using the most recent Spark version on a standalone setup of 16+1
machines.
While running GraphX workloads, I found that some executors are lazy? They
*rarely* participate in computation. This causes some other executors to do
their work. This behavior is consistent in all iterations and
