17, 2015 at 10:58 PM
To: "user@spark.apache.org<mailto:user@spark.apache.org>"
Subject: Spark Streaming scheduler delay VS driver.cores
Hi,
I’ve recently bumped up the resources for a spark streaming job – and the
performance started to degrade over time.
it was running fine on
Hi,
I’ve recently bumped up the resources for a spark streaming job – and the
performance started to degrade over time.
it was running fine on 7 nodes with 14 executor cores each (via Yarn) until I
bumped executor.cores to 22 cores/node (out of 32 on AWS c3.xlarge, 24 for yarn)
The driver has
