Re: Spark driver CPU usage

:57 AM To: user@spark.apache.org Subject: RE: Spark driver CPU usage Does that configuration parameter affect the CPU usage of the driver? If it does, we have that property unchanged from its default value of "1" yet the same behaviour as before. -Original Message- F

RE: Spark driver CPU usage

2017 06:08 To: Phadnis, Varun <phad...@sky.optymyze.com> Cc: user@spark.apache.org Subject: Re: Spark driver CPU usage Use conf spark.task.cpus to control number of cpus to use in a task. On Mar 1, 2017, at 5:41 PM, Phadnis, Varun <phad...@sky.optymyze.com> wrote: > > Hello, > > I

Re: Spark driver CPU usage

Use conf spark.task.cpus to control number of cpus to use in a task. On Mar 1, 2017, at 5:41 PM, Phadnis, Varun wrote: > > Hello, > > Is there a way to control CPU usage for driver when running applications in > client mode? > > Currently we are observing that the

Spark driver CPU usage

Hello, Is there a way to control CPU usage for driver when running applications in client mode? Currently we are observing that the driver occupies all the cores. Launching just 3 instances of driver of WordCount sample application concurrently on the same machine brings the usage of its 4