Re: Spark driver thread

2020-03-06 Thread Enrico Minack
@spark.apache.org *Subject:* Re: Spark driver thread Hi james, You can configure the Spark Driver to use more than a single thread. It is something that depends on the application, but the Spark driver can take advantage of multiple threads in many situations. For instance, when the driver

Re: Spark driver thread

2020-03-06 Thread Pol Santamaria
ol Santamaria >> *Sent:* Friday, March 6, 2020 12:59 AM >> *To:* James Yu >> *Cc:* user@spark.apache.org >> *Subject:* Re: Spark driver thread >> >> Hi james, >> >> You can configure the Spark Driver to use more than a single thread. It >>

Re: Spark driver thread

2020-03-06 Thread Russell Spitzer
cluster mode. Thanks in advance for your further > clarification. > > -- > *From:* Pol Santamaria > *Sent:* Friday, March 6, 2020 12:59 AM > *To:* James Yu > *Cc:* user@spark.apache.org > *Subject:* Re: Spark driver thread > > Hi james, >

Re: Spark driver thread

2020-03-06 Thread James Yu
@spark.apache.org Subject: Re: Spark driver thread Hi james, You can configure the Spark Driver to use more than a single thread. It is something that depends on the application, but the Spark driver can take advantage of multiple threads in many situations. For instance, when the driver

Re: Spark driver thread

2020-03-06 Thread Pol Santamaria
Hi james, You can configure the Spark Driver to use more than a single thread. It is something that depends on the application, but the Spark driver can take advantage of multiple threads in many situations. For instance, when the driver program gathers or sends data to the workers. So yes, if

Spark driver thread

2020-03-05 Thread James Yu
Hi, Does a Spark driver always works as single threaded? If yes, does it mean asking for more than one vCPU for the driver is wasteful? Thanks, James