Re: Interest in adding ability to request GPU's to the spark client?

There's some discussion and proposal of supporting GPUs in this Spark JIRA: https://jira.apache.org/jira/browse/SPARK-24615 "Accelerator-aware task scheduling for Spark" Susan On Thu, Jul 12, 2018 at 11:17 AM, Mich Talebzadeh wrote: > I agree. > > Adding GPU capability to Spark in my opinion

Re: Interest in adding ability to request GPU's to the spark client?

I agree. Adding GPU capability to Spark in my opinion is a must for Advanced Analytics. HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw *

Re: Interest in adding ability to request GPU's to the spark client?

Hi, I've been meaning to reply to this email for a while now, sorry for taking so much time. I personally think that adding GPU resource management will allow us to boost some ETL performance a lot. For the last year, I've worked in transforming some Machine Learning pipelines from Python in

Interest in adding ability to request GPU's to the spark client?

Hi all, Is anyone here interested in adding the ability to request GPUs to Spark's client (i.e, spark-submit)? As of now, Yarn 3.0's resource manager server has the ability to schedule GPUs as resources via cgroups, but the Spark client lacks an ability to request these. The ability to guarantee