Re: Which manufacturers' GPUs support Spark?

2022-02-16 Thread Gourav Sengupta
Hi, 100% agree with Sean, the entire RAPIDS solution is built by wonderful people from NVIDIA. Just out of curiosity, if you are using AWS then EMR already supports RAPIDS, please try to use that. AWS has cheaper GPU's which can be used for testing solutions. For certain operations on SPARK the

Re: Which manufacturers' GPUs support Spark?

2022-02-16 Thread Sean Owen
Spark itself does not use GPUs, and is agnostic to what GPUs exist on a cluster, scheduled by the resource manager, and used by an application. In practice, virtually all GPU-related use cases (for deep learning for example) use CUDA, and this is NVIDIA-specific. Certainly, RAPIDS is from NVIDIA.

Which manufacturers' GPUs support Spark?

2022-02-16 Thread 15927907...@163.com
Hello, We have done some Spark GPU accelerated work using the spark-rapids component(https://github.com/NVIDIA/spark-rapids). However, we found that this component currently only supports Nvidia GPU, and on the official Spark website, we did not see the manufacturer's description of the GPU