Hi Alfredo, I have been building something similar and found that EMR is not suitable for this, as the gpu instances don't come with nvidia drivers (and the bootstrap process does not allow to restart instances).
The way I'm setting up is based on the spark-ec2 script where you can use custom AMIs which can contain your dockerized application plus all the drivers and dependencies installed. I haven't completed my project yet, but haven't run into any major blocker so far. thanks, -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Anyone-have-a-tutorial-or-guide-to-implement-Spark-AWS-Caffe-CUDA-tp26705p26707.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
