rongou commented on issue #23347: allow building spark gpu docker images
URL: https://github.com/apache/spark/pull/23347#issuecomment-453706000
@mccheah with the latest commit this now uses debian slim as the base image
for CPUs. The total size is within striking distance of alpine-based im
rongou commented on issue #23347: allow building spark gpu docker images
URL: https://github.com/apache/spark/pull/23347#issuecomment-452773664
So basically any docker image based on linux is a no go because of GPL?
In any case, this PR doesn't depend on publishing docker images. I th
rongou commented on issue #23347: allow building spark gpu docker images
URL: https://github.com/apache/spark/pull/23347#issuecomment-452435272
I think I have a solution to address all the concerns here (well, almost :).
By switching the CPU base image to `debian:stretch-slim`, and a couple
rongou commented on issue #23347: allow building spark gpu docker images
URL: https://github.com/apache/spark/pull/23347#issuecomment-452139101
OK, I just pushed a new commit to show what it looks like to use Ubuntu as
the base image for both CPU and GPU builds. I think this is cleaner and
rongou commented on issue #23347: allow building spark gpu docker images
URL: https://github.com/apache/spark/pull/23347#issuecomment-452123596
Building from head, Spark image based on
Alpine: 373MB
Ubuntu 18.04: 617MB
@ifilonenko I was told by the container guys within NVIDIA t
rongou commented on issue #23347: allow building spark gpu docker images
URL: https://github.com/apache/spark/pull/23347#issuecomment-451366536
@vanzin yes more or less. Since Ubuntu and Alpine use different package
managers, the setups are slightly different. If we are willing to use Ubunt
rongou commented on issue #23347: allow building spark gpu docker images
URL: https://github.com/apache/spark/pull/23347#issuecomment-448507634
I'm mostly following the current structure. There are a few things that can
be done to simplify this and lessen the maintenance burden:
* As I m
