Hi, all I would like to start the discussion for supporting Docker Official Image for Spark.
This SPIP is proposed to add Docker Official Image(DOI) <https://github.com/docker-library/official-images> to ensure the Spark Docker images meet the quality standards for Docker images, to provide these Docker images for users who want to use Apache Spark via Docker image. There are also several Apache projects that release the Docker Official Images <https://hub.docker.com/search?q=apache&image_filter=official>, such as: flink <https://hub.docker.com/_/flink>, storm <https://hub.docker.com/_/storm>, solr <https://hub.docker.com/_/solr>, zookeeper <https://hub.docker.com/_/zookeeper>, httpd <https://hub.docker.com/_/httpd> (with 50M+ to 1B+ download for each). From the huge download statistics, we can see the real demands of users, and from the support of other apache projects, we should also be able to do it. After support: - The Dockerfile will still be maintained by the Apache Spark community and reviewed by Docker. - The images will be maintained by the Docker community to ensure the quality standards for Docker images of the Docker community. It will also reduce the extra docker images maintenance effort (such as frequently rebuilding, image security update) of the Apache Spark community. See more in SPIP DOC: https://docs.google.com/document/d/1nN-pKuvt-amUcrkTvYAQ-bJBgtsWb9nAkNoVNRM2S2o cc: Ruifeng (co-author) and Hyukjin (shepherd) Regards, Yikun
