Re: Spark 2.4.3 with hadoop 3.2 docker image.

Hi Did you try using the image build by mesosphere ? I am not sure they already build the combo 2.4 / 3.2 but they provide a project on github that Can be used to generate tour custom combo. It is named mesosphere/spark-build Regards Le jeu. 4 juil. 2019 à 19:13, José Luis Pedrosa a écrit : >

Spark 2.4.3 with hadoop 3.2 docker image.

Hi All I'm trying to create docker images that can access azure services using abfs hadoop driver, which is only available in haddop 3.2. So I downloaded spark without Hadoop and generated spark images using the docker-image-tool.sh itself. In a new image using the resulting image as FROM,