my spark cluster can access either hadoop 2 or 3. so it doesn't care
what the current hadoop version is.
Håkan Nordgren wrote:
Hi All: Which Hadoop versions (and distributions — Cloudera,
Hortonworks, etc.) are supported for Spark 3.3 for the “Pre-built with
user-provided Apache Hadoop”
Hi All: Which Hadoop versions (and distributions — Cloudera, Hortonworks, etc.)
are supported for Spark 3.3 for the “Pre-built with user-provided Apache
Hadoop” package from https://spark.apache.org/downloads.html?
Thanks
Karl Håkan Nordgren, Ph. D.
Software engineer
DataRobot
Join us online:
