pan3793 commented on code in PR #4691:
URL: https://github.com/apache/zeppelin/pull/4691#discussion_r1536645215
##########
pom.xml:
##########
@@ -139,17 +139,12 @@
<maven.version>3.6.3</maven.version>
<dropwizard.version>4.1.14</dropwizard.version>
<micrometer.version>1.6.0</micrometer.version>
+ <findbugs.jsr305.version>3.0.2</findbugs.jsr305.version>
- <hadoop2.7.version>2.7.7</hadoop2.7.version>
- <hadoop3.0.version>3.0.3</hadoop3.0.version>
- <hadoop3.1.version>3.1.3</hadoop3.1.version>
<hadoop3.2.version>3.2.4</hadoop3.2.version>
<hadoop3.3.version>3.3.6</hadoop3.3.version>
- <hadoop.version>${hadoop2.7.version}</hadoop.version>
+ <hadoop.version>${hadoop3.3.version}</hadoop.version>
Review Comment:
another reason is, as we use the hadoop-minicluster to launch Mini YARN
cluster for testing in some modules, while since Spark 3.2.0, the pre-built
Spark tgz ships Hadoop 3.3.x jars, Hadoop requires that client version <=
server version, so we must use Hadoop 3.3 to launch Mini YARN cluster to allow
Spark works properly.
##########
pom.xml:
##########
@@ -139,17 +139,12 @@
<maven.version>3.6.3</maven.version>
<dropwizard.version>4.1.14</dropwizard.version>
<micrometer.version>1.6.0</micrometer.version>
+ <findbugs.jsr305.version>3.0.2</findbugs.jsr305.version>
- <hadoop2.7.version>2.7.7</hadoop2.7.version>
- <hadoop3.0.version>3.0.3</hadoop3.0.version>
- <hadoop3.1.version>3.1.3</hadoop3.1.version>
<hadoop3.2.version>3.2.4</hadoop3.2.version>
<hadoop3.3.version>3.3.6</hadoop3.3.version>
- <hadoop.version>${hadoop2.7.version}</hadoop.version>
+ <hadoop.version>${hadoop3.3.version}</hadoop.version>
Review Comment:
another reason is, we use the hadoop-minicluster to launch Mini YARN cluster
for testing in some modules, while since Spark 3.2.0, the pre-built Spark tgz
ships Hadoop 3.3.x jars, Hadoop requires that client version <= server version,
so we must use Hadoop 3.3 to launch Mini YARN cluster to allow Spark works
properly.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
