[apache-spark][Spark SQL][Debug] Maven Spark build fails while compiling spark-hive-thriftserver_2.12 for Hadoop 2.10.1

[Enrico Minardi]

Hello,


the Maven build of Apache Spark 3.1.2 for user-provided Hadoop 2.10.1 with Hive 
and Hive-Thriftserver profiles fails while compiling 
spark-hive-thriftserver_2.12.


I am most probably missing something. Could you please help?


I have searched the Scala-Maven-Plugin website 
(https://davidb.github.io/scala-maven-plugin/usage.html), Stack Overflow / 
Stack Exchange, and the ASF user-list archive, but could not progress on this 
issue.


The Maven version is 3.6.3, Scala version is the 2.12 (not installed, as 
mentioned here: https://davidb.github.io/scala-maven-plugin/index.html).



Thank you very much for any suggestion. I would be very appreciated.


Kind regards,

Enrico

----------


The error message is:


Failed to execute goal 
net.alchim31.maven:scala-maven-plugin:4.3.0:compile 
(scala-compile-first) on project spark-hive-thriftserver_2.12: 
Execution scala-compile-first of goal 
net.alchim31.maven:scala-maven-plugin:4.3.0:compile failed: 
java.lang.AssertionError: assertion failed: Expected protocol to be 'file' or 
empty in URI 
jar:file:/home/vmuser/.m2/repository/org/eclipse/jetty/jetty-server/9.4.40.v20210413/jetty-server-9.4.40.v20210413.jar!/org/eclipse/jetty/server/AbstractConnectionFactory.class



I have adjusted the ./pom.xml as follows:


<profile>
      <id>hadoop-provided</id>
      <properties>
        <hadoop.version>2.10.1</hadoop.version>
        <curator.version>2.13.0</curator.version>
        <commons-io.version>2.4</commons-io.version>
        <javax.servlet-api.name>servlet-api</javax.servlet-api.name>
      </properties>
(...)


The command I run is:


./dev/make-distribution.sh -X -q -Phadoop-provided -Pyarn -Pkubernetes 
-Pscala-2.12 -Phive -Phive-thriftserver -DzincPort=3036