Re: [apache-spark][Spark SQL][Debug] Maven Spark build fails while compiling spark-hive-thriftserver_2.12 for Hadoop 2.10.1

2021-09-17 Thread Sean Owen
I don't think that has ever showed up in the CI/CD builds and can't recall
someone reporting this. What did you change? it may be some local env issue

On Fri, Sep 17, 2021 at 7:09 AM Enrico Minardi 
wrote:

>
> Hello,
>
>
> the Maven build of Apache Spark 3.1.2 for user-provided Hadoop 2.10.1 with
> Hive and Hive-Thriftserver profiles fails while compiling
> spark-hive-thriftserver_2.12.
>
>
> I am most probably missing something. Could you please help?
>
>
> I have searched the Scala-Maven-Plugin website (
> https://davidb.github.io/scala-maven-plugin/usage.html), Stack Overflow /
> Stack Exchange, and the ASF user-list archive, but could not progress on
> this issue.
>
>
> The Maven version is 3.6.3, Scala version is the 2.12 (not installed, as
> mentioned here: https://davidb.github.io/scala-maven-plugin/index.html).
>
>
> Thank you very much for any suggestion. I would be very appreciated.
>
>
> Kind regards,
>
> Enrico
>
> --
>
>
> The error message is:
>
>
> Failed to execute goal
> [32mnet.alchim31.maven:scala-maven-plugin:4.3.0:compile [m
> [1m(scala-compile-first) [m on project [36mspark-hive-thriftserver_2.12 [m:
> [1;31mExecution scala-compile-first of goal
> net.alchim31.maven:scala-maven-plugin:4.3.0:compile failed:
> java.lang.AssertionError: assertion failed: Expected protocol to be 'file'
> or empty in URI
> jar:file:/home/vmuser/.m2/repository/org/eclipse/jetty/jetty-server/9.4.40.v20210413/jetty-server-9.4.40.v20210413.jar!/org/eclipse/jetty/server/AbstractConnectionFactory.class
>
>
> I have adjusted the ./pom.xml as follows:
>
>
> 
>   hadoop-provided
>   
> 2.10.1
> 2.13.0
> 2.4
> servlet-api
>   
> (...)
>
>
> The command I run is:
>
>
> ./dev/make-distribution.sh -X -q -Phadoop-provided -Pyarn -Pkubernetes
> -Pscala-2.12 -Phive -Phive-thriftserver -DzincPort=3036
>
>


[apache-spark][Spark SQL][Debug] Maven Spark build fails while compiling spark-hive-thriftserver_2.12 for Hadoop 2.10.1

2021-09-17 Thread Enrico Minardi

Hello,


the Maven build of Apache Spark 3.1.2 for user-provided Hadoop 2.10.1 with Hive 
and Hive-Thriftserver profiles fails while compiling 
spark-hive-thriftserver_2.12.


I am most probably missing something. Could you please help?


I have searched the Scala-Maven-Plugin website 
(https://davidb.github.io/scala-maven-plugin/usage.html), Stack Overflow / 
Stack Exchange, and the ASF user-list archive, but could not progress on this 
issue.


The Maven version is 3.6.3, Scala version is the 2.12 (not installed, as 
mentioned here: https://davidb.github.io/scala-maven-plugin/index.html).



Thank you very much for any suggestion. I would be very appreciated.


Kind regards,

Enrico

--


The error message is:


Failed to execute goal 
net.alchim31.maven:scala-maven-plugin:4.3.0:compile 
(scala-compile-first) on project spark-hive-thriftserver_2.12: 
Execution scala-compile-first of goal 
net.alchim31.maven:scala-maven-plugin:4.3.0:compile failed: 
java.lang.AssertionError: assertion failed: Expected protocol to be 'file' or 
empty in URI 
jar:file:/home/vmuser/.m2/repository/org/eclipse/jetty/jetty-server/9.4.40.v20210413/jetty-server-9.4.40.v20210413.jar!/org/eclipse/jetty/server/AbstractConnectionFactory.class



I have adjusted the ./pom.xml as follows:



  hadoop-provided
  
2.10.1
2.13.0
2.4
servlet-api
  
(...)


The command I run is:


./dev/make-distribution.sh -X -q -Phadoop-provided -Pyarn -Pkubernetes 
-Pscala-2.12 -Phive -Phive-thriftserver -DzincPort=3036