Re: Drop-In Virtual Office Half-Hour

2021-09-17 Thread Holden Karau 
Some folks have had difficulty adding the event so:

https://calendar.google.com/calendar/embed?src=qpnm67gesrccnq39b3otr9b5jo%40group.calendar.google.com&ctz=America%2FLos_Angeles

Holden - OSS Virtual Office Half Hour, Drop-Ins Welcome :)
Monday, Sep 20 · 2:30–3 PM Pacific time
Google Meet joining info
Video call link: https://meet.google.com/ccd-mkbd-gfv


On Mon, Sep 13, 2021 at 4:12 PM Holden Karau  wrote:

> Hi Folks,
>
> I'm going to experiment with a drop-in virtual half-hour office hour type
> thing next Monday, if you've got any burning Spark or general OSS questions
> you haven't had the time to ask anyone else I hope you'll swing by and join
> me. If no one comes with questions I'll tour some of the Spark on K8s code
> I've been working on recently -
> https://calendar.google.com/event?action=TEMPLATE&tmeid=MG84MWJwaGc2YnNuNnFscHJ1c2ptb3NiMm8gaG9sZGVuLmthcmF1QG0&tmsrc=holden.karau%40gmail.com
>
>
> Cheers,
>
> Holden :)
>
> --
> Twitter: https://twitter.com/holdenkarau
> Books (Learning Spark, High Performance Spark, etc.):
> https://amzn.to/2MaRAG9  
> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>


-- 
Twitter: https://twitter.com/holdenkarau
Books (Learning Spark, High Performance Spark, etc.):
https://amzn.to/2MaRAG9  
YouTube Live Streams: https://www.youtube.com/user/holdenkarau

Re: [apache-spark][Spark SQL][Debug] Maven Spark build fails while compiling spark-hive-thriftserver_2.12 for Hadoop 2.10.1

2021-09-17 Thread Sean Owen 
I don't think that has ever showed up in the CI/CD builds and can't recall
someone reporting this. What did you change? it may be some local env issue

On Fri, Sep 17, 2021 at 7:09 AM Enrico Minardi 
wrote:

>
> Hello,
>
>
> the Maven build of Apache Spark 3.1.2 for user-provided Hadoop 2.10.1 with
> Hive and Hive-Thriftserver profiles fails while compiling
> spark-hive-thriftserver_2.12.
>
>
> I am most probably missing something. Could you please help?
>
>
> I have searched the Scala-Maven-Plugin website (
> https://davidb.github.io/scala-maven-plugin/usage.html), Stack Overflow /
> Stack Exchange, and the ASF user-list archive, but could not progress on
> this issue.
>
>
> The Maven version is 3.6.3, Scala version is the 2.12 (not installed, as
> mentioned here: https://davidb.github.io/scala-maven-plugin/index.html).
>
>
> Thank you very much for any suggestion. I would be very appreciated.
>
>
> Kind regards,
>
> Enrico
>
> --
>
>
> The error message is:
>
>
> Failed to execute goal
> [32mnet.alchim31.maven:scala-maven-plugin:4.3.0:compile [m
> [1m(scala-compile-first) [m on project [36mspark-hive-thriftserver_2.12 [m:
> [1;31mExecution scala-compile-first of goal
> net.alchim31.maven:scala-maven-plugin:4.3.0:compile failed:
> java.lang.AssertionError: assertion failed: Expected protocol to be 'file'
> or empty in URI
> jar:file:/home/vmuser/.m2/repository/org/eclipse/jetty/jetty-server/9.4.40.v20210413/jetty-server-9.4.40.v20210413.jar!/org/eclipse/jetty/server/AbstractConnectionFactory.class
>
>
> I have adjusted the ./pom.xml as follows:
>
>
> 
>   hadoop-provided
>   
> 2.10.1
> 2.13.0
> 2.4
> servlet-api
>   
> (...)
>
>
> The command I run is:
>
>
> ./dev/make-distribution.sh -X -q -Phadoop-provided -Pyarn -Pkubernetes
> -Pscala-2.12 -Phive -Phive-thriftserver -DzincPort=3036
>
>

[apache-spark][Spark SQL][Debug] Maven Spark build fails while compiling spark-hive-thriftserver_2.12 for Hadoop 2.10.1

2021-09-17 Thread Enrico Minardi 

Hello,


the Maven build of Apache Spark 3.1.2 for user-provided Hadoop 2.10.1 with Hive 
and Hive-Thriftserver profiles fails while compiling 
spark-hive-thriftserver_2.12.


I am most probably missing something. Could you please help?


I have searched the Scala-Maven-Plugin website 
(https://davidb.github.io/scala-maven-plugin/usage.html), Stack Overflow / 
Stack Exchange, and the ASF user-list archive, but could not progress on this 
issue.


The Maven version is 3.6.3, Scala version is the 2.12 (not installed, as 
mentioned here: https://davidb.github.io/scala-maven-plugin/index.html).



Thank you very much for any suggestion. I would be very appreciated.


Kind regards,

Enrico

--


The error message is:


Failed to execute goal 
net.alchim31.maven:scala-maven-plugin:4.3.0:compile 
(scala-compile-first) on project spark-hive-thriftserver_2.12: 
Execution scala-compile-first of goal 
net.alchim31.maven:scala-maven-plugin:4.3.0:compile failed: 
java.lang.AssertionError: assertion failed: Expected protocol to be 'file' or 
empty in URI 
jar:file:/home/vmuser/.m2/repository/org/eclipse/jetty/jetty-server/9.4.40.v20210413/jetty-server-9.4.40.v20210413.jar!/org/eclipse/jetty/server/AbstractConnectionFactory.class



I have adjusted the ./pom.xml as follows:



  hadoop-provided
  
2.10.1
2.13.0
2.4
servlet-api
  
(...)


The command I run is:


./dev/make-distribution.sh -X -q -Phadoop-provided -Pyarn -Pkubernetes 
-Pscala-2.12 -Phive -Phive-thriftserver -DzincPort=3036