Re: Spark master build hangs using parallel build option in maven

2020-01-18 Thread Sean Owen
I think we can remove that note from the README then, I'll do that. On Sat, Jan 18, 2020 at 1:38 AM Dongjoon Hyun wrote: > > Hi, Saurabh. > > It seems that you are hitting > https://issues.apache.org/jira/browse/SPARK-26095 . > > And, we disabled the parallel build via >

Re: Spark master build hangs using parallel build option in maven

2020-01-17 Thread Dongjoon Hyun
Hi, Saurabh. It seems that you are hitting https://issues.apache.org/jira/browse/SPARK-26095 . And, we disabled the parallel build via https://github.com/apache/spark/pull/23061 at 3.0.0. According to the stack trace in JIRA and PR description, `maven-shade-plugin` seems to be the root cause.

Re: Spark master build hangs using parallel build option in maven

2020-01-17 Thread Saurabh Chawla
Hi Sean, Thanks for checking this. I am able to see parallel build info in the readme file https://github.com/apache/spark#building-spark " You can build Spark using more than one thread by using the -T option with Maven, see "Parallel builds in Maven 3"

Re: Spark master build hangs using parallel build option in maven

2020-01-17 Thread Sean Owen
I don't believe you can use a parallel build indeed. Some things collide with each other. Some of the suites are run in parallel inside the build though already. On Fri, Jan 17, 2020 at 1:23 PM Saurabh Chawla wrote: > > Hi All, > > Spark master build hangs using parallel build option in maven.