Re: spark distribution build fails

2022-03-17 Thread Martin Grigorov
Hi, For the mail archives: this error happens when the user has MAVEN_OPTS env var pre-exported. In this case ./build/mvn|sbt does not export its own MAVEN_OPTS with the -XssXYZ value, and the default one is too low and leads to the StackOverflowError On Mon, Mar 14, 2022 at 11:13 PM

Re: spark distribution build fails

2022-03-14 Thread Bulldog20630405
thanx; that worked great! On Mon, Mar 14, 2022 at 11:17 AM Sean Owen wrote: > Try increasing the stack size in the build. It's the Xss argument you find > in various parts of the pom or sbt build. I have seen this and not sure why > it happens on certain envs, but that's the workaround > > On

Re: spark distribution build fails

2022-03-14 Thread Sean Owen
Try increasing the stack size in the build. It's the Xss argument you find in various parts of the pom or sbt build. I have seen this and not sure why it happens on certain envs, but that's the workaround On Mon, Mar 14, 2022, 8:59 AM Bulldog20630405 wrote: > > using tag v3.2.1 with java 8

spark distribution build fails

2022-03-14 Thread Bulldog20630405
using tag v3.2.1 with java 8 getting a stackoverflow when building the distribution: > alias mvn alias mvn='mvn --errors --fail-at-end -DskipTests ' > dev/make-distribution.sh --name 'hadoop-3.2' --pip --tgz -Phive -Phive-thriftserver -Pmesos -Pyarn -Pkubernetes [INFO]