Re: Unable to run Spark Job(3.3.2 SNAPSHOT) with Volcano scheduler in Kubernetes

2022-12-16 Thread Gnana Kumar
I have opened the pom file under cd ~/spark/sql/catalyst$ vi pom.xml and increases from "-Xss4m" to "-Xss4g" but still no luck..It is the same stackoverflow error. On Fri, Dec 16, 2022 at 9:42 PM Sean Owen wrote: > OK that's good. Hm, I seem to recall the build needs more mem in Java 11 >

Re: Unable to run Spark Job(3.3.2 SNAPSHOT) with Volcano scheduler in Kubernetes

2022-12-16 Thread Bjørn Jørgensen
I use java 17 to build this. Are there any reasons why you have to build spark yourself? Can't you start from spark 3.3.1 tar file and build a docker image from there? fre. 16. des. 2022 kl. 18:26 skrev Gnana Kumar : > I have opened the pom file under cd ~/spark/sql/catalyst$ vi pom.xml and >

Re: Unable to run Spark Job(3.3.2 SNAPSHOT) with Volcano scheduler in Kubernetes

2022-12-16 Thread Sean Owen
OK that's good. Hm, I seem to recall the build needs more mem in Java 11 and/or some envs. As a quick check, try replacing all "-Xss4m" with "-Xss16m" or something larger, in the project build files. Just search and replace. On Fri, Dec 16, 2022 at 9:53 AM Gnana Kumar wrote: > I have been

Re: Unable to run Spark Job(3.3.2 SNAPSHOT) with Volcano scheduler in Kubernetes

2022-12-16 Thread Sean Owen
You need to increase the stack size during compilation. The included mvn wrapper in build does this. Are you using it? On Fri, Dec 16, 2022 at 9:13 AM Gnana Kumar wrote: > This is my latest error and fails to build SPARK CATALYST > > Exception in thread "main" java.lang.StackOverflowError >