Re: VolcanoFeatureStep( Custom Scheduler ) not found in Spark 3.3.1 archive

2022-11-20 Thread Gnana Kumar
Thanks Chris for your guidance.Your maven commands have worked really. I have been able to build the source and generate the binary distribution as well using below steps. >mvn -Denforcer.skip=true -DrecompileMode=all -Pkubernetes -Pvolcano -Pscala-2.12 -DskipTests clean package

Re: VolcanoFeatureStep( Custom Scheduler ) not found in Spark 3.3.1 archive

2022-11-18 Thread Chris Nauroth
Hello Gnana, I'm bringing this thread back to the user@ list for the benefit of anyone else who might want to try this feature. Running this from the root of the source tree should give you a working full build with Kubernetes and the experimental Volcano feature, using Scala 2.12: build/mvn

VolcanoFeatureStep( Custom Scheduler ) not found in Spark 3.3.1 archive

2022-11-16 Thread Gnana Kumar
Hi There, I have installed Spark 3.3.1 and tried to use the following configuration in Spark Submit for a spark job to run in Kubernetes Cluster and I have got class not found exception for the reference "VolcanoFeatureStep" --conf