Re: [I] master --yarn on EMR with OSS Spark fails with java.lang.ClassNotFoundException: org.apache.spark.shuffle.sort.ColumnarShuffleManager [incubator-gluten]
sagarlakshmipathy commented on issue #4924: URL: https://github.com/apache/incubator-gluten/issues/4924#issuecomment-1992591955 moved the gluten jar to `SPARK_HOME/jars` folder and got it to work ``` ./spark-3.4.1-bin-hadoop3/bin/spark-shell \ --master yarn \ --deploy-mode client \ --conf spark.plugins=io.glutenproject.GlutenPlugin \ --conf spark.memory.offHeap.enabled=true \ --conf spark.memory.offHeap.size=10g \ --conf spark.shuffle.manager=org.apache.spark.shuffle.sort.ColumnarShuffleManager ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@gluten.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@gluten.apache.org For additional commands, e-mail: commits-h...@gluten.apache.org
Re: [I] master --yarn on EMR with OSS Spark fails with java.lang.ClassNotFoundException: org.apache.spark.shuffle.sort.ColumnarShuffleManager [incubator-gluten]
sagarlakshmipathy closed issue #4924: master --yarn on EMR with OSS Spark fails with java.lang.ClassNotFoundException: org.apache.spark.shuffle.sort.ColumnarShuffleManager URL: https://github.com/apache/incubator-gluten/issues/4924 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@gluten.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@gluten.apache.org For additional commands, e-mail: commits-h...@gluten.apache.org
