cc123n commented on issue #9151:
URL:
https://github.com/apache/incubator-gluten/issues/9151#issuecomment-2765702331
@wangyum
I encountered the same error.
Spark version: spark-3.3.4-bin-hadoop3
Gluten version: gluten-velox-bundle-spark3.3_2.12-centos_7_x86_64-1.3.0.jar
Configuration:
```
--master yarn
spark.shuffle.service.enabled=true
spark.shuffle.manager=org.apache.spark.shuffle.sort.ColumnarShuffleManager
```
Error:
```
cluster.YarnScheduler: Lost executor 7 on core3: Unable to create executor
due to Unable to register with external shuffle server due to :
java.lang.UnsupportedOperationException: Unsupported shuffle manager of
executor:
ExecutorShuffleInfo{localDirs=[/yarn/nm/usercache/root/appcache/application_1737597222514_148679/blockmgr-349056fc-c113-416c-a2c5-c6697fa6c17b],
subDirsPerLocalDir=64,
shuffleManager=org.apache.spark.shuffle.sort.ColumnarShuffleManager}
```
Spark is already version spark-3.3.4. Do I need to make any other changes ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
