tgravescs commented on PR #46496: URL: https://github.com/apache/spark/pull/46496#issuecomment-2117624849
what version of Spark are you using? That issue I pointed to was fixed in 4.0.0 and 3.5.1. The check and error that is on the main branch should read: ``` if ((notRunningUnitTests || testExceptionThrown) && !(isStandaloneOrLocalCluster || isYarn || isK8s)) { throw new SparkException("TaskResourceProfiles are only supported for Standalone, " + "Yarn and Kubernetes cluster for now when dynamic allocation is disabled.") ``` https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/resource/ResourceProfileManager.scala#L73 I'm guessing you are using a version of Spark before that change. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org