[ https://issues.apache.org/jira/browse/SPARK-39473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Attila Zsolt Piros resolved SPARK-39473. ---------------------------------------- Resolution: Invalid This is because of Scala 2.11 on latter version *asScala* is prepared to handle null values. > NullPointerException in SparkRackResolver > ------------------------------------------ > > Key: SPARK-39473 > URL: https://issues.apache.org/jira/browse/SPARK-39473 > Project: Spark > Issue Type: Improvement > Components: YARN > Affects Versions: 2.4.8, 3.0.0, 3.0.1, 3.0.2, 3.0.3, 3.1.0, 3.1.1, 3.1.2, > 3.2.0, 3.2.1 > Reporter: Attila Zsolt Piros > Assignee: Attila Zsolt Piros > Priority: Major > > When the underlying DNSToSwitchMapping's resolver returns a null we get a > NullPointerException: > {noformat} > 22/05/24 08:12:12 980 ERROR DAGSchedulerEventProcessLoop: > DAGSchedulerEventProcessLoop failed; shutting down SparkContext > java.lang.NullPointerException > at > scala.collection.convert.Wrappers$JListWrapper.isEmpty(Wrappers.scala:87) > at > org.apache.spark.deploy.yarn.SparkRackResolver.coreResolve(SparkRackResolver.scala:76) > {noformat} -- This message was sent by Atlassian Jira (v8.20.7#820007) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org