[ https://issues.apache.org/jira/browse/SPARK-22519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Apache Spark reassigned SPARK-22519: ------------------------------------ Assignee: Apache Spark > Remove unnecessary stagingDirPath null check in > ApplicationMaster.cleanupStagingDir() > ------------------------------------------------------------------------------------- > > Key: SPARK-22519 > URL: https://issues.apache.org/jira/browse/SPARK-22519 > Project: Spark > Issue Type: Improvement > Components: YARN > Affects Versions: 2.2.0 > Reporter: Devaraj K > Assignee: Apache Spark > Priority: Trivial > > In the below, the condition checks whether the stagingDirPath is null but > stagingDirPath never becomes null. If SPARK_YARN_STAGING_DIR env var is null > then it throws NPE while creating the Path. > {code:title=ApplicationMaster.scala|borderStyle=solid} > stagingDirPath = new Path(System.getenv("SPARK_YARN_STAGING_DIR")) > if (stagingDirPath == null) { > logError("Staging directory is null") > return > } > {code} > Here we need to check whether the System.getenv("SPARK_YARN_STAGING_DIR") is > null or not, not the stagingDirPath. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org