Carson Wang created SPARK-13889: ----------------------------------- Summary: Integer overflow when calculating the max number of executor failure Key: SPARK-13889 URL: https://issues.apache.org/jira/browse/SPARK-13889 Project: Spark Issue Type: Bug Components: YARN Affects Versions: 1.6.1, 1.6.0 Reporter: Carson Wang
The max number of executor failure before failing the application is default to twice the maximum number of executors if dynamic allocation is enabled. The default value for "spark.dynamicAllocation.maxExecutors" is Int.MaxValue. So this causes an integer overflow and a wrong result. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org