Alexandre CLEMENT created SPARK-36042:
-----------------------------------------
Summary: [Dynamic allocation] Executor grace period
(ExecutorIdleTimeout) ignored due to nulll startTime for pods in pending state
Key: SPARK-36042
URL: https://issues.apache.org/jira/browse/SPARK-36042
Project: Spark
Issue Type: Bug
Components: Kubernetes
Affects Versions: 3.1.1
Environment: AWS EKS with dynamic allocation
Reporter: Alexandre CLEMENT
Pending executor are always timeouted due to null startTime and funtion
returning true in case of exception in parsing startTime.
private def isExecutorIdleTimedOut(state: ExecutorPodState, currentTime: Long):
Boolean = {
{{ try {}}
{{ val startTime =
Instant.parse(state.pod.getStatus.getStartTime).toEpochMilli()}}
{{ currentTime - startTime > executorIdleTimeout}}
{{ } catch {}}
{{ case _: Exception =>}}
{{ logDebug(s"Cannot get startTime of pod ${state.pod}")}}
{{ true}}
{{ }}}
{{}}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
