I am seeing a problem with a Spark job in standalone mode. Spark master's web interface shows a task RUNNING on a particular executor, but the logs of the executor do not show the task being ever assigned to it, that is, such a line is missing from the log:
15/02/25 16:53:36 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 27. The missing task wasn't the first task executing on the executor. Also, subsequent tasks are running on other executor threads on this executor. Any good way to figure out what happened here? -Akshat
