[ https://issues.apache.org/jira/browse/SPARK-22424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16235344#comment-16235344 ]
Sean Owen commented on SPARK-22424: ----------------------------------- This shows task 52 finished in both logs and UI. > Task not finished for a long time in monitor UI, but I found it finished in > logs > -------------------------------------------------------------------------------- > > Key: SPARK-22424 > URL: https://issues.apache.org/jira/browse/SPARK-22424 > Project: Spark > Issue Type: Bug > Components: Spark Core > Affects Versions: 2.1.0 > Reporter: chengning > Priority: Blocking > Attachments: C33oL.jpg > > > Task not finished for a long time in monitor UI, but I found it finished in > logs > Thanks a lot. > !https://i.stack.imgur.com/C33oL.jpg! > executor log: > 17/09/29 17:32:28 INFO executor.CoarseGrainedExecutorBackend: Got assigned > task 213492 > 17/09/29 17:32:28 INFO executor.Executor: Running task 52.0 in stage 2468.0 > (TID 213492) > 17/09/29 17:32:28 INFO storage.ShuffleBlockFetcherIterator: Getting 30 > non-empty blocks out of 30 blocks > 17/09/29 17:32:28 INFO storage.ShuffleBlockFetcherIterator: Started 29 remote > fetches in 1 ms > 17:32:28.447: tcPartition=7 ms > 17/09/29 17:32:28 INFO executor.Executor: Finished task 52.0 in stage 2468.0 > (TID 213492). 2755 bytes result sent to driver > driver logļ¼: > 17/09/29 17:32:28 INFO scheduler.TaskSetManager: Starting task 52.0 in stage > 2468.0 (TID 213492, HMGQXD2, executor 1, partition 52, PROCESS_LOCAL, 6386 > bytes) > 17/09/29 17:32:28 INFO scheduler.TaskSetManager: Finished task 52.0 in stage > 2468.0 (TID 213492) in 24 ms on HMGQXD2 (executor 1) (53/200) > 17/09/29 17:32:28 INFO cluster.YarnScheduler: Removed TaskSet 2468.0, whose > tasks have all completed, from pool > 17/09/29 17:32:28 INFO scheduler.DAGScheduler: ResultStage 2468 > (foreachPartition at Counter2.java:152) finished in 0.255 s > 17/09/29 17:32:28 INFO scheduler.DAGScheduler: Job 1647 finished: > foreachPartition at Counter2.java:152, took 0.415256 s -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org