[ https://issues.apache.org/jira/browse/SPARK-4440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14222549#comment-14222549 ]
Xuefu Zhang commented on SPARK-4440: ------------------------------------ CC: [~sandyr], [~rxin] > Enhance the job progress API to expose more information > ------------------------------------------------------- > > Key: SPARK-4440 > URL: https://issues.apache.org/jira/browse/SPARK-4440 > Project: Spark > Issue Type: Improvement > Reporter: Rui Li > > The progress API introduced in SPARK-2321 provides a new way for user to > monitor job progress. However the information exposed in the API is > relatively limited. It'll be much more useful if we can enhance the API to > expose more data. > Some improvement for example may include but not limited to: > 1. Stage submission and completion time. > 2. Task metrics. > The requirement is initially identified for the hive on spark > project(HIVE-7292), other application should benefit as well. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org