[ https://issues.apache.org/jira/browse/SPARK-26258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aihua Xu updated SPARK-26258: ----------------------------- Description: SPARK-15857 adds the support of callerContext for HDFS and Yarn. Currently, Spark callerContext prints Job Id, Stage Id, Task Id in the callerContext. It would be useful to include JobGroup Id as well since such JobGroup Id could be meaningful from the Spark Client point of view to group the jobs by JobGroup. callerContext=SPARK_CLIENT_application_1541467098185_0008 callerContext=SPARK_TASK_application_1541702365678_0005_1_JId_1_SId_3_0_TId_3_0 was: Currently, Spark callerContext prints Job Id, Stage Id, Task Id in the callerContext. It would be useful to include JobGroup Id as well since such JobGroup Id could be meaningful from the Spark Client point of view to group the jobs by JobGroup. callerContext=SPARK_CLIENT_application_1541467098185_0008 callerContext=SPARK_TASK_application_1541702365678_0005_1_JId_1_SId_3_0_TId_3_0 > Include JobGroupId in the callerContext > ---------------------------------------- > > Key: SPARK-26258 > URL: https://issues.apache.org/jira/browse/SPARK-26258 > Project: Spark > Issue Type: Improvement > Components: Spark Core > Affects Versions: 2.1.0 > Reporter: Aihua Xu > Priority: Major > > SPARK-15857 adds the support of callerContext for HDFS and Yarn. Currently, > Spark callerContext prints Job Id, Stage Id, Task Id in the callerContext. It > would be useful to include JobGroup Id as well since such JobGroup Id could > be meaningful from the Spark Client point of view to group the jobs by > JobGroup. > callerContext=SPARK_CLIENT_application_1541467098185_0008 > callerContext=SPARK_TASK_application_1541702365678_0005_1_JId_1_SId_3_0_TId_3_0 -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org