[jira] [Commented] (SPARK-3835) Spark applications that are killed should show up as "KILLED" or "CANCELLED" in the Spark UI
[ https://issues.apache.org/jira/browse/SPARK-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165815#comment-14165815 ] Nan Zhu commented on SPARK-3835: no...it cannot capture kill -9 > Spark applications that are killed should show up as "KILLED" or "CANCELLED" > in the Spark UI > > > Key: SPARK-3835 > URL: https://issues.apache.org/jira/browse/SPARK-3835 > Project: Spark > Issue Type: Improvement > Components: Web UI >Affects Versions: 1.1.0 >Reporter: Matt Cheah > Labels: UI > > Spark applications that crash or are killed are listed as FINISHED in the > Spark UI. > It looks like the Master only passes back a list of "Running" applications > and a list of "Completed" applications, All of the applications under > "Completed" have status "FINISHED", however if they were killed manually they > should show "CANCELLED", or if they failed they should read "FAILED". -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-3835) Spark applications that are killed should show up as "KILLED" or "CANCELLED" in the Spark UI
[ https://issues.apache.org/jira/browse/SPARK-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165807#comment-14165807 ] Nan Zhu commented on SPARK-3835: ah, I see, didn't look at your description closely Does shutdown hook work? > Spark applications that are killed should show up as "KILLED" or "CANCELLED" > in the Spark UI > > > Key: SPARK-3835 > URL: https://issues.apache.org/jira/browse/SPARK-3835 > Project: Spark > Issue Type: Improvement > Components: Web UI >Affects Versions: 1.1.0 >Reporter: Matt Cheah > Labels: UI > > Spark applications that crash or are killed are listed as FINISHED in the > Spark UI. > It looks like the Master only passes back a list of "Running" applications > and a list of "Completed" applications, All of the applications under > "Completed" have status "FINISHED", however if they were killed manually they > should show "CANCELLED", or if they failed they should read "FAILED". -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-3835) Spark applications that are killed should show up as "KILLED" or "CANCELLED" in the Spark UI
[ https://issues.apache.org/jira/browse/SPARK-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165785#comment-14165785 ] Matt Cheah commented on SPARK-3835: --- This is the opposite problem, actually - a Spark context that is killed forcefully, i.e. kill -9 on the JVM hosting the context, is shown as "FINISHED" but should be shown as "KILLED". > Spark applications that are killed should show up as "KILLED" or "CANCELLED" > in the Spark UI > > > Key: SPARK-3835 > URL: https://issues.apache.org/jira/browse/SPARK-3835 > Project: Spark > Issue Type: Improvement > Components: Web UI >Affects Versions: 1.1.0 >Reporter: Matt Cheah > Labels: UI > > Spark applications that crash or are killed are listed as FINISHED in the > Spark UI. > It looks like the Master only passes back a list of "Running" applications > and a list of "Completed" applications, All of the applications under > "Completed" have status "FINISHED", however if they were killed manually they > should show "CANCELLED", or if they failed they should read "FAILED". -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-3835) Spark applications that are killed should show up as "KILLED" or "CANCELLED" in the Spark UI
[ https://issues.apache.org/jira/browse/SPARK-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165768#comment-14165768 ] Nan Zhu commented on SPARK-3835: this problem still exists? I once reported the same thing in SPARK-1118 > Spark applications that are killed should show up as "KILLED" or "CANCELLED" > in the Spark UI > > > Key: SPARK-3835 > URL: https://issues.apache.org/jira/browse/SPARK-3835 > Project: Spark > Issue Type: Improvement > Components: Web UI >Affects Versions: 1.1.0 >Reporter: Matt Cheah > Labels: UI > > Spark applications that crash or are killed are listed as FINISHED in the > Spark UI. > It looks like the Master only passes back a list of "Running" applications > and a list of "Completed" applications, All of the applications under > "Completed" have status "FINISHED", however if they were killed manually they > should show "CANCELLED", or if they failed they should read "FAILED". -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-3835) Spark applications that are killed should show up as "KILLED" or "CANCELLED" in the Spark UI
[ https://issues.apache.org/jira/browse/SPARK-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165722#comment-14165722 ] Matt Cheah commented on SPARK-3835: --- Any updates on this? > Spark applications that are killed should show up as "KILLED" or "CANCELLED" > in the Spark UI > > > Key: SPARK-3835 > URL: https://issues.apache.org/jira/browse/SPARK-3835 > Project: Spark > Issue Type: Improvement > Components: Web UI >Affects Versions: 1.1.0 >Reporter: Matt Cheah > Labels: UI > > Spark applications that crash or are killed are listed as FINISHED in the > Spark UI. > It looks like the Master only passes back a list of "Running" applications > and a list of "Completed" applications, All of the applications under > "Completed" have status "FINISHED", however if they were killed manually they > should show "CANCELLED", or if they failed they should read "FAILED". -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
