[jira] [Created] (SPARK-33168) spark REST API Unable to get JobDescription
zhaoyachao created SPARK-33168: -- Summary: spark REST API Unable to get JobDescription Key: SPARK-33168 URL: https://issues.apache.org/jira/browse/SPARK-33168 Project: Spark Issue Type: Bug Components: Spark Core Affects Versions: 2.4.4 Reporter: zhaoyachao spark set job description ,use spark REST API (localhost:4040/api/v1/applications/xxx/jobs)unable to get job description,but it can be displayed at localhost:4040/jobs spark.sparkContext.setJobDescription({color:#6a8759}"test_count"{color}) spark.range({color:#6897bb}100{color}).count() -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-33168) spark REST API Unable to get JobDescription
[ https://issues.apache.org/jira/browse/SPARK-33168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyachao updated SPARK-33168: --- Attachment: image-2020-10-19-21-07-01-514.png > spark REST API Unable to get JobDescription > --- > > Key: SPARK-33168 > URL: https://issues.apache.org/jira/browse/SPARK-33168 > Project: Spark > Issue Type: Bug > Components: Spark Core >Affects Versions: 2.4.4 >Reporter: zhaoyachao >Priority: Major > Attachments: image-2020-10-19-21-07-01-514.png > > > spark set job description ,use spark REST API > (localhost:4040/api/v1/applications/xxx/jobs)unable to get job > description,but it can be displayed at localhost:4040/jobs > spark.sparkContext.setJobDescription({color:#6a8759}"test_count"{color}) > spark.range({color:#6897bb}100{color}).count() -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-33168) spark REST API Unable to get JobDescription
[ https://issues.apache.org/jira/browse/SPARK-33168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyachao updated SPARK-33168: --- Attachment: image-2020-10-19-21-08-45-123.png > spark REST API Unable to get JobDescription > --- > > Key: SPARK-33168 > URL: https://issues.apache.org/jira/browse/SPARK-33168 > Project: Spark > Issue Type: Bug > Components: Spark Core >Affects Versions: 2.4.4 >Reporter: zhaoyachao >Priority: Major > Attachments: image-2020-10-19-21-07-01-514.png, > image-2020-10-19-21-08-45-123.png > > > spark set job description ,use spark REST API > (localhost:4040/api/v1/applications/xxx/jobs)unable to get job > description,but it can be displayed at localhost:4040/jobs > spark.sparkContext.setJobDescription({color:#6a8759}"test_count"{color}) > spark.range({color:#6897bb}100{color}).count() -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-33168) spark REST API Unable to get JobDescription
[ https://issues.apache.org/jira/browse/SPARK-33168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyachao updated SPARK-33168: --- Attachment: image-2020-10-19-21-12-41-145.png > spark REST API Unable to get JobDescription > --- > > Key: SPARK-33168 > URL: https://issues.apache.org/jira/browse/SPARK-33168 > Project: Spark > Issue Type: Bug > Components: Spark Core >Affects Versions: 2.4.4 >Reporter: zhaoyachao >Priority: Major > Attachments: image-2020-10-19-21-07-01-514.png, > image-2020-10-19-21-08-45-123.png, image-2020-10-19-21-12-41-145.png > > > spark set job description ,use spark REST API > (localhost:4040/api/v1/applications/xxx/jobs)unable to get job > description,but it can be displayed at localhost:4040/jobs > spark.sparkContext.setJobDescription({color:#6a8759}"test_count"{color}) > spark.range({color:#6897bb}100{color}).count() -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-33168) spark REST API Unable to get JobDescription
[ https://issues.apache.org/jira/browse/SPARK-33168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyachao updated SPARK-33168: --- Attachment: image-2020-10-19-21-13-09-960.png > spark REST API Unable to get JobDescription > --- > > Key: SPARK-33168 > URL: https://issues.apache.org/jira/browse/SPARK-33168 > Project: Spark > Issue Type: Bug > Components: Spark Core >Affects Versions: 2.4.4 >Reporter: zhaoyachao >Priority: Major > Attachments: image-2020-10-19-21-07-01-514.png, > image-2020-10-19-21-08-45-123.png, image-2020-10-19-21-12-41-145.png, > image-2020-10-19-21-13-09-960.png > > > spark set job description ,use spark REST API > (localhost:4040/api/v1/applications/xxx/jobs)unable to get job > description,but it can be displayed at localhost:4040/jobs > spark.sparkContext.setJobDescription({color:#6a8759}"test_count"{color}) > spark.range({color:#6897bb}100{color}).count() -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-33168) spark REST API Unable to get JobDescription
[ https://issues.apache.org/jira/browse/SPARK-33168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyachao updated SPARK-33168: --- Attachment: (was: image-2020-10-19-21-07-01-514.png) > spark REST API Unable to get JobDescription > --- > > Key: SPARK-33168 > URL: https://issues.apache.org/jira/browse/SPARK-33168 > Project: Spark > Issue Type: Bug > Components: Spark Core >Affects Versions: 2.4.4 >Reporter: zhaoyachao >Priority: Major > Attachments: image-2020-10-19-21-12-41-145.png, > image-2020-10-19-21-13-09-960.png > > > spark set job description ,use spark REST API > (localhost:4040/api/v1/applications/xxx/jobs)unable to get job > description,but it can be displayed at localhost:4040/jobs > spark.sparkContext.setJobDescription({color:#6a8759}"test_count"{color}) > spark.range({color:#6897bb}100{color}).count() -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-33168) spark REST API Unable to get JobDescription
[ https://issues.apache.org/jira/browse/SPARK-33168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17216712#comment-17216712 ] zhaoyachao commented on SPARK-33168: I don't know what I did wrong, this result is not what I expected, below is all my verification look: val sparkConf = new SparkConf() sparkConf.setMaster("local[7]") sparkConf.set("spark.serializer", "org.apache.spark.serializer.KryoSerializer") val spark = SparkSession .builder() .config(sparkConf) .enableHiveSupport() .getOrCreate() spark.sparkContext.setJobDescription("test_count") spark.range(100).count() while(true){ Thread.sleep(1000*5) } !image-2020-10-19-21-13-09-960.png! !image-2020-10-19-21-12-41-145.png! > spark REST API Unable to get JobDescription > --- > > Key: SPARK-33168 > URL: https://issues.apache.org/jira/browse/SPARK-33168 > Project: Spark > Issue Type: Bug > Components: Spark Core >Affects Versions: 2.4.4 >Reporter: zhaoyachao >Priority: Major > Attachments: image-2020-10-19-21-07-01-514.png, > image-2020-10-19-21-08-45-123.png, image-2020-10-19-21-12-41-145.png, > image-2020-10-19-21-13-09-960.png > > > spark set job description ,use spark REST API > (localhost:4040/api/v1/applications/xxx/jobs)unable to get job > description,but it can be displayed at localhost:4040/jobs > spark.sparkContext.setJobDescription({color:#6a8759}"test_count"{color}) > spark.range({color:#6897bb}100{color}).count() -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-33168) spark REST API Unable to get JobDescription
[ https://issues.apache.org/jira/browse/SPARK-33168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyachao updated SPARK-33168: --- Attachment: (was: image-2020-10-19-21-08-45-123.png) > spark REST API Unable to get JobDescription > --- > > Key: SPARK-33168 > URL: https://issues.apache.org/jira/browse/SPARK-33168 > Project: Spark > Issue Type: Bug > Components: Spark Core >Affects Versions: 2.4.4 >Reporter: zhaoyachao >Priority: Major > Attachments: image-2020-10-19-21-12-41-145.png, > image-2020-10-19-21-13-09-960.png > > > spark set job description ,use spark REST API > (localhost:4040/api/v1/applications/xxx/jobs)unable to get job > description,but it can be displayed at localhost:4040/jobs > spark.sparkContext.setJobDescription({color:#6a8759}"test_count"{color}) > spark.range({color:#6897bb}100{color}).count() -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org