[jira] [Created] (SPARK-33168) spark REST API Unable to get JobDescription

2020-10-16 Thread zhaoyachao (Jira) 
zhaoyachao created SPARK-33168:
--

 Summary: spark REST API Unable to get JobDescription
 Key: SPARK-33168
 URL: https://issues.apache.org/jira/browse/SPARK-33168
 Project: Spark
  Issue Type: Bug
  Components: Spark Core
Affects Versions: 2.4.4
Reporter: zhaoyachao


spark set job description ,use spark REST API 
(localhost:4040/api/v1/applications/xxx/jobs)unable to get job description,but 
it can be displayed at localhost:4040/jobs

spark.sparkContext.setJobDescription({color:#6a8759}"test_count"{color})
spark.range({color:#6897bb}100{color}).count()



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Updated] (SPARK-33168) spark REST API Unable to get JobDescription

2020-10-19 Thread zhaoyachao (Jira) 


 [ 
https://issues.apache.org/jira/browse/SPARK-33168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

zhaoyachao updated SPARK-33168:
---
Attachment: image-2020-10-19-21-07-01-514.png

> spark REST API Unable to get JobDescription
> ---
>
> Key: SPARK-33168
> URL: https://issues.apache.org/jira/browse/SPARK-33168
> Project: Spark
>  Issue Type: Bug
>  Components: Spark Core
>Affects Versions: 2.4.4
>Reporter: zhaoyachao
>Priority: Major
> Attachments: image-2020-10-19-21-07-01-514.png
>
>
> spark set job description ,use spark REST API 
> (localhost:4040/api/v1/applications/xxx/jobs)unable to get job 
> description,but it can be displayed at localhost:4040/jobs
> spark.sparkContext.setJobDescription({color:#6a8759}"test_count"{color})
> spark.range({color:#6897bb}100{color}).count()



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Updated] (SPARK-33168) spark REST API Unable to get JobDescription

2020-10-19 Thread zhaoyachao (Jira) 


 [ 
https://issues.apache.org/jira/browse/SPARK-33168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

zhaoyachao updated SPARK-33168:
---
Attachment: image-2020-10-19-21-08-45-123.png

> spark REST API Unable to get JobDescription
> ---
>
> Key: SPARK-33168
> URL: https://issues.apache.org/jira/browse/SPARK-33168
> Project: Spark
>  Issue Type: Bug
>  Components: Spark Core
>Affects Versions: 2.4.4
>Reporter: zhaoyachao
>Priority: Major
> Attachments: image-2020-10-19-21-07-01-514.png, 
> image-2020-10-19-21-08-45-123.png
>
>
> spark set job description ,use spark REST API 
> (localhost:4040/api/v1/applications/xxx/jobs)unable to get job 
> description,but it can be displayed at localhost:4040/jobs
> spark.sparkContext.setJobDescription({color:#6a8759}"test_count"{color})
> spark.range({color:#6897bb}100{color}).count()



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Updated] (SPARK-33168) spark REST API Unable to get JobDescription

2020-10-19 Thread zhaoyachao (Jira) 


 [ 
https://issues.apache.org/jira/browse/SPARK-33168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

zhaoyachao updated SPARK-33168:
---
Attachment: image-2020-10-19-21-12-41-145.png

> spark REST API Unable to get JobDescription
> ---
>
> Key: SPARK-33168
> URL: https://issues.apache.org/jira/browse/SPARK-33168
> Project: Spark
>  Issue Type: Bug
>  Components: Spark Core
>Affects Versions: 2.4.4
>Reporter: zhaoyachao
>Priority: Major
> Attachments: image-2020-10-19-21-07-01-514.png, 
> image-2020-10-19-21-08-45-123.png, image-2020-10-19-21-12-41-145.png
>
>
> spark set job description ,use spark REST API 
> (localhost:4040/api/v1/applications/xxx/jobs)unable to get job 
> description,but it can be displayed at localhost:4040/jobs
> spark.sparkContext.setJobDescription({color:#6a8759}"test_count"{color})
> spark.range({color:#6897bb}100{color}).count()



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Updated] (SPARK-33168) spark REST API Unable to get JobDescription

2020-10-19 Thread zhaoyachao (Jira) 


 [ 
https://issues.apache.org/jira/browse/SPARK-33168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

zhaoyachao updated SPARK-33168:
---
Attachment: image-2020-10-19-21-13-09-960.png

> spark REST API Unable to get JobDescription
> ---
>
> Key: SPARK-33168
> URL: https://issues.apache.org/jira/browse/SPARK-33168
> Project: Spark
>  Issue Type: Bug
>  Components: Spark Core
>Affects Versions: 2.4.4
>Reporter: zhaoyachao
>Priority: Major
> Attachments: image-2020-10-19-21-07-01-514.png, 
> image-2020-10-19-21-08-45-123.png, image-2020-10-19-21-12-41-145.png, 
> image-2020-10-19-21-13-09-960.png
>
>
> spark set job description ,use spark REST API 
> (localhost:4040/api/v1/applications/xxx/jobs)unable to get job 
> description,but it can be displayed at localhost:4040/jobs
> spark.sparkContext.setJobDescription({color:#6a8759}"test_count"{color})
> spark.range({color:#6897bb}100{color}).count()



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Updated] (SPARK-33168) spark REST API Unable to get JobDescription

2020-10-19 Thread zhaoyachao (Jira) 


 [ 
https://issues.apache.org/jira/browse/SPARK-33168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

zhaoyachao updated SPARK-33168:
---
Attachment: (was: image-2020-10-19-21-07-01-514.png)

> spark REST API Unable to get JobDescription
> ---
>
> Key: SPARK-33168
> URL: https://issues.apache.org/jira/browse/SPARK-33168
> Project: Spark
>  Issue Type: Bug
>  Components: Spark Core
>Affects Versions: 2.4.4
>Reporter: zhaoyachao
>Priority: Major
> Attachments: image-2020-10-19-21-12-41-145.png, 
> image-2020-10-19-21-13-09-960.png
>
>
> spark set job description ,use spark REST API 
> (localhost:4040/api/v1/applications/xxx/jobs)unable to get job 
> description,but it can be displayed at localhost:4040/jobs
> spark.sparkContext.setJobDescription({color:#6a8759}"test_count"{color})
> spark.range({color:#6897bb}100{color}).count()



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Commented] (SPARK-33168) spark REST API Unable to get JobDescription

2020-10-19 Thread zhaoyachao (Jira) 


[ 
https://issues.apache.org/jira/browse/SPARK-33168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17216712#comment-17216712
 ] 

zhaoyachao commented on SPARK-33168:


I don't know what I did wrong, this result is not what I expected, below is all 
my verification

look：

val sparkConf = new SparkConf()
sparkConf.setMaster("local[7]")
sparkConf.set("spark.serializer", "org.apache.spark.serializer.KryoSerializer")
val spark = SparkSession
 .builder()
 .config(sparkConf)
 .enableHiveSupport()
 .getOrCreate()

spark.sparkContext.setJobDescription("test_count")
spark.range(100).count()
while(true){
 Thread.sleep(1000*5)
}

!image-2020-10-19-21-13-09-960.png!

!image-2020-10-19-21-12-41-145.png!

 

> spark REST API Unable to get JobDescription
> ---
>
> Key: SPARK-33168
> URL: https://issues.apache.org/jira/browse/SPARK-33168
> Project: Spark
>  Issue Type: Bug
>  Components: Spark Core
>Affects Versions: 2.4.4
>Reporter: zhaoyachao
>Priority: Major
> Attachments: image-2020-10-19-21-07-01-514.png, 
> image-2020-10-19-21-08-45-123.png, image-2020-10-19-21-12-41-145.png, 
> image-2020-10-19-21-13-09-960.png
>
>
> spark set job description ,use spark REST API 
> (localhost:4040/api/v1/applications/xxx/jobs)unable to get job 
> description,but it can be displayed at localhost:4040/jobs
> spark.sparkContext.setJobDescription({color:#6a8759}"test_count"{color})
> spark.range({color:#6897bb}100{color}).count()



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Updated] (SPARK-33168) spark REST API Unable to get JobDescription

2020-10-19 Thread zhaoyachao (Jira) 


 [ 
https://issues.apache.org/jira/browse/SPARK-33168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

zhaoyachao updated SPARK-33168:
---
Attachment: (was: image-2020-10-19-21-08-45-123.png)

> spark REST API Unable to get JobDescription
> ---
>
> Key: SPARK-33168
> URL: https://issues.apache.org/jira/browse/SPARK-33168
> Project: Spark
>  Issue Type: Bug
>  Components: Spark Core
>Affects Versions: 2.4.4
>Reporter: zhaoyachao
>Priority: Major
> Attachments: image-2020-10-19-21-12-41-145.png, 
> image-2020-10-19-21-13-09-960.png
>
>
> spark set job description ,use spark REST API 
> (localhost:4040/api/v1/applications/xxx/jobs)unable to get job 
> description,but it can be displayed at localhost:4040/jobs
> spark.sparkContext.setJobDescription({color:#6a8759}"test_count"{color})
> spark.range({color:#6897bb}100{color}).count()



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org