[jira] [Assigned] (SPARK-40506) Spark Streaming metrics name don't need application name

[Apache Spark (Jira)]

 [ 
https://issues.apache.org/jira/browse/SPARK-40506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Apache Spark reassigned SPARK-40506:


Assignee: Apache Spark

> Spark Streaming metrics name don't need application name
> 
>
> Key: SPARK-40506
> URL: https://issues.apache.org/jira/browse/SPARK-40506
> Project: Spark
>  Issue Type: Improvement
>  Components: DStreams
>Affects Versions: 3.2.2
>Reporter: 王俊博
>Assignee: Apache Spark
>Priority: Trivial
>
> Spark  StreamingSource  Metrics sourceName is inappropriate.The label now 
> looks like 
> `application_x__driver_NetworkWordCount_StreamingMetrics_streaming_lastCompletedBatch_processingEndTime
>  `, instead of 
> `application_x__driver_StreamingMetrics_streaming_lastCompletedBatch_processingEndTime`,
>  the Spark app name is not need.
> This makes it hard to use metrics for different Spark applications over time. 
> And this makes the metrics sourceName standard inconsistent
> {code:java}
> //代码占位符
> private[streaming] class StreamingSource(ssc: StreamingContext) extends 
> Source {
>   override val metricRegistry = new MetricRegistry
>   override val sourceName = 
> "%s.StreamingMetrics".format(ssc.sparkContext.appName)
> 
> }{code}
> And for example, other metrics sourceName don't have appName.
> {code:java}
> //代码占位符
> private[spark] class LiveListenerBusMetrics(conf: SparkConf)
>   extends Source with Logging {
>   override val sourceName: String = "LiveListenerBus"
>   override val metricRegistry: MetricRegistry = new MetricRegistry
> ...
> }
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Assigned] (SPARK-40506) Spark Streaming metrics name don't need application name

[Apache Spark (Jira)]

 [ 
https://issues.apache.org/jira/browse/SPARK-40506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Apache Spark reassigned SPARK-40506:


Assignee: (was: Apache Spark)

> Spark Streaming metrics name don't need application name
> 
>
> Key: SPARK-40506
> URL: https://issues.apache.org/jira/browse/SPARK-40506
> Project: Spark
>  Issue Type: Improvement
>  Components: DStreams
>Affects Versions: 3.2.2
>Reporter: 王俊博
>Priority: Trivial
>
> Spark  StreamingSource  Metrics sourceName is inappropriate.The label now 
> looks like 
> `application_x__driver_NetworkWordCount_StreamingMetrics_streaming_lastCompletedBatch_processingEndTime
>  `, instead of 
> `application_x__driver_StreamingMetrics_streaming_lastCompletedBatch_processingEndTime`,
>  the Spark app name is not need.
> This makes it hard to use metrics for different Spark applications over time. 
> And this makes the metrics sourceName standard inconsistent
> {code:java}
> //代码占位符
> private[streaming] class StreamingSource(ssc: StreamingContext) extends 
> Source {
>   override val metricRegistry = new MetricRegistry
>   override val sourceName = 
> "%s.StreamingMetrics".format(ssc.sparkContext.appName)
> 
> }{code}
> And for example, other metrics sourceName don't have appName.
> {code:java}
> //代码占位符
> private[spark] class LiveListenerBusMetrics(conf: SparkConf)
>   extends Source with Logging {
>   override val sourceName: String = "LiveListenerBus"
>   override val metricRegistry: MetricRegistry = new MetricRegistry
> ...
> }
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org