王俊博 created SPARK-40506: --------------------------- Summary: Spark Streaming Metrics SourceName is unsuitable Key: SPARK-40506 URL: https://issues.apache.org/jira/browse/SPARK-40506 Project: Spark Issue Type: Improvement Components: DStreams Affects Versions: 3.2.2 Reporter: 王俊博
Spark StreamingSource Metrics sourceName is inappropriate.The label now looks like `application_xxxxx_xxxx_driver_NetworkWordCount_StreamingMetrics_streaming_lastCompletedBatch_processingEndTime `, instead of `application_xxxxx_xxxx_driver_StreamingMetrics_streaming_lastCompletedBatch_processingEndTime`, the Spark app name is not need. {code:java} //代码占位符 private[streaming] class StreamingSource(ssc: StreamingContext) extends Source { override val metricRegistry = new MetricRegistry override val sourceName = "%s.StreamingMetrics".format(ssc.sparkContext.appName) .... }{code} And for example, other metrics sourceName don't have appName. {code:java} //代码占位符 private[spark] class LiveListenerBusMetrics(conf: SparkConf) extends Source with Logging { override val sourceName: String = "LiveListenerBus" override val metricRegistry: MetricRegistry = new MetricRegistry ... } {code} -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org