bettermouse created SPARK-27647: ----------------------------------- Summary: Metric Gauge not threadsafe Key: SPARK-27647 URL: https://issues.apache.org/jira/browse/SPARK-27647 Project: Spark Issue Type: Bug Components: Spark Core Affects Versions: 2.4.2 Reporter: bettermouse
when I read class DAGSchedulerSource,I find some Gauges may be not threadSafe.like metricRegistry.register(MetricRegistry.name("stage", "failedStages"), new Gauge[Int] { override def getValue: Int = dagScheduler.failedStages.size }) this method may be called in other thread,but failedStages field is not thread safe filed runningStages,waitingStages have same problem -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org