Erik Krogen created MAPREDUCE-6918: -------------------------------------- Summary: ShuffleMetrics.ShuffleConnections Gauge Metric Climbs Infinitely Key: MAPREDUCE-6918 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6918 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Reporter: Erik Krogen
We recently noticed that the {{mapred.ShuffleMetrics.ShuffleConnections}} metric seems to climb infinitely, up to many millions (see attached graph), despite being supposedly a gauge measure of the number of open connections: {code:title=ShuffleHandler.java} @Metric("# of current shuffle connections") MutableGaugeInt shuffleConnections; {code} It seems that shuffleConnections gets incremented once for every map fetched, but only decremented once for every request. It seems to me it should be modified to only be incremented once for every request rather than for every map fetched, but I'm not familiar with the original intent. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org