Jason Lowe created MAPREDUCE-6958: ------------------------------------- Summary: Shuffle audit logger should log size of shuffle transfer Key: MAPREDUCE-6958 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6958 Project: Hadoop Map/Reduce Issue Type: Improvement Reporter: Jason Lowe Assignee: Jason Lowe Priority: Minor
The shuffle audit logger currently logs the job ID and reducer ID but nothing about the size of the requested transfer. It calculates this as part of the HTTP response headers, so it would be trivial to log the response size. This would be very valuable for debugging network traffic storms from the shuffle handler. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org