[ https://issues.apache.org/jira/browse/MAPREDUCE-5652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jason Lowe updated MAPREDUCE-5652: ---------------------------------- Attachment: MAPREDUCE-5652.patch Patch to recover shuffle handler state using leveldb as a state store. Note that this patch depends upon the changes in YARN-1757. > ShuffleHandler should handle NM restarts > ---------------------------------------- > > Key: MAPREDUCE-5652 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5652 > Project: Hadoop Map/Reduce > Issue Type: Bug > Affects Versions: 2.2.0 > Reporter: Karthik Kambatla > Assignee: Jason Lowe > Labels: shuffle > Attachments: MAPREDUCE-5652.patch > > > ShuffleHandler should work across NM restarts and not require re-running > map-tasks. On NM restart, the map outputs are cleaned up requiring > re-execution of map tasks and should be avoided. -- This message was sent by Atlassian JIRA (v6.1.5#6160)