RE: Shuffle's getMapOutput() fails with EofException, followed by IllegalStateException

2012-12-13 Thread David Parks
fle's getMapOutput() fails with EofException, followed by IllegalStateException I'm having exactly this problem, and it's causing my job to fail when I try to process a larger amount of data (I'm attempting to process 30GB of compressed CSVs and the entire job fails every time). T

Shuffle's getMapOutput() fails with EofException, followed by IllegalStateException

2012-12-12 Thread David Parks
I'm having exactly this problem, and it's causing my job to fail when I try to process a larger amount of data (I'm attempting to process 30GB of compressed CSVs and the entire job fails every time). This issues is open for it: https://issues.apache.org/jira/browse/MAPREDUCE-5 Anyone have any ide