[ http://issues.apache.org/jira/browse/HADOOP-532?page=comments#action_12434776 ] Bryan Pendleton commented on HADOOP-532: ----------------------------------------
I had trouble reading old compressed SequenceFiles using the new block-compressing code, with similar kinds of problems. I haven't been able to characterize why, yet, so I don't have anything useful to add to this bug except "I've seen this general sort of thing, too!". In my case, it's with a class that's similar to BytesWritable. > Writable underrun in sort example > --------------------------------- > > Key: HADOOP-532 > URL: http://issues.apache.org/jira/browse/HADOOP-532 > Project: Hadoop > Issue Type: Bug > Components: io > Affects Versions: 0.6.1 > Reporter: Owen O'Malley > Assigned To: Owen O'Malley > Fix For: 0.6.2 > > > When running the sort benchmark, I get consistent failures of this sort: > java.lang.RuntimeException: java.io.IOException: [EMAIL PROTECTED] read 2048 > bytes, should read 2052 at > org.apache.hadoop.mapred.ReduceTask$ValuesIterator.next(ReduceTask.java:150) > at > org.apache.hadoop.mapred.lib.IdentityReducer.reduce(IdentityReducer.java:39) > at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:271) at > org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1066) Caused > by: java.io.IOException: [EMAIL PROTECTED] read 2048 bytes, should read 2052 > at > org.apache.hadoop.io.SequenceFile$Reader.getCurrentValue(SequenceFile.java:1163) > at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1239) at > org.apache.hadoop.mapred.ReduceTask$ValuesIterator.getNext(ReduceTask.java:181) > at > org.apache.hadoop.mapred.ReduceTask$ValuesIterator.next(ReduceTask.java:147) > ... 3 more -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira
