[ https://issues.apache.org/jira/browse/HADOOP-6196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jay Booth updated HADOOP-6196: ------------------------------ Attachment: sync-bug.patch Here's the patch. To reproduce the problem, patch, then revert SequenceFile (to undo the fix) and run the attached test TestSequenceFileSync. Strangely, it works sometimes and breaks other times. When it works, it'll tend to work for a few times in a row until a few seconds pass and then it starts breaking again (EOFException at readInt). I don't get it, could be something weird with my environment, but the patch to SequenceFile means that it works all the time, so who cares :) The fix required bumping the version of SequenceFile from 6 to 7, writing the SYNC_ESCAPE int properly before writing the sync block at the end of the header file, and then scanning past that prior to loading sync when opening. Now sync(0); next(); works properly. > sync(0); next() breaks SequenceFile > ----------------------------------- > > Key: HADOOP-6196 > URL: https://issues.apache.org/jira/browse/HADOOP-6196 > Project: Hadoop Common > Issue Type: Bug > Reporter: Jay Booth > Attachments: sync-bug.patch > > > Currently, the end of the SequenceFile header is a sync block that isn't > prefaced with SYNC_ESCAPE. This means that sync(0) followed by next() fails. > Patch w/ test attached, bumps VERSION from 6 to 7. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.