[ http://issues.apache.org/jira/browse/HADOOP-522?page=all ]
Doug Cutting updated HADOOP-522: -------------------------------- Attachment: (was: block-compress-map-file.patch) > MapFile should support block compression > ---------------------------------------- > > Key: HADOOP-522 > URL: http://issues.apache.org/jira/browse/HADOOP-522 > Project: Hadoop > Issue Type: New Feature > Components: io > Reporter: Doug Cutting > Assigned To: Doug Cutting > > MapFile is layered on SequenceFile and permits random-access to sorted data > files (typically reduce output) through a parallel index file. This is used > widely in Nutch (e.g. at search time for displaying cached pages, incoming > links, etc). Such sorted data should benefit from block compression, but the > current MapFile API does not support specification of block compression. > Also, even if it did, the semantics of SequenceFile methods like seek() and > getPosition() are changed under block compression so that MapFile may not > work. -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira