[ https://issues.apache.org/jira/browse/HBASE-6868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13461293#comment-13461293 ]
Jerry Chen commented on HBASE-6868: ----------------------------------- On 89-fb, we are depending on inline HDFS checksum to solve the checksum iop overhead. See https://issues.apache.org/jira/browse/HDFS-2699. Our HDFS progress can be seen here: https://github.com/facebook/hadoop-20/tree/develop. It is code complete (not committed to github yet) and is under production testing. > Skip checksum is broke; are we double-checksumming by default? > -------------------------------------------------------------- > > Key: HBASE-6868 > URL: https://issues.apache.org/jira/browse/HBASE-6868 > Project: HBase > Issue Type: Bug > Components: HFile, wal > Affects Versions: 0.94.0, 0.94.1 > Reporter: LiuLei > Priority: Blocker > Fix For: 0.94.3, 0.96.0 > > > The HFile contains checksums for decrease the iops, so when Hbase read HFile > , that dont't need to read the checksum from meta file of HDFS. But HLog > file of Hbase don't contain the checksum, so when HBase read the HLog, that > must read checksum from meta file of HDFS. We could add setSkipChecksum per > file to hdfs or we could write checksums into WAL if this skip checksum > facility is enabled -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira