Re: Mysterious 7 byte reads from .meta files

2013-07-07 Thread Harsh J
The header of the meta file is read for block metadata version validation. The checksum checks are performed after the header is read (and skipped if the config's so). The code can be viewed in the BlockReaderLocal.java, which is used when local reads are turned on. I suppose we could skip

Re: Mysterious 7 byte reads from .meta files

2013-07-07 Thread Varun Sharma
Created https://issues.apache.org/jira/browse/HDFS-4960 and attached a patch... Thanks ! On Sun, Jul 7, 2013 at 9:06 AM, Harsh J ha...@cloudera.com wrote: The header of the meta file is read for block metadata version validation. The checksum checks are performed after the header is read

Mysterious 7 byte reads from .meta files

2013-07-05 Thread Varun Sharma
Hi, We are running hbase with application level checksums turned on. We basically have the following configuration: dfs.client.read.shortcircuit.skip.checksum - true hbase.regionserver.checksum.verify - true We have shortcircuit reads enabled and have verified that its working - only the HBase