Re: Mysterious 7 byte reads from .meta files

2013-07-07 Thread Varun Sharma
kipped if the config's so). The code can be viewed in the > BlockReaderLocal.java, which is used when local reads are turned on. > > I suppose we could skip reading the version as well, though it seems > "general". Please file a JIRA for this! > > On Sat, Jul 6, 20

[jira] [Created] (HDFS-4960) Unnecessary .meta seeks even when skip checksum is true

2013-07-07 Thread Varun Sharma (JIRA)
Varun Sharma created HDFS-4960: -- Summary: Unnecessary .meta seeks even when skip checksum is true Key: HDFS-4960 URL: https://issues.apache.org/jira/browse/HDFS-4960 Project: Hadoop HDFS Issue

Mysterious 7 byte reads from .meta files

2013-07-05 Thread Varun Sharma
Hi, We are running hbase with application level checksums turned on. We basically have the following configuration: dfs.client.read.shortcircuit.skip.checksum -> true hbase.regionserver.checksum.verify -> true We have shortcircuit reads enabled and have verified that its working - only the HBase

Re: A Look at HDFS 4721

2013-04-22 Thread Varun Sharma
Sorry checking again if any committer can help take a look at https://issues.apache.org/jira/browse/HDFS-4721 Thanks ! On Mon, Apr 22, 2013 at 9:37 AM, Varun Sharma wrote: > Hi, > > Can someone please take a look at HDFS 4721 ? > > Thanks > Varun >

A Look at HDFS 4721

2013-04-22 Thread Varun Sharma
Hi, Can someone please take a look at HDFS 4721 ? Thanks Varun

[jira] [Created] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-21 Thread Varun Sharma (JIRA)
Varun Sharma created HDFS-4721: -- Summary: Speed up lease/block recovery when DN fails and a block goes into recovery Key: HDFS-4721 URL: https://issues.apache.org/jira/browse/HDFS-4721 Project: Hadoop

Re: Meaning of UNDER_RECOVERY blocks

2013-04-19 Thread Varun Sharma
Would be nice if someone could help out with this - it looks like a trivial question - but seems like some blocks are being lost for us when datanodes fail... Varun On Fri, Apr 19, 2013 at 2:28 PM, Varun Sharma wrote: > Hi, > > I had an instance where a datanode died while writing th

Meaning of UNDER_RECOVERY blocks

2013-04-19 Thread Varun Sharma
Hi, I had an instance where a datanode died while writing the block I am using Hadoop 2.0 patched with HDFS 3703 for stale node detection every 20 seconds. The block being written to, went into the UNDER_RECOVERY state looking at the namenode logs and there were several internalRecoverLease() cal