Disk space leak when using HBase and HDFS ShortCircuit

2014-06-25 Thread Giuseppe Reina
Hi all, we have been experiencing the same problem with 2 of our clusters. We are currently using HDP 2.1 that comes with HBase 0.98. The problem manifested by showing a huge differences (hundreds of GB) between the output of "df" and "du" of the hdfs data directories. Eventually, other systems

RE: Disk space leak when using HBase and HDFS ShortCircuit

2014-06-25 Thread Vladimir Rodionov
ce leak when using HBase and HDFS ShortCircuit Hi all, we have been experiencing the same problem with 2 of our clusters. We are currently using HDP 2.1 that comes with HBase 0.98. The problem manifested by showing a huge differences (hundreds of GB) between the output of "df" and

Fwd: Disk space leak when using HBase and HDFS ShortCircuit

2014-06-25 Thread Andrew Purtell
Forwarded -- Forwarded message -- From: Vladimir Rodionov Date: Wed, Jun 25, 2014 at 12:03 PM Subject: RE: Disk space leak when using HBase and HDFS ShortCircuit To: "user@hbase.apache.org" >> Apparently those file descriptors were stored by the HDFS >> S

Re: Disk space leak when using HBase and HDFS ShortCircuit

2014-06-25 Thread Enis Söztutar
iq.com > > > From: Giuseppe Reina [g.re...@gmail.com] > Sent: Wednesday, June 25, 2014 2:54 AM > To: user@hbase.apache.org > Subject: Disk space leak when using HBase and HDFS ShortCircuit > > Hi all, >we have been experienci

Re: Disk space leak when using HBase and HDFS ShortCircuit

2014-06-26 Thread Giuseppe Reina
st regards, > > Vladimir Rodionov > > Principal Platform Engineer > > Carrier IQ, www.carrieriq.com > > e-mail: vrodio...@carrieriq.com > > > > > > From: Giuseppe Reina [g.re...@gmail.com] > > Sent: Wednesday, June

Re: Disk space leak when using HBase and HDFS ShortCircuit

2014-06-27 Thread lars hofhansl
, June 25, 2014 2:54 AM Subject: Disk space leak when using HBase and HDFS ShortCircuit Hi all,   we have been experiencing the same problem with 2 of our clusters. We are currently using HDP 2.1 that comes with HBase 0.98. The problem manifested by showing a huge differences (hundreds of GB

Re: Disk space leak when using HBase and HDFS ShortCircuit

2014-06-27 Thread Ted Yu
ngs in > the HBase book. > > -- Lars > > > - Original Message - > From: Giuseppe Reina > To: user@hbase.apache.org > Cc: > Sent: Wednesday, June 25, 2014 2:54 AM > Subject: Disk space leak when using HBase and HDFS ShortCircuit > > Hi all, >we ha

Re: Disk space leak when using HBase and HDFS ShortCircuit

2014-06-27 Thread Andrew Purtell
ment this behavior and recommend settings in > the HBase book. > > -- Lars > > > - Original Message - > From: Giuseppe Reina > To: user@hbase.apache.org > Cc: > Sent: Wednesday, June 25, 2014 2:54 AM > Subject: Disk space leak when using HBase and HDFS Shor