Hi, I’m observing strange behaviour in HDFS/HBase cluster.
The disk space of one of datanodes is increasing very fast even when there are
no write requests.
It is 8GB per hour in average. Here is the graph which shows it.
I am using hbase-0.98.7-hadoop2 and hadoop-2.5.1.
And this is logs from t
Are there any map reduce jobs running?
On Jul 28, 2015 10:11 PM, "Akmal Abbasov" wrote:
> Hi, I’m observing strange behaviour in HDFS/HBase cluster.
> The disk space of one of datanodes is increasing very fast even when there
> are no write requests.
> It is 8GB per hour in average. Here is the g
I am running HBase snapshot exporting, but I stopped it, and still the capacity
used is increasing.
Here you can see that it is increased to 60 GB, and mostly it is because of 1
detanode.
Moreover I am checking the directories sizes using bin/hdfs dfs -du -h /
and while the HDFS used capacity is
What is the size of your Hbase table?
A copy of snapshot will be stored in archive directory.
hadoop fs -du -s -h /apps/hbase/data/data/default/
hadoop fs -du -s -h /apps/hbase/data/archive/data/default/
Check this directory size.
Thanks
Sandeep Nemuri
ᐧ
On Thu, Jul 30, 2015 at 3:36 PM, Akmal
From log below, hbase-rs4 was writing to the datanode.
Can you take a look at region server log and see if there is some clue ?
Thanks
> On Jul 28, 2015, at 9:41 AM, Akmal Abbasov wrote:
>
> Hi, I’m observing strange behaviour in HDFS/HBase cluster.
> The disk space of one of datanodes is
Please take a look at HDFS-6133 which aims to help with hbase data locality.
It was integrated to hadoop 2.7.0 release.
FYI
On Thu, Jul 30, 2015 at 3:06 AM, Akmal Abbasov
wrote:
> I am running HBase snapshot exporting, but I stopped it, and still the
> capacity used is increasing.
> Here you c
