Hi, I am new to Hadoop Hbase. I have a Hbase cluster in one datacenter, and I
need to create a backup in the second one. Currently the second HBase cluster
is ready, and I would like to import data from first cluster.
I would like to use exportSnapshot tool for this, I’ve tried it one my test
e
Hi, I am now working on hadoop cluster monitoring, and currently playing with
hadoop-metrics2.properties file. I would like to use filters to exclude the
records which I am not going to use.
In fact I am trying to exclude “UgiMetrics” and “MetricsSystem” records, by
using the following
datanode
Hi Ted,
I am using hadoop-2.5.1
Thank you.
> On 21 Apr 2015, at 19:32, Ted Yu wrote:
>
> What release of hadoop are you using ?
>
> Maybe try regex such as:
> [Ugi]*Metrics[System]*
>
> Cheers
>
> On Tue, Apr 21, 2015 at 9:43 AM, Akmal Abbasov <mailto:akmal
Hi Ted,
I’ve tried [Ugi]*Metrics[System]*,
and in this case the output contains both of them.
Thank you.
> On 21 Apr 2015, at 19:39, Akmal Abbasov wrote:
>
> Hi Ted,
> I am using hadoop-2.5.1
> Thank you.
>
>> On 21 Apr 2015, at 19:32, Ted Yu > <mailto:yuzhih...@
Hi, I was wondering is there is a way to disable some of the sources of metrics
in Hadoop? In fact I do not want to receive ugi, metricssystem and defaut
metrics. Is there any way to achieve this?
Thank you.
> On 21 Apr 2015, at 19:49, Akmal Abbasov wrote:
>
> Hi Ted,
> I’v
figured
AM to use 512 mb in mapred-site.xml.
What is wrong here?
Thank you.
Regards,
Akmal Abbasov
find it in hadoop 2.5.1.
Thank you.
Regards,
Akmal Abbasov
Hi Yves,
Now I got it.
Thank you.
Regards,
Akmal Abbasov
> On 05 May 2015, at 13:03, yves callaert wrote:
>
> Hi,
> From the hortonworks guide:
>
> In YARN, vcores (virtual cores) are used to normalize CPU resources across
> the cluster. The vcores value sets the number
Hi all,
I have HBase cluster.
I run a cron job each hour to create a snapshot of tables in HBase and export
these snapshots to another HBase cluster for backup.
But I’ve noticed that there are ~4000 znodes in
/hadoop-ha/testhbase1/rmstore/ZKRMStateRoot/RMAppRoot in Zookeeper.
What are these zno
e name format as follows ‘application_x_’
Thank you.
> On 07 Jul 2015, at 19:00, Xuan Gong wrote:
>
> Hey, Akmal:
>Are you running a lots of apps ? Or could you, maybe, share some of
> file names of those znodes, please ?
>
>
> Thanks
>
> Xu
> But I’ve noticed that there are ~4000 znodes in
> /hadoop-ha/testhbase1/rmstore/ZKRMStateRoot/RMAppRoot in Zookeeper.
Can I manually remove this znodes, or do I need to do this through yarn command
line?
Thank you.
> On 07 Jul 2015, at 10:23, Akmal Abbasov wrote:
>
> Hi all,
Hi, I’m observing strange behaviour in HDFS/HBase cluster.
The disk space of one of datanodes is increasing very fast even when there are
no write requests.
It is 8GB per hour in average. Here is the graph which shows it.
I am using hbase-0.98.7-hadoop2 and hadoop-2.5.1.
And this is logs from t
.
> On 28 Jul 2015, at 19:08, Harshit Mathur wrote:
>
> Are there any map reduce jobs running?
>
> On Jul 28, 2015 10:11 PM, "Akmal Abbasov" <mailto:akmal.abba...@icloud.com>> wrote:
> Hi, I’m observing strange behaviour in HDFS/HBase cluster.
> The disk
Hi,
I’m having strange behaviour in hbase cluster. It is almost idle, only <5 puts
and gets.
But the data in hdfs is increasing, and region servers have very high
iowait(>100, in 2 core CPU).
iotop shows that datanode process is reading and writing all the time.
Any suggestions?
Thanks.
rote:
>
> Please provide some more information:
>
> release of hbase / hadoop you're using
> were region servers doing compaction ?
> have you checked region server logs ?
>
> Thanks
>
> On Wed, Sep 2, 2015 at 9:11 AM, Akmal Abbasov <mailto:akmal.abba...@iclo
t; Cheers
>
> On Wed, Sep 2, 2015 at 9:39 AM, Akmal Abbasov <mailto:akmal.abba...@icloud.com>> wrote:
> Hi Ted,
> sorry forget to mention
>
>> release of hbase / hadoop you're using
>
> hbase hbase-0.98.7-hadoop2, hadoop hadoop-2.5.1
>
>> were
nks.
> On 02 Sep 2015, at 21:57, Ted Yu wrote:
>
> I assume you have enabled short-circuit read.
>
> Can you capture region server stack trace(s) and pastebin them ?
>
> Thanks
>
> On Wed, Sep 2, 2015 at 12:11 PM, Akmal Abbasov <mailto:akmal.abba...@icloud.com>&
Hi,
I’m having problems with accessing HBase master webui. when I try to access it,
it returns redirect page /master-status, and then it is freezes.
I’ve tried to wait for a long time, but still it didn’t work.
I am using hbase hbase-0.98.7-hadoop2, hadoop hadoop-2.5.1
Any suggestions?
Thanks.
ote:
>
> Can you log into the master node and check master log ?
>
> Pastebin snippet of master log if you need more help.
>
> Cheers
>
>
>> On Sep 3, 2015, at 6:24 AM, Akmal Abbasov wrote:
>>
>> Hi,
>> I’m having problems with accessing HBase ma
I’ve started HDFS balancer, but then stopped it immediately after knowing that
it is not a good idea.
but it was around 3 weeks ago, is it possible that it had an influence on the
cluster behaviour I’m having now?
Thanks.
> On 03 Sep 2015, at 14:23, Akmal Abbasov wrote:
>
> Hi Ted,
&
eeks-ago balancer shouldn't have any effect if you've ran a major
> compaction, successfully, yesterday.
>
> On 3 September 2015 at 16:32, Akmal Abbasov <mailto:akmal.abba...@icloud.com>> wrote:
> I’ve started HDFS balancer, but then stopped it immediately after kn
015, at 18:57, Adrien Mogenet
> wrote:
>
> Is the uptime of RS "normal"? No quick and global reboot that could lead into
> a regiongi-reallocation-storm?
>
> On 3 September 2015 at 18:42, Akmal Abbasov <mailto:akmal.abba...@icloud.com>> wrote:
> Hi Adri
> On Thu, Sep 3, 2015 at 7:15 AM, Akmal Abbasov <mailto:akmal.abba...@icloud.com>> wrote:
> Hi Ted,
> I’m getting a lot of
> 2015-09-03 14:08:20,651 WARN [1865504699@qtp-838397579-13]
> client.HConnectionManager$HConnectionImplementation: Checking master
>
sibly a dysfunctional RAID
> controller, or a constantly-rebuilding array.
>
> Do you have any idea at which files are linked the read blocks?
>
> On 4 September 2015 at 11:02, Akmal Abbasov <mailto:akmal.abba...@icloud.com>> wrote:
> Hi Adrien,
> for the last 24 h
gt; <http://search-hadoop.com/m/uOzYt48qItawnLv1>
>
>
>
> On Sep 7, 2015, at 5:15 AM, Akmal Abbasov <mailto:akmal.abba...@icloud.com>> wrote:
>
>> While looking into this problem, I found that I have large
>> dncp_block_verification.log.curr and dncp_blo
26 matches
Mail list logo
