Thanks everyone for the info. We apply the fix mentioned by Mallik and we want
to propose again the serial mode when we update hbase
Il lunedì 13 dicembre 2021, 07:14:43 CET, Mallikarjun
ha scritto:
Thanks Duo
I will patch this and verify for the issue I mentioned above.
On Sun, De
Thanks Duo
I will patch this and verify for the issue I mentioned above.
On Sun, Dec 12, 2021, 8:06 PM 张铎(Duo Zhang) wrote:
> We have fixed several replication related issues which may cause data loss,
> for example, this one
>
> https://issues.apache.org/jira/browse/HBASE-26482
>
> For serial
We have fixed several replication related issues which may cause data loss,
for example, this one
https://issues.apache.org/jira/browse/HBASE-26482
For serial replication, if we miss some wal files, it usually causes
replication to be stuck...
Mallikarjun 于2021年12月12日周日 18:19写道：
> Sync table i
Sync table is to be run manually when you think there can be
inconsistencies between the 2 clusters only for specific time period.
As soon as you disable serial replication, it should start replicating from
the time it was stuck. You can build dashboards from jmx metrics generated
from hmaster to
Ok perfect.How often should this sync run? I guess in this case you have to
automate it somehow, correct?
Since I will have to disable serial mode, do I first have to align tables
manually or the moment I disable serial mode, the regionservers will start
replicating from where they were blocked?
https://hbase.apache.org/book.html#hashtable.synctable
To copy the difference between tables for a specific time period.
On Sun, Dec 12, 2021, 3:12 PM Hamado Dene
wrote:
> Interesting, thank you very much for the info. I'll try to disable serial
> replication.As for "sync table utility" what do
Interesting, thank you very much for the info. I'll try to disable serial
replication.As for "sync table utility" what do you mean?I am new to Hbase, I
am not yet familiar with all Hbase tools.
Il domenica 12 dicembre 2021, 10:15:01 CET, Mallikarjun
ha scritto:
We have faced issues
We have faced issues with serial replication when one of the region server
of either cluster goes into hardware failure, typically memory from my
understanding. I could not spend enough time to reproduce reliably to
identify the root cause. So I don't know why it is caused.
Issue could be your ser
I'm using hbase 2.2.6 with hadoop 2.8.5.Yes, My replication serial is
enabled.This is my peer configuration
|
| Peer Id | Cluster Key | Endpoint | State | IsSerial | Bandwidth |
ReplicateAll | Namespaces | Exclude Namespaces | Table Cfs | Exclude Table Cfs |
| replicav1 | acv-db10-hn,acv-db11
Which version of hbase are you using? Is your replication serial enabled?
---
Mallikarjun
On Sun, Dec 12, 2021 at 1:54 PM Hamado Dene
wrote:
> Hi Hbase community,
>
> On our production installation we have two hbase clusters in two different
> datacenters.The primary datacenter replicates the
Hi Hbase community,
On our production installation we have two hbase clusters in two different
datacenters.The primary datacenter replicates the data to the secondary
datacenter.When we create the tables, we first create on the secondary
datacenter and then on the primary and then we set replic
1. Would you mind showing your "/etc/zookeeper/conf/server-jaas.conf",
>
> 2. and using zkCli.sh to getAcl /hbase.
> 3. BTW, what was your login principal when executing "add_peer" in
> hbase shell.
>
> From: Saad Mufti
s.conf",
>
> 2. and using zkCli.sh to getAcl /hbase.
> 3. BTW, what was your login principal when executing "add_peer" in
> hbase shell.
>
> From: Saad Mufti
> Sent: 23 May 2018 01:48:17
> To: user@hbase.apache.org
>
i
Sent: 23 May 2018 01:48:17
To: user@hbase.apache.org
Subject: HBase Replication Between Two Secure Clusters With Different Kerberos
KDC's
Hi,
Here is my scenario, I have two secure/authenticated EMR based HBase
clusters, both have their own cluster dedicated KDC (using EMR support fo
Hi,
Here is my scenario, I have two secure/authenticated EMR based HBase
clusters, both have their own cluster dedicated KDC (using EMR support for
this which means we get Kerberos support by just turning on a config flag).
Now we want to get replication going between them. For other application
Hi all,
I'm running HBase replication on CDH 5.9.0 and am wondering if there are
known configurations/methods to decrease the replication lag/latency. I am
monitoring replication latency via two separate methods:
1) The JMX 'replication.source.ageOfLastShippedOp' exposed by th
Hi Kahlil
Your understanding is right as how HBase replication is across data centres
where as Hbase read replicas are more for providing faster availability for
reads.
>>not be the proper tool to use here since it appears to have higher
replication latency and be more catered towards Di
Hi All,
I have some questions about when to use HBase Replication vs. HBase Read
Replicas. They seem to accomplish similar-ish things, and I'm trying to
figure out which I should use.
I've read through the documentation, but I am confused on a few points. It
seems that HBase Replicatio
Hi All,
I have setup HBase replication between two clusters containing 25
nodes each. The inter-data center network link has a capacity of 500
MBPS.
I have been running some tests to understand the speed of replication.
I am observing that the replication speed does not go more than 5
MBPS.
On
methods which will fetch you these metrics value.
HTH
Regards,
Ashish
-Original Message-
From: Sreeram [mailto:sreera...@gmail.com]
Sent: 24 April 2017 14:01
To: user@hbase.apache.org
Subject: API to get HBase replication status
Hi,
I am trying to understand if the hbase shell commands to
Hi,
I am trying to understand if the hbase shell commands to get the
replication status are based on any underlying API.
Specifically I am trying to fetch values of last shipped timestamp and
replication lag per regionserver. The ReplicationAdmin does not seem
to be providing the information ( o
Hello,
Did you check the RegionServer logs, was there any exception ?
Regards,
Ashish
On Thu, Mar 30, 2017 at 10:14 PM, James Johansville <
james.johansvi...@gmail.com> wrote:
> Hello,
>
> I attempted HBase replication for the first time and am trying to
> understand how it
Hello,
I attempted HBase replication for the first time and am trying to
understand how it works.
I have three HBase clusters each with their own ZK ensemble, A, B, C. I
wanted to have complete acyclical replication between all 3 clusters, so I
added B as a peer of A, C as a peer of B, A as a
t: 15 January 2017 11:15
To: user@hbase.apache.org; BAD BOY **
Subject: Hbase Replication || Impact on cluster || Storage
Hi All,
I have question regarding Hbase replication The clusters participating in
replication can be of different sizes. The master cluster relies on
randomization to attem
Hi All,
I have question regarding Hbase replication
The clusters participating in replication can be of different sizes. The
master cluster relies on randomization to attempt to balance the stream of
replication on the slave clusters. It is expected that the slave cluster
has storage capacity to
2016 8:18 PM
> To: user@hbase.apache.org
> Subject: Best way to disable & enable HBASE replication
>
> If we have to stop hbase replication and re enable after sometime, which
> one
> is better way to do
> 1. stop_replication, later enable by running start_replication and copy
might've changed.
-Chien
-Original Message-
From: spats [mailto:spatil.sud...@gmail.com]
Sent: Monday, October 3, 2016 8:18 PM
To: user@hbase.apache.org
Subject: Best way to disable & enable HBASE replication
If we have to stop hbase replication and re enable after sometime, which on
If we have to stop hbase replication and re enable after sometime, which one
is better way to do
1. stop_replication, later enable by running start_replication and copy
missing data for that duration using copyTable command.
2. disable_peer("1") , later enable_peer("1")
2nd op
HBase replication supported both of them. You can use add_peer or
set_peer_tableCFs to config specific tables for specific peers.
Good day,
Hope this message finds everyone well. We are working on some requirements
around HBase replication and wanted to verify our understanding.
We understand that we can replicate a source HBase cluster to multiple
destination clusters by setting up peers and then setting the tables
Great, thanks Ted.
On Aug 26, 2016 7:29 PM, "Ted Yu" wrote:
> Replication between 0.98.6 and 1.2.0 should work.
>
> Thanks
>
> > On Aug 26, 2016, at 1:59 AM, spats wrote:
> >
> >
> > Does hbase replication works between different versions 0.98
Replication between 0.98.6 and 1.2.0 should work.
Thanks
> On Aug 26, 2016, at 1:59 AM, spats wrote:
>
>
> Does hbase replication works between different versions 0.98.6 and 1.2.0?
>
> We are in the process of upgrading our clusters & during that time we want
> to
Does hbase replication works between different versions 0.98.6 and 1.2.0?
We are in the process of upgrading our clusters & during that time we want
to make sure if replication will work fine across clusters. It would be
really helpful if anyone can share about hbase replication with diffe
Hello Ted,
Great! thanks for keeping us posted.
esteban.
--
Cloudera, Inc.
On Tue, Aug 23, 2016 at 5:42 PM, Ted wrote:
> thanks, that helped.
>
> It showed it was doing a subsequent call via 127.0.0.1 so I double checked
> all my configs to make sure I used the hostname/dns entries then it
thanks, that helped.
It showed it was doing a subsequent call via 127.0.0.1 so I double checked
all my configs to make sure I used the hostname/dns entries then it all
worked.
thanks.
On Tue, Aug 23, 2016 at 2:11 PM, Esteban Gutierrez
wrote:
> Hello Ted,
>
> the first 2 commands interact wit
Hello Ted,
the first 2 commands interact with the HBase Master and the third command
needs to get the splits from Meta, probably the exception is coming from
there but its can you retry the commands but this time launching the hbase
shell with the -d flag? e.g. "hbase shell -d" that should give us
Hi I'm running hbase 1.2.1 and I'm getting an error trying to setup
replication.
I have 2 hbase systems running fine,
I can connect from both to each other via ssh and on all ports as there's
no firewall (this is just a test system).
I can connect from the source to the destination ZK on port 2181
se. I also already manually
set up Hbase replication from these two clusters so I don't think krb5.conf
is the issue.
Thanks.
--
View this message in context:
http://apache-hbase.679495.n3.nabble.com/HBase-replication-on-secured-clusters-tp4081486p4081519.html
Sent from the HBase User maili
s and
realms in the [domain_realm] section.
cheers,
esteban.
--
Cloudera, Inc.
On Mon, Aug 1, 2016 at 11:34 AM, maychau
wrote:
> Hello everyone,
>
> I'm trying to write a Scala application to test HBase replication on
> secured
> (Kerberized) clusters. I'm using Cloude
Hello everyone,
I'm trying to write a Scala application to test HBase replication on secured
(Kerberized) clusters. I'm using Cloudera CDH5.5.2 version. My keytab is
hbase user. The program did pickup the keytab and is able to log in with it
based on INFO message, however I'
Abraham Tom [mailto:work2m...@gmail.com]
> Sent: 14 April 2016 18:52
> To: Hbase-User
> Subject: Hbase Replication no longer replicating, help diagnose
>
> my hbase replication has stopped
>
> I am on hbase version 1.0.0-cdh5.4.8 (Cloudera build)
>
> I have 2 clusters in 2 d
that and network speed, need to adjust the hbase.rpc.timeout value and
restart the source and peer cluster.
Regards,
Ashish
-Original Message-
From: Abraham Tom [mailto:work2m...@gmail.com]
Sent: 14 April 2016 18:52
To: Hbase-User
Subject: Hbase Replication no longer replicating, help
my hbase replication has stopped
I am on hbase version 1.0.0-cdh5.4.8 (Cloudera build)
I have 2 clusters in 2 different datacenters
1 is master the other is slave
I see the following errors in log
2016-04-13 22:32:50,217 WARN
Hi all.
After looking more into the code we found that currently cross realm trust can
work in HBase only when FQDN in the Kerberos principal for hbase processes is
hostname.
So we changed the Kerberos principal accordingly and hbase replication is
working fine.
May be we can enhance our Sasl
Hi all.
We are using HBase 1.0.2 and Java 1.8.0_51
HBase replication is not working for us in Kerberos cross realm trust.
We have followed all the instructions provided at
http://www.cloudera.com/content/www/en-us/documentation/archive/cdh/4-x/4-5-0/CDH4-Security-Guide/cdh4sg_topic_8_4.html
We
Replication from master cluster will do retry of the failed one
-Anoop-
On Sat, Dec 12, 2015 at 6:05 AM, Abraham Tom wrote:
> I have 2 clusters ( 1 master and 1 slave) on CDH 5.4 hbase 1.0
> replication is working 95% of the time
> but I do get the following WARN which I consider an error
>
>
>
I have 2 clusters ( 1 master and 1 slave) on CDH 5.4 hbase 1.0
replication is working 95% of the time
but I do get the following WARN which I consider an error
Can't replicate because of an error on the remote cluster:
org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.
Hi,
We are seeing some performance issue on one of our write heavy cluster, and
trying to find out the root cause. One confusion I have during investigate
is that I found in ReplicationSink.java, it says this which seems wrong:
**
* This class is responsible for replicating the edits coming
* f
On 20/05/14 05:35, Hansi Klose wrote:
Hi,
we are starting to think about the upgrade of our existing CDH 4.2.0 Cluster
to CDH5.0.1
We have a master Hadoop cluster with hbase and a slave Hadoop cluster with hbase
Hbase replication is enabled from master to slave cluster.
What is the best
Hi,
we are starting to think about the upgrade of our existing CDH 4.2.0 Cluster
to CDH5.0.1
We have a master Hadoop cluster with hbase and a slave Hadoop cluster with hbase
Hbase replication is enabled from master to slave cluster.
What is the best was to upgrade this environment with a
gt; > > > > deletes, that might do the trick, but you might end up with some
> > issues
> > > > at
> > > > > the end if you want to do some maintenance in the target cluster...
> > > > >
> > > > >
> > > > > 20
you want to do some maintenance in the target cluster...
> > > >
> > > >
> > > > 2014-04-04 4:26 GMT-04:00 冯宏华 :
> > > >
> > > > > Can't figure out solution to achieve this behavior using existing
> > means
> > &
diately.
> > > >
> > > > But it seems not that hard to implement it by changing some code, a
> > rough
> > > > thought is to filter out delete entries when pushing entries to the
> > > > according replication peer and this behavior can be made
> co
ionov
> > Principal Platform Engineer
> > Carrier IQ, www.carrieriq.com
> > e-mail: vrodio...@carrieriq.com
> >
> > ____
> > From: Jeff Storey [storey.j...@gmail.com]
> > Sent: Sunday, March 30, 2014 2:31 PM
> > To: user@hbase.apache.org
> > Subject: hbase repli
e immediately.
> > >
> > > But it seems not that hard to implement it by changing some code, a
> rough
> > > thought is to filter out delete entries when pushing entries to the
> > > according replication peer and this behavior can be made configurable.
> >
peer and this behavior can be made configurable.
> > ________
> > 发件人: Manthosh Kumar T [manth...@gmail.com]
> > 发送时间: 2014年4月4日 16:11
> > 收件人: user@hbase.apache.org
> > 主题: Re: 答复: HBase Replication - Addition alone
> >
&g
an be made configurable.
>
> 发件人: Manthosh Kumar T [manth...@gmail.com]
> 发送时间: 2014年4月4日 16:11
> 收件人: user@hbase.apache.org
> 主题: Re: 答复: HBase Replication - Addition alone
>
> Is it possible by any other meansin HBase?
>
made configurable.
发件人: Manthosh Kumar T [manth...@gmail.com]
发送时间: 2014年4月4日 16:11
收件人: user@hbase.apache.org
主题: Re: 答复: HBase Replication - Addition alone
Is it possible by any other meansin HBase?
On 4 April 2014 13:37, 冯宏华 wrote:
Is it possible by any other meansin HBase?
On 4 April 2014 13:37, 冯宏华 wrote:
> No
>
> 发件人: Manthosh Kumar T [manth...@gmail.com]
> 发送时间: 2014年4月4日 16:00
> 收件人: user@hbase.apache.org
> 主题: HBase Replication - Addition alone
>
>
No
发件人: Manthosh Kumar T [manth...@gmail.com]
发送时间: 2014年4月4日 16:00
收件人: user@hbase.apache.org
主题: HBase Replication - Addition alone
Hi All,
In a master-slave replication, is it possible to replicate only
the addition of rows?. If I delete in the
Hi All,
In a master-slave replication, is it possible to replicate only
the addition of rows?. If I delete in the master it shouldn't be deleted in
the slave.
--
Cheers,
Manthosh Kumar. T
IQ, www.carrieriq.com
> e-mail: vrodio...@carrieriq.com
>
>
> From: Jeff Storey [storey.j...@gmail.com]
> Sent: Sunday, March 30, 2014 2:31 PM
> To: user@hbase.apache.org
> Subject: hbase replication for higher availability
>
> In evaluating strategies for minimizing
org
Subject: hbase replication for higher availability
In evaluating strategies for minimizing downtime when a region server
fails, in addition to the common approaches such as lowering the zookeeper
timeout, is it possible to use replication to improve availability (at the
cost of consistency
Hey,
You might be interested in the "shadow replica" discussion in the dev list.
The aim is to lower the mttr incase of a failure. Here is the link to the
discussion[1] and the jira[2]. These are very much relevant to what you are
looking for.
[1]
http://apache-hbase.679495.n3.nabble.com/Shadow-R
In evaluating strategies for minimizing downtime when a region server
fails, in addition to the common approaches such as lowering the zookeeper
timeout, is it possible to use replication to improve availability (at the
cost of consistency) for reads?
I'm still getting more familiar with the HBASE
o
> Cluster B", consider the output of the first mapreduce job will be put
> into a HBase table of ClusterA. there is no need to wait till the
> replication complete, as long as use different rowID so the 2nd output
> wont' overwrite the 1st one. HBase replication will
the 2nd output
wont' overwrite the 1st one. HBase replication will handle the situation
very well.
Demai
On Mon, Nov 11, 2013 at 4:03 PM, Kevin Su wrote:
> Hi,
>
> I am having trouble searching for answers regarding HBase replication, so I
> thought I would email the mailing li
Hi,
I am having trouble searching for answers regarding HBase replication, so I
thought I would email the mailing list.
Does HBase provide an API/way to see what has/hasn't been replicated yet?
My use case is the following:
I run a map reduce job in Cluster A and stick the output in HBa
Thanks Ted. Will take a look at it.
On Mon, Oct 28, 2013 at 3:33 PM, Ted Yu wrote:
> Please see also 'Replication Metrics' at the bottom of
> http://hbase.apache.org/replication.html
>
>
> On Mon, Oct 28, 2013 at 3:23 PM, hdev ml wrote:
>
> > Thanks Demai. Need to find out how to access HBase
Please see also 'Replication Metrics' at the bottom of
http://hbase.apache.org/replication.html
On Mon, Oct 28, 2013 at 3:23 PM, hdev ml wrote:
> Thanks Demai. Need to find out how to access HBase metrics.
>
> But thanks for your insights.
> Harshad
>
>
> On Mon, Oct 28, 2013 at 2:45 PM, Demai
Thanks Demai. Need to find out how to access HBase metrics.
But thanks for your insights.
Harshad
On Mon, Oct 28, 2013 at 2:45 PM, Demai Ni wrote:
> 1) you can use replication metrics info such as:ageOfLastShippedOp,
> timeStampsOfLastShippedOp, sizeOfLogQueue ageOfLastAppliedOp, and
> timeSt
1) you can use replication metrics info such as:ageOfLastShippedOp,
timeStampsOfLastShippedOp, sizeOfLogQueue ageOfLastAppliedOp, and
timeStampsOfLastAppliedOp to figure out the lag.
2) with my best knowledge, the replication won't be together with snapshot.
That is the peers won't know there is a
Hello all,
I have a couple of questions for HBase.
1. Is there any way to find out by how much time the replication is lagging
on the peer cluster or even primary cluster is ok.
2. Say replication is going on for some time for a table and then you
restore a snapshot on the Primary. Would replicat
id...@gmail.com]
> Sent: Monday, August 19, 2013 1:28 PM
> To: user@hbase.apache.org
> Subject: Re: I am curious how to find hbase replication lag
>
> Ted, thanks for connecting the two discussion. a topic that quite some
> folks are looking for solutions.
>
> Alex, as far as
...@carrieriq.com
From: Demai Ni [nid...@gmail.com]
Sent: Monday, August 19, 2013 1:28 PM
To: user@hbase.apache.org
Subject: Re: I am curious how to find hbase replication lag
Ted, thanks for connecting the two discussion. a topic that quite some
folks are looking for
be either time or quantity. Although
current hbase replication metrics contains a lot of good information, third
party tool/monitor has to be applied (JMX, ganglia, etc.) On 0.94 level,
the metrics info is at regionsever level, on 95.0 such info also at peer
cluster level. I don't think there is pl
This is related: http://search-hadoop.com/m/SrEIT1jtzPF
Cheers
On Mon, Aug 19, 2013 at 12:50 PM, gordoslocos wrote:
> I believe hbase keeps info in zk that gives you the count of pending
> operations to be replicated. Check into the rz zookeeper node in the hbase
> replication docu
I believe hbase keeps info in zk that gives you the count of pending operations
to be replicated. Check into the rz zookeeper node in the hbase replication
documentation.
http://hbase.apache.org/replication.html
On 19/08/2013, at 16:42, Alex Newman wrote:
> I have setup HBase replication
I have setup HBase replication. I want to know how out of date my replicant
cluster is. How does one monitor that?
-Alex Newman
I don't know how this works well enough to suggest lowering default setting,
maybe 64MB really helps the throughput for other setups ? At least there could
be a note in Hbase requirements about heap sizes and replication.
Ideally there should be throttling of some kind so that if target regions
Yes... your master cluster must have helluva backup to replicate :)
Seems to make a good argument to lower the default setting. What do you
think?
J-D
On Wed, Jul 17, 2013 at 3:37 PM, Anusauskas, Laimonas <
lanusaus...@corp.untd.com> wrote:
> Thanks, setting replication.source.size.capacity to
Thanks, setting replication.source.size.capacity to 2MB resolved this. I see
heap growing to about 700MB but then going down and full GC is only triggered
occasionally.
And while primary cluster is has very little load (< 100 requests/sec) the
standby cluster is now pretty loaded at 5K reques
1GB is a pretty small heap and it could be that the default size for logs
to replicate is set to high. The default
for replication.source.size.capacity is 64MB. Can you set it much lower on
your master cluster (on each RS), like 2MB, and see if it makes a
difference?
The logs and the jstack seem t
And here is the jstack output.
http://pastebin.com/JKnQYqRg
Ok, here is log from data node 1:
http://pastebin.com/yCYYEG2r
And out log containing GC log:
http://pastebin.com/wzt1fbTA
I started replication around 11:16 and with 1000M heap it got full pretty fast.
Limus
Yean WARN won't give us anything, and please try to get us a fat log. Post
it on pastebin or such.
Thx,
J-D
On Wed, Jul 17, 2013 at 11:03 AM, Anusauskas, Laimonas <
lanusaus...@corp.untd.com> wrote:
> J-D,
>
> I have log level org.apache=WARN and there is only following in the logs
> before GC
J-D,
I have log level org.apache=WARN and there is only following in the logs before
GC happens:
2013-07-17 10:56:45,830 ERROR
org.apache.hadoop.hbase.regionserver.metrics.SchemaMetrics: Inconsistent
configuration. Previous configuration for using table name in metrics: true,
new configuratio
, 2013 at 9:06 AM, Anusauskas, Laimonas
wrote:
> Hi,
>
> I am fairly new to Hbase. We are trying to setup OpenTSDB system here and
> just started setting up production clusters. We have 2 datacenters, on a
> west/east coasts and we want to have 2 active-passive Hbase clusters with
>
Hi,
I am fairly new to Hbase. We are trying to setup OpenTSDB system here and just
started setting up production clusters. We have 2 datacenters, on a west/east
coasts and we want to have 2 active-passive Hbase clusters with Hbase
replication between them. Right now each cluster has 4 nodes (1
Generally， It's network issue to root cause these problems.
On Thu, Jul 4, 2013 at 12:12 AM, Patrick Schless
wrote:
> Thanks for the tip, Himanshu.
>
> I'm on 0.92.1 (cdh 4.1.2), so I imagine I don't have 7122.
>
>
> On Tue, Jul 2, 2013 at 6:00 PM, Himanshu Vashishtha >wrote:
>
> > Patrick,
> >
Thanks for the tip, Himanshu.
I'm on 0.92.1 (cdh 4.1.2), so I imagine I don't have 7122.
On Tue, Jul 2, 2013 at 6:00 PM, Himanshu Vashishtha wrote:
> Patrick,
>
> What is the HBase version you using for Master cluster? If < 0.94.8, does
> it has 7122? https://issues.apache.org/jira/browse/HBASE
Patrick,
What is the HBase version you using for Master cluster? If < 0.94.8, does
it has 7122? https://issues.apache.org/jira/browse/HBASE-7122
Thanks,
Himanshu
On Tue, Jul 2, 2013 at 3:09 PM, Patrick Schless
wrote:
> I've just enabled replication (to 1 peer), and I'm seeing a bunch of
> erro
I've just enabled replication (to 1 peer), and I'm seeing a bunch of
errors, along the lines of [1]. Replication does seem to work, though (data
is showing up in the standby cluster).
The file exists (I can see it in the HDFS web GUI), but it seems be empty.
Is this an error I need to worry about
makes a lot of sense.
thanks Dave,
Jason
On Thu, Jun 27, 2013 at 10:26 AM, Dave Wang wrote:
> Jason,
>
> HBase replication is for between two HBase clusters as you state.
>
> What you are seeing is merely the expected behavior within a single
> cluster. DFS replicati
Jason,
HBase replication is for between two HBase clusters as you state.
What you are seeing is merely the expected behavior within a single
cluster. DFS replication is not involved directly here - the shell ends up
acting like any other HBase client and constructing the scan the same way
(i.e
Hello,
I am a bit confused how configurations of hbase replication and dfs
replication works together.
My application deploys on an HBase cluster (0.94.3) with two Region
servers. The two hadoop datanodes run on the same two Region severs.
Because we only have two datanodes, dfs.replication was
Did you find what the issue was? From your other thread it looks like
you got it working.
Thx,
J-D
On Mon, Jun 17, 2013 at 11:48 PM, Asaf Mesika wrote:
> Hi,
>
> I have two cluster setup in a lab, each has 1 Master and 3 RS.
> I'm inserting roughly 15GB into the master cluster, but I see betwee
The problem is that when the recovered edits log is done processing
(Replicating) (queue = 0), the metrics still reports its
agetOfLastShippedOp instead of the current live active log, which seems
like a bug.
On Tue, Jun 18, 2013 at 9:55 PM, Elliott Clark wrote:
> On Tue, Jun 18, 2013 at 1:09
On Tue, Jun 18, 2013 at 1:09 AM, Asaf Mesika wrote:
> Does HBase Region Server arbitrarily chooses which one to publish to its
>
The metrics reports the last source to report in. So for recovered edits
since it will probably have higher throughput than the live log, you'll
more often see that v
Hi,
I noticed that when a Region Server takes over a dead region server
replication queue, the ageOfLastShippedOp is reported of the latter. For
instance, I had an age of 500ms, and when I shutdown region server 2, then
region server took over the queue, and suddenly I had an age of 700k ms.
When
1 - 100 of 165 matches
Mail list logo
