Hi,
Here is the situation.
I have an heterogeneous cluster with 2 cores CPUs, 4 cores CPUs and 8
cores CPUs servers. The performances of those different servers allow
them to handle different size of load. So far, I built a LoadBalancer
which balance the regions over those servers based on the
pe
Agree with what Ian says below except I'd say with work it's possible to do
cross DC quorum writes in a layer on top of HBase that persists into
HBase, like
when Google built Megastore on BigTable. At this year's VLDB if I recall
correctly there was a megastore-like system with an interesting varia
On Fri, Dec 7, 2012 at 1:01 PM, Bryan Beaudreault
wrote:
> We have a couple tables that had thousands of regions due to the size of
> the day in them. We recently changed them to have larger regions (nearly
> 4GB). We are trying to bulk load these in now, but every time we do our
> servers die w
On 12/07/2012 04:01 PM, Bryan Beaudreault wrote:
We have a couple tables that had thousands of regions due to the size of
the day in them. We recently changed them to have larger regions (nearly
4GB). We are trying to bulk load these in now, but every time we do our
servers die with OOM.
When
We have a couple tables that had thousands of regions due to the size of
the day in them. We recently changed them to have larger regions (nearly
4GB). We are trying to bulk load these in now, but every time we do our
servers die with OOM.
The logs seem to show that there is always a major compa
Hi Harsh,
Thanks a lot for your reply, it's . For #2, I double checked and found the
patches(HADOOP-8154 and HADOOP-7806) are also in branch-1, only that it
exists in hadoop release later than(including) 1.1.0, we're using
hadoop-1.0.4 here, so it's not included.
On 7 December 2012 21:12, Harsh
Hi Harsh,
Thanks a lot for your reply, it's enlightening.
For #2, I double checked and found the patches(HADOOP-8154 and HADOOP-7806)
are also in branch-1, only that it exists in hadoop release later
than(including) 1.1.0, but we're using hadoop-1.0.4 here.
On 7 December 2012 21:12, Harsh J wr
Ha - that's what I get for trying to answer list emails from my phone. :)
Ian
On Dec 7, 2012, at 1:58 PM, sriraam h wrote:
Thanks Ian. I DID miss the point. The person who started the chain is a
different person :)
- Sri
From: Ian Varley mailto:ivar...@sales
Thanks Ian. I DID miss the point. The person who started the chain is a
different person :)
- Sri
>
> From: Ian Varley
>To: "user@hbase.apache.org"
>Sent: Saturday, 8 December 2012, 1:21
>Subject: Re: PROD/DR - Replication
>
>Yes, I think so. A single HBase
What failure condition are you trying to safeguard against? A full
data center failure? That's when you would lose your entire cluster
and need the DR to kick in. Otherwise, you could deploy such that an
entire rack failure or even a row failure won't take you down. Just
span across multiple racks
Yes, I think so. A single HBase cluster can't (or, at least, really shouldn't)
span multiple data centers; the strong consistency you refer to is only
available within a cluster.
But the replication you were referring to in your initial email is cross-data
center, between two or more clusters.
"Strongly consistent reads/writes: HBase is not an "eventually consistent"
DataStore. This makes it very suitable for tasks such as high-speed counter
aggregation"
http://hbase.apache.org/book/architecture.html
Am I missing something ?
- Sri
>
> From: Ian Va
That regionserver is stopping? If not, you may need to restart it.
2012-12-07 13:18:53,947 DEBUG
org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler:
Processing open of -ROOT-,,0.70236052
2012-12-07 13:18:53,947 INFO
org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler: Serve
Juan,
No; that would mean every single write to HBase has to wait for an ACK from a
remote data center, which would decrease your cluster throughput dramatically.
If you need that, consider other database solutions.
Ian
On Dec 7, 2012, at 12:14 PM, Juan P. wrote:
I was reading up on HBase Rep
I was reading up on HBase Replication and wanted to make sure I'm not
missing something.
Given that replication happens asynchronously the replication strategy has
an "eventually consistent" policy.
I was considering using this feature for Production / Disaster Recovery
setup.
Is there a way to
Yi,
Thanks for your reply.
following is the link for regionserver 'dn004' log :http://pastebin.com/224CKwsu
I can't find anything useful.
Thanks,
Jing Wang
At 2012-12-07 13:16:14,"Yi Liang" wrote:
Jing,
I think you could follow this kind of log to check rs log to find why it could
not open
Hi,
I am trying to connect to hbase-0.94.1, through a java war (soup ui) but
it is not connected to hbase and through error as below.
As for reference i have added all the required jar to war for the new
version of the hadoop as well as hbase.
WARN client.HConnectionManager: Error o
Hi, Yun
Code in HConnectionManager.java, method: "submit(List> actionList,
...)".
It will combine all actions towards the same rs, and send them together...
- Dong
在 2012-12-7，上午2:34， yun peng 写道：
> Hi, I have question on how the multiple Puts() are executed when they are
> issued against the
Thanks for your prompt reply.
I have submited a documentation update to add this in
http://hbase.apache.org/book/config.files.html .
JM
2012/12/7, Harsh J :
> You need to implement your own class, and plug it in via the configuration
> key "hbase.master.loadbalancer.class" in the master's config
Hi,
1. Too bad that you can't change the hostname to be an actual meaningful
one. I would not consider a node in the network a proper one if it does not
define a usable default hostname.
2. Virtual NIF name support (iface:sub-iface format) is available in Hadoop
2.x based releases. Perhaps that ma
You need to implement your own class, and plug it in via the configuration
key "hbase.master.loadbalancer.class" in the master's configuration.
On Fri, Dec 7, 2012 at 6:04 PM, Jean-Marc Spaggiari wrote:
> Hi,
>
> In the HBase doc it's explained how we can change the balancer period
> http://hba
Hi,
In the HBase doc it's explained how we can change the balancer period
http://hbase.apache.org/book/config.files.html), but I'm not able to
find how to configure the balancer class.
The balancer used is DefaultLoadBalancer which extends
BaseLoadBalancer which implements LoadBalancer. I guess t
Emm, have you tried to tune your GC deeply? please provide the exactly VM
options and jdk version and GC logs..
In our test cluster this week, i managed to reduce the longest STW from 22+
seconds(Xmx20G) to 1.1s(Xmx48G) under a very heavy YCSB stress
long-term-testing.
Also it would be better t
But, if your counters are on the row keys, then just send one Increment
objects, and have the hourly, daily columns in there, as well the general
counter columns. Way easier than doing it by a region observer.
On 6 בדצמ 2012, at 15:42, Amit Sela wrote:
> Got it, so if my coprocessor is aggrega
24 matches
Mail list logo
