Hi,
I am starting to think of a new project using Hadoop and Hbase as my
persistent store. But I am quite confused as to how to use these HBASE data.
1. Can these HBASE data be used in web applications. Meaning retrieving the
data and showing it on the web page.
Can somebody please suggest how
Hi Jean-Daniel,
thank you for your answer and bring some light into the darkness.
You can see the bad rows listed in the user logs for your MR job.
What log do you mean. The output from the command line?
I only see the count of GOOD or BAD rows.
Are the bad rows listed in that log which are
I have a table in Hbase that sizes around 96Gb,
I generate 4 regions of 30Gb. Some time, table starts to split because the
max size for region is 1Gb (I just realize of that, I'm going to change it
or create more pre-splits.).
There're two things that I don't understand. how is it creating the
There're some new regions that they're just a some KBytes!. Why they are so
small?? When does HBase decide to split? because it started to split two
hours later to create the table.
When hbase does a split, it doesn't actually split at the disk/file level.
Its just a metadata operation which
The default split policy in hbase0.94.x is IncreaseToUpperBound rather than
ConstantSizeSplitPolicy which was the default in the older versions of
hbase.
Please refer to the link given below to understand how a
IncreaseToUpperBoundSplitPolicy works:
Please take a look at
https://m.facebook.com/UsingHbase?id=191660807562816refsrc=https%3A%2F%2Fwww.facebook.com%2FUsingHbase
On Apr 14, 2014, at 11:20 PM, Shashidhar Rao raoshashidhar...@gmail.com wrote:
Hi,
I am starting to think of a new project using Hadoop and Hbase as my
persistent
I read the article, that's why I typed the question, because I didn't
understand the result I got.
Oh, yes!!, that's true, so silly.
I think some of the files are pretty small because the table has two
families and one of them is much smaller than the another one. So, it has
been splitted many
I am using HDP 2.0.6, which has 18 nodes(region servers). One of my HBase
tables has 50 regions but I found that the 50 regions all stay in just two
nodes, not spread evenly in the 18 nodes. I did not pre-create splits so
this table was gradually split into 50 regions itself.
I'd like to know why
Check if hbase balancer is on.
$hbase_shell balance_switch true
Run the balancer from the hbase shell
$hbase_shell balancer
If the above command returns false check for any regions in transition on
the HMaster UI or check HMaster logs.
Thanks
Divye Sheth
On Tue, Apr 15, 2014 at 5:10 PM, Tao
Is load balancer enabled ?
Can you grep this table in master log and pastebin what you found ?
Cheers
On Apr 15, 2014, at 4:40 AM, Tao Xiao xiaotao.cs@gmail.com wrote:
I am using HDP 2.0.6, which has 18 nodes(region servers). One of my HBase
tables has 50 regions but I found that the 50
bq. HFileScanner for reader reader=hdfs://
192.168.11.150:8020/hbase/vc2.in_link/6http://192.168.11.150:8020/hbase/vc2.in_link/6b879cb43205cdae084a280c38fab34a/cf/4dc235709de44f53b2484d2903f1bb75
On Tue, Apr 15, 2014 at 12:17 AM, Hansi Klose hansi.kl...@web.de wrote:
Hi Jean-Daniel,
thank you for your answer and bring some light into the darkness.
You're welcome!
You can see the bad rows listed in the user logs for your MR job.
What log do you mean. The output from the command
Thanks Yu. I have added below coprocessor to my table. And tried to invoke
coprocessor using java client. But fails with below error. But I could see
coprocessor in describe table output.
Caused by:
Hmm... Wouldn't mvcc prevent seeing partial append?
Append is just put in the end, the way it is currently implemented.
On Mon, Apr 14, 2014 at 10:41 AM, Vladimir Rodionov vrodio...@carrieriq.com
wrote:
From HRegion.java:
Appends performed are done under row lock but reads do not take locks
The command balance_switch true returns true, but the command balancer
returns false. I checked the HMaster UI and found some regions of other
tables in transition, not of this table.
This table's name is E_MP_DAY_READ, I did grep it in the master log and
found only the following lines:
15 matches
Mail list logo