Re: Not running balancer because processing dead regionserver(s)

2011-02-25 Thread Yi Liang
Thanks you Stack! On Wed, Feb 23, 2011 at 6:25 AM, Stack st...@duboce.net wrote: On Mon, Feb 21, 2011 at 10:04 PM, Yi Liang white...@gmail.com wrote: Yes, the server zcl crashed at that time. But after I restarted it later, it's still in the dead server list. We failed processing its

Increment fails on simple test

2011-02-25 Thread Sandesh Devaraju
Hi All, Surely, I'm doing something wrong here! # hbase shell 11/02/25 08:22:31 WARN conf.Configuration: DEPRECATED: hadoop-site.xml found in the classpath. Usage of hadoop-site.xml is deprecated. Instead use core-site.xml, mapred-site.xml and hdfs-site.xml to override properties of

Increment fails on simple test!

2011-02-25 Thread Sandesh Devaraju
Hi All, Surely, I'm doing something wrong here! # hbase shell 11/02/25 08:22:31 WARN conf.Configuration: DEPRECATED: hadoop-site.xml found in the classpath. Usage of hadoop-site.xml is deprecated. Instead use core-site.xml, mapred-site.xml and hdfs-site.xml to override properties of

Re: Increment fails on simple test

2011-02-25 Thread Ryan Rawson
Increment expects a long as per returned by Bytes.toBytes(long). ie: 8 bytes, big endian. you put '1' array length 1. when increment finds no value, it assumes '0'. if you want 0 based counting dont put an initial value. On Fri, Feb 25, 2011 at 12:23 AM, Sandesh Devaraju

Re: NativeException: java.io.IOException: Unable to enable table

2011-02-25 Thread Jean-Daniel Cryans
I that's the bug where disabling a table that was just split and still has the parent entries in .META. puts it into a weird state. We can do some deeper debugging to help you getting that table back but I strongly suggest that you upgrade to 0.90.1 where the issue is fixed. There's no backport

Re: Disabling a table taking very long time

2011-02-25 Thread Jean-Daniel Cryans
An hour to disable? That doesn't sound right at all :) I would approach this problem like I generally do with HBase issue, first check the master log for any weirdness regarding my problem (in this case, grep for the table name). Then I would look the region server log(s) of the nodes that were

Re: the region server can't join in the new hmaster while the state become active from standy

2011-02-25 Thread Jean-Daniel Cryans
I see the master is waiting and I see the exceptions but there's no context and the timestamps don't match (what happened in the region server at the time the second master took over), can you explain exactly what was done to get in that state? Also could you please tell use which hbase version

Ad-hoc reports against HBase - any way? any tools?

2011-02-25 Thread Otis Gospodnetic
Hello, I have a HBase cluster chock-full of data and would like to run canned reports (i.e., reports known ahead of time), but also ad-hoc reports against that data. Are there any open-source or commercial tools one can use? Here's what I *think* I know so far, but please correct me wherever

Re: Ad-hoc reports against HBase - any way? any tools?

2011-02-25 Thread Jean-Daniel Cryans
We use the HBase+Hive integration here for ad-hoc queries, I don't understand the data duplication you're talking about... when you create an external table you can directly query your existing tables. We run with the latest patch posted in HIVE-1634 since we have a lot of binary values and I made

Re: Ad-hoc reports against HBase - any way? any tools?

2011-02-25 Thread Otis Gospodnetic
Hi J-D, Yes, I'm interested in HBase-Hive integration. Thanks for the pointer to the external tables. I was aware of that at some point, but for some reason started thinking that data copying is necessary. Are there any gotchas or serious limitations around this integration? Thanks, Otis

RE: Ad-hoc reports against HBase - any way? any tools?

2011-02-25 Thread Peter Haidinyak
Sorry to jump in here but does HBase use Map/Reduce under the covers? I was under the impression that HBase used the DFS of Hadoop but not Map/Reduce. Thanks -Pete -Original Message- From: Otis Gospodnetic [mailto:otis_gospodne...@yahoo.com] Sent: Friday, February 25, 2011 2:39 PM To:

Re: Ad-hoc reports against HBase - any way? any tools?

2011-02-25 Thread Jean-Daniel Cryans
On Fri, Feb 25, 2011 at 2:49 PM, Peter Haidinyak phaidin...@local.com wrote: Sorry to jump in here but does HBase use Map/Reduce under the covers? I was under the impression that HBase used the DFS of Hadoop but not Map/Reduce. You're right, and I don't see anything that contradicts that in

RE: Ad-hoc reports against HBase - any way? any tools?

2011-02-25 Thread Peter Haidinyak
Consider a HBase cluster whose primary task is to ingest data, process it with MR jobs, and store it back in some table(s). That's what the cluster does today. I was just wondering if when I did 'puts' or 'scans' in my HBase Client was HBase using Map/Reduce to add/query the tables.

Re: Ad-hoc reports against HBase - any way? any tools?

2011-02-25 Thread Jean-Daniel Cryans
It doesn't, I'm 99.% sure that Otis referred to MR jobs that are run by himself and not by HBase. Look at the HTable code, there's no dependency on mapred or mapreduce. J-D On Fri, Feb 25, 2011 at 2:56 PM, Peter Haidinyak phaidin...@local.com wrote: Consider a HBase cluster whose primary

HTable client help

2011-02-25 Thread benchmark
We are using 0.20x hbase. We are seeing some big delays on the client's read. The server side stats shows about 2-3 ms, but on the client side we are seeing about 20ms. The network delay is negligible. We have a about 250 threads per JVM each having its own HTable client handle. Reducing the

RE: Ad-hoc reports against HBase - any way? any tools?

2011-02-25 Thread Peter Haidinyak
That's what I thought but being new I just wanted make sure so I can get a better idea of the internals. -Original Message- From: jdcry...@gmail.com [mailto:jdcry...@gmail.com] On Behalf Of Jean-Daniel Cryans Sent: Friday, February 25, 2011 2:59 PM To: user@hbase.apache.org Subject:

Re: Ad-hoc reports against HBase - any way? any tools?

2011-02-25 Thread Ted Dunning
Otis, There is early work on hbase replication happening. That might be useful to firewall the load in the way that you are looking for. On Fri, Feb 25, 2011 at 2:39 PM, Otis Gospodnetic otis_gospodne...@yahoo.com wrote: Ah, I have another question: When you have HBase-Hive integration in

Re: 答复: the region server can't join in the new hmaster while the state become active from standy

2011-02-25 Thread Stack
The below looks like https://issues.apache.org/jira/browse/HBASE-3545. The fix will be in 0.90.2. Try upgrading to 0.90.1 and patching in HBASE-3545. See if that fixes your issue. Yours, St.Ack