Re: HBaseTestingUtility on windows

2012-08-03 Thread N Keywal
Hi Mohit, For simple cases, it works for me for hbase 0.94 at least. But I'm not sure it works for all features. I've never tried to run hbase unit tests on windows for example. N. On Fri, Aug 3, 2012 at 6:01 AM, Mohit Anchlia mohitanch...@gmail.com wrote: I am trying to run mini cluster using

Re: hbase can't start:KeeperErrorCode = NoNode for /hbase

2012-08-03 Thread abloz...@gmail.com
The problem resolved. it caused by the zookeeper data corrupted. so I modified zookeeper data dir to another directory on hbase-site.xml and restart hbase again. property namehbase.zookeeper.property.dataDir/name value/home/zhouhh/myhadoop/zk/value descriptionProperty

add_table.rb in -0.92.x

2012-08-03 Thread holger.lewin
I just checked out hbase-0.92.1 and noticed that /bin/add_table.rb has been deleted. (CHANGES.txt: HBASE-2460 add_table.rb deletes any tables for which the target table name is a prefix). I wonder if theres a replacement or fixed version of it somewhere? Thanks, Holger -- View this message in

Re: How to query by rowKey-infix

2012-08-03 Thread Christian Schäfer
Hi Alex, thanks a lot for the hint about setting the timestamp of the put. I didn't know that this would be possible but that's solving the problem (first test was successful). So I'm really glad that I don't need to apply a filter to extract the time and so on for every row. Nevertheless I

Re: How to query by rowKey-infix

2012-08-03 Thread Christian Schäfer
Hi Matt, sure I got this in mind as an last option (at least on a limited subset of data). Due to our estimation of some billions rows a week a selective filtering needs to take place at the server side. But I agree that one could do fine filtering stuff on the client side on a handy data

Re: How to query by rowKey-infix

2012-08-03 Thread Michael Segel
Hi, What does your schema look like? Would it make sense to changing the key to user_id '|' timestamp and then use the session_id in the column name? On Aug 2, 2012, at 7:23 AM, Christian Schäfer syrious3...@yahoo.de wrote: OK, at first I will try the scans. If that's too slow I

Never ending distributed log split

2012-08-03 Thread Jean-Marc Spaggiari
Hi, I'm using HBase 0.94.0. I stopped the cluster for some maintenance, and I'm have some troubles to restart it. I'm getting one line every about Start Time Description State Status Fri Aug 03 08:59:54 EDT 2012Doing distributed log split in

Re: Never ending distributed log split

2012-08-03 Thread Jean-Marc Spaggiari
Here us the complete log. And seems it's every 30 seconds and not every 20 seconds... http://pastebin.com/gMiURnnj 2012/8/3, Jean-Marc Spaggiari jean-m...@spaggiari.org: Hi, I'm using HBase 0.94.0. I stopped the cluster for some maintenance, and I'm have some troubles to restart it. I'm

Re: Never ending distributed log split

2012-08-03 Thread Jean-Marc Spaggiari
Me again ;) I did some more investigation. And I found that: http://pastebin.com/Bedm6Ldy Seems that no region is serving my logs. That's strange because all my servers are up and fsck is telling me that FS is clean. Can I just delete those files? What's the impact of such delete? I don't

Re: add_table.rb in -0.92.x

2012-08-03 Thread Jean-Daniel Cryans
hbck should be able to take care of it now. J-D On Fri, Aug 3, 2012 at 2:21 AM, holger.lewin holger.le...@linklift.net wrote: I just checked out hbase-0.92.1 and noticed that /bin/add_table.rb has been deleted. (CHANGES.txt: HBASE-2460 add_table.rb deletes any tables for which the target

Re: Never ending distributed log split

2012-08-03 Thread Jean-Daniel Cryans
On Fri, Aug 3, 2012 at 8:15 AM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: Me again ;) I did some more investigation. It would really help to see the region server log although the fsck output might be enough. BTW you'll find 0.94.1 RC1 here:

Re: HBaseTestingUtility on windows

2012-08-03 Thread Jerry Lam
Hi Mohit: You might need to install Cygwin if the tool has dependency on Linux command like bash. Best Regards, Jerry On Friday, August 3, 2012, N Keywal wrote: Hi Mohit, For simple cases, it works for me for hbase 0.94 at least. But I'm not sure it works for all features. I've never

Re: Never ending distributed log split

2012-08-03 Thread Jean-Marc Spaggiari
2012/8/3, Jean-Daniel Cryans jdcry...@apache.org: On Fri, Aug 3, 2012 at 8:15 AM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: Me again ;) I did some more investigation. It would really help to see the region server log although the fsck output might be enough. I looked under evey

Re: Need to fast-forward a scanner inside a coprocessor

2012-08-03 Thread lars hofhansl
We recently added a new API for that: RegionScanner.reseek(...). See HBASE-5520. 0.94+ only, unfortunately. So it depends specifically on where you hook this up. If you do it at RegionObserver.postScannerOpen you can reseek forward at any time. -- Lars - Original Message - From: Tom

Problems starting HBase

2012-08-03 Thread sk101
Hi guys, I've been trying to setup HBase for OpenTSDB for a few days now and am completely stuck. I've gotten .92 running on a virtual machine but I am completely unable to deploy it to a real machine. Firstly, I've been following this guide: http://opentsdb.net/setup-hbase.html Here's what

Re: How to query by rowKey-infix

2012-08-03 Thread Alex Baranau
Good! Submitted initial patch of fuzzy row key filter at https://issues.apache.org/jira/browse/HBASE-6509. You can just copy the filter class and include it in your code and use it in your setup as any other custom filter (no need to patch HBase). Please let me know if you try it out (or post

Re: Need to fast-forward a scanner inside a coprocessor

2012-08-03 Thread lars hofhansl
Oh... I just meant you need to have your hands on a RegionScanner :) As long as you only scan forward it should work. - Original Message - From: Tom Brown tombrow...@gmail.com To: user@hbase.apache.org; lars hofhansl lhofha...@yahoo.com Cc: Sent: Friday, August 3, 2012 5:47 PM Subject:

Re: adding data

2012-08-03 Thread Bijeet Singh
Well, if the file that you have contains TSV, you can directly use the ImportTSV utility of HBase to do a bulk load. More details about that can be found here : http://hbase.apache.org/book/ops_mgt.html#importtsv The other option for you is to run a MR job on the file that you have, to generate

Re: adding data

2012-08-03 Thread anil gupta
Hi Rita, HBase Bulk Loader is a viable solution for loading such huge data set. Even if your import file has a separator other than tab you can use ImportTsv as long as the separator is single character. If in case you want to put in your business logic while writing the data to HBase then you