Re: long pauses during hbase.PerformanceEvaluation tests

2009-10-30 Thread Jean-Daniel Cryans
As a remainder, on the Getting Started page in the Requirements it says "HBase currently is a file handle hog. The usual default of 1024 on *nix systems is insufficient if you are loading any significant amount of data into regionservers. See the FAQ: Why do I see "java.io.IOException...(Too many

Re: long pauses during hbase.PerformanceEvaluation tests

2009-10-30 Thread Sujee Maniyam
following up on this; hopefully this can help out some one else. turned out the culprit was 'ulimit -n'. it was the default 1024. I upped it to 32k.And that was like flicking a switch and making every thing work great! :-) now the benchmark-tests look much, much better. regards Sujee On

Re: Region server going down

2009-10-30 Thread Clint Morgan
In your first post, you are hitting 1858. Fixed in trunk and 0.20 branch, but you will need to add the config value to recover from the WAL. I take issue with Ryan's handwavy statement about index/trx extensions not being scalable. With the indexing you pay an extra cost on puts which is essentia

Re: HBase 0.20.1 on Ubuntu 9.04: master fails to start

2009-10-30 Thread Artyom Shvedchikov
Hello, Tatsuya Thank you for all advises, I'll keep them all in mind. Once I'll receive some results during optimization of hbase instance and table structure - I'll write here. - Best wishes, Artyom Shvedchikov On Fri, Oct 30, 2009 at 2:04 AM, Tat

Re: can't find region

2009-10-30 Thread stack
Zero in transition. Did close work? You should come on #IRC. You'll get response quicker. St.Ack On Fri, Oct 30, 2009 at 12:13 PM, Ananth T. Sarathy < ananth.t.sara...@gmail.com> wrote: > version 0.20.0 > 0 regionsInTransition > 3 live servers >ip-10-244-9-171.ec2.internal:60020 1256917873

Re: can't find region

2009-10-30 Thread Ananth T. Sarathy
version 0.20.0 0 regionsInTransition 3 live servers ip-10-244-9-171.ec2.internal:60020 1256917873423 requests=0, regions=2, usedHeap=26, maxHeap=991 GS_EventLists,,1254948399496 stores=3, storefiles=0, storefileSizeMB=0, memstoreSizeMB=0, storefileIndexSizeMB=0

Re: can't find region

2009-10-30 Thread stack
And 'detailed'? On Fri, Oct 30, 2009 at 11:26 AM, Ananth T. Sarathy < ananth.t.sara...@gmail.com> wrote: > thanks. when i do a status simple, is the region name just this > ip-10-245-82-160.ec2.internal > > status 'simple' output > >ip-10-245-82-160.ec2.internal:60020 1256917873229 >

Re: can't find region

2009-10-30 Thread Ananth T. Sarathy
thanks. when i do a status simple, is the region name just this ip-10-245-82-160.ec2.internal status 'simple' output ip-10-245-82-160.ec2.internal:60020 1256917873229 requests=0, regions=3, usedHeap=30, maxHeap=996 ip-10-242-71-191.ec2.internal:60020 1256918175106 request

Re: can't find region

2009-10-30 Thread stack
hbase> close_region "REGION_NAME" Type 'tools' in shell to explaination of this and other like commands. St.Ack On Fri, Oct 30, 2009 at 10:58 AM, Ananth T. Sarathy < ananth.t.sara...@gmail.com> wrote: > not in transition how do i close a region? > Ananth T Sarathy > > > On Fri, Oct 30, 2009

Re: can't find region

2009-10-30 Thread Ananth T. Sarathy
not in transition how do i close a region? Ananth T Sarathy On Fri, Oct 30, 2009 at 1:44 PM, stack wrote: > Try closing that region. Before you do, run 'status "detailed"' in shell > to > see if the region is stuck in transition? See top of the listing for this > status. > > Also, I added

Re: can't find region

2009-10-30 Thread stack
Try closing that region. Before you do, run 'status "detailed"' in shell to see if the region is stuck in transition? See top of the listing for this status. Also, I added a patch to https://issues.apache.org/jira/browse/HBASE-1781that might fix the stackoverflow you were seeing. If you are abl

Re: Can not start hbase in windows

2009-10-30 Thread stack
Below looks like a zookeeper/networking issue. Is zk up? Is it available at 127.0.0.1? Says connection refused in the below. Can you run hbase shell and do: hbase> zk_dump Anything messages of use? St.Ack On Fri, Oct 30, 2009 at 8:43 AM, Jeff Zhang wrote: > Hi all, > > I followed the tut

Re: Issue with bulk loader tool

2009-10-30 Thread stack
That is interesting. It'd almost point to a shell issue. Enable DEBUG so client can see it. Then rerun shell. Is it at least loading the right region? (The regions start and end keys span the asked for key?). I took a look at your attached .META. scan. All looks good there. The region speci

Can not start hbase in windows

2009-10-30 Thread Jeff Zhang
Hi all, I followed the tutorial to install hbase in windows, but can not start it successfully. Here's error logs : --- 2009-10-31 00:41:52,

can't find region

2009-10-30 Thread Ananth T. Sarathy
In relation with my constant internal scanner problem i am getting a org.apache.hadoop.hbase.client.NoServerForRegionException: No server address listed in .META. for region anyway to fix this? Ananth T Sarathy

Re: Issue with bulk loader tool

2009-10-30 Thread stack
Can you send a listing of ".META."? hbase> scan ".META." Also, can you bring a region down from hdfs, tar and gzip it, and then put it someplace I can pull so I can take a look? Thanks, St.Ack On Fri, Oct 30, 2009 at 3:31 AM, Murali Krishna. P wrote: > Hi guys, > I created a table according

Issue with bulk loader tool

2009-10-30 Thread Murali Krishna. P
Hi guys, I created a table according to hbase-48. A mapreduce job which creates HFiles and then used loadtable.rb script to create the table. Everything worked fine and i was able to scan the table. But when i do a get for a key displayed in the scan output, it is not retrieving the row. shell