Re: Applying QualifierFilter to one column family only.

2012-07-19 Thread David Koch
Hello Anoop, Thank you for your answer. The QualifierFilter on T specifies a minimum value not one that has to be matched exactly, so merely adding a specific qualifier value directly to the scan does not work if I understand correctly :-/ /David On Thu, Jul 19, 2012 at 7:05 AM, Anoop Sam John

RE: Table not storing versions after deleteall

2012-07-19 Thread Zoltán Tóth-Czifra
Hi, Thank you very much for the clarification! The JIRA task is especially useful so that I can follow the status of this bug/feature. According to what you say and what I read in the docs, when I do a major compact after the deletes it should resolve the problem - but it doesn't :( Even if I

Re: Rowkey hashing to avoid hotspotting

2012-07-19 Thread AnandaVelMurugan Chandra Mohan
Hi Cristofer, No problem... I am happy to share and learn.. :) Regarding timestamp based column family, I haven't thought about it. But my only concern is no of column families. I read somewhere that HBase is not good at handling more than 100 column families. On Wed, Jul 18, 2012 at 11:15 PM,

Re: Rowkey hashing to avoid hotspotting

2012-07-19 Thread Alex Baranau
> I read somewhere that HBase is not > good at handling more than 100 column families Heh. Usually it is not good to have more than two or three, actually. See [1], and may be also [2]. Alex Baranau -- Sematext :: http://blog.sematext.com/ :: Hadoop - HBase - ElasticSearch - Solr [1] http://

Re: Rowkey hashing to avoid hotspotting

2012-07-19 Thread syed kather
Anand , i had a case which i had combine 4 fields and made one row key . serial number can be first part of rowkey and model number can be second part . So that B-Search on Row key will be more faster because we can reduce lot jump while doing B- Search Note : if serial number is changing freq

Re: Hardware and Heap Allocation Questions

2012-07-19 Thread Jean-Daniel Cryans
Inline. J-D On Tue, Jul 17, 2012 at 2:49 PM, Young Kim wrote: > 1. There seems to be a dearth of articles in what hardware most people use > for their master servers. So, is there a recommended spec for the Master > servers? The HBase master in particular doesn't need anything special, it's y

Re: HConnectionManager get closed

2012-07-19 Thread Jean-Daniel Cryans
Is your job configured to talk to HBase correctly? J-D On Wed, Jul 18, 2012 at 9:07 AM, syed kather wrote: > Team , >While Running the Map Reduce Program on 3 node cluster . i had noticed > that one of node is throw Error most often > > java.lang.RuntimeException: java.io.IOException: > org.

HTable.coprocessorExec call times out

2012-07-19 Thread Kevin
Hi, I'm using endpoint coprocessors to do intense scans in parallel on some tables. I log the time it takes for each coprocessor to finish its job on the region. Each coprocessor rarely takes longer than a few seconds, maximum of 5 seconds (there are only 5 regions on the tables right now). As my

Ticket for Hbase book

2012-07-19 Thread Mohammad Tariq
Hello list, I have raised a JIRA(HBASE-6430) for a small modification in Hbase book. Please have a look at it and let me know if I have not done it properly. Pardon me if things are not put in the appropriate way, as it is my first attempt. Many thanks. Regards, Mohammad Tariq

Re: HTable.coprocessorExec call times out

2012-07-19 Thread Ted Yu
Kevin: Can you pastebin the log snippet from region server just before it died ? How frequent were your coprocessorExec() calls ? What HBase version were you using ? Thanks On Thu, Jul 19, 2012 at 12:44 PM, Kevin wrote: > Hi, > > I'm using endpoint coprocessors to do intense scans in parallel

Re: HTable.coprocessorExec call times out

2012-07-19 Thread Kevin
The log snippet just before the regionservers die look like this: 2012-07-19 09:49:18,551 INFO project.coproc.IndexEndpoint: putting new rowkey 2012-07-19 09:49:18,551 INFO project.coproc.IndexEndpoint: new rowkey put 2012-07-19 09:49:18,551 INFO project.coproc.IndexEndpoint: coproc time: 1227 ms

Re: HTable.coprocessorExec call times out

2012-07-19 Thread Ted Yu
Can you paste more of the region server log after 09:49:18,551 (till the region server died) ? Thanks On Thu, Jul 19, 2012 at 1:46 PM, Kevin wrote: > The log snippet just before the regionservers die look like this: > > 2012-07-19 09:49:18,551 INFO project.coproc.IndexEndpoint: putting new > ro

Re: HTable.coprocessorExec call times out

2012-07-19 Thread Kevin
That's it. That's the end of the regionserver log. In the master's web UI the regionserver is in the table labeled "Dead Region Servers." In the master's log there is: 2012-07-19 07:02:04,016 INFO org.apache.hadoop.hbase.zookeeper.RegionServerTracker: RegionServer ephemeral node deleted, processin

Re: [poll] Does anyone run or test against hadoop 0.21, 0.22, 0.23 under HBase 0.92.0+/0.94.0?

2012-07-19 Thread Marcos Ortiz
We are using 0.94 and 1.0.3 too Best wishes On 07/18/2012 05:47 PM, Tony Dean wrote: We are using HBase 0.94.0 against Hadoop 1.0.3, but plan to move to 0.23.x. -Original Message- From: Ted Yu [mailto:yuzhih...@gmail.com] Sent: Wednesday, July 18, 2012 4:12 PM To: d...@hbase.apache.org

Re: Ticket for Hbase book

2012-07-19 Thread Stack
On Thu, Jul 19, 2012 at 10:34 PM, Mohammad Tariq wrote: > Hello list, > >I have raised a JIRA(HBASE-6430) for a small modification in > Hbase book. Please have a look at it and let me know if I have not > done it properly. Pardon me if things are not put in the appropriate > way, as it is

Re: Ticket for Hbase book

2012-07-19 Thread Mohammad Tariq
Hi Stack, Thank you so very much for the support and guidance. I'll follow the instructions. Regards, Mohammad Tariq On Fri, Jul 20, 2012 at 4:22 AM, Stack wrote: > On Thu, Jul 19, 2012 at 10:34 PM, Mohammad Tariq wrote: >> Hello list, >> >>I have raised a JIRA(HBASE-6430

Re: Ticket for Hbase book

2012-07-19 Thread Stack
On Fri, Jul 20, 2012 at 12:55 AM, Mohammad Tariq wrote: > Hi Stack, > > Thank you so very much for the support and guidance. I'll > follow the instructions. > Thank you for the help you have been providing up on the mailing lists. Its great. Let us know if you can't figure how to make

Re: Ticket for Hbase book

2012-07-19 Thread Mohammad Tariq
It's my pleasure to share space with you guys. I'll do whatever you have suggested and get back to you in case any help is required.(Actually this is my very first attempt, so the probability is quite high). Thanks again. Regards, Mohammad Tariq On Fri, Jul 20, 2012 at 4:28 AM, Stack wrote:

Re: Rowkey hashing to avoid hotspotting

2012-07-19 Thread AnandaVelMurugan Chandra Mohan
Thank a lot, Guys!!! I will evaluate and implement a solution based on your suggestions.. On Thu, Jul 19, 2012 at 10:22 PM, syed kather wrote: > Anand , > i had a case which i had combine 4 fields and made one row key . > serial number can be first part of rowkey and model number can be sec

RE: Applying QualifierFilter to one column family only.

2012-07-19 Thread Anoop Sam John
Yes I was having this doubt. So if you know exactly the qualifier names in advance you can use this scan way. Else filter only u can use. QualifierFilter just checks the qualifier name only which CF it is part of is not checked. So the similar qualifier names in both T and S will get filtered ou

Re: Applying QualifierFilter to one column family only.

2012-07-19 Thread Anoop Sam John
>Yes I was having this doubt. Yes I was having this doubt abt ur use case. I assumed ur use case is like u know the qualifier names in advance. :) From: Anoop Sam John Sent: Friday, July 20, 2012 8:40 AM To: user@hbase.apache.org Subject: RE: Applying Qualifi

Re: ColumnRangeFilter

2012-07-19 Thread lars hofhansl
Just checked, ColumnRangeFilter was added in 0.92 (HBASE-3684) -- Lars - Original Message - From: Mohit Anchlia To: user@hbase.apache.org Cc: Sent: Thursday, July 19, 2012 4:54 PM Subject: ColumnRangeFilter I am using verision 0.90.4 and in that I don't see ColumnRangeFilter. Is this

Re: HBase 0.94.1 release date

2012-07-19 Thread lars hofhansl
Working on it. The only piece left now is to stabilize the tests a bit to get more confidence in the build. I sunk RC0 yesterday, because of test instability. I will probably tag RC1 over the weekend (or possibly tomorrow). -- Lars - Original Message - From: Harsh J To: user@hbase.ap

Error in importtsv

2012-07-19 Thread iwannaplay games
I ran this command ./hbase org.apache.hadoop.hbase.mapreduce.ImportTsv -Dimporttsv.columns=HBASE_ROW_KEY,startip,endip,countryname IPData /usr/ipdata.txt It says : INFO mapred.JobClient: Cleaning up the staging area hdfs://master:54310/app/hadoop/tmp/hadoop/mapred/staging/hduser/.staging/job_20