RES: Rowkey hashing to avoid hotspotting

2012-07-16 Thread Cristofer Weber
uction data and if you have more to share, for sure it will help! Regards, Cristofer -Mensagem original- De: AnandaVelMurugan Chandra Mohan [mailto:ananthu2...@gmail.com] Enviada em: segunda-feira, 16 de julho de 2012 02:30 Para: user@hbase.apache.org Assunto: Rowkey hashing to avoid hotsp

Re: Rowkey hashing to avoid hotspotting

2012-07-17 Thread AnandaVelMurugan Chandra Mohan
and a lot of questions, so by now I feel I > started to shoot in the dark. Try to understand your production data and if > you have more to share, for sure it will help! > > Regards, > Cristofer > > -Mensagem original- > De: AnandaVelMurugan Chandra Mohan [mailto:ananthu

Re: Rowkey hashing to avoid hotspotting

2012-07-17 Thread Alex Baranau
ing. It's not for free. > > > > There's a lot of words here and a lot of questions, so by now I feel I > > started to shoot in the dark. Try to understand your production data and > if > > you have more to share, for sure it will help! > > > > Regards, >

Re: Rowkey hashing to avoid hotspotting

2012-07-17 Thread Michel Segel
a String.format("%03x", hashValue) >>> >>> In both cases, you still have to split your regions in advance, and it >>> will be better to work your splitting before starting to feed your table >>> with production data. >>> >>> Also, y

Re: Rowkey hashing to avoid hotspotting

2012-07-17 Thread Alex Baranau
tion must be your rowkey prefix to ensure a kind of > >>> balanced distribution over something (where something is your region > >>> servers). I'm working with a case that is a bit similar to yours, and > >> what > >>> I'm doing right now is

RES: Rowkey hashing to avoid hotspotting

2012-07-17 Thread Cristofer Weber
lly a serial number is unique. But, of course, it's just curiosity. :-) Regards, Cristofer -Mensagem original- De: Alex Baranau [mailto:alex.barano...@gmail.com] Enviada em: terça-feira, 17 de julho de 2012 12:53 Para: user@hbase.apache.org Assunto: Re: Rowkey hashing to avoid h

Re: Rowkey hashing to avoid hotspotting

2012-07-18 Thread AnandaVelMurugan Chandra Mohan
reate a hex string to prepend to my > > > rowkey. Something like a String.format("%03x", hashValue) > > > > > > In both cases, you still have to split your regions in advance, and > > > it will be better to work your splitting before starting to feed >

RES: Rowkey hashing to avoid hotspotting

2012-07-18 Thread Cristofer Weber
;s my curiosity asking again! Thanks for sharing! Regards, Cristofer -Mensagem original- De: AnandaVelMurugan Chandra Mohan [mailto:ananthu2...@gmail.com] Enviada em: quarta-feira, 18 de julho de 2012 13:04 Para: user@hbase.apache.org Assunto: Re: Rowkey hashing to avoid hotspottin

Re: Rowkey hashing to avoid hotspotting

2012-07-19 Thread AnandaVelMurugan Chandra Mohan
om] > Enviada em: quarta-feira, 18 de julho de 2012 13:04 > Para: user@hbase.apache.org > Assunto: Re: Rowkey hashing to avoid hotspotting > > Hi Cristofer, > > Data i store is test cell reports about a component. I have many test cell > reports for each model number + seria

Re: Rowkey hashing to avoid hotspotting

2012-07-19 Thread Alex Baranau
> > De: AnandaVelMurugan Chandra Mohan [mailto:ananthu2...@gmail.com] > > Enviada em: quarta-feira, 18 de julho de 2012 13:04 > > Para: user@hbase.apache.org > > Assunto: Re: Rowkey hashing to avoid hotspotting > > > > Hi Cristofer, > > > > Data i store is test

Re: Rowkey hashing to avoid hotspotting

2012-07-19 Thread syed kather
; > > > Also, two other things got my attention here... > > > > > > 1 - Why are you filtering with regex? If your queries are over > > > > > > model > > > > no. > > > > > + > > > > > > serial no., why don&

Re: Rowkey hashing to avoid hotspotting

2012-07-19 Thread AnandaVelMurugan Chandra Mohan
pliting your table will balance your load over > > your > > > > Region Servers. > > > > > Also, you will be able to recalculate your hash for your model# > > before > > > > > scanning for it, allowing for a scan over specific rowkey while >