How to set region parameter?

2011-11-08 Thread 吕鹏
I have three question: 1 How large a region will be, if i want to use map-reduce to analyze the data in hbase table. 2 How many region in a region server is suitable? 3 If the rowkey in my application is not dispersive such as md5 or hash, how can i control the hotspot of region split? thx

Re: The Elephant in the Room: You are invited

2011-11-08 Thread Jignesh Patel
Millind, Looks like I lost my cell in the event place, and I am not able to recollect name of the hotel, can you please let me know the name of the hotel so that I can follow up. -Jignesh On Thu, Nov 3, 2011 at 1:12 PM, wrote: > Hello Hadoopers ! > > Are you attending Hadoop World in New York o

What happens if Hbase is installed on machines with no HDFS?

2011-11-08 Thread edward choi
Hi, Pardon me for asking such a stupid question. I recently read an article about HBase basic architecture here: http://www.larsgeorge.com/2009/10/hbase-architecture-101-storage.html What really makes me wonder is, what if HBase is installed on machines where there is no HDFS? For example, ther

Re: HBase Master dies with an unexpected exception

2011-11-08 Thread Amit Phadke
Adding right address. On Nov 7, 2011, at 2:45 PM, Amit Phadke wrote: Hey Guys, We are seeing an issue where Master dies with something like the following. Any idea why the master dies ? Ideally, if a RS isnt behaving well, shouldnt that RS be blacklisted and ignored or something of that sort ?

Re: hbase heap size beyond 16G ?

2011-11-08 Thread N Keywal
If your're interested, some good slides on GC (slide 45 and after): http://www.azulsystems.com/sites/www.azulsystems.com/SpringOne2011_UnderstandingGC.pdf On Tue, Nov 8, 2011 at 11:25 PM, Mikael Sitruk wrote: > Concurrent GC (a.k.a CMS) does not mean that there is no more pause. The > pauses are

Re: hbase heap size beyond 16G ?

2011-11-08 Thread Mikael Sitruk
Concurrent GC (a.k.a CMS) does not mean that there is no more pause. The pauses are reduced to minimum but can still happen especially if the concurrent thread will not finish their work under high pressure. The G1 collector in JDK 7.0 pretends to be a better collector than CMS, but i presume tests

storing MB sized files in HBase

2011-11-08 Thread Sujee Maniyam
HI All I have data files (binary) that are in 2-5 MB in size. Can I store them in a Hbase shell -- adjusting block-size and region-size ? or should I store them in HDFS and store the pointer in Hbase? http://wiki.apache.org/hadoop/Hbase/FAQ_Design#A3 says not to go beyond 10MB per cell. any

Re: upgrade to 0.92 from 0.90.x

2011-11-08 Thread Ted Yu
I don't think so. Cheers On Tue, Nov 8, 2011 at 12:30 PM, Suraj Varma wrote: > Hi Ted: > Would a 0.92 client be able to talk to a 0.90.x cluster? (i.e. the > other way around?) > > --Suraj > > On Mon, Nov 7, 2011 at 9:45 AM, Ted Yu wrote: > > HBASE-3581 would disallow 0.90 HBase client to talk

Re: upgrade to 0.92 from 0.90.x

2011-11-08 Thread Suraj Varma
Hi Ted: Would a 0.92 client be able to talk to a 0.90.x cluster? (i.e. the other way around?) --Suraj On Mon, Nov 7, 2011 at 9:45 AM, Ted Yu wrote: > HBASE-3581 would disallow 0.90 HBase client to talk to 0.92 HBase server. > So in order to utilize the new cluster, you should upgrade your client

Re: Omid: Transactional Support for HBase

2011-11-08 Thread Daniel Gómez Ferro
On Nov 8, 2011, at 10:48 , Daniel Gómez Ferro wrote: > Hi Jignesh > > On Nov 7, 2011, at 21:44 , Jignesh Patel wrote: > >> Looks like this transaction is limited for one row. Is that correct? >> > > No, it's not. Transactions can span multiple rows. > >> Another thing I don't have zookeepr i

Re: Omid: Transactional Support for HBase

2011-11-08 Thread Daniel Gómez Ferro
Hi Jignesh On Nov 7, 2011, at 21:44 , Jignesh Patel wrote: > Looks like this transaction is limited for one row. Is that correct? > No, it's not. Transactions can span multiple rows. > Another thing I don't have zookeepr installed as I am running in > pseudo distibuted mode. The document doesn