Re: blockcache always on?

2009-06-04 Thread Ryan Rawson
In 0.20 its a global setting right now. We hope to support in memory column families soon. What do you think the appropriate setting should be? My thought is to avoid block cache on very large blocks and otherwise let the lru do its job. On Jun 4, 2009 11:25 PM, "Billy Pearson" wrote: I create

blockcache always on?

2009-06-04 Thread Billy Pearson
I created a table with one column in my cluster and started putting data in to it I noticed that even with blockcache = false it still uses the block cache Is this a know problem or is there plans to remove the option from the table create alter commands? Billy

Re: HBase v0.19.3 with Hadoop v0.19.1?

2009-06-04 Thread Billy Pearson
Hbase can be used on the same hadoop release as its version so hbase 0.19.x with hadoop 0.19.x, hbase 0.20.x with hadoop 0.20.x I thank production can be considered safe with version 1.0 we are not there yet. With that said there are many using hbase in production here are a few : http://wiki.ap

Re: Question regarding MR for Hbase

2009-06-04 Thread Billy Pearson
Take a look also at TableMapReduceUtil Its in the api docs for 0.19 and 0.20 Billy "Vijay" wrote in message news:9b40bc2a0906041247j7d25f5a4y61351200ae2bb...@mail.gmail.com... Hello Everyone, I wanted to write a mr for hbase table there is a million record and i wanted to write a Map red

Re: Question regarding MR for Hbase

2009-06-04 Thread Erik Holstad
Hey Vijay! Have a look at: *https://issues.apache.org/jira/browse/HBASE-974* Not the best written code, was among the first MR jobs we wrote, but it gets the job done. You don't have to do do the split yourself unless you want to, it is done for you. So basically you should just be able to run t

Re: Question regarding MR for Hbase

2009-06-04 Thread Vijay
Thanks Eric, After a while of reading i got the concept ( http://www.larsgeorge.com/2009/05/hbase-mapreduce-101-part-i.html) but the problem is implementation I tried using the following extended TableInputFormatBase and then added the filter and the baseclass Then In

HBase v0.19.3 with Hadoop v0.19.1?

2009-06-04 Thread Amandeep Khurana
I have a couple of questions: 1. Is Hbase 0.19.3 release stable for a production cluster? 2. Can it be deployed over Hadoop v0.19.1? ..amandeep Amandeep Khurana Computer Science Graduate Student University of California, Santa Cruz

Re: Question regarding MR for Hbase

2009-06-04 Thread Erik Holstad
Hey Vijay! You can have a look at http://wiki.apache.org/hadoop/Hbase/MapReduce That might make things easier to understand, just remember that the new API for 0.20 will look different, but the concept will be the same Erik

Question regarding MR for Hbase

2009-06-04 Thread Vijay
Hello Everyone, I wanted to write a mr for hbase table there is a million record and i wanted to write a Map reduce task to scan through it and then get the data and find the 90the percentail of the result. It would be helpful if some one has a tried it before... The thing which i am finding h

Re: DrWho is killing my regionserver on .20-trunk?

2009-06-04 Thread Alex Loddengaard
Hey Bradford, If you were wondering what "DrWho" is about, take a look here: Alex On Thu, Jun 4, 2009 at 11:40 AM, stack wrote: > The Daleks must be running that host. Run! > > Your hbase user doesn't have permissions to read/write all over

Re: DrWho is killing my regionserver on .20-trunk?

2009-06-04 Thread stack
The Daleks must be running that host. Run! Your hbase user doesn't have permissions to read/write all over hadoop? Paste more context from around the log so I can see what hbase was trying to do. That it only happens on one host might also indicate that this host doesn't have same config. as oth

DrWho is killing my regionserver on .20-trunk?

2009-06-04 Thread Bradford Stephens
Out of the 10 HBase nodes on my dev cluster, one is extremely unhappy. It crashes every few hours, with messages like this: 2009-06-03 12:35:21,530 FATAL org.apache.hadoop.hbase.regionserver.HRegionServer: Unhandled exception. Aborting... org.apache.hadoop.security.AccessControlException: org.apac

Re: HBase looses regions.

2009-06-04 Thread Lars George
Oops, sorry, misread your question. Lars George wrote: From the download page, see http://hadoop.apache.org/hbase/releases.html for reference. llpind wrote: Andrew Purtell-2 wrote: Is the patch for HADOOP- 4681 applied? See https://issues.apache.org/jira/browse/HADOOP-4681 - Andy