Re: Settings

On Wed, Aug 26, 2009 at 7:40 AM, Lars George wrote: > Hi, > > It seems over the years I tried various settings in both Hadoop and HBase > and when redoing a cluster it is always a question if we should keep that > setting or not - since the issue it "suppressed" was fixed already. Maybe we > shou

Re: Settings

> > HBase: > - > - fs.default.name => hdfs://:9000/ > > This is usually in core-site.xml in Hadoop. Is the client or server needing > this key at all? Did I copy it in the hbase site file by mistake? > [schubert] I think it's better not to copy it into HBase conf file. I suggest you modi

RE: Settings

Lars, Good stuff. Want to add it to the wiki? -Original Message- From: Lars George [mailto:l...@worldlingo.com] Sent: Wednesday, August 26, 2009 7:40 AM To: hbase-user@hadoop.apache.org Subject: Settings Hi, It seems over the years I tried various settings in both Hadoop and HBase and

Re: Seattle / NW Hadoop, HBase Lucene, etc. Meetup , Wed August 26th, 6:45pm

Hello, My apologies, but there was a mix-up reserving our meeting location, and we don't have access to it. I'm very sorry, and beer is on me next month. Promise :) Sent from my Internets On Aug 25, 2009, at 4:21 PM, Bradford Stephens > wrote: Hey there, Apologies for this not going out

Re: Will ROOT region be a bottleneck?

Once ROOT is cached in client, it will talk directly to META. Once it is cached, it talks directly to the region servers. You will see a bottleneck on META when a lot of clients have to discover regions location at the same time (like at the beginning of a MR job with hundreds of concurrent tasks).

Re: Will ROOT region be a bottleneck?

While it seems like ROOT might be a bottleneck, with aggressive client caching it ends up not being an issue. Clients cache the location of ROOT, then the cache the location of META and the locations of the user tables. All is well. -ryan On Wed, Aug 26, 2009 at 5:43 PM, wrote: > Hi, > The HBa

Will ROOT region be a bottleneck?

Hi, The HBaseMaster is responsible for assigning regions to HRegionServers. The first region to be assigned is the ROOT region. The ROOT region is served by a region server, right? Will it be a bottleneck? While many clients request at the same time. Thanks Fleming ---

Re: Hbase Map-reduce Scheduler

I thank you are looking for this jira for reduce assignment https://issues.apache.org/jira/browse/HBASE-1199 Regions are assigned in the map to be ran on the server hosting the region but if there is an idle server it will pull the next map task. Billy "bharath vissapragada" wrote in mess

Re: Hbase 0.20 example\manual

Got it, Thanks. On Wed, Aug 26, 2009 at 9:16 PM, stack wrote: > On Wed, Aug 26, 2009 at 9:35 AM, Alex Spodinets > wrote: > > > St.Ack, > > > > That is a client example. I'm hoping to get Map\Reduce example, have it > > handy ? > > > > Sorry about that. Yeah, what Lars said (I just committed a

Re: Hbase 0.20 example\manual

On Wed, Aug 26, 2009 at 9:35 AM, Alex Spodinets wrote: > St.Ack, > > That is a client example. I'm hoping to get Map\Reduce example, have it > handy ? > Sorry about that. Yeah, what Lars said (I just committed a patch that clears out the old example with deprecated code and instead points you t

Re: HBase mention in VLDB keynote

On Tue, Aug 25, 2009 at 7:05 PM, Schubert Zhang wrote: > Thanks JG. We are trying to load up our datasets now. But one thing's for > sure that the cluster will become slow while dataset become larger and > larger. It is distinct on writes and random read. What kinda of sizes are you talking of

Re: HBase mention in VLDB keynote

On Tue, Aug 25, 2009 at 2:01 PM, Schubert Zhang wrote: > @stack > We know HIVE-705, and already have good communication with the contributor, > since we are all chinese. :-) > In fact some code of the patch are used and tested in our project. But we > need more flexible data store schema to resol

Re: Hbase 0.20 example\manual

Alex, Check the org.apache.hadoop.hbase.mapreduce package. It has the updated API and new classes. The legacy mapred package is deprecated. If you like to see an example then check out the RowCounter class. Lars Alex Spodinets wrote: St.Ack, That is a client example. I'm hoping to get Map

Re: Hbase 0.20 example\manual

St.Ack, That is a client example. I'm hoping to get Map\Reduce example, have it handy ? Thanks, Alex On Wed, Aug 26, 2009 at 7:27 PM, stack wrote: > See under > http://people.apache.org/~stack/hbase-0.20.0-candidate-2/docs/ > .

Re: Hbase 0.20 example\manual

hi , I saw the tableindexed package here http://people.apache.org/~stack/hbase-0.20.0-candidate-1/docs/api/org/apache/hadoop/hbase/client/tableindexed/package-summary.html I have a doubt ... Suppose i have the following tab;e rowkey col 1a 2a 3b 4

Re: Hbase 0.20 example\manual

See under http://people.apache.org/~stack/hbase-0.20.0-candidate-2/docs/. The client code is linked from the 'Getting Started' section. Here is direct link: http://su.pr/Anqe9D St.Ack On Wed, Aug 26, 2009 at 9:10 AM, Alex Spodinets wrote: > Gents, > > It appears that example for mapred in hbase

Re: Hbase 0.20 example\manual

Gents, It appears that example for mapred in hbase 0.20RC1 source uses alot of deprecated classes. Is it true to assume that it is out of date ? If so, could anyone point me to example for mapred of 0.20 ? Thanks, Alex On Tue, Aug 18, 2009 at 2:26 AM, Alex Spodinets wrote: > exciting, thanks.

Settings

Hi, It seems over the years I tried various settings in both Hadoop and HBase and when redoing a cluster it is always a question if we should keep that setting or not - since the issue it "suppressed" was fixed already. Maybe we should have a wiki page with the current settings and more advan

Re: hbase/jython outdated

I have fixed the code samples and opened a feature request on JIRA for the jython command. https://issues.apache.org/jira/browse/HBASE-1796 Until recently I have used the python thrift interface but it has some serious issues with unicode. Currently I am searching for alternatives. Is there any

Re: HBase mention in VLDB keynote

Right, the point I was making is not about absolute numbers but the scale of the test and successful results at that scale. I would think that is on par with the (failed) experimentation at Yahoo, but have yet to see the evaluation materials posted anywhere. - Andy _