Problem with Hadoop Streaming and -D mapred.tasktracker.map.tasks.maximum option

2010-05-10 Thread Corneliu-Tudor Vlad
Hello I am a new user of Hadoop and I have some trouble using Hadoop Streaming and the -D mapred.tasktracker.map.tasks.maximum option. I'm experimenting with an unmanaged application (C++) which I want to run over several nodes in 2 scenarious 1) the number of maps (input splits) is

Re: Hadoop support for hbase

2010-05-10 Thread Allen Wittenauer
Let me understand this: a) the hbase folks have been required to patch hadoop due to bugs b) they have been doing this for X months now c) we finally have momentum on getting 0.21 out the door d) hey, let's make their life easier and take resources out of 0.21 by creating a branch Are we

Re: Hadoop support for hbase

2010-05-10 Thread Stack
On Mon, May 10, 2010 at 9:58 AM, Allen Wittenauer awittena...@linkedin.com wrote: Let me understand this: a) the hbase folks have been required to patch hadoop due to bugs The branch is to work on adding a feature to 0.20, not for fixing bugs. c) we finally have momentum on getting 0.21 out

Re: Hadoop support for hbase

2010-05-10 Thread Allen Wittenauer
On May 10, 2010, at 10:18 AM, Stack wrote: The above is a fallacious setup. How does a branch in 0.20 detract from the 0.21 momentum (The append feature that we'd work on in 0.20 branch has little relation to how append works in 0.21). There are X amount of hours that people can put into

Re: Hadoop support for hbase

2010-05-10 Thread Ryan Rawson
On Mon, May 10, 2010 at 10:24 AM, Allen Wittenauer awittena...@linkedin.com wrote: On May 10, 2010, at 10:18 AM, Stack wrote: The above is a fallacious setup.  How does a branch in 0.20 detract from the 0.21 momentum (The append feature that we'd work on in 0.20 branch has little relation to

Re: Hadoop support for hbase

2010-05-10 Thread Allen Wittenauer
On May 10, 2010, at 11:05 AM, Ryan Rawson wrote: That's not how it works though - people have adopted and use Hadoop 0.20 because of the fact that people like Yahoo, Facebook, etc run it on multi-thousand node clusters and have done so for months (or soon to be years now). If you look

RE: Hadoop support for hbase

2010-05-10 Thread Michael Segel
From: t...@cloudera.com Date: Mon, 10 May 2010 10:45:13 -0700 Subject: Re: Hadoop support for hbase To: general@hadoop.apache.org The above is a fallacious setup. How does a branch in 0.20 detract from the 0.21 momentum (The append feature that we'd work on in 0.20 branch has

Re: Hadoop support for hbase

2010-05-10 Thread Jay Booth
Given that the 0.20-append branch pretty much already exists unofficially, via IRC, IM and email forwarded patchsets, it seems like giving it an official home is just recognizing the status quo. Especially since 0.21 probably won't be getting rolled out into production everywhere the first day