Re: How to set the number of tasks running on each slave?

2010-11-15 Thread Wei Xue
I depends on how many tasks you created, how many slave nodes in the cluster, how many slots allocated in each slave node, and how each node is occupied. Each of them has corresponding setting parameters. Please refer to hadoop document for more details. 2010/11/16 Shen LI > How to set the numbe

Re: How can I compile and use my own hadoop?

2010-11-08 Thread Wei Xue
Hi, Shen Li, I'm modifying hadoop core code too. I just use the build.xml distributed along with the source code. It just works. 2010/11/9 Shen LI > Hi, > > How can I compile and use my own hadoop? I modified some source code of > hadoop-0.20.2. Then, I tried to build it with eclipse according

Re: Is continuous map reduce supported

2010-09-02 Thread Wei Xue
Thanks Jeff. Those are all valuable links. It seems there are quite a few people out there working on incremental MapReduce. 2010/9/1 Jeff Hammerbacher > Hey Stephen, > > There have been several proposals for implementing such a feature. See > https://issues.apache.org/jira/browse/MAPREDUCE-121

Does Hadoop MapReduce have Counters for Double?

2010-08-06 Thread Wei Xue
I have some job scope statistics of double type, and I want to use mechanism like Counters (Reporter). Does Hadoop MR have such kind of thing? Thanks.

Re: error when executing mapreduce program

2010-07-20 Thread Wei Xue
Seems you didn't register a Writable factory for your data type. 2010/7/19 Khaled BEN BAHRI > Hello :) > > I developped my first mapreduce program with eclipse. > > when i want to execute it i have this error i tried to solve it but i > failed : > > > > Jul 19, 2010 5:06:37 PM org.apache.hadoop.

Re: Developping MapReduce functions

2010-07-01 Thread Wei Xue
That's a very good book. :-) 2010/6/29 Mohamed Riadh Trad > Hi Khaled, > > I started with Hadoop The Definitive Guide, in addition of the sample > programs. > > http://oreilly.com/catalog/9780596521981 > > Regards. > > Trad Mohamed Riadh, M.Sc, Ing. > PhD. student > INRIA-TELECOM PARISTECH > > O