Re: FW: NNbench and MRBench

2011-05-10 Thread Wantao
test results. Benchmakring work for other systems (e.g., file systems) is probably helpful for you as well. Wantao -- Original -- From: "Marcos Ortiz"; Date: Sun, May 8, 2011 02:14 PM To: "stanley.shi"; Cc: "mapreduce-user";

Re:What is the property for setting the number of tolerated failure taskin one job

2011-05-10 Thread Wantao
I guess the property is "mapreduce.job.maxtaskfailures.per.tracker", and the default value is 4. Wantao -- Original -- From: "Jeff Zhang"; Date: Tue, May 10, 2011 04:32 PM To: "mapreduce-user"; Subject: What is the prop

Re:what is the difference between the two packages "org.apache.hadoop.mapreduce"and "org.apache.hadoop.mapred"?

2011-04-26 Thread Wantao
"org.apache.hadoop.mapred" is the package for old API and "org.apache.hadoop.mapreduce" is the package for new API. Although the two APIs have similar functionality, the implementation is different. Hadoop is migrating from the old API to the new API. Wantao ---

Terasort error when running Hadoop over PVFS2

2011-04-06 Thread Wantao
ystem mapreduce.cluster.temp.dir file:///pvfs/hadoop/mapred/temp mapreduce.jobtracker.staging.root.dir file:///pvfs/hadoop/mapred/staging mapreduce.cluster.local.dir /root/hadoop_local Does anybody know how to fix this problem? Thanks for any advice. Wantao

Mapper and Reducer of Terasort example

2011-03-30 Thread Wantao
Hi all, I did not find where Mapper and Reducer are set in source code of the Terasort example in Hadoop 0.21.0. So I guess default Mapper and Reducer are used. If so, what are the classes names for them? Thanks for any advice. Wantao