Re: error: UNRESOLVED DEPENDENCIES

GFW, you knew that. On Thu, Feb 24, 2011 at 9:43 PM, 祝美祺 wrote: > when i try to compile mapred of 0.21.0 > > I got error: > > [ivy:resolve] :: problems summary :: > [ivy:resolve] WARNINGS > [ivy:resolve] module not found: org.apache.hadoop#hadoop-common;0.21.0 > [ivy:resolve] apache-sn

Re: How to get file configuration from mapper

DistributedCache could help you. http://hadoop.apache.org/common/docs/r0.20.2/mapred_tutorial.html#DistributedCache On Fri, Jan 28, 2011 at 6:47 PM, Joan wrote: > Hi > > I'm trying to access to my custom configuration file (myconfig.xml) from > MyMapper. > > So I'm doing: > > *File configuratio

Re: How to set object in Configuration

yes, I agree. The configuration parameter should be a serialize-able value. because the parameter will be transfer to other node to run the job. If the value can not be serialized, I believe it should be a problem. On Wed, Jan 26, 2011 at 11:52 PM, David Rosenstrauch wrote: > On 01/26/2011 05:43

Re: Several TT in hadoop MR in clustering?

Actually, the TT should run on every datanode. On Thu, Dec 30, 2010 at 7:32 AM, Pedro Costa wrote: > Hi, > > 1 - When Hadoop MR is running in cluster mode, is it possible to have > several TT, a TT per machine, running simultaneously and the JT is > communicating to every TT? > For example, runn

Re: When a Reduce Task starts?

I think the reduce can be started before all of the map finished. See the configration item in mapred-site.xml mapred.reduce.slowstart.completed.maps 0.05 Fraction of the number of maps in the job which should be complete before reduces are scheduled for the job. Correct me, if I'm w

Re: Scheduler in Hadoop MR

sure, you can use multiple JTs. and also, you can deploy the every JT on different machine. On Wed, Dec 15, 2010 at 1:42 AM, Harsh J wrote: > On Thu, Dec 9, 2010 at 4:06 AM, Allen Wittenauer > wrote: > > > > On Dec 7, 2010, at 6:47 PM, Harsh J wrote: > >>> 1 - When we've two JobTrackers running

Re: delay the execution of reducers

org.apache.hadoop.mapred.JobInProgress Maybe you find this class. On Mon, Nov 29, 2010 at 4:36 AM, Da Zheng wrote: > I have a problem with subscribing mapreduce mailing list. > > I use hadoop-0.20.2. I have added this parameter to mapred-site.xml. Is > there any way for me to check whether the

Re: Starting a Hadoop job programtically

When I use the IP address, the application can run on any machine. Thanks for your great help. 2010/11/25 li ping > But I can run the application on the hadoop server. (not use the hadoop > command to run). > > > > On Thu, Nov 25, 2010 at 4:38 PM, Jeff Zhang wrote: > >

Re: Starting a Hadoop job programtically

But I can run the application on the hadoop server. (not use the hadoop command to run). On Thu, Nov 25, 2010 at 4:38 PM, Jeff Zhang wrote: > Please check the status of job tracker since you can not find port > 9001 using netstat > > > > 2010/11/25 li ping : > > Hi:

Starting a Hadoop job programtically

Hi: I am trying to run a job in my own application. So far, I can run the job on the server which the hadoop server is running on. But what I expect is the hadoop server is running on server A. and the application will run on other server (B server). If I run the application on Server B, it will