Re: Building and Deploying MRv2

Hi, Finally, got all the jars built. Now is the time to run the MRv2. It would be nice if the below documentation gets updated http://svn.apache.org/repos/asf/hadoop/common/branches/MR-279/mapreduce/INSTALL -- yarn build Ubuntu had an older version of the protoc binary, I did put th

Re: Quincy Fair Scheduler Vs Hadoop Fair Scheduler

Hi Venu, The paper compares against a naive implementation of fair scheduling, not against the Hadoop Fair Scheduler. You can find out about the data locality algorithms used in the Fair Scheduler in http://www.cs.berkeley.edu/~matei/papers/2010/eurosys_delay_scheduling.pdf. These are availabl

[jira] [Created] (MAPREDUCE-2604) Delegation token renewal over https in JobTracker

Delegation token renewal over https in JobTracker -- Key: MAPREDUCE-2604 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2604 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versio

Re: Building and Deploying MRv2

Ubuntu seems to install the protocol buffer library (protobuf-compiler) as part of the standard install. Can you run 'protoc --version' to figure out which version is being used. If you've installed it separately - you could play around with the path, remove the package installed by Ubuntu, etc to

Quincy Fair Scheduler Vs Hadoop Fair Scheduler

Hi All, I have come across a Fair Scheduler published by Microsoft known as Quincy Fair SCheduler. In this they compare Hadoop Fair Scheduler with Quincy and say the Hadoop Scheduler has the following problems 1) Sticky Slots - One drawback of simple fair scheduling is that it is damagi

Hadoop-Mapreduce-trunk - Build # 711 - Still Failing

See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/711/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 237387 lines...] [junit]0.85:96549 [junit

Re: MR-279

Did you build common and hdfs before doing mvn install in mapreduce? You have to build them in order as stated in INSTALL doc - common, hdfs, then mapreduce. Tom On 6/17/11 3:33 AM, "Thomas Anderson" wrote: > I was not aware that the source downloaded (a few months ago) is > obsoleted. So now

Re: MR-279

I was not aware that the source downloaded (a few months ago) is obsoleted. So now I switch by doing svn update, which solves the code obsolete issue. Then I follow the instruction at mapreduce/INSTALL [1], which points to install depdencies for yarn first at README[2]. During searching mailing li

Re: Building and Deploying MRv2

MR-279 actually works fine with maven 3.0.3 (sans a few (IMO bogus) warnings). You can leave out the "tar" target (which depends on the "docs" target, which requires forrest 0.8) to unblock the progress, as mvn-install would suffice for common and hdfs builds. On Thu, Jun 16, 2011 at 7:55 PM, Prav

Re: Api for Job History

Do you mean contrib/vaidya? On Fri, Jun 17, 2011 at 3:15 PM, Sudharsan Sampath wrote: > > Hi, > > Is there any api to analyse the list of jobs in the history? > > Thanks > Sudharsan S > >

Api for Job History

Hi, Is there any api to analyse the list of jobs in the history? Thanks Sudharsan S