[jira] [Created] (MAPREDUCE-4736) Remove obsolete option [-rootDir] from TestDFSIO

2012-10-18 Thread Brandon Li (JIRA)
Brandon Li created MAPREDUCE-4736: - Summary: Remove obsolete option [-rootDir] from TestDFSIO Key: MAPREDUCE-4736 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4736 Project: Hadoop Map/Reduce

Re: Max Maps for default queues in FairScheduler

2012-10-18 Thread Arun C Murthy
You might just want the CapacityScheduler which has the feature(s) you are want... On Oct 18, 2012, at 5:03 PM, lohit wrote: > In a big cluster with hundreds are users, not all of them would submit > their job to specific queues. > And creating hundreds are pool is not very easy. Having somethin

[jira] [Created] (MAPREDUCE-4734) The history server should link back to NM logs if aggregation is incomplete / disabled

2012-10-18 Thread Siddharth Seth (JIRA)
Siddharth Seth created MAPREDUCE-4734: - Summary: The history server should link back to NM logs if aggregation is incomplete / disabled Key: MAPREDUCE-4734 URL: https://issues.apache.org/jira/browse/MAPREDUCE-

Re: Max Maps for default queues in FairScheduler

2012-10-18 Thread lohit
In a big cluster with hundreds are users, not all of them would submit their job to specific queues. And creating hundreds are pool is not very easy. Having something like userMaxMaps would limit users from consuming all resources. We could create small set of queues with more weight, but JobTracke

Re: Max Maps for default queues in FairScheduler

2012-10-18 Thread Sandy Ryza
You're correct that there's no way to put a hard limit on the number of maps or reduces for a given user, and a user can potentially consume all of the cluster resources. However, if there are multiple users contending for resources, the scheduler makes an effort to schedule tasks equally, so it w

[jira] [Created] (MAPREDUCE-4733) Reducer can fail to make progress during shuffle if too many reducers complete consecutively

2012-10-18 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-4733: - Summary: Reducer can fail to make progress during shuffle if too many reducers complete consecutively Key: MAPREDUCE-4733 URL: https://issues.apache.org/jira/browse/MAPREDUCE-47

[jira] [Created] (MAPREDUCE-4732) testcase testJobRetire fails using IBM JAVA 7

2012-10-18 Thread Amir Sanjar (JIRA)
Amir Sanjar created MAPREDUCE-4732: -- Summary: testcase testJobRetire fails using IBM JAVA 7 Key: MAPREDUCE-4732 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4732 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-4731) FSShell doble encodes qualified Paths

2012-10-18 Thread Robert Joseph Evans (JIRA)
Robert Joseph Evans created MAPREDUCE-4731: -- Summary: FSShell doble encodes qualified Paths Key: MAPREDUCE-4731 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4731 Project: Hadoop Map/Re

Hadoop-Mapreduce-trunk - Build # 1229 - Still Failing

2012-10-18 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1229/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 30487 lines...] Tests run: 3, Failures: 0, Errors: 0