[jira] [Created] (MAPREDUCE-5501) RMContainer Allocator loops forever after cluster shutdown in tests

2013-09-09 Thread Andrey Klochkov (JIRA)
Andrey Klochkov created MAPREDUCE-5501: -- Summary: RMContainer Allocator loops forever after cluster shutdown in tests Key: MAPREDUCE-5501 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5501

Will Hadoop CapacityScheduler slot reservation scheme cost deadlock?

2013-09-09 Thread Li, Shen
Hi, Hadoop CapacityScheduler reserves slots on a TaskTracker if the available memory does not satisfy the need of the job being scheduled ( in TaskSchedulingMgr.getTaskFromQueue(...)). However, will this create any deadlock? Suppose, I have two different jobs from two different queues, each ma

Re: hadoop1.2.1 speedup model

2013-09-09 Thread 牛兆捷
Thanks bobby. I will try more times. Is there any more fine-grained profile tools for each task? For example, cpu utilization, disk and network IO for each task. 2013/9/9 Robert Evans > How many times did you run the experiment at each setting? What is the > standard deviation for each o

Re: hadoop1.2.1 speedup model

2013-09-09 Thread Robert Evans
How many times did you run the experiment at each setting? What is the standard deviation for each of these settings. It could be that you are simply running into the error bounds of Hadoop. Hadoop is far from consistent in it's performance. For our benchmarking we typically will run the test 5

Hadoop-Mapreduce-trunk - Build # 1543 - Still Failing

2013-09-09 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1543/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 34961 lines...] TestMapReduceChain.testChain:73->c