tasks localized and launched serially by TaskLauncher - causing other tasks to 
be delayed
-----------------------------------------------------------------------------------------

                 Key: MAPREDUCE-2705
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2705
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: tasktracker
    Affects Versions: 0.20.205.0
            Reporter: Thomas Graves
            Assignee: Thomas Graves


The current TaskLauncher serially launches new tasks one at a time. During the 
launch it does the localization and then starts the map/reduce task.  This can 
cause any other tasks to be blocked waiting for the current task to be 
localized and started. In some instances we have seen a task that has a large 
file to localize (1.2MB) block another task for about 40 minutes. This 
particular task being blocked was a cleanup task which caused the job to be 
delayed finishing for the 40 minutes.


--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to