[
https://issues.apache.org/jira/browse/MAPREDUCE-5541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13803654#comment-13803654
]
zhaoyunjiong commented on MAPREDUCE-5541:
-----------------------------------------
On branch-1.2, ant test have below Failures and Errors with this patch, none of
them related to this patch:
[junit] Running org.apache.hadoop.cli.TestCLI
[junit] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed:
57.154 sec
[junit] Running org.apache.hadoop.fs.TestFileUtil
[junit] Tests run: 8, Failures: 2, Errors: 0, Skipped: 0, Time elapsed:
3.683 sec
[junit] Running org.apache.hadoop.fs.TestLocalDirAllocator
[junit] Tests run: 5, Failures: 3, Errors: 0, Skipped: 0, Time elapsed:
0.099 sec
[junit] Running org.apache.hadoop.hdfs.server.namenode.TestStartup
[junit] Tests run: 4, Failures: 3, Errors: 0, Skipped: 0, Time elapsed:
205.051 sec
[junit] Running org.apache.hadoop.fs.TestFsShellReturnCode
[junit] Tests run: 4, Failures: 1, Errors: 0, Skipped: 0, Time elapsed:
0.752 sec
[junit] Running
org.apache.hadoop.filecache.TestTrackerDistributedCacheManager
[junit] Tests run: 11, Failures: 11, Errors: 0, Skipped: 0, Time elapsed:
1.089 sec
[junit] Running org.apache.hadoop.hdfs.server.namenode.TestNameNodeMXBean
[junit] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed:
3.004 sec
[junit] Running org.apache.hadoop.hdfs.server.datanode.TestDiskError
[junit] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0
sec
[junit] Running org.apache.hadoop.hdfs.server.namenode.TestCheckpoint
[junit] Tests run: 3, Failures: 0, Errors: 2, Skipped: 0, Time elapsed:
77.738 sec
[junit] Running org.apache.hadoop.ipc.TestRPC
[junit] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0
sec
[junit] Running org.apache.hadoop.hdfs.server.namenode.TestNameEditsConfigs
[junit] Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
79.839 sec
[junit] Running org.apache.hadoop.hdfs.TestSyncingWriterInterrupted
[junit] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
90.102 sec
[junit] Running
org.apache.hadoop.hdfs.server.namenode.TestStorageDirectoryFailure
[junit] Tests run: 3, Failures: 0, Errors: 2, Skipped: 0, Time elapsed:
141.996 sec
[junit] Running org.apache.hadoop.hdfs.server.namenode.TestStorageRestore
[junit] Tests run: 2, Failures: 0, Errors: 2, Skipped: 0, Time elapsed:
134.115 sec
> Improved algorithm for whether need speculative task
> ----------------------------------------------------
>
> Key: MAPREDUCE-5541
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5541
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: mrv1
> Affects Versions: 1.2.1
> Reporter: zhaoyunjiong
> Assignee: zhaoyunjiong
> Fix For: 1.2.2
>
> Attachments: MAPREDUCE-5541-branch-1.2.patch,
> MAPREDUCE-5541-branch-1.2.patch
>
>
> Most of time, tasks won't start running at same time.
> In this case hasSpeculativeTask in TaskInProgress not working very well.
> Some times, some tasks just start running, and scheduler already decide it
> need speculative task to run.
> And this waste a lot of resource.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
