[
https://issues.apache.org/jira/browse/HADOOP-5194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12689360#action_12689360
]
Ravi Gummadi commented on HADOOP-5194:
--------------------------------------
unit tests passed on my linux machine.
The number of failures in unit tests on Windows reduced from 80(with trunk) to
18(with this patch). Here are the failures with this patch:
org.apache.hadoop.hdfs.server.namenode.TestBackupNode.testCheckpoint
org.apache.hadoop.fs.TestDFVariations.testOSParsing
org.apache.hadoop.mapreduce.TestMapReduceLazyOutput.testLazyOutput
org.apache.hadoop.cli.TestCLI.testAll
org.apache.hadoop.fs.TestTrash.testTrash
org.apache.hadoop.fs.TestTrash.testNonDefaultFS
org.apache.hadoop.hdfs.TestHDFSServerPorts.testNameNodePorts
org.apache.hadoop.hdfs.TestHDFSServerPorts.testDataNodePorts
org.apache.hadoop.hdfs.TestHDFSServerPorts.testSecondaryNodePorts
org.apache.hadoop.hdfs.TestHDFSTrash.testNonDefaultFS
org.apache.hadoop.mapred.TestJobInProgress.testRunningTaskCount
org.apache.hadoop.mapred.TestJobQueueInformation.testJobQueues
org.apache.hadoop.mapred.TestJobTrackerRestart.testJobTrackerRestart
org.apache.hadoop.mapred.TestMRServerPorts.testJobTrackerPorts
org.apache.hadoop.mapred.TestMRServerPorts.testTaskTrackerPorts
org.apache.hadoop.mapred.TestMiniMRDFSCaching.testWithDFS
org.apache.hadoop.mapred.TestMiniMRLocalFS.testWithLocal
org.apache.hadoop.security.authorize.TestServiceLevelAuthorization.testRefresh
The logs of these failures show that these failures are not related to setsid
and pidfiles stuff.
Reliability test also passed.
ant test-patch gave:
[exec] +1 overall.
[exec]
[exec] +1 @author. The patch does not contain any @author tags.
[exec]
[exec] +1 tests included. The patch appears to include 3 new or
modified tests.
[exec]
[exec] +1 javadoc. The javadoc tool did not generate any warning
messages.
[exec]
[exec] +1 javac. The applied patch does not increase the total number
of javac compiler warnings.
[exec]
[exec] +1 findbugs. The patch does not introduce any new Findbugs
warnings.
[exec]
[exec] +1 Eclipse classpath. The patch retains Eclipse classpath
integrity.
[exec]
[exec] +1 release audit. The applied patch does not increase the
total number of release audit warnings.
> DiskErrorException in TaskTracker when running a job
> ----------------------------------------------------
>
> Key: HADOOP-5194
> URL: https://issues.apache.org/jira/browse/HADOOP-5194
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Environment: Windows, Cygwin
> Reporter: Tsz Wo (Nicholas), SZE
> Assignee: Ravi Gummadi
> Priority: Blocker
> Fix For: 0.21.0
>
> Attachments: HADOOP-5194.patch, HADOOP-5194.v1.patch
>
> Original Estimate: 0h
> Remaining Estimate: 0h
>
> In particular, this can be reproduced in Windows by running a hadoop example
> such as PiEstimator.
> {noformat}
> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
> taskTracker/pids/attempt_200902021632_0001_m_000002_0 in any of the
> configured local directories
> at
> org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:381)
> at
> org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:138)
> at
> org.apache.hadoop.mapred.TaskTracker.getPidFilePath(TaskTracker.java:430)
> at
> org.apache.hadoop.mapred.TaskTracker.removePidFile(TaskTracker.java:440)
> at
> org.apache.hadoop.mapred.JvmManager$JvmManagerForType$JvmRunner.runChild(JvmManager.java:370)
> at
> org.apache.hadoop.mapred.JvmManager$JvmManagerForType$JvmRunner.run(JvmManager.java:338)
> {noformat}
> (Have changed TaskTracker.java to print out the trace.)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
