[
https://issues.apache.org/jira/browse/HADOOP-2260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12549391
]
Amareshwari Sri Ramadasu commented on HADOOP-2260:
--------------------------------------------------
Konstantin, after running the test on your machine, I noticed
FSEditLog.java:printStatistics is taking time.
The following logs show that fs.FSNamesystem
(FSEditLog.java:printStatistics(741)) is taking time, which is timing out the
job also, thereby failing the test.
[junit] 2007-11-28 00:56:50,097 WARN conf.Configuration
(Configuration.java:loadResource(808)) -
/home/hadoop/build/test/mapred/local/0_0/taskTracker/jobcache/job_200711280056_0001/job.xml:a
attempt to override final parameter: hadoop.tmp.dir; Ignoring.
[junit] 2007-11-28 00:57:02,146 INFO dfs.DataNode
(DataNode.java:readBlock(908)) - 127.0.0.1:50010Served block
blk_-7029027322613824567 to /127.0.0.1
[junit] 2007-11-28 00:59:48,902 INFO fs.FSNamesystem
(FSEditLog.java:printStatistics(741)) - Number of transactions: 26 Total time
for transactions(ms): 1 Number of syncs: 14 SyncTimes(ms): 7 5
took approximately 3 mins here.
[junit] 2007-11-28 01:04:36,903 WARN conf.Configuration
(Configuration.java:loadResource(808)) -
/home/hadoop/build/test/mapred/local/1_0/taskTracker/jobcache/job_200711280056_0001/job.xml:a
attempt to override final parameter: hadoop.tmp.dir; Ignoring.
[junit] 2007-11-28 01:04:37,772 INFO dfs.DataNode
(FSDataset.java:invalidate(740)) - Deleting block blk_-148340339789949624 file
/home/hadoop/build/test/data/dfs/data/data2/current/blk_-148340339789949624
[junit] 2007-11-28 01:08:25,304 INFO fs.FSNamesystem
(FSEditLog.java:printStatistics(741)) - Number of transactions: 38 Total time
for transactions(ms): 2 Number of syncs: 22 SyncTimes(ms): 711 748
took approximately 4 mins here.
[junit] 2007-11-28 01:09:17,650 INFO dfs.StateChange
(FSNamesystem.java:blocksToInvalidate(2821)) - BLOCK*
NameSystem.blockToInvalidate: ask 127.0.0.1:50010 to delete
blk_-5242484275070429080
[junit] 2007-11-28 01:09:18,541 INFO dfs.DataNode
(FSDataset.java:invalidate(740)) - Deleting block blk_-5242484275070429080 file
/home/hadoop/build/test/data/dfs/data/data1/current/blk_-5242484275070429080
[junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
[junit] Test org.apache.hadoop.mapred.TestMiniMRMapRedDebugScript FAILED
(timeout)
Timeout here.
> TestMiniMRMapRedDebugScript times out
> -------------------------------------
>
> Key: HADOOP-2260
> URL: https://issues.apache.org/jira/browse/HADOOP-2260
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.16.0
> Environment: Linux
> Reporter: Konstantin Shvachko
> Assignee: Amareshwari Sri Ramadasu
> Fix For: 0.16.0
>
> Attachments: Hadoop-2260.log, testrun-2260.log
>
>
> I am running TestMiniMRMapRedDebugScript from trunc.
> This is what I see in the stdout:
> {code}
> 2007-11-22 02:21:23,494 WARN conf.Configuration
> (Configuration.java:loadResource(808)) -
> hadoop/build/test/mapred/local/1_0/taskTracker/jobcache/job_200711220217_0001/task_200711220217_0001_m_000000_0/job.xml:a
> attempt to override final parameter: hadoop.tmp.dir; Ignoring.
> 2007-11-22 02:21:28,940 INFO jvm.JvmMetrics (JvmMetrics.java:init(56)) -
> Initializing JVM Metrics with processName=MAP, sessionId=
> 2007-11-22 02:22:09,504 INFO mapred.MapTask (MapTask.java:run(127)) -
> numReduceTasks: 0
> 2007-11-22 02:22:42,434 WARN mapred.TaskTracker
> (TaskTracker.java:main(1982)) - Error running child
> java.io.IOException
> at
> org.apache.hadoop.mapred.TestMiniMRMapRedDebugScript$MapClass.map(TestMiniMRMapRedDebugScript.java:41)
> at
> org.apache.hadoop.mapred.TestMiniMRMapRedDebugScript$MapClass.map(TestMiniMRMapRedDebugScript.java:35)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:192)
> at
> org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1977)
> {code}
> Stderr and debugout both say: Bailing out.
> BTW on Windows everything works just fine.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
