[
https://issues.apache.org/jira/browse/HADOOP-1596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12511928
]
Konstantin Shvachko commented on HADOOP-1596:
---------------------------------------------
This is the result of changing job id HADOOP-1473
The initial exception in TestSymLink is hard to find but it actually is this:
java.lang.NumberFormatException: For input string: "m"
at
java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
at java.lang.Integer.parseInt(Integer.java:447)
at java.lang.Integer.parseInt(Integer.java:497)
at
org.apache.hadoop.streaming.StreamUtil.getTaskInfo(StreamUtil.java:451)
at
org.apache.hadoop.streaming.PipeMapRed.setStreamJobDetails(PipeMapRed.java:190)
at org.apache.hadoop.streaming.PipeMapRed.configure(PipeMapRed.java:132)
at org.apache.hadoop.streaming.PipeMapper.configure(PipeMapper.java:61)
at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:58)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:82)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:32)
at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:58)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:82)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:185)
at
org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1763)
After that the task remains not configured. And we see other exceptions NPE or
"File does not exist".
So the problem is that streaming was not changed to correctly parse new task
ids.
A more general problem with streaming is that it just dumps exceptions into
stderr and proceeds like nothing happened.
> TestSymLink is failing
> ----------------------
>
> Key: HADOOP-1596
> URL: https://issues.apache.org/jira/browse/HADOOP-1596
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Reporter: Doug Cutting
> Priority: Blocker
> Fix For: 0.14.0
>
>
> TestSymLink started failing sometime today.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.