[ 
https://issues.apache.org/jira/browse/HADOOP-1596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12511928
 ] 

Konstantin Shvachko commented on HADOOP-1596:
---------------------------------------------

This is the result of changing job id    HADOOP-1473
The initial exception in TestSymLink is hard to find but it actually is this:

java.lang.NumberFormatException: For input string: "m"
        at 
java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
        at java.lang.Integer.parseInt(Integer.java:447)
        at java.lang.Integer.parseInt(Integer.java:497)
        at 
org.apache.hadoop.streaming.StreamUtil.getTaskInfo(StreamUtil.java:451)
        at 
org.apache.hadoop.streaming.PipeMapRed.setStreamJobDetails(PipeMapRed.java:190)
        at org.apache.hadoop.streaming.PipeMapRed.configure(PipeMapRed.java:132)
        at org.apache.hadoop.streaming.PipeMapper.configure(PipeMapper.java:61)
        at 
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:58)
        at 
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:82)
        at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:32)
        at 
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:58)
        at 
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:82)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:185)
        at 
org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1763)

After that the task remains not configured. And we see other exceptions NPE or 
"File does not exist".
So the problem is that streaming was not changed to correctly parse new task 
ids.

A more general problem with streaming is that it just dumps exceptions into 
stderr and proceeds like nothing happened.


> TestSymLink is failing
> ----------------------
>
>                 Key: HADOOP-1596
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1596
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/streaming
>            Reporter: Doug Cutting
>            Priority: Blocker
>             Fix For: 0.14.0
>
>
> TestSymLink started failing sometime today.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to