Hello Folks,
I am trying to run a simplistic Hadoop pipes program (the typical
wordcount example). Unfortunately I am seeing a bunch of errors while
running it as follows:
$ bin/hadoop pipes -Dhadoop.pipes.java.recordreader=true \
-Dhadoop.pipes.java.recordwriter=true \
-input <inputHDFSPath> \
-output <outputHDFSPath> \
-program <cppBinaryHDFSPath>
This is resulting in a NullPointerException:
java.io.IOException: pipe child exception
at
org.apache.hadoop.mapred.pipes.Application.abort(Application.java:160)
at
org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:102)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:397)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
at org.apache.hadoop.mapred.Child$4.run(Child.java:217)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:742)
at org.apache.hadoop.mapred.Child.main(Child.java:211)
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:86)
... 7 more
More details have been posted here: http://goo.gl/GMy8Q
It would be great if someone could point me in the right direction.
Thanks in advance!!
Regards,
DP