I tested that example as well and I'm getting the same exception with this
in stderr:
Hadoop Pipes Exception: failed to open hdfs://compute-0-7-2:54310/in/file
at
/home/scaino/hadoop-2.2.0-maven/hadoop-tools/hadoop-pipes/src/main/native/examples/impl/wordcount-nopipe.cc:82
in WordCountReader
I
I'm having similar problems with pipes, mostly because of issues with the
native shared libraries that leave the job stuck either at 0%-0% or before
launch (because the resource manager gets stuck as well and crashes).
I found that out by looking at the stderr logs by the way.
Let us know if you
Ok, I had some problems with configuration and host resolution and I fixed
them. I was able to run successfully the simple wordcount example, but I
failed running wordcount-nopipe.cc.
This is the stack trace:
Error: java.io.IOException: pipe child exception
at
Ok, I will try.
Il 13/dic/2013 19:23 Vinod Kumar Vavilapalli vino...@hortonworks.com ha
scritto:
Could it just be LocalJobRunner? Can you try it on a cluster? We've tested
pipes on clusters, so will be surprised if it doesn't work there.
Thanks,
+Vinod
On Dec 13, 2013, at 7:44 AM, Mauro
I installed hadoop 2.2.0 on a small cluster, just two nodes. I run a simple
wordcount in c++ with pipes, this time there was no exception, but the job
didn't finish. This is the output on the shell where I launched pipes:
mauro@mauro-VirtualBox:~/hadoop-2.2.0$ bin/mapred pipes -program wc -input
You should navigate to the ResourceManager UI following the link and see what
is happening on the ResourceManager as well as the application-master. Check if
any nodes are active first. Then look at ResourceManager and NodeManager logs.
+Vinod
On Dec 16, 2013, at 10:29 AM, Mauro Del Rio
Hi, I tried to run a simple test with pipes, but it crashes.
java.lang.Exception: java.lang.NullPointerException
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:403)
Caused by: java.lang.NullPointerException
at
Could it just be LocalJobRunner? Can you try it on a cluster? We've tested
pipes on clusters, so will be surprised if it doesn't work there.
Thanks,
+Vinod
On Dec 13, 2013, at 7:44 AM, Mauro Del Rio mdrio1...@gmail.com wrote:
Hi, I tried to run a simple test with pipes, but it crashes.