Re: pipes on hadoop 2.2.0 crashes

2013-12-18 Thread Silvina Caíno Lores
I tested that example as well and I'm getting the same exception with this in stderr: Hadoop Pipes Exception: failed to open hdfs://compute-0-7-2:54310/in/file at /home/scaino/hadoop-2.2.0-maven/hadoop-tools/hadoop-pipes/src/main/native/examples/impl/wordcount-nopipe.cc:82 in WordCountReader I

Re: pipes on hadoop 2.2.0 crashes

2013-12-17 Thread Silvina Caíno Lores
I'm having similar problems with pipes, mostly because of issues with the native shared libraries that leave the job stuck either at 0%-0% or before launch (because the resource manager gets stuck as well and crashes). I found that out by looking at the stderr logs by the way. Let us know if you

Re: pipes on hadoop 2.2.0 crashes

2013-12-17 Thread Mauro Del Rio
Ok, I had some problems with configuration and host resolution and I fixed them. I was able to run successfully the simple wordcount example, but I failed running wordcount-nopipe.cc. This is the stack trace: Error: java.io.IOException: pipe child exception at

Re: pipes on hadoop 2.2.0 crashes

2013-12-16 Thread Mauro Del Rio
Ok, I will try. Il 13/dic/2013 19:23 Vinod Kumar Vavilapalli vino...@hortonworks.com ha scritto: Could it just be LocalJobRunner? Can you try it on a cluster? We've tested pipes on clusters, so will be surprised if it doesn't work there. Thanks, +Vinod On Dec 13, 2013, at 7:44 AM, Mauro

Re: pipes on hadoop 2.2.0 crashes

2013-12-16 Thread Mauro Del Rio
I installed hadoop 2.2.0 on a small cluster, just two nodes. I run a simple wordcount in c++ with pipes, this time there was no exception, but the job didn't finish. This is the output on the shell where I launched pipes: mauro@mauro-VirtualBox:~/hadoop-2.2.0$ bin/mapred pipes -program wc -input

Re: pipes on hadoop 2.2.0 crashes

2013-12-16 Thread Vinod Kumar Vavilapalli
You should navigate to the ResourceManager UI following the link and see what is happening on the ResourceManager as well as the application-master. Check if any nodes are active first. Then look at ResourceManager and NodeManager logs. +Vinod On Dec 16, 2013, at 10:29 AM, Mauro Del Rio

pipes on hadoop 2.2.0 crashes

2013-12-13 Thread Mauro Del Rio
Hi, I tried to run a simple test with pipes, but it crashes. java.lang.Exception: java.lang.NullPointerException at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:403) Caused by: java.lang.NullPointerException at

Re: pipes on hadoop 2.2.0 crashes

2013-12-13 Thread Vinod Kumar Vavilapalli
Could it just be LocalJobRunner? Can you try it on a cluster? We've tested pipes on clusters, so will be surprised if it doesn't work there. Thanks, +Vinod On Dec 13, 2013, at 7:44 AM, Mauro Del Rio mdrio1...@gmail.com wrote: Hi, I tried to run a simple test with pipes, but it crashes.