Directory /tmp/hadoop-root/dfs/name is in an inconsistent state: storage directory DOES NOT exist or is NOT accesible

2010-05-12 Thread Michael Robinson
what are their names Thank you Michael Robinson

Directory /tmp/hadoop-root/dfs/name is in an inconsistent state: storage directory DOES NOT exist or is NOT accesible

2010-05-12 Thread Michael Robinson
what are their names Thank you Michael Robinson

calling C programs from Hadoop

2010-05-29 Thread Michael Robinson
I am new to Hadoop. I have successfully run java programs from Hadoop and I would like to call C programs from Hadoop. Thank you for your help Michael -- View this message in context: http://lucene.472066.n3.nabble.com/calling-C-programs-from-Hadoop-tp854833p854833.html Sent from the Hadoop lu

Re: calling C programs from Hadoop

2010-05-29 Thread Michael Robinson
Owen, Where do I find information about PIPES Thanks much Michael -- View this message in context: http://lucene.472066.n3.nabble.com/calling-C-programs-from-Hadoop-tp854833p855152.html Sent from the Hadoop lucene-users mailing list archive at Nabble.com.

Re: calling C programs from Hadoop

2010-05-29 Thread Michael Robinson
Asif, Thanks very much for your help, I found and downloaded hadoop streaming Michael -- View this message in context: http://lucene.472066.n3.nabble.com/calling-C-programs-from-Hadoop-tp854833p855163.html Sent from the Hadoop lucene-users mailing list archive at Nabble.com.

Re: calling C programs from Hadoop

2010-05-29 Thread Michael Robinson
Thanks for your answers. I have read "hadoop streaming" and I think it is great, however what I am trying to do is to run a C program that I have with its own data, and have hadoop do the scheduling and make it run in multiple nodes as a distributed system. The process I need to do does NOT do m

Re: calling C programs from Hadoop

2010-05-29 Thread Michael Robinson
Thanks for your answers. I have read "hadoop streaming" and I think it is great, however what I am trying to do is to run a C program that I have with its own data, and have hadoop do the scheduling and make it run in multiple nodes as a distributed system. The process I need to do does NOT do m

Re: calling C programs from Hadoop

2010-05-31 Thread Michael Robinson
Hi Brian, Yes, it is a batch process. I am using Ubuntu Linux, can you tell me how to open the p7s file you send me? I googled for p7s viewer and it seems they work on windows and mac only. Thanks Michael -- View this message in context: http://lucene.472066.n3.nabble.com/calling-C-programs

Re: calling C programs from Hadoop

2010-05-31 Thread Michael Robinson
Hi Jef, I have a C program that processes very large data files which are compressed, so this program has to have full control of the process. However the input data can be broken down into chunks, and a separate (distributed) process for each chunk can be run, which what I am doing now, but I am

Re: calling C programs from Hadoop

2010-05-31 Thread Michael Robinson
Jeff, Reading "Hadoof Streaming" I found the following: "How Does Streaming Work In the above example, both the mapper and the reducer are executables that read the input from stdin (line by line) and emit the output to stdout. The utility will create a Map/Reduce job, submit the job to an appro

where is hadoop-streaming?

2010-06-12 Thread Michael Robinson
I am new to hadoop. downloaded version 0.20.2 and installed it on local mode. Run wordcount examples and others successfully, however, I am trying to run the hadoop-streaming example: $HADOOP_HOME/bin/hadoop jar $HADOOP_HOME/hadoop-streaming.jar \ -input myInputDirs \ -output myOutputDi

Re: where is hadoop-streaming?

2010-06-12 Thread Michael Robinson
Ted, Thanks, do you know is there is a way to update the hadoop documentation adding this information to save hours of time to the next persons with the same problem? Thanks again Michael -- View this message in context: http://lucene.472066.n3.nabble.com/where-is-hadoop-streaming-tp891281p89

PipeMapRed.waitOutputThreads(): subprocess failed with code 50

2010-06-19 Thread Michael Robinson
I am new to hadoop and I am experimenting with hadoop-streaming. I run this task: bin/hadoop jar hadoop-streaming.jar -input pa01.idx -output outputTestDirC -mapper cat -reducer mywc.exe and I am getting this error: PipeMapRed.waitOutputThreads(): subprocess failed with code 50 If there a place