Re: kmeans

2011-02-26 Thread Varadharajan Mukundan
Hi, > I m facing a problem...I m not able to run the kmeans clustering algo > on a singls node...till now I have just run the wordcount > program...what are the steps in doing so??? please give more information on problem you are facing (error, log entries etc). -- Thanks, M. Varadharajan

Regarding chaining multiple map-reduce jobs in Hadoop streaming

2011-01-07 Thread Varadharajan Mukundan
Hi, I need to chain a couple of mapreduce jobs in Hadoop streaming. i am planning to use python to write the mapper and reducer scripts. is there any other way to chain these jobs other than using a shell script and a temporary directory in HDFS? -- Thanks, M. Varadharajan -

Re: exceptions copying files into HDFS

2010-12-12 Thread Varadharajan Mukundan
HI, > jps reports DataNode, NameNode, and SecondayNameNode as running: > > r...@ritter:/tmp/hadoop-rock> jps > 31177 Jps > 29909 DataNode > 29751 NameNode > 30052 SecondaryNameNode In master node, the output of the "JPS" will contain a tasktracker, jobtracker, namenode, secondary namenode, datano

Re: exceptions copying files into HDFS

2010-12-11 Thread Varadharajan Mukundan
Hi, > org.apache.hadoop.ipc.RemoteException: java.io.IOException: File > /user/rock/input/fair-scheduler.xml could only be replicated to 0 nodes, > instead of 1 I think none of your datanodes are actually running. why not use jps and make sure whether they are running. Also check the datanode log