In getting Nutch 1.2 up and running with Hadoop should I be using the tutorial on the Nutch wiki (1), this tutorial link (2) or the link to the hadoop cluster setup (3)
I am using 2 desktops (one running Vista and one running XP) with Cygwin to execute commands and wish to experiment running a hadoop tutorial. I have Openssh installed with my Cygwin installation and can start sshd service fine on both desktops. Problem begins when I hit a quarter of the way through tutorial (1) when attempting to run the following ssh -l root Mcgibbney-PC mkdir /nutch mkdir /nutch/search mkdir /nutch/filesystem mkdir /nutch/local mkdir /nutch/home groupadd users useradd -d /nutch/home -g users nutch chown -R nutch:users /nutch passwd nutch nutchuserpassword as my output is as follows $ ssh -1 root Mcgibbney-PC ssh: Could not resolve hostname root: hostname nor servname provided, or not known Can anyone provide insight to how I can get past this hurdle. (1) http://wiki.apache.org/nutch/NutchHadoopTutorial (2) http://wiki.apache.org/nutch/Nutch0.9-Hadoop0.10-Tutorial?highlight=%28hadoop%29%7C%28tutorial%29 (3) http://hadoop.apache.org/common/docs/r0.20.2/cluster_setup.html ---------------------------------------------------------------------- Sorry file name should be mapred-site.xml. If it doesnt exist, You can create one and add the property as defined in below. Also in old version, Configuration can be defined in hadoop-site.xml, which is deprecated in hadoop-0.20. If you have already configured in hadoop-site.xml, Just make sure the following entry is in the right format <HOST>:<PORT> <configuration> <property> <name>mapred.job.tracker</name> <value>HOST:PAIR</value> </property> </configuration> Wiki to hadoop cluster setup. http://hadoop.apache.org/common/docs/r0.20.2/cluster_setup.html Thanks, Charan On Mon, Jan 24, 2011 at 12:00 PM, McGibbney, Lewis John < lewis.mcgibb...@gcu.ac.uk> wrote: > Hi Charan > > I have not touched mapred-config.xml and don't appear to have this file in > my conf directory within 1.2 dist! > > ________________________________________ > From: Charan K [charan.ku...@gmail.com] > Sent: 24 January 2011 17:49 > To: user@nutch.apache.org > Subject: Re: Hadoop Tutorial > > Hi > Can you verify if you set the job tracker entry in right format in > mapred-config.xml? > > Thanks, > Charan > > Sent from my iPhone > > On Jan 24, 2011, at 9:42 AM, "McGibbney, Lewis John" < > lewis.mcgibb...@gcu.ac.uk> wrote: > > > Hi list, > > > > I am using Nutch 1.2 and currently working my way through the Nutch and > Hadoop tutorial on the wiki for the first time. Not having much luck to date > and have reached the following part "So log into the master nodes and all of > the slave nodes as root." which I do not understand. Under > /logs/hadoop-...-jobtracker-...log I get the following > > > > > > 2011-01-24 16:55:08,008 ERROR mapred.JobTracker - > java.lang.RuntimeException: Not a host:port pair: local > > > > at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:136) > > > > at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:123) > > > > at org.apache.hadoop.mapred.JobTracker.getAddress(JobTracker.java:1807) > > > > at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:1579) > > > > at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:183) > > > > at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:175) > > > > at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:3702) > > > > 2011-01-24 16:57:01,233 ERROR mapred.JobTracker - > java.lang.RuntimeException: Not a host:port pair: local > > > > at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:136) > > > > at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:123) > > > > at org.apache.hadoop.mapred.JobTracker.getAddress(JobTracker.java:1807) > > > > at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:1579) > > > > at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:183) > > > > at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:175) > > > > at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:3702) > > > > > > > > I am pretty much stuck here so any help would be appreciated. Please > state whether I need to provide more information if this is not sufficient. > > > > > > > > Thanks > > > > Lewis > > > > Glasgow Caledonian University is a registered Scottish charity, number > SC021474 > > > > Winner: Times Higher Education's Widening Participation Initiative of the > Year 2009 and Herald Society's Education Initiative of the Year 2009 > > > http://www.gcu.ac.uk/newsevents/news/bycategory/theuniversity/1/name,6219,en.html > Email has been scanned for viruses by Altman Technologies' email management > service - www.altman.co.uk/emailsystems > > Glasgow Caledonian University is a registered Scottish charity, number > SC021474 > > Winner: Times Higher Education’s Widening Participation Initiative of the > Year 2009 and Herald Society’s Education Initiative of the Year 2009 > > http://www.gcu.ac.uk/newsevents/news/bycategory/theuniversity/1/name,6219,en.html > Email has been scanned for viruses by Altman Technologies' email management service - www.altman.co.uk/emailsystems Glasgow Caledonian University is a registered Scottish charity, number SC021474 Winner: Times Higher Education’s Widening Participation Initiative of the Year 2009 and Herald Society’s Education Initiative of the Year 2009 http://www.gcu.ac.uk/newsevents/news/bycategory/theuniversity/1/name,6219,en.html
