Ignore if you have already done this. But have you built all the plugins in src/plugin using the build.xml in that folder? If you have done that, and also pointed plugin.folders to the build folder and its still not working, then its quite likely because the plugin.xml's have not copied to the built plugins. The ant build.xml in src.plugin doesn't copy the plugin.xml for each plugin as it builds them. You can try hand-copying some of them to see if it works.
Most likely all the plugins are not getting loaded, and this throws a RuntimeException that Hadoop happily swallows and notes with a JobStatus.FAILED. As Bartosz suggests these are logged as WARNs in hadoop.log. Sanjoy -----Original Message----- From: Frank McCown [mailto:fmcc...@harding.edu] Sent: Friday, April 10, 2009 2:29 PM To: nutch-dev@lucene.apache.org Subject: Re: login failed exception Adding cygwin to my PATH solved my problem with whoami. But now I'm getting an exception when running the crawler: Injector: Converting injected urls to crawl db entries. Exception in thread "main" java.io.IOException: Job failed! at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1232) at org.apache.nutch.crawl.Injector.inject(Injector.java:160) at org.apache.nutch.crawl.Crawl.main(Crawl.java:114) I know from searching the mailing list that this is normally due to a bad plugin.folders setting in the nutch-default.xml, but I used the same value as the tutorial (./src/plugin) to no avail. (As an aside, seems like Hadoop should provide a better error message if the plugin folder doesn't exist.) Anyway, thanks, Bartosz, for your help. Frank 2009/4/10 Bartosz Gadzimski <bartek...@o2.pl>: > Hello, > > So now you have to install cygwin and be sure that you add it to PATH > > it's in http://wiki.apache.org/nutch/RunNutchInEclipse0.9 > > After this you should be able to run "bash" command from command prompt > (Menu Start > RUN > cmd.exe) > > Then you'r done - everything will be working. > > I must add it to wiki, I forgot about whoami problem. > > Take care, > Bartosz > > sanjoy.gh...@thomsonreuters.com pisze: >> >> Thanks for the suggestion Bartosz. I downloaded whoami, and It promptly >> crashed on "bash". >> >> 09/04/10 12:02:28 WARN fs.FileSystem: uri=file:/// >> javax.security.auth.login.LoginException: Login failed: Cannot run >> program "bash": CreateProcess error=2, The system cannot find the file >> specified >> at >> org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupI >> nformation.java:250) >> at >> org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupI >> nformation.java:275) >> at >> org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupI >> nformation.java:257) >> at >> org.apache.hadoop.security.UserGroupInformation.login(UserGroupInformati >> on.java:67) >> at >> org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1438) >> at >> org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1376) >> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:215) >> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:120) >> at org.apache.nutch.crawl.Crawl.main(Crawl.java:84) >> >> Where am I going to find "bash" on Windows without running commandline >> cygwin? Is there a way to turn off this security in Hadoop? >> >> Thanks, >> Sanjoy >> >> -----Original Message----- >> From: Bartosz Gadzimski [mailto:bartek...@o2.pl] Sent: Friday, April 10, >> 2009 5:06 AM >> To: nutch-dev@lucene.apache.org >> Subject: Re: login failed exception >> >> Hello, >> >> I am not sure if it's the case but you should try to add whoami to your >> windows box. >> >> for example for windows xp and sp2: >> http://www.microsoft.com/downloads/details.aspx?FamilyId=49AE8576-9BB9-4 >> 126-9761-BA8011FABF38&displaylang=en >> >> >> Thanks, >> Bartosz >> >> Frank McCown pisze: >> >>> >>> I've been running 0.9 in Eclipse on Windows for some time, and I was >>> successful in running the NutchBean from version 1.0 in Eclipse, but >>> the crawler gave me the same exception as it gave this individual. >>> Maybe there's something else I'm overlooking, but I followed the >>> Tutorial at >>> >>> http://wiki.apache.org/nutch/RunNutchInEclipse0.9 >>> >>> to a T. I'll keep working on it though. >>> >>> Frank >>> >>> >>> 2009/4/10 Bartosz Gadzimski <bartek...@o2.pl>: >>> >>>> >>>> fmccown pisze: >>>> >>>>> >>>>> You must run Nutch's crawler using cygwin on Windows since cygwin >>>>> >> >> has the >> >>>>> >>>>> whoami program. If you run it from Eclipse on Windows, it can't use >>>>> cygwin's whoami program and will fail with the exceptions you saw. >>>>> >> >> This >> >>>>> >>>>> is >>>>> an unfortunately design decision in Hadoop which makes anything >>>>> >> >> after >> >>>>> >>>>> version 9.0 not work in Eclipse on Windows. >>>>> >>>>> >>>>> >>>> >>>> It's not true, please look at >>>> http://wiki.apache.org/nutch/RunNutchInEclipse0.9 >>>> >>>> I am using nutch 1.0 with eclipse on windows with no problems. >>>> >>>> Thanks, >>>> Bartosz >>>> >>>> >>> >>> >> >> >> >> >
