You wouldn't be trying to run the bin/nutch script that is downloaded directly 
via SVN vs. the one included in the build directory would you?
 
The SVN downloaded version would load all the libs, since they are part of the 
download also, but the plugins directory wouldn't be there, that's only in the 
directory structure that was created by "ant package".

 
Looking at your errors, it only seems to be related to plugins not loading, as 
apposed to Hadoop or something else.

 
----- Original Message ----
From: Gal Nitzan <[EMAIL PROTECTED]>
To: [email protected]
Sent: Friday, January 19, 2007 4:44:40 AM
Subject: notch 0.9 + hadoop 0.10.1 problem


Hi,

Just upgraded to latest trunk and I get consistent errors: so I think I have
a classpath problem. However I added nutch classes in the bin/hadoop and
when checking the task/jobtracker classpath using ps -ef|grep java I can see
the libs and all exists in the -classpath.

Any idea what am I doing wrong?

For parsing a segment (bin/nutch parse) I get
java.lang.RuntimeException: org.apache.nutch.scoring.ScoringFilter not
found.
    at org.apache.nutch.scoring.ScoringFilters.(ScoringFilters.java:60)
    at
org.apache.nutch.parse.ParseSegment.configure(ParseSegment.java:55)
    at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:50)
    at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:70)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
    at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:50)
    at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:70)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:178)
    at
org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1367)

However the scoring filter does exists in the build/plugins 

For inject :
java.lang.RuntimeException: x point org.apache.nutch.net.URLNormalizer not
found.
    at org.apache.nutch.net.URLNormalizers.(URLNormalizers.java:120)
    at
org.apache.nutch.crawl.Injector$InjectMapper.configure(Injector.java:57)
    at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:50)
    at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:70)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
    at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:50)
    at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:70)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:178)
    at
org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1367)
-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
Nutch-general mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nutch-general

Reply via email to