hi,
I follow the nutch08 tutorial. The step to do crawling is "inject,
generator, fetch, update".
But there is a command in nutch/bin, called "parse", which parse a segment's
page. I wonder if I should use it before "update" in the above steps.
Currently, I didn't use "parse" cmd and "update" still see the parsed
outlinks. Seems some kind of parsing is already done in "fetch" step.
thanks,
Michael,
-------------------------------------------------------------------------
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
_______________________________________________
Nutch-general mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nutch-general
