On 13/09/13 15:59, Paul Smith wrote:
So there are many tools out there but mechanize and scrapy 3rd party
modules seem to produce the best results; however nothing like these
exist for Python3. I get close but cannot produce the clean simple url
results in python3
Yes that's the biggest barrie
Attempting a simple web crawler in python3, browse a url -
collect/clean/produce valid url list from a url; random choice from valid
url list; visit new url repeat process - collect/clean/produce valid url
list from new url...
So there are many tools out there but mechanize and scrapy 3rd party
mo
