> Actually, at the moment, the above will generate an error because apparently there is an unbalanced <a> tag somewhere on the web2py.com page.
Yes scraping real-life websites is frustrating because so much html is broken. In the end I achieved reasonable success with Beautifulsoup. However, I also understand that Scrapy is good and I was thinking of using that for a future project. > On Friday, May 3, 2013 3:15:55 AM UTC-4, Timmie wrote: >> >> Hello, >> is there an example how to use this: >> >> scraping utils >> https://groups.google.com/forum/?fromgroups=#!topic/web2py/skcc2ql3zOs >> >> in a controller? >> >> Especially the first lines (fetching the page and getting it into an >> element) is what I am looking for. >> >> >> The above example is made for the shell access. >> >> Thanks and kind regards, >> Timmie >> >> >> -- --- You received this message because you are subscribed to the Google Groups "web2py-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to web2py+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.
