Re: [Tutor] Question about scraping

2014-05-31 Thread Joel Goldstick
On May 30, 2014 10:12 PM, "Matthew Ngaha" wrote: > > Thanks for the response Alan. I forgot to reply to tutor on my 2nd > comment. Just incase someone might want to see it, here it is: > > "Okay I think learning how to scrap (library or framework) is not > worth the trouble. Especially if some peo

Re: [Tutor] Question about scraping

2014-05-30 Thread Matthew Ngaha
Thanks for the response Alan. I forgot to reply to tutor on my 2nd comment. Just incase someone might want to see it, here it is: "Okay I think learning how to scrap (library or framework) is not worth the trouble. Especially if some people consider it illegal. Thanks for the input." _

Re: [Tutor] Question about scraping

2014-05-30 Thread ALAN GAULD
On Fri, May 30, 2014 at 7:20 PM, Alan Gauld wrote: > > >> If a site offers an API that returns the data you need then use it, >> If not you have few alternatives to scraping (although scraping >> may be 'illegal' anyway due to the impact on other users). But scraping, >> whether a web page or a GU

Re: [Tutor] Question about scraping

2014-05-30 Thread Alan Gauld
On 30/05/14 18:25, Matthew Ngaha wrote: Hey all. I've been meaning to get into web scraping and was pointed to the directions of lxml (library) and scrapy (framework). Can I ask in terms of web scraping, what's the difference between a library and a framework? I don;t know of anything web speci

[Tutor] Question about scraping

2014-05-30 Thread Matthew Ngaha
Hey all. I've been meaning to get into web scraping and was pointed to the directions of lxml (library) and scrapy (framework). Can I ask in terms of web scraping, what's the difference between a library and a framework? Surely everyone should use a framework but I get the idea more people use the