I don't know that there are two many rules about this, but here's what comes to mind for me:
1. respect robots.txt 2. cache content so you don't hit their site more often than is reasonable. (i'd say that once a day is pretty reasonable) 3. also cache or mockup or something when you're writing your code, so you're not pounding them with live hits while you're working out the bugs. as far as legality, i'm gonna leave that to someone else. citation is, of course, a really good start. Ken On Sun, Oct 2, 2011 at 22:23, Nate Hill <nathanielh...@gmail.com> wrote: > A question: what are the 'rules' around screen scraping? > If one site doesn't offer an RSS feed and you want to grab (for example) > their weekly top ten list with a script and then redisplay it on another > site, is that bad form? Or even illegal? > Thanks- > Nate > > > -- > Nate Hill > nathanielh...@gmail.com > http://www.natehill.net >
