A question: what are the 'rules' around screen scraping?
If one site doesn't offer an RSS feed and you want to grab (for example)
their weekly top ten list with a script and then redisplay it on another
site, is that bad form? Or even illegal?
Thanks-
Nate
--
Nate Hill
nathanielh...@gmail.com
h
It's only illegal if you respect the authority of the HTTPolice*.
-Mike
* OCLC
On Sun, Oct 2, 2011 at 22:23, Nate Hill wrote:
> A question: what are the 'rules' around screen scraping?
> If one site doesn't offer an RSS feed and you want to grab (for example)
> their weekly top ten list with a
In Canada, the BC Supreme Court ruled that screen scrapping real estate
listings from one site and using them on another indeed infringed on copyright.
Not sure if this would cover your use -- but if you are coming from Canada, it
might be something to consider.
Decision URL:
http://www.canli
I don't know that there are two many rules about this, but here's what comes to
mind for me:
1. respect robots.txt
2. cache content so you don't hit their site more often than is reasonable.
(i'd say that once a day is pretty reasonable)
3. also cache or mockup or something when you're writing y
At Sun, 2 Oct 2011 19:23:09 -0700,
Nate Hill wrote:
>
> A question: what are the 'rules' around screen scraping?
> If one site doesn't offer an RSS feed and you want to grab (for example)
> their weekly top ten list with a script and then redisplay it on another
> site, is that bad form? Or even i
On 10/2/2011 10:23 PM, Nate Hill wrote:
A question: what are the 'rules' around screen scraping?
If one site doesn't offer an RSS feed and you want to grab (for example)
their weekly top ten list with a script and then redisplay it on another
site, is that bad form? Or even illegal?
If the sit
I think what I'm hearing here is that it would be a good idea to ask a
webmaster on the other end if it's OK.
Advertising... Roberto, good point I hadn't thought of that. Thanks.
On Sun, Oct 2, 2011 at 7:46 PM, Roberto Hoyle wrote:
> On 10/2/2011 10:23 PM, Nate Hill wrote:
>
>> A question: what
I don’t know how well this applies to your specific use of screen-scraping, but
for libraries’ broader use of crawlers to build archives, the Section 108 Study
Group Recommendations are a good source of guidance (though not law). They
propose specific copyright exceptions for libraries in regar
For public use, I'd Ask the Webmaster as a courtesy -- regardless of
legality. After all, it is (presumably) their content and they should have
some say in whether it appears on another site. If my content were used to
drive traffic at another site, I'd probably want to know who and where,
etc.
