On 2026-01-24, ivy86 <[email protected]> wrote: > On Fri, 23 Jan 2026 23:34:37 +0100 > Страхиња Радић <[email protected]> wrote: > >> Дана 26/01/23 11:44AM, Adam Van Ymeren написа: >> > I followed a link from undeadly.org and got redirected to the aptly >> > named theannoyingsite.com >> > >> > Suffice to say this is pretty annoying, and in my opinion hurts the >> > credibility of the project and of sites like undeadly.org that try >> > to link to interesting things. >> > >> > This appears to be intentional based upon whether some stale ipk= >> > param is in the url. >> >> It also happens when the browser doesn't supply the referrer header. >> >> https://marc.info/?t=176402576800001&r=1&w=2 >> https://marc.info/?l=openbsd-misc&m=176406809623993&w=2 >> https://marc.info/?l=openbsd-misc&m=176408086402658&w=2 >> >> tl;dr: It's an anti-spam/anti-scraping measure. >> > > Some scrapers, like Wget's recursive mode, send out referers by > default, making this ineffective.
wget's recursive mode follows robots.txt (unless patched; there's no cli option) so it won't be fetching from cvsweb anyway. -- Please keep replies on the mailing list.
