How to restrict outsider to use "wget" on my web-page?
--
#Joseph
--
gentoo-user@gentoo.org mailing list
Joseph wrote:
How to restrict outsider to use "wget" on my web-page?
Wget by default sends a User-Agent string of "Wget/" so you could,
for
example, configure Apache to send a "HTTP/1.1 404 Not Found" error (or something
else) for a specific page if the user agent is Wget.
Or you could alternativ
Peter Gordon wrote:
Wget (as far as I know) is very well-behaved in that it will follow any
restirctions imposed by a webserver's robots.txt file.
Sorry. I meant "restrictions". I hate it when I forget to use spell-check >_<
--
() The ASCII Ribbon Campaign - against HTML Email,
/\ vCards, and pro
On Fri, 2005-03-25 at 19:48 -0800, Peter Gordon wrote:
> Joseph wrote:
> > How to restrict outsider to use "wget" on my web-page?
>
> Wget by default sends a User-Agent string of "Wget/" so you could,
> for
> example, configure Apache to send a "HTTP/1.1 404 Not Found" error (or
> something
> e
On Fri, 25 Mar 2005 21:07:59 -0700 Joseph <[EMAIL PROTECTED]> wrote:
| How about the -U option "--user-agent=" in "wget" to change "wget user
| agent"; could it be used to defeat this purpose?
Yup. But then, no matter how clever you make your wget blocking, it'll
get circumvented if someone real
Joseph wrote:
How about the -U option "--user-agent=" in "wget" to change "wget user
agent"; could it be used to defeat this purpose?
Ah monkey. I forgot about that. >_<
I'd think it would still follow the robots.txt's
restrictions though...
--
() The ASCII Ribbon Campaign - against HTML Email,
Here's another possibility, you can restrict access by not allowing
people to view the directory listing.
If they were going to recursively wget your site they would need to
obtain a directory listing, if they cannot obtain a directory listing
then they have to know the name of each file that they
On Sat, 26 Mar 2005, David Post wrote:
> Here's another possibility, you can restrict access by not allowing
> people to view the directory listing.
> If they were going to recursively wget your site they would need to
> obtain a directory listing, if they cannot obtain a directory listing
> then
On Fri, 25 Mar 2005 20:35:13 -0700
Joseph <[EMAIL PROTECTED]> wrote:
> How to restrict outsider to use "wget" on my web-page?
You can add a robots.txt and put he following in it:
User-agent: Wget
Disallow: /
This will keep wget from working on it but still allow search engins
to catalog the page
