I would use this:
#
# robots.txt file for a default Sambar Server
#
User-agent: *
Disallow: /poem
----- Original Message -----
From: "Chi Omega" <[EMAIL PROTECTED]>
To: <[EMAIL PROTECTED]>
Sent: Sunday, May 19, 2002 10:00 AM
Subject: [sambar] Search Engine {04] {01}
> Yes its the robot.txt, how do i make it
>
> i have a directory called /poem
> and i dont want the Search Engien to index that
>
> I have tryed to make a robots.txt, and placed it in
> the root, but i dont know if it work this is what i
> have writen in it
>
> # robots.txt for http://www.example.com/
>
> User-agent: *
> Disallow: /poem/ # This is an infinite virtual URL space
>
> Is that right ?
>
> Thanks for the help
>
> -------------------------------------------------------
> To unsubscribe please go to http://www.sambar.ch/list/
>
>
>
>
>
-------------------------------------------------------
To unsubscribe please go to http://www.sambar.ch/list/
