Thanks for the help
----- Original Message -----
From: "Peter" <[EMAIL PROTECTED]>
To: <[EMAIL PROTECTED]>
Sent: Sunday, May 19, 2002 6:08 PM
Subject: [sambar] Search Engine {04] {02}
> I would use this:
>
> #
> # robots.txt file for a default Sambar Server
> #
> User-agent: *
> Disallow: /poem
>
> ----- Original Message -----
> From: "Chi Omega" <[EMAIL PROTECTED]>
> To: <[EMAIL PROTECTED]>
> Sent: Sunday, May 19, 2002 10:00 AM
> Subject: [sambar] Search Engine {04] {01}
>
>
> > Yes its the robot.txt, how do i make it
> >
> > i have a directory called /poem
> > and i dont want the Search Engien to index that
> >
> > I have tryed to make a robots.txt, and placed it in
> > the root, but i dont know if it work this is what i
> > have writen in it
> >
> > # robots.txt for http://www.example.com/
> >
> > User-agent: *
> > Disallow: /poem/ # This is an infinite virtual URL space
> >
> > Is that right ?
> >
> > Thanks for the help
> >
> > -------------------------------------------------------
> > To unsubscribe please go to http://www.sambar.ch/list/
> >
> >
> >
> >
> >
>
> -------------------------------------------------------
> To unsubscribe please go to http://www.sambar.ch/list/
>
>
>
>
-------------------------------------------------------
To unsubscribe please go to http://www.sambar.ch/list/
