Hi !
How do I set the program to follow links out of the site requested to be
indexed ?
Regards,
Nelson
----- Original Message -----
From: "Alexander Barkov" <[EMAIL PROTECTED]>
To: "duncan" <[EMAIL PROTECTED]>
Cc: <[EMAIL PROTECTED]>
Sent: Tuesday, April 24, 2001 12:43 PM
Subject: Re: Webboard: Indexing only .iso files
> So does it work as expected now?
>
> duncan wrote:
> >
> > Getting close... here is a sample of the output if indexer -amv6
> >
> > Indexer[31338]: indexer from mnogosearch-3.1.12/UdmDB started with
> > '/home/mnogo/etc/indexer.conf' Indexer[31338]: [1]
> > http://www.redhat.com/robots.txt
> > Indexer[31338]: [1] Server 'http://www.redhat.com/download/'
> > Indexer[31338]: [1] HrefOnly NoCase *
> > ...
> > Indexer[31338]: [1] "/apps/download/": HrefOnly NoCase *
> > Indexer[31338]: [1] Skip "/apps/download/" : no Server
> > Indexer[31338]: [1] "/download/howto_download.html": HrefOnly NoCase *
> > Indexer[31338]: [1] "/download/mirror.html": HrefOnly NoCase *
> > Indexer[31338]: [1] "/apps/download/beta/": HrefOnly NoCase *
> > Indexer[31338]: [1] Skip "/apps/download/beta/" : no Server
> > Indexer[31338]: [1]
> > "ftp://ftp.crc.ca/pub/systems/linux/redhat/ftp.redhat.com": HrefOnly
> > NoCase *Indexer[31338]: [1] Skip
> > "ftp://ftp.crc.ca/pub/systems/linux/redhat/ftp.redhat.com"; : no Server
> > Indexer[31338]: [1]
> > "ftp://ftp.crc.ca/pub/systems/linux/redhat/ftp.redhat.com/updates":
> > HrefOnly NoCase *
> > Indexer[31338]: [1] Skip
> > "ftp://ftp.crc.ca/pub/systems/linux/redhat/ftp.redhat.com/updates"; : no
> > Server
> > Indexer[31338]: [1]
> > "ftp://ftp.crc.ca/pub/systems/linux/redhat/contrib.redhat.com": HrefOnly
> > NoCase *
> > Indexer[31338]: [1] Skip
> > "ftp://ftp.crc.ca/pub/systems/linux/redhat/contrib.redhat.com"; : no
Server
> > Indexer[31338]: [1] "ftp://ftp.muug.mb.ca/mirror/redhat/redhat":
HrefOnly
> > NoCase *
> > Indexer[31338]: [1] Skip "ftp://ftp.muug.mb.ca/mirror/redhat/redhat"; :
no
> > Server
> > Indexer[31338]: [1] "ftp://ftp.muug.mb.ca/mirror/redhat/redhat/updates":
> > HrefOnly NoCase *
> > Indexer[31338]: [1] Skip
> > "ftp://ftp.muug.mb.ca/mirror/redhat/redhat/updates"; : no Server
> > Indexer[31338]: [1] "ftp://ftp.muug.mb.ca/mirror/redhat-contrib":
HrefOnly
> > NoCase *
> > Indexer[31338]: [1] Skip "ftp://ftp.muug.mb.ca/mirror/redhat-contrib"; :
no
> > Server
> > Indexer[31338]: [1]
> > "ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com":
> > HrefOnly NoCase *
> > Indexer[31338]: [1] Skip
> > "ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com"; : no
> > Server
> > Indexer[31338]: [1]
> >
"ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com/redhat/upd
ates":
> > HrefOnly NoCase *
> > Indexer[31338]: [1] Skip
> >
"ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com/redhat/upd
ates"
> > : no Server
> > Indexer[31338]: [1]
> >
"ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com/contrib":
> > HrefOnly NoCase *
> > Indexer[31338]: [1] Skip
> >
"ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com/contrib";
> > : no Server
> > Indexer[31338]: [1] "ftp://redhat.eyetap.org/": HrefOnly NoCase *
> > Indexer[31338]: [1] Skip "ftp://redhat.eyetap.org/"; : no Server
> > Indexer[31338]: [1] "ftp://redhat.eyetap.org/updates": HrefOnly NoCase
*
> > Indexer[31338]: [1] Skip "ftp://redhat.eyetap.org/updates"; : no Server
> > Indexer[31338]: [1] "ftp://redhat.eyetap.org/contrib": HrefOnly NoCase
*
> > Indexer[31338]: [1] Skip "ftp://redhat.eyetap.org/contrib"; : no Server
> >
> > thank you again, i really appreciate your help!
> >
> > duncan
> >
> > On Tue, 24 Apr 2001, Alexander Barkov wrote:
> >
> > > Try this combination instead of your one:
> > >
> > > Allow *.iso
> > > HrefOnly *
> > >
> > >
> > >
> > >
> > > duncan wrote:
> > > >
> > > > Here is the output:
> > > >
> > > > Indexer[31136]: indexer from mnogosearch-3.1.12/UdmDB started with
> > > > '/home/mnogo/etc/indexer.conf'
> > > > Indexer[31136]: [1] http://www.redhat.com/robots.txt
> > > > Indexer[31136]: [1] Server 'http://www.redhat.com/download/'
> > > > Indexer[31136]: [1] Disallow NoCase *
> > > > Indexer[31136]: [1] http://www.redhat.com/download/mirror.html
> > > > Indexer[31136]: [1] Server 'http://www.redhat.com/download/'
> > > > Indexer[31136]: [1] Disallow NoCase *
> > > > Indexer[31136]: [1] Done (0 seconds)
> > > >
> > > > thank you!
> > > >
> > > > On Tue, 24 Apr 2001, Alexander Barkov wrote:
> > > >
> > > > > Please run
> > > > >
> > > > > indexer -amv6
> > > > >
> > > > > and check it's output. It will print an information about all
> > > > > found links.
> > > > >
> > > > >
> > > > > duncan wrote:
> > > > > >
> > > > > > Hello, and thanks matthew-
> > > > > >
> > > > > > I tried what you suggested, and in fact, here is the whole conf
file:
> > > > > >
> > > > > > Allow */
> > > > > > CheckOnly *.iso
> > > > > > Disallow *
> > > > > >
> > > > > > Server http://www.redhat.com/download/mirror.html
> > > > > >
> > > > > > and it only returns this:
> > > > > >
> > > > > > Indexer[30131]: indexer from mnogosearch-3.1.12/UdmDB started
with
> > > > > > '/home/mnogo/etc/indexer.conf'
> > > > > > Indexer[30131]: [1] http://www.redhat.com/robots.txt
> > > > > > Indexer[30131]: [1] http://www.redhat.com/download/mirror.html
> > > > > > Indexer[30131]: [1] Done (0 seconds)
> > > > > >
> > > > > > Something isint right there, and I dont know where to do with
it. I feel
> > > > > > like i try so many things... is there more doc. out there, or
more
> > > > > > examples?
> > > > > >
> > > > > > thnaks, i appreciate your response
> ___________________________________________
> If you want to unsubscribe send "unsubscribe general"
> to [EMAIL PROTECTED]
>
___________________________________________
If you want to unsubscribe send "unsubscribe general"
to [EMAIL PROTECTED]
