Re: Webboard: Indexing only .iso files
The matter is that the "follow outside" flag isn't available in the windows interface ! - Original Message - From: "Alexander Barkov" <[EMAIL PROTECTED]> To: <[EMAIL PROTECTED]>; "La Rocca Network" <[EMAIL PROTECTED]> Sent: Saturday, April 28, 2001 5:13 AM Subject: Re: Webboard: Indexing only .iso files > Take a look into doc/follow.txt > > > > La Rocca Network wrote: > > > > Hi ! > > > > How do I set the program to follow links out of the site requested to be > > indexed ? > > > > Regards, > > Nelson > > > > - Original Message - > > From: "Alexander Barkov" <[EMAIL PROTECTED]> > > To: "duncan" <[EMAIL PROTECTED]> > > Cc: <[EMAIL PROTECTED]> > > Sent: Tuesday, April 24, 2001 12:43 PM > > Subject: Re: Webboard: Indexing only .iso files > > > > > So does it work as expected now? > > > > > > duncan wrote: > > > > > > > > Getting close... here is a sample of the output if indexer -amv6 > > > > > > > > Indexer[31338]: indexer from mnogosearch-3.1.12/UdmDB started with > > > > '/home/mnogo/etc/indexer.conf' Indexer[31338]: [1] > > > > http://www.redhat.com/robots.txt > > > > Indexer[31338]: [1] Server 'http://www.redhat.com/download/' > > > > Indexer[31338]: [1] HrefOnly NoCase * > > > > ... > > > > Indexer[31338]: [1] "/apps/download/": HrefOnly NoCase * > > > > Indexer[31338]: [1] Skip "/apps/download/" : no Server > > > > Indexer[31338]: [1] "/download/howto_download.html": HrefOnly NoCase * > > > > Indexer[31338]: [1] "/download/mirror.html": HrefOnly NoCase * > > > > Indexer[31338]: [1] "/apps/download/beta/": HrefOnly NoCase * > > > > Indexer[31338]: [1] Skip "/apps/download/beta/" : no Server > > > > Indexer[31338]: [1] > > > > "ftp://ftp.crc.ca/pub/systems/linux/redhat/ftp.redhat.com": HrefOnly > > > > NoCase *Indexer[31338]: [1] Skip > > > > "ftp://ftp.crc.ca/pub/systems/linux/redhat/ftp.redhat.com"; : no Server > > > > Indexer[31338]: [1] > > > > "ftp://ftp.crc.ca/pub/systems/linux/redhat/ftp.redhat.com/updates": > > > > HrefOnly NoCase * > > > > Indexer[31338]: [1] Skip > > > > "ftp://ftp.crc.ca/pub/systems/linux/redhat/ftp.redhat.com/updates"; : no > > > > Server > > > > Indexer[31338]: [1] > > > > "ftp://ftp.crc.ca/pub/systems/linux/redhat/contrib.redhat.com": HrefOnly > > > > NoCase * > > > > Indexer[31338]: [1] Skip > > > > "ftp://ftp.crc.ca/pub/systems/linux/redhat/contrib.redhat.com"; : no > > Server > > > > Indexer[31338]: [1] "ftp://ftp.muug.mb.ca/mirror/redhat/redhat": > > HrefOnly > > > > NoCase * > > > > Indexer[31338]: [1] Skip "ftp://ftp.muug.mb.ca/mirror/redhat/redhat"; : > > no > > > > Server > > > > Indexer[31338]: [1] "ftp://ftp.muug.mb.ca/mirror/redhat/redhat/updates": > > > > HrefOnly NoCase * > > > > Indexer[31338]: [1] Skip > > > > "ftp://ftp.muug.mb.ca/mirror/redhat/redhat/updates"; : no Server > > > > Indexer[31338]: [1] "ftp://ftp.muug.mb.ca/mirror/redhat-contrib": > > HrefOnly > > > > NoCase * > > > > Indexer[31338]: [1] Skip "ftp://ftp.muug.mb.ca/mirror/redhat-contrib"; : > > no > > > > Server > > > > Indexer[31338]: [1] > > > > "ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com": > > > > HrefOnly NoCase * > > > > Indexer[31338]: [1] Skip > > > > "ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com"; : no > > > > Server > > > > Indexer[31338]: [1] > > > > > > "ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com/redhat/upd > > ates": > > > > HrefOnly NoCase * > > > > Indexer[31338]: [1] Skip > > > > > > "ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com/redhat/upd > > ates" > > > > : no Server > > > > Indexer[31338]: [1] > > > > > > "ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com/contrib": > > > > HrefOnly NoCase * > > > > Indexer[31338]: [1]
Re: Webboard: Indexing only .iso files
Take a look into doc/follow.txt La Rocca Network wrote: > > Hi ! > > How do I set the program to follow links out of the site requested to be > indexed ? > > Regards, > Nelson > > - Original Message - > From: "Alexander Barkov" <[EMAIL PROTECTED]> > To: "duncan" <[EMAIL PROTECTED]> > Cc: <[EMAIL PROTECTED]> > Sent: Tuesday, April 24, 2001 12:43 PM > Subject: Re: Webboard: Indexing only .iso files > > > So does it work as expected now? > > > > duncan wrote: > > > > > > Getting close... here is a sample of the output if indexer -amv6 > > > > > > Indexer[31338]: indexer from mnogosearch-3.1.12/UdmDB started with > > > '/home/mnogo/etc/indexer.conf' Indexer[31338]: [1] > > > http://www.redhat.com/robots.txt > > > Indexer[31338]: [1] Server 'http://www.redhat.com/download/' > > > Indexer[31338]: [1] HrefOnly NoCase * > > > ... > > > Indexer[31338]: [1] "/apps/download/": HrefOnly NoCase * > > > Indexer[31338]: [1] Skip "/apps/download/" : no Server > > > Indexer[31338]: [1] "/download/howto_download.html": HrefOnly NoCase * > > > Indexer[31338]: [1] "/download/mirror.html": HrefOnly NoCase * > > > Indexer[31338]: [1] "/apps/download/beta/": HrefOnly NoCase * > > > Indexer[31338]: [1] Skip "/apps/download/beta/" : no Server > > > Indexer[31338]: [1] > > > "ftp://ftp.crc.ca/pub/systems/linux/redhat/ftp.redhat.com": HrefOnly > > > NoCase *Indexer[31338]: [1] Skip > > > "ftp://ftp.crc.ca/pub/systems/linux/redhat/ftp.redhat.com"; : no Server > > > Indexer[31338]: [1] > > > "ftp://ftp.crc.ca/pub/systems/linux/redhat/ftp.redhat.com/updates": > > > HrefOnly NoCase * > > > Indexer[31338]: [1] Skip > > > "ftp://ftp.crc.ca/pub/systems/linux/redhat/ftp.redhat.com/updates"; : no > > > Server > > > Indexer[31338]: [1] > > > "ftp://ftp.crc.ca/pub/systems/linux/redhat/contrib.redhat.com": HrefOnly > > > NoCase * > > > Indexer[31338]: [1] Skip > > > "ftp://ftp.crc.ca/pub/systems/linux/redhat/contrib.redhat.com"; : no > Server > > > Indexer[31338]: [1] "ftp://ftp.muug.mb.ca/mirror/redhat/redhat": > HrefOnly > > > NoCase * > > > Indexer[31338]: [1] Skip "ftp://ftp.muug.mb.ca/mirror/redhat/redhat"; : > no > > > Server > > > Indexer[31338]: [1] "ftp://ftp.muug.mb.ca/mirror/redhat/redhat/updates": > > > HrefOnly NoCase * > > > Indexer[31338]: [1] Skip > > > "ftp://ftp.muug.mb.ca/mirror/redhat/redhat/updates"; : no Server > > > Indexer[31338]: [1] "ftp://ftp.muug.mb.ca/mirror/redhat-contrib": > HrefOnly > > > NoCase * > > > Indexer[31338]: [1] Skip "ftp://ftp.muug.mb.ca/mirror/redhat-contrib"; : > no > > > Server > > > Indexer[31338]: [1] > > > "ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com": > > > HrefOnly NoCase * > > > Indexer[31338]: [1] Skip > > > "ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com"; : no > > > Server > > > Indexer[31338]: [1] > > > > "ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com/redhat/upd > ates": > > > HrefOnly NoCase * > > > Indexer[31338]: [1] Skip > > > > "ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com/redhat/upd > ates" > > > : no Server > > > Indexer[31338]: [1] > > > > "ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com/contrib": > > > HrefOnly NoCase * > > > Indexer[31338]: [1] Skip > > > > "ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com/contrib"; > > > : no Server > > > Indexer[31338]: [1] "ftp://redhat.eyetap.org/": HrefOnly NoCase * > > > Indexer[31338]: [1] Skip "ftp://redhat.eyetap.org/"; : no Server > > > Indexer[31338]: [1] "ftp://redhat.eyetap.org/updates": HrefOnly NoCase > * > > > Indexer[31338]: [1] Skip "ftp://redhat.eyetap.org/updates"; : no Server > > > Indexer[31338]: [1] "ftp://redhat.eyetap.org/contrib": HrefOnly NoCase > * > > > Indexer[31338]: [1] Skip "ftp://redhat.eyetap.org/contrib"; : no Server > > > > > > thank you again, i really appreciate your help! > > > > > > du
Re: Webboard: Indexing only .iso files
Hi ! How do I set the program to follow links out of the site requested to be indexed ? Regards, Nelson - Original Message - From: "Alexander Barkov" <[EMAIL PROTECTED]> To: "duncan" <[EMAIL PROTECTED]> Cc: <[EMAIL PROTECTED]> Sent: Tuesday, April 24, 2001 12:43 PM Subject: Re: Webboard: Indexing only .iso files > So does it work as expected now? > > duncan wrote: > > > > Getting close... here is a sample of the output if indexer -amv6 > > > > Indexer[31338]: indexer from mnogosearch-3.1.12/UdmDB started with > > '/home/mnogo/etc/indexer.conf' Indexer[31338]: [1] > > http://www.redhat.com/robots.txt > > Indexer[31338]: [1] Server 'http://www.redhat.com/download/' > > Indexer[31338]: [1] HrefOnly NoCase * > > ... > > Indexer[31338]: [1] "/apps/download/": HrefOnly NoCase * > > Indexer[31338]: [1] Skip "/apps/download/" : no Server > > Indexer[31338]: [1] "/download/howto_download.html": HrefOnly NoCase * > > Indexer[31338]: [1] "/download/mirror.html": HrefOnly NoCase * > > Indexer[31338]: [1] "/apps/download/beta/": HrefOnly NoCase * > > Indexer[31338]: [1] Skip "/apps/download/beta/" : no Server > > Indexer[31338]: [1] > > "ftp://ftp.crc.ca/pub/systems/linux/redhat/ftp.redhat.com": HrefOnly > > NoCase *Indexer[31338]: [1] Skip > > "ftp://ftp.crc.ca/pub/systems/linux/redhat/ftp.redhat.com"; : no Server > > Indexer[31338]: [1] > > "ftp://ftp.crc.ca/pub/systems/linux/redhat/ftp.redhat.com/updates": > > HrefOnly NoCase * > > Indexer[31338]: [1] Skip > > "ftp://ftp.crc.ca/pub/systems/linux/redhat/ftp.redhat.com/updates"; : no > > Server > > Indexer[31338]: [1] > > "ftp://ftp.crc.ca/pub/systems/linux/redhat/contrib.redhat.com": HrefOnly > > NoCase * > > Indexer[31338]: [1] Skip > > "ftp://ftp.crc.ca/pub/systems/linux/redhat/contrib.redhat.com"; : no Server > > Indexer[31338]: [1] "ftp://ftp.muug.mb.ca/mirror/redhat/redhat": HrefOnly > > NoCase * > > Indexer[31338]: [1] Skip "ftp://ftp.muug.mb.ca/mirror/redhat/redhat"; : no > > Server > > Indexer[31338]: [1] "ftp://ftp.muug.mb.ca/mirror/redhat/redhat/updates": > > HrefOnly NoCase * > > Indexer[31338]: [1] Skip > > "ftp://ftp.muug.mb.ca/mirror/redhat/redhat/updates"; : no Server > > Indexer[31338]: [1] "ftp://ftp.muug.mb.ca/mirror/redhat-contrib": HrefOnly > > NoCase * > > Indexer[31338]: [1] Skip "ftp://ftp.muug.mb.ca/mirror/redhat-contrib"; : no > > Server > > Indexer[31338]: [1] > > "ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com": > > HrefOnly NoCase * > > Indexer[31338]: [1] Skip > > "ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com"; : no > > Server > > Indexer[31338]: [1] > > "ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com/redhat/upd ates": > > HrefOnly NoCase * > > Indexer[31338]: [1] Skip > > "ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com/redhat/upd ates" > > : no Server > > Indexer[31338]: [1] > > "ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com/contrib": > > HrefOnly NoCase * > > Indexer[31338]: [1] Skip > > "ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com/contrib"; > > : no Server > > Indexer[31338]: [1] "ftp://redhat.eyetap.org/": HrefOnly NoCase * > > Indexer[31338]: [1] Skip "ftp://redhat.eyetap.org/"; : no Server > > Indexer[31338]: [1] "ftp://redhat.eyetap.org/updates": HrefOnly NoCase * > > Indexer[31338]: [1] Skip "ftp://redhat.eyetap.org/updates"; : no Server > > Indexer[31338]: [1] "ftp://redhat.eyetap.org/contrib": HrefOnly NoCase * > > Indexer[31338]: [1] Skip "ftp://redhat.eyetap.org/contrib"; : no Server > > > > thank you again, i really appreciate your help! > > > > duncan > > > > On Tue, 24 Apr 2001, Alexander Barkov wrote: > > > > > Try this combination instead of your one: > > > > > > Allow *.iso > > > HrefOnly * > > > > > > > > > > > > > > > duncan wrote: > > > > > > > > Here is the output: > > > > > > > > Indexer[31136]: indexer from mnogosearch-3.1.12/UdmDB started with > > > > '/home/mnogo/etc/indexer.conf' > > > > Indexer[31136]: [1] http:
Re: Webboard: Indexing only .iso files
So does it work as expected now? duncan wrote: > > Getting close... here is a sample of the output if indexer -amv6 > > Indexer[31338]: indexer from mnogosearch-3.1.12/UdmDB started with > '/home/mnogo/etc/indexer.conf' Indexer[31338]: [1] > http://www.redhat.com/robots.txt > Indexer[31338]: [1] Server 'http://www.redhat.com/download/' > Indexer[31338]: [1] HrefOnly NoCase * > ... > Indexer[31338]: [1] "/apps/download/": HrefOnly NoCase * > Indexer[31338]: [1] Skip "/apps/download/" : no Server > Indexer[31338]: [1] "/download/howto_download.html": HrefOnly NoCase * > Indexer[31338]: [1] "/download/mirror.html": HrefOnly NoCase * > Indexer[31338]: [1] "/apps/download/beta/": HrefOnly NoCase * > Indexer[31338]: [1] Skip "/apps/download/beta/" : no Server > Indexer[31338]: [1] > "ftp://ftp.crc.ca/pub/systems/linux/redhat/ftp.redhat.com": HrefOnly > NoCase *Indexer[31338]: [1] Skip > "ftp://ftp.crc.ca/pub/systems/linux/redhat/ftp.redhat.com"; : no Server > Indexer[31338]: [1] > "ftp://ftp.crc.ca/pub/systems/linux/redhat/ftp.redhat.com/updates": > HrefOnly NoCase * > Indexer[31338]: [1] Skip > "ftp://ftp.crc.ca/pub/systems/linux/redhat/ftp.redhat.com/updates"; : no > Server > Indexer[31338]: [1] > "ftp://ftp.crc.ca/pub/systems/linux/redhat/contrib.redhat.com": HrefOnly > NoCase * > Indexer[31338]: [1] Skip > "ftp://ftp.crc.ca/pub/systems/linux/redhat/contrib.redhat.com"; : no Server > Indexer[31338]: [1] "ftp://ftp.muug.mb.ca/mirror/redhat/redhat": HrefOnly > NoCase * > Indexer[31338]: [1] Skip "ftp://ftp.muug.mb.ca/mirror/redhat/redhat"; : no > Server > Indexer[31338]: [1] "ftp://ftp.muug.mb.ca/mirror/redhat/redhat/updates": > HrefOnly NoCase * > Indexer[31338]: [1] Skip > "ftp://ftp.muug.mb.ca/mirror/redhat/redhat/updates"; : no Server > Indexer[31338]: [1] "ftp://ftp.muug.mb.ca/mirror/redhat-contrib": HrefOnly > NoCase * > Indexer[31338]: [1] Skip "ftp://ftp.muug.mb.ca/mirror/redhat-contrib"; : no > Server > Indexer[31338]: [1] > "ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com": > HrefOnly NoCase * > Indexer[31338]: [1] Skip > "ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com"; : no > Server > Indexer[31338]: [1] > "ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com/redhat/updates": > HrefOnly NoCase * > Indexer[31338]: [1] Skip > "ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com/redhat/updates"; > : no Server > Indexer[31338]: [1] > "ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com/contrib": > HrefOnly NoCase * > Indexer[31338]: [1] Skip > "ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com/contrib"; > : no Server > Indexer[31338]: [1] "ftp://redhat.eyetap.org/": HrefOnly NoCase * > Indexer[31338]: [1] Skip "ftp://redhat.eyetap.org/"; : no Server > Indexer[31338]: [1] "ftp://redhat.eyetap.org/updates": HrefOnly NoCase * > Indexer[31338]: [1] Skip "ftp://redhat.eyetap.org/updates"; : no Server > Indexer[31338]: [1] "ftp://redhat.eyetap.org/contrib": HrefOnly NoCase * > Indexer[31338]: [1] Skip "ftp://redhat.eyetap.org/contrib"; : no Server > > thank you again, i really appreciate your help! > > duncan > > On Tue, 24 Apr 2001, Alexander Barkov wrote: > > > Try this combination instead of your one: > > > > Allow *.iso > > HrefOnly * > > > > > > > > > > duncan wrote: > > > > > > Here is the output: > > > > > > Indexer[31136]: indexer from mnogosearch-3.1.12/UdmDB started with > > > '/home/mnogo/etc/indexer.conf' > > > Indexer[31136]: [1] http://www.redhat.com/robots.txt > > > Indexer[31136]: [1] Server 'http://www.redhat.com/download/' > > > Indexer[31136]: [1] Disallow NoCase * > > > Indexer[31136]: [1] http://www.redhat.com/download/mirror.html > > > Indexer[31136]: [1] Server 'http://www.redhat.com/download/' > > > Indexer[31136]: [1] Disallow NoCase * > > > Indexer[31136]: [1] Done (0 seconds) > > > > > > thank you! > > > > > > On Tue, 24 Apr 2001, Alexander Barkov wrote: > > > > > > > Please run > > > > > > > > indexer -amv6 > > > > > > > > and check it's output. It will print an information about all > > > > found links. > > > > > > > > > > > > duncan wrote: > > > > > > > > > > Hello, and thanks matthew- > > > > > > > > > > I tried what you suggested, and in fact, here is the whole conf file: > > > > > > > > > > Allow */ > > > > > CheckOnly *.iso > > > > > Disallow * > > > > > > > > > > Server http://www.redhat.com/download/mirror.html > > > > > > > > > > and it only returns this: > > > > > > > > > > Indexer[30131]: indexer from mnogosearch-3.1.12/UdmDB started with > > > > > '/home/mnogo/etc/indexer.conf' > > > > > Indexer[30131]: [1] http://www.redhat.com/robots.txt > > > > > Indexer[30131]: [1] http://www.redhat.com/download/mirror.html > > > > > Indexer[30131]: [1] Done (0 seconds) > > > > > > > > > > Something isint right there, and I dont know where to do with it. I feel > > > > > like i try so many things... is there more doc. out there, or more > > > > > examples? > > >
Re: Webboard: Indexing only .iso files
Getting close... here is a sample of the output if indexer -amv6 Indexer[31338]: indexer from mnogosearch-3.1.12/UdmDB started with '/home/mnogo/etc/indexer.conf' Indexer[31338]: [1] http://www.redhat.com/robots.txt Indexer[31338]: [1] Server 'http://www.redhat.com/download/' Indexer[31338]: [1] HrefOnly NoCase * ... Indexer[31338]: [1] "/apps/download/": HrefOnly NoCase * Indexer[31338]: [1] Skip "/apps/download/" : no Server Indexer[31338]: [1] "/download/howto_download.html": HrefOnly NoCase * Indexer[31338]: [1] "/download/mirror.html": HrefOnly NoCase * Indexer[31338]: [1] "/apps/download/beta/": HrefOnly NoCase * Indexer[31338]: [1] Skip "/apps/download/beta/" : no Server Indexer[31338]: [1] "ftp://ftp.crc.ca/pub/systems/linux/redhat/ftp.redhat.com": HrefOnly NoCase *Indexer[31338]: [1] Skip "ftp://ftp.crc.ca/pub/systems/linux/redhat/ftp.redhat.com"; : no Server Indexer[31338]: [1] "ftp://ftp.crc.ca/pub/systems/linux/redhat/ftp.redhat.com/updates": HrefOnly NoCase * Indexer[31338]: [1] Skip "ftp://ftp.crc.ca/pub/systems/linux/redhat/ftp.redhat.com/updates"; : no Server Indexer[31338]: [1] "ftp://ftp.crc.ca/pub/systems/linux/redhat/contrib.redhat.com": HrefOnly NoCase * Indexer[31338]: [1] Skip "ftp://ftp.crc.ca/pub/systems/linux/redhat/contrib.redhat.com"; : no Server Indexer[31338]: [1] "ftp://ftp.muug.mb.ca/mirror/redhat/redhat": HrefOnly NoCase * Indexer[31338]: [1] Skip "ftp://ftp.muug.mb.ca/mirror/redhat/redhat"; : no Server Indexer[31338]: [1] "ftp://ftp.muug.mb.ca/mirror/redhat/redhat/updates": HrefOnly NoCase * Indexer[31338]: [1] Skip "ftp://ftp.muug.mb.ca/mirror/redhat/redhat/updates"; : no Server Indexer[31338]: [1] "ftp://ftp.muug.mb.ca/mirror/redhat-contrib": HrefOnly NoCase * Indexer[31338]: [1] Skip "ftp://ftp.muug.mb.ca/mirror/redhat-contrib"; : no Server Indexer[31338]: [1] "ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com": HrefOnly NoCase * Indexer[31338]: [1] Skip "ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com"; : no Server Indexer[31338]: [1] "ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com/redhat/updates": HrefOnly NoCase * Indexer[31338]: [1] Skip "ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com/redhat/updates"; : no Server Indexer[31338]: [1] "ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com/contrib": HrefOnly NoCase * Indexer[31338]: [1] Skip "ftp://sunsite.ualberta.ca/pub/Mirror/Linux/redhat/ftp.redhat.com/contrib"; : no Server Indexer[31338]: [1] "ftp://redhat.eyetap.org/": HrefOnly NoCase * Indexer[31338]: [1] Skip "ftp://redhat.eyetap.org/"; : no Server Indexer[31338]: [1] "ftp://redhat.eyetap.org/updates": HrefOnly NoCase * Indexer[31338]: [1] Skip "ftp://redhat.eyetap.org/updates"; : no Server Indexer[31338]: [1] "ftp://redhat.eyetap.org/contrib": HrefOnly NoCase * Indexer[31338]: [1] Skip "ftp://redhat.eyetap.org/contrib"; : no Server thank you again, i really appreciate your help! duncan On Tue, 24 Apr 2001, Alexander Barkov wrote: > Try this combination instead of your one: > > Allow *.iso > HrefOnly * > > > > > duncan wrote: > > > > Here is the output: > > > > Indexer[31136]: indexer from mnogosearch-3.1.12/UdmDB started with > > '/home/mnogo/etc/indexer.conf' > > Indexer[31136]: [1] http://www.redhat.com/robots.txt > > Indexer[31136]: [1] Server 'http://www.redhat.com/download/' > > Indexer[31136]: [1] Disallow NoCase * > > Indexer[31136]: [1] http://www.redhat.com/download/mirror.html > > Indexer[31136]: [1] Server 'http://www.redhat.com/download/' > > Indexer[31136]: [1] Disallow NoCase * > > Indexer[31136]: [1] Done (0 seconds) > > > > thank you! > > > > On Tue, 24 Apr 2001, Alexander Barkov wrote: > > > > > Please run > > > > > > indexer -amv6 > > > > > > and check it's output. It will print an information about all > > > found links. > > > > > > > > > duncan wrote: > > > > > > > > Hello, and thanks matthew- > > > > > > > > I tried what you suggested, and in fact, here is the whole conf file: > > > > > > > > Allow */ > > > > CheckOnly *.iso > > > > Disallow * > > > > > > > > Server http://www.redhat.com/download/mirror.html > > > > > > > > and it only returns this: > > > > > > > > Indexer[30131]: indexer from mnogosearch-3.1.12/UdmDB started with > > > > '/home/mnogo/etc/indexer.conf' > > > > Indexer[30131]: [1] http://www.redhat.com/robots.txt > > > > Indexer[30131]: [1] http://www.redhat.com/download/mirror.html > > > > Indexer[30131]: [1] Done (0 seconds) > > > > > > > > Something isint right there, and I dont know where to do with it. I feel > > > > like i try so many things... is there more doc. out there, or more > > > > examples? > > > > > > > > thnaks, i appreciate your response > > > > > > > -- > > || || || || || || > > duncan shannon > > [EMAIL PROTECTED] > -- || || || || || || duncan shannon [EMAIL PROTECTED] ___ If you want to unsubscribe send "unsubscribe general" to [EMAIL P
Re: Webboard: Indexing only .iso files
Try this combination instead of your one: Allow *.iso HrefOnly * duncan wrote: > > Here is the output: > > Indexer[31136]: indexer from mnogosearch-3.1.12/UdmDB started with > '/home/mnogo/etc/indexer.conf' > Indexer[31136]: [1] http://www.redhat.com/robots.txt > Indexer[31136]: [1] Server 'http://www.redhat.com/download/' > Indexer[31136]: [1] Disallow NoCase * > Indexer[31136]: [1] http://www.redhat.com/download/mirror.html > Indexer[31136]: [1] Server 'http://www.redhat.com/download/' > Indexer[31136]: [1] Disallow NoCase * > Indexer[31136]: [1] Done (0 seconds) > > thank you! > > On Tue, 24 Apr 2001, Alexander Barkov wrote: > > > Please run > > > > indexer -amv6 > > > > and check it's output. It will print an information about all > > found links. > > > > > > duncan wrote: > > > > > > Hello, and thanks matthew- > > > > > > I tried what you suggested, and in fact, here is the whole conf file: > > > > > > Allow */ > > > CheckOnly *.iso > > > Disallow * > > > > > > Server http://www.redhat.com/download/mirror.html > > > > > > and it only returns this: > > > > > > Indexer[30131]: indexer from mnogosearch-3.1.12/UdmDB started with > > > '/home/mnogo/etc/indexer.conf' > > > Indexer[30131]: [1] http://www.redhat.com/robots.txt > > > Indexer[30131]: [1] http://www.redhat.com/download/mirror.html > > > Indexer[30131]: [1] Done (0 seconds) > > > > > > Something isint right there, and I dont know where to do with it. I feel > > > like i try so many things... is there more doc. out there, or more > > > examples? > > > > > > thnaks, i appreciate your response > > > > -- > || || || || || || > duncan shannon > [EMAIL PROTECTED] ___ If you want to unsubscribe send "unsubscribe general" to [EMAIL PROTECTED]
Re: Webboard: Indexing only .iso files
Here is the output: Indexer[31136]: indexer from mnogosearch-3.1.12/UdmDB started with '/home/mnogo/etc/indexer.conf' Indexer[31136]: [1] http://www.redhat.com/robots.txt Indexer[31136]: [1] Server 'http://www.redhat.com/download/' Indexer[31136]: [1] Disallow NoCase * Indexer[31136]: [1] http://www.redhat.com/download/mirror.html Indexer[31136]: [1] Server 'http://www.redhat.com/download/' Indexer[31136]: [1] Disallow NoCase * Indexer[31136]: [1] Done (0 seconds) thank you! On Tue, 24 Apr 2001, Alexander Barkov wrote: > Please run > > indexer -amv6 > > and check it's output. It will print an information about all > found links. > > > duncan wrote: > > > > Hello, and thanks matthew- > > > > I tried what you suggested, and in fact, here is the whole conf file: > > > > Allow */ > > CheckOnly *.iso > > Disallow * > > > > Server http://www.redhat.com/download/mirror.html > > > > and it only returns this: > > > > Indexer[30131]: indexer from mnogosearch-3.1.12/UdmDB started with > > '/home/mnogo/etc/indexer.conf' > > Indexer[30131]: [1] http://www.redhat.com/robots.txt > > Indexer[30131]: [1] http://www.redhat.com/download/mirror.html > > Indexer[30131]: [1] Done (0 seconds) > > > > Something isint right there, and I dont know where to do with it. I feel > > like i try so many things... is there more doc. out there, or more > > examples? > > > > thnaks, i appreciate your response > -- || || || || || || duncan shannon [EMAIL PROTECTED] ___ If you want to unsubscribe send "unsubscribe general" to [EMAIL PROTECTED]
Re: Webboard: Indexing only .iso files
Please run indexer -amv6 and check it's output. It will print an information about all found links. duncan wrote: > > Hello, and thanks matthew- > > I tried what you suggested, and in fact, here is the whole conf file: > > Allow */ > CheckOnly *.iso > Disallow * > > Server http://www.redhat.com/download/mirror.html > > and it only returns this: > > Indexer[30131]: indexer from mnogosearch-3.1.12/UdmDB started with > '/home/mnogo/etc/indexer.conf' > Indexer[30131]: [1] http://www.redhat.com/robots.txt > Indexer[30131]: [1] http://www.redhat.com/download/mirror.html > Indexer[30131]: [1] Done (0 seconds) > > Something isint right there, and I dont know where to do with it. I feel > like i try so many things... is there more doc. out there, or more > examples? > > thnaks, i appreciate your response ___ If you want to unsubscribe send "unsubscribe general" to [EMAIL PROTECTED]
Re: Webboard: Indexing only .iso files
Hello, and thanks matthew- I tried what you suggested, and in fact, here is the whole conf file: Allow */ CheckOnly *.iso Disallow * Server http://www.redhat.com/download/mirror.html and it only returns this: Indexer[30131]: indexer from mnogosearch-3.1.12/UdmDB started with '/home/mnogo/etc/indexer.conf' Indexer[30131]: [1] http://www.redhat.com/robots.txt Indexer[30131]: [1] http://www.redhat.com/download/mirror.html Indexer[30131]: [1] Done (0 seconds) Something isint right there, and I dont know where to do with it. I feel like i try so many things... is there more doc. out there, or more examples? thnaks, i appreciate your response On Tue, 24 Apr 2001, Matthew Sullivan wrote: -- || || || || || || duncan shannon [EMAIL PROTECTED] ___ If you want to unsubscribe send "unsubscribe general" to [EMAIL PROTECTED]
Re: Webboard: Indexing only .iso files
duncan shannon wrote: I want to spider thru sites and only index .iso files, and when a person then searches, for say redhat 7.1 it will grab return links based on the paths indexed to a redhat 7.1 iso file, not a directory that contains that iso file. so, basically, i want to have the results be in the form of: www.server.com/path/to/redhat7.1/disc1.iso Unless I have missed something you will probably not be able to do this without indexing the directory structures of the target sites as well... You could try this: Allow */ CheckOnly *.iso Disallow * -- Yours Matthew -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- This is an unauthorized cybernetic announcement. begin:vcard n:Sullivan;Matthew tel;cell:+61 (0)414 861 744 (Not for work use) tel;fax:+61 (0)3 9693 7699 tel;home:+61 (0)3 9397 4859 tel;work:+61 (0)3 9693 7640 x-mozilla-html:TRUE url:http://people.netscape.com/matthews/ org:http://people.netscape.com/matthews/penguin.gif";>Senior Technical Support EngineeriPlanet E-Commerce SolutionsNetscape Communications Australia Pty LtdA division of America On Line Inc. version:2.1 email;internet:[EMAIL PROTECTED] adr;quoted-printable:;;Netscape Communications Australia=0D=0A;Level 1, The Tea House, 28 Clarendon Street;South Melbourne;VIC 3205;Australia x-mozilla-cpt:nemesis.netscape.com;-18464 fn:Matthew Sullivan end:vcard S/MIME Cryptographic Signature