I setup my indexer.conf file to look like: ========= DBPort 5432 DBHost hub.org DBName XXXXXXXXX DBUser XXXXX DBPass Robots no Server http://www.postgresql.org Disallow /cgi-bin/ \.cgi /nph \? Disallow \.b$ \.sh$ \.md5$ \.rpm$ Disallow \.arj$ \.tar$ \.zip$ \.tgz$ \.gz$ Disallow \.lha$ \.lzh$ \.tar\.Z$ \.rar$ \.zoo$ Disallow \.gif$ \.jpg$ \.jpeg$ \.bmp$ \.tiff$ \.xpm$ \.xbm$ Disallow \.vdo$ \.mpeg$ \.mpe$ \.mpg$ \.avi$ \.movie$ Disallow \.mid$ \.mp3$ \.rm$ \.ram$ \.wav$ \.aiff$ \.ra$ Disallow \.vrml$ \.wrl$ \.png$ Disallow \.exe$ \.cab$ \.dll$ \.bin$ \.class$ Disallow \.tex$ \.texi$ \.xls$ \.doc$ \.texinfo$ Disallow \.rtf$ \.pdf$ \.cdf$ \.ps$ Disallow \.ai$ \.eps$ \.ppt$ \.hqx$ Disallow \.cpt$ \.bms$ \.oda$ \.tcl$ Disallow \.o$ \.a$ \.la$ \.so$ \.so\.[0-9]$ Disallow \.pat$ \.pm$ \.m4$ \.am$ Disallow \?D=A$ \?D=A$ \?D=D$ \?M=A$ \?M=D$ \?N=A$ \?N=D$ \?S=A$ \?S=D$ Disallow /[.]{1,2} /\%2e /\%2f AddType text/plain \.pl$ \.js$ \.txt$ \.h$ \.c$ \.pm$ \.e$ AddType text/html \.html$ \.htm$ AddType image/x-xpixmap \.xpm$ AddType image/x-xbitmap \.xbm$ AddType image/gif \.gif$ AddType application/unknown .* ========== Now, if I'm understanding what should happen, it should follow each and every link, correct? But: UdmSearch[96540]: http://www.postgresql.org/mhonarc/pgsql-admin UdmSearch[96540]: http://www.postgresql.org/mhonarc/pgsql-general UdmSearch[96540]: http://www.postgresql.org/mhonarc/pgsql-hackers UdmSearch[96540]: http://www.postgresql.org/mhonarc/pgsql-interfaces UdmSearch[96540]: http://www.postgresql.org/mhonarc/pgsql-novice UdmSearch[96540]: http://www.postgresql.org/mhonarc/pgsql-patches UdmSearch[96540]: http://www.postgresql.org/mhonarc/pgsql-questions UdmSearch[96540]: http://www.postgresql.org/mhonarc/pgsql-sql If you go to any one of those links above, there are links from it that don't appear to be followed, so none of the mailing list archives are being indexed... Am I making a mistake in my indexer.conf file? Or expecting it to do something that it can't? We're trying to change our search engine away from ht/Dig over to something that uses PostgreSQL, vs flat files, as a back end, and udmsearch *looks* promising ... ______________ If you want to unsubscribe send "unsubscribe udmsearch" to [EMAIL PROTECTED]
