Hi, thanks for the great input. Good news (I think). As instructed, I went into the htdig.conf file to check for hidden characters. And, it was loaded with M-underline (carriage returns). I stripped all of those out and re-indexed and, behold, when I ran a search I did not come up with any forum-related, database entries for the sub-directories I was trying to exclude. Wow, so, I will do more testing but, for now, it seems that the problem is solved. Guess those hidden characters somehow gummed up the works. So glad to have the tip. I, also, had placed exclude_urls all on the same row.
As for ver. 3.1.6 and why I am running 3.1.5, I recall a great deal of difficulty in installation, when we tried the newest version, initially, and being instructed to use the older version 3.1.5, which has worked fine and seems to be working fine, now. Should we go with "if it it is not broken, don't fix it?" [Translation: I am pretty technophobic]. Or, do you strongly recommend that we go with 3.1.6? Whatever you say, we'll do. We are on a shared server, however, and do not have root access, so that had been a problem in the past and could possibly be an obstacle now. Just let us know what you recommend. By the way, in further reply to your inquiry, we have not changed rundig in any way. Not sure what you mean by line-character as line-terminator. We are not using mac, but a PC (plain-text-editor). When performing the last edit, we removed all of the M-underline characters, so, at present, there are no hidden characters in htdig.conf file, at all. Is that the way it is supposed to be? Does that answer your question, adequately? Finally, I did not check the file date-stamp, because, as I mentioned, I think it is now working, by excluding the proper sub-directories. I, also, am not posting the htdig.conf file, for the same reason. But, I shall, of course, if the problem crops up, once again. OK? Thanks, again. -- On Thu, 17 Oct 2002 17:16:11 Gilles Detillieux wrote: >According to Pub Litics: >> Hi. I did just as instructed. Replaced what was in htdig.conf with >> the following: >> >> exclude_urls: /cgi-bin/ .cgi \ >> /forum/ \ >> /applets/ \ >> /chat/ \ >> /dig/ \ >> /htdig/ \ >> /poll/ \ >> /random/ >> >> I then ran rundig per usual in Telnet (hoping for the best). I, then, >> performed a search and still find that thousands of search names come >> through for forum entries, such as: >> >> >http://www.mydomain.com/forum/viewforum.php?f=6&sid=b1f86e7819e04ab4b178b4ad539b6686 > >Well, for whatever reason, htdig is not taking this exclude_urls setting. >You need to work through every point in FAQ 5.31 until you've ruled >them all out. It might be helpful if you posted an exact copy of your >whole htdig.conf file, so that we could see it in context. Also, how >are you editing this file, and are you sure it has the proper line-feed >character as line terminator? If you're editing it on a Mac, chances >are it'll have CR instead of LF line terminators. > >> Am I doing something wrong? Did I fail to follow instructions properly? >> Is there something else I need to do/try? > >Did you make any changes at all to your "rundig" script? If so, you >should perhaps post a copy of that too, especially if the changes involve >the use of the -c command line option to htdig. > >> As for the question, "Do you interrupt?" I (once again) am not sure >> if you are asking me do I stop the program from running or do I do >> something else? I do not stop the program, in any way. I simply sit >> back and let it run. Is that what you are asking me? If I did not >> understand the question, please pardon me and perhaps ask me again in >> another way. The program does not appear to stop in and by itself, >> in any way, but rather completes its cycle, uninterrupted. > >As Jim said, if the db.log file isn't there, then you've ruled out this >problem already. That you let htdig complete its cycle confirms it. >This was a bit of a red herring anyway, as I forgot that you were running >3.1.5, not 3.1.6. (Any reason for running an older version, by the way?) >In 3.1.5, it would only have produced the db.log file if you ran "htdig -l" >and then interrupted it. > >Focus instead on http://www.htdig.org/FAQ.html#q5.31 points 4-6. > >-- >Gilles R. Detillieux E-mail: <[EMAIL PROTECTED]> >Spinal Cord Research Centre WWW: http://www.scrc.umanitoba.ca/ >Dept. Physiology, U. of Manitoba Winnipeg, MB R3E 3J7 (Canada) > > >------------------------------------------------------- >This sf.net email is sponsored by: viaVerio will pay you up to >$1,000 for every account that you consolidate with us. >http://ad.doubleclick.net/clk;4749864;7604308;v? >http://www.viaverio.com/consolidator/osdn.cfm >_______________________________________________ >htdig-general mailing list <[EMAIL PROTECTED]> >To unsubscribe, send a message to <[EMAIL PROTECTED]> with >a subject of unsubscribe >FAQ: http://htdig.sourceforge.net/FAQ.html > ____________________________________________________________ Get 25MB of email storage with Lycos Mail Plus! Sign up today -- http://www.mail.lycos.com/brandPage.shtml?pageId=plus ------------------------------------------------------- This sf.net email is sponsored by:ThinkGeek Welcome to geek heaven. http://thinkgeek.com/sf _______________________________________________ htdig-general mailing list <[EMAIL PROTECTED]> To unsubscribe, send a message to <[EMAIL PROTECTED]> with a subject of unsubscribe FAQ: http://htdig.sourceforge.net/FAQ.html
