The size of the databases, naturally do not tell you anything about 
the contents of them. For example, you could have a pile of 
almost-duplicates due to symlinks or something along those lines.

For one thing, you should be very careful when using '\' as 
continuation characters. They must be the last character on the line 
for it to be considered in this fashion.

For another, you don't mention what your limit_urls_to or other limit 
attributes are. Naturally these could prevent the various URLs from 
being indexed.

--
-Geoff Hutchison
Williams Students Online
http://wso.williams.edu/

At 6:54 PM -0800 2/7/01, Jeff Nelson wrote:
>Hi, Geoff:
>
>Question:
>
>In my htdig.conf file I have it set up, for example, to get all the
>discussion board messages, and I have it say:
>
># start_url:           `${common_dir}/start.url`
>#
>start_url: \
>http://www.vegsource.com/index.htm \
>http://www.vegsource.com/talk/recipes/messages/ \
>http://www.vegsource.com/mcdougall/messages/ \
>http://www.vegsource.com/talk/veganism/messages/ \
>http://www.vegsource.com/talk/health/messages/ \
>http://www.vegsource.com/talk/beginner/messages/ \
>
>
>What I'm finding is that it when I do a search it doesn't return any of
>the many posts from the /messages/ directory.  It will give me posts if
>they appear on the discussion board, eg:
>
>http://www.vegsource.com/talk/recipes/index.html
>
>but not the many which are under
>
>http://www.vegsource.com/talk/recipes/messages/
>
>My db file is like 1 gig in size so I'm assuming they should be in
>there, but...they don't come up.  Am I doing this wrong?
>
>Thanks,
>Jeff
>
>
>Geoff Hutchison wrote:
>  >
>  > At 7:17 PM -0800 1/4/01, Jeff Nelson wrote:
>  > >How do I do it if I want to restrict it to just one directory, and not
>  > >give a second dropdown box with options?  Where do I put some restrict
>  > >code?  Inside the search form itself somewhere?
>  >
>  > <INPUT NAME="restrict" CONTENT="/foo/">
>  >
>  > Cheers,
>  >
>  > --
>  > -Geoff Hutchison
>  > Williams Students Online
>  > http://wso.williams.edu/


_______________________________________________
htdig-general mailing list <[EMAIL PROTECTED]>
Information: http://lists.sourceforge.net/lists/listinfo/htdig-general
FAQ: http://htdig.sourceforge.net/FAQ.html

Reply via email to