Geoff Hutchison wrote:
>
> And what is your limit_urls_to setting? Remember that this will
> determine if additional links will be accepted. Also remember that if
> you have large index documents, max_doc_size can become an issue.
>
My 'limit_urls' is set to ${start_url} which in turn is
'http://www/realitydiluted.com'. I set my 'max_doc_size' to
by 1000000 just for kicks even though none of my documents are
that large.
> Also remember that if you specify, -vv or -vvv when you call htdig,
> you will get debugging information with explicit reasons for
> rejecting individual links.
>
I did this and below are the the important lines:
A tag: pos = 2, position = ="projects/index.html">
href: http://www.realitydiluted.com/projects/index.html (fadsfasd)
resolving 'http://www.realitydiluted.com/projects/index.html'
pushing http://www.realitydiluted.com/projects/
+ size = 2285
pick: www.realitydiluted.com, # servers = 1
8:8:1:http://www.realitydiluted.com/projects/: Trying local files
found existing file /home/httpd/html/projects/index.html
Read 1283 from document
Read a total of 1283 bytes
There are HREF directives in the 'index.html' that point to pages
in subdirectories down a level that are full of pages and for some
reason they are not being parsed out. This is my whole problem. I
used '-vvv' for verbosity. Thanks for your reply.
-Steve
--
Steven J. Hill - Embedded SW Engineer
Public Key: 'http://www.cotw.com/pubkey.txt'
FPR1: E124 6E1C AF8E 7802 A815
FPR2: 7D72 829C 3386 4C4A E17D
_______________________________________________
htdig-general mailing list <[EMAIL PROTECTED]>
To unsubscribe, send a message to <[EMAIL PROTECTED]> with a
subject of unsubscribe
FAQ: http://htdig.sourceforge.net/FAQ.html
