I have set up htdig to index a page that's dynamically generated and contains approximately 15,000 links to articles within the site. It is only processing the first 1944 of them, leading me to believe I must be violating some rule of nature. Is there actually a maximum, and if so can I change it? If not, is there a strategy others use in this situation? I'm thinking of putting out 1900 (or so) links on a page, followed by a link to the next page, and so on.
thanks,
janine
------------------------------------------------------- This SF.Net email is sponsored by: IntelliVIEW -- Interactive Reporting Tool for open source databases. Create drag-&-drop reports. Save time by over 75%! Publish reports on the web. Export to DOC, XLS, RTF, etc. Download a FREE copy at http://www.intelliview.com/go/osdn_nl _______________________________________________ ht://Dig general mailing list: <[email protected]> ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html List information (subscribe/unsubscribe, etc.) https://lists.sourceforge.net/lists/listinfo/htdig-general
