Hi htdig folks,

A couple of residual questions after trying out ht://dig (which I find
really great!).  

I think this first one is simpler.  Now that I know how great htdig
is, I'd like to use it to index the local files on my workstation.  Is
it possible to get htdig to simply iterate recursively through a
filesystem, rather than following hyperlinks?  Perhaps using the
local_* variables somehow?    

I'm also experimenting with using namazu for this (www.namazu.org),
but it seems a bit buggy & I'd rather have one search syntax for all
the search enginess.

That's one question.  The other one's a bit more complex, I think.  I
first posted it to the list a couple of days ago, but it was at the
bottom of a long, self-generated problem I solved myself immediately
thereafter, so I worry no one noticed it. so here it is again:  

my course websites have a fair number of external links.  I would love
for ht://dig to index the pages linked to, but NOT keep crawling
further along the chain of links.  That is, when ht://dig sees a link
to an external page, it would follow that link, index it, but NOT go
any further.  Even better would be if those links that wget calls
"page-requisite" -- links that need to be loaded in order to view the
page properly -- are also indexed.

(this behaviour is obviously a kind of combination of limit_urls_to
and max_hop_count,  but I don't see how one could get precisely this
result just by setting the conf variables)

In conjuncion with this, I'd also love it if htdig could, like wget,
use mozilla's cookies file to access login controlled sites like the
new york times.

anyway, thanks for all the help.

Matt


--------------------------
 .''`.       Matt Price 
: :'  :      Debian User
`. `'`       & hemi-geek
  `-     
-------------------------- 


-------------------------------------------------------
This SF.Net email is sponsored by The 2004 JavaOne(SM) Conference
Learn from the experts at JavaOne(SM), Sun's Worldwide Java Developer
Conference, June 28 - July 1 at the Moscone Center in San Francisco, CA
REGISTER AND SAVE! http://java.sun.com/javaone/sf Priority Code NWMGYKND
_______________________________________________
ht://Dig general mailing list: <[EMAIL PROTECTED]>
ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html
List information (subscribe/unsubscribe, etc.)
https://lists.sourceforge.net/lists/listinfo/htdig-general

Reply via email to