Janine,
I can tell you how I accomplished this task. Be warned: it's kind of a kludge.
I created a modified rundig script that looks like this: #!/bin/sh
BINDIR=/usr/local/htdig/bin
if [ $1 ]; then $BINDIR/htdig -v -m - <<-EOF $1
EOF
$BINDIR/htmerge fi # END OF SCRIPT
Then I created another script that gets hit via http when a new page needs to be added to the index.
#!/bin/sh
if [ $1 ]; then echo "Content-Type: text/plain\n\n"
/usr/local/htdig/bin/rundig.new $1
echo "Index completed.\n" else echo "Content-Type: text/plain\n\n" echo "Error Missing data to be indexed" fi #END OF SCRIPT
I chowned all the db files so that the webserver could write them: sudo chown -R nobody /usr/local/htdig/var/htdig/*
Then in a web browser I just hit that reindex script passing the new page's url as the first and only parameter.
http://localhost/cgi-bin/reindex?http://foo.com/newpage.php
Eventually I'm going to rewrite the cgi in perl. I'm sure this is probably the biggest kludge ever, but it works for me :)
-Chuck
On Feb 23, 2005, at 10:29 PM, Janine Sisk wrote:
Can someone please explain how to do this, and/or point me to the right place in the documentation? Something seems to be wrong with the search at htdig.org; a search for "update" returns no matches, but I know the word is used on the page for rundig and probably many other places.
As I posted before, I have a site that takes over 30 hours to index, and when I have tried experimenting with a modified version of rundig that removes the -i and does not allow -a, it looked like it was going to run almost as long. It seems that with database files that large everything takes forever, even examining a page to see if it has changed. I need some way to add a few new or updated pages to the index explicitly instead of trying to crawl the site again.
Thanks in advance for any tips,
janine
-------------------------------------------------------
SF email is sponsored by - The IT Product Guide
Read honest & candid reviews on hundreds of IT Products from real users.
Discover which products truly live up to the hype. Start reading now.
http://ads.osdn.com/?ad_id=6595&alloc_id=14396&op=click
_______________________________________________
ht://Dig general mailing list: <[email protected]>
ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html
List information (subscribe/unsubscribe, etc.)
https://lists.sourceforge.net/lists/listinfo/htdig-general
------------------------------------------------------- SF email is sponsored by - The IT Product Guide Read honest & candid reviews on hundreds of IT Products from real users. Discover which products truly live up to the hype. Start reading now. http://ads.osdn.com/?ad_id=6595&alloc_id=14396&op=click _______________________________________________ ht://Dig general mailing list: <[email protected]> ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html List information (subscribe/unsubscribe, etc.) https://lists.sourceforge.net/lists/listinfo/htdig-general
