Hi,
I've compiled and am using htdig 3.12 on DEC Alpha D-Unix 4.0d.
I'm a little confused as to why this version does not seem to
automagically do multiple search 'endings' when a search is submitted.
I've removed the two endings databases and re-indexed my server and
updated the english.0 file to contain all the English dictionaries from
the Ispell distribution but yet when I do searches I still don't seem
to get the search engine to do any endings for me.....
What gives?
Adam Bentley, Coventry University CSV, UK.
-----------------------------------------------------------------
[ PLEASE REPLY TO ME DIRECTLY AS I AM NOT ON THE LIST ]
-----------------------------------------------------------------
<here's my rundig script>
#!/bin/sh
#
# rundig
#
# $Id: rundig,v 1.7 1999/01/31 04:27:02 ghutchis Exp $
#
# This is a sample script to create a search database for ht://Dig.
#
DBDIR=/someplace/htdig/db
COMMONDIR=/someplace/htdig/common
BINDIR=/someplace/htdig/bin
# To help debug problems, try running rundig -vvv
# This will add lots of debugging output to all of the programs
stats= opts= alt=
for arg
do
case "$arg" in
-a) alt="$arg" ;;
-s) stats="$arg" ;;
*) opts="$opts $arg" ;; # e.g. -v or -c config
esac
done
#
# Set the TMPDIR variable if you want htmerge to put files in a location
# other than the default. This is important if you do not have enough
# disk space for the big sort that htmerge runs. Also, be aware that
# on some systems, /tmp is a memory mapped filesystem that takes away
# from virtual memory.
#
TMPDIR=$DBDIR
export TMPDIR
$BINDIR/htdig -si $opts $stats $alt
$BINDIR/htmerge -s $opts $stats $alt
case "$alt" in
-a)
( cd $DBDIR && test -f db.docdb.work &&
for f in *.work
do
mv -f $f `basename $f .work`
done ) ;;
esac
# If you're low on disk space and you don't mind completely reindexing
# every time you run this script, you can always
# rm $DBDIR/db.wordlist
# OR
# If you'd rather run update digs all the time with the minimal databases
# Keep only the following files (and don't call htdig with -i):
# db.docdb, db.docdb.work, db.docs.index, db.wordlist.work, db.words.db
$BINDIR/htnotify $opts
# If you want to use the soundex and (or) metaphone fuzzy matchings,
# Uncomment the following line
#$BINDIR/htfuzzy $opts soundex metaphone
#
# Create the endings and synonym databases if they don't exist
# or if they're older than the files they're generated from.
# These databases are semi-static, so even if pages change,
# these databases will not need to be rebuilt.
#
if [ "`ls -t $COMMONDIR/english.0 $COMMONDIR/word2root.db 2>/dev/null | sed 1q`" = \
"$COMMONDIR/english.0" ]
then
$BINDIR/htfuzzy $opts endings
fi
if [ "`ls -t $COMMONDIR/synonyms $COMMONDIR/synonyms.db 2>/dev/null | sed 1q`" = \
"$COMMONDIR/synonyms" ]
then
$BINDIR/htfuzzy $opts synonyms
fi
<here's htdig.conf>
#
# Example config file for ht://Dig.
# Last modified 13-Oct-1998 by Andrew Scherpbier
#
# This configuration file is used by all the programs that make up ht://Dig.
# Please refer to the attribute reference manual for more details on what
# can be put into this file. (http://www.htdig.org/confindex.html)
# Note that most attributes have very reasonable default values so you
# really only have to add attributes here if you want to change the defaults.
#
# What follows are some of the common attributes you might want to change.
#
#
# Specify where the database files need to go. Make sure that there is
# plenty of free disk space available for the databases. They can get
# pretty big.
#
database_dir: /someplace/htdig/db
#
# This specifies the URL where the robot (htdig) will start. You can specify
# multiple URLs here. Just separate them by some whitespace.
# The example here will cause the ht://Dig homepage and related pages to be
# indexed.
#
start_url: http://somedomain.thing/somedir
#
# This attribute limits the scope of the indexing process. The default is to
# set it to the same as the start_url above. This way only pages that are on
# the sites specified in the start_url attribute will be indexed and it will
# reject any URLs that go outside of those sites.
#
# Keep in mind that the value for this attribute is just a list of string
# patterns. As long as URLs contain at least one of the patterns it will be
# seen as part of the scope of the index.
#
limit_urls_to: ${start_url}
#
# If there are particular pages that you definately do NOT want to index, you
# can use the exclude_urls attribute. The value is a list of string patterns.
# If a URL matches any of the patterns, it will NOT be indexed. This is
# useful to exclude things like virtual web trees or database accesses. By
# default, all CGI URLs will be excluded. (Note that the /cgi-bin/ convention
# may not work on your web server. Check the path prefix used on your web
# server.)
#
exclude_urls: /cgi-bin/ .cgi
#
# The string htdig will send in every request to identify the robot. Change
# this to your email address.
#
maintainer: [EMAIL PROTECTED]
#
# The excerpts that are displayed in long results rely on stored information
# in the index databases. The compiled default only stores 512 characters of
# text from each document (this excludes any HTML markup...) If you plan on
# using the excerpts you probably want to make this larger. The only concern
# here is that more disk space is going to be needed to store the additional
# information. Since disk space is cheap (! :-)) you might want to set this
# to a value so that a large percentage of the documents that you are going
# to be indexing are stored completely in the database. At SDSU we found
# that by setting this value to about 50k the index would get 97% of all
# documents completely and only 3% was cut off at 50k. You probably want to
# experiment with this value.
# Note that if you want to set this value low, you probably want to set the
# excerpt_show_top attribute to false so that the top excerpt_length characters
# of the document are always shown.
#
max_head_length: 10000
#
# Depending on your needs, you might want to enable some of the fuzzy search
# algorithms. There are several to choose from and you can use them in any
# combination you feel comfortable with. Each algorithm will get a weight
# assigned to it so that in combinations of algorithms, certain algorithms get
# preference over others. Note that the weights only affect the ranking of
# the results, not the actual searching.
# The available algorithms are:
# exact
# endings
# synonyms
# soundex
# metaphone
# By default only the "exact" algorithm is used with weight 1.
# Note that if you are going to use any of the algorithms other than "exact",
# you need to use the htfuzzy program to generate the databases that each
# algorithm requires.
#
search_algorithm: exact:1 synonyms:0.5 endings:0.1
#
# The following are used to change the text for the page index.
# The defaults are just boring text numbers. These images spice
# up the result pages quite a bit. (Feel free to do whatever, though)
#
next_page_text: <img src=/htdig/buttonr.gif border=0 align=middle width=30
height=30 alt=next>
no_next_page_text:
prev_page_text: <img src=/htdig/buttonl.gif border=0 align=middle width=30
height=30 alt=prev>
no_prev_page_text:
page_number_text: "<img src=/htdig/button1.gif border=0 align=middle width=30
height=30 alt=1>" \
"<img src=/htdig/button2.gif border=0 align=middle width=30
height=30 alt=2>" \
"<img src=/htdig/button3.gif border=0 align=middle width=30
height=30 alt=3>" \
"<img src=/htdig/button4.gif border=0 align=middle width=30
height=30 alt=4>" \
"<img src=/htdig/button5.gif border=0 align=middle width=30
height=30 alt=5>" \
"<img src=/htdig/button6.gif border=0 align=middle width=30
height=30 alt=6>" \
"<img src=/htdig/button7.gif border=0 align=middle width=30
height=30 alt=7>" \
"<img src=/htdig/button8.gif border=0 align=middle width=30
height=30 alt=8>" \
"<img src=/htdig/button9.gif border=0 align=middle width=30
height=30 alt=9>" \
"<img src=/htdig/button10.gif border=0 align=middle width=30
height=30 alt=10>"
#
# To make the current page stand out, we will put a border arround the
# image for that page.
#
no_page_number_text: "<img src=/htdig/button1.gif border=2 align=middle width=30
height=30 alt=1>" \
"<img src=/htdig/button2.gif border=2 align=middle width=30
height=30 alt=2>" \
"<img src=/htdig/button3.gif border=2 align=middle width=30
height=30 alt=3>" \
"<img src=/htdig/button4.gif border=2 align=middle width=30
height=30 alt=4>" \
"<img src=/htdig/button5.gif border=2 align=middle width=30
height=30 alt=5>" \
"<img src=/htdig/button6.gif border=2 align=middle width=30
height=30 alt=6>" \
"<img src=/htdig/button7.gif border=2 align=middle width=30
height=30 alt=7>" \
"<img src=/htdig/button8.gif border=2 align=middle width=30
height=30 alt=8>" \
"<img src=/htdig/button9.gif border=2 align=middle width=30
height=30 alt=9>" \
"<img src=/htdig/button10.gif border=2 align=middle width=30
height=30 alt=10>"
# local variables:
# mode: text
# eval: (if (eq window-system 'x) (progn (setq font-lock-keywords (list '("^#.*" .
font-lock-keyword-face) '("^[a-zA-Z][^ :]+" . font-lock-function-name-face) '("[+$]*:"
. font-lock-comment-face) )) (font-lock-mode)))
# end:
------------------------------------
To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED] containing the single word "unsubscribe" in
the SUBJECT of the message.
