One of the configuration files is attached. Maybe you can figure something out. Thanx a lot Thorsten R�der > > ---------- Forwarded message ---------- > Date: Fri, 3 Dec 1999 17:10:59 -0000 > From: Philip Coates <[EMAIL PROTECTED]> > To: Thorsten Roeder <[EMAIL PROTECTED]>, [EMAIL PROTECTED] > Subject: Re: [htdig] Problem Indexing huge sites > > Could you post the configuration, please - that should help clarify what the > problem is. > > -----Original Message----- > From: Thorsten Roeder <[EMAIL PROTECTED]> > To: [EMAIL PROTECTED] <[EMAIL PROTECTED]> > Date: Friday, December 03, 1999 4:41 PM > Subject: [htdig] Problem Indexing huge sites > > >Hello, > >maybe anyone can help me with this Problem: > > > >I'm indexing my server (and other virtual servers) with htdig it all works > >quite fine. > > > >To have a search engine for special groups I have made an extra .conf - > >File and header and ... using the "restrict" option in the HTML forms. > > > >So I can generate different outputs. But only on one configuration it > >doesn't work correctly, althought it is equal to the others. It only > >works if I type in more than one word to search. By entering only one word > >it doesn't find anything. > > > >If you know anything, please drop me a line . > > > >thanx > > > >Thorsten Roeder > > > > > > > > > >------------------------------------ > >To unsubscribe from the htdig mailing list, send a message to > >[EMAIL PROTECTED] > >You will receive a message to confirm this. > >
# # Example config file for ht://Dig. # # This configuration file is used by all the programs that make up ht://Dig. # Please refer to the attribute reference manual for more details on what # can be put into this file. (http://www.htdig.org/confindex.html) # Note that most attributes have very reasonable default values so you # really only have to add attributes here if you want to change the defaults. # # What follows are some of the common attributes you might want to change. # # # Specify where the database files need to go. Make sure that there is # plenty of free disk space available for the databases. They can get # pretty big. # database_dir: /opt/www/htdig/db # # This specifies the URL where the robot (htdig) will start. You can specify # multiple URLs here. Just separate them by some whitespace. # The example here will cause the ht://Dig homepage and related pages to be # indexed. # You could also index all the URLs in a file like so: # start_url: `${common_dir}/start.url` # start_url: http://www.weihenstephan.org/ # # This attribute limits the scope of the indexing process. The default is to # set it to the same as the start_url above. This way only pages that are on # the sites specified in the start_url attribute will be indexed and it will # reject any URLs that go outside of those sites. # # Keep in mind that the value for this attribute is just a list of string # patterns. As long as URLs contain at least one of the patterns it will be # seen as part of the scope of the index. # limit_urls_to: ${start_url} # # If there are particular pages that you definately do NOT want to index, you # can use the exclude_urls attribute. The value is a list of string patterns. # If a URL matches any of the patterns, it will NOT be indexed. This is # useful to exclude things like virtual web trees or database accesses. By # default, all CGI URLs will be excluded. (Note that the /cgi-bin/ convention # may not work on your web server. Check the path prefix used on your web # server.) # exclude_urls: /cgi-bin/ /orte/erding/ /schulen/rsm/ # Suchanfragen an syslog() # local5.info # logging: true # Sprachverzeichnis DEUTSCH DEUTSCH=/var/lib/common/german lang_dir: $DEUTSCH bad_word_list: $DEUTSCH/bad_words endings_affix_file: $DEUTSCH/german.aff endings_dictionary: $DEUTSCH/german.0 endings_root2word_db: $DEUTSCH/root2word.db endings_word2root_db: $DEUTSCH/word2root.db nothing_found_file: /var/lib/htdig/common/freising/nomatch.html search_results_footer: /var/lib/htdig/common/freising/footer.html search_results_header: /var/lib/htdig/common/freising/header.html # #Anzahl der maximal angezeigten Sterne # max_stars:5 #Anzahl der maximal (moeglich) angezeigten Seiten maximum_pages:10 #Anzahl der angezeigten Ergebnisse pro Suchseite # matches_per_page:40 # The string htdig will send in every request to identify the robot. Change # this to your email address. # maintainer: [EMAIL PROTECTED] # # The excerpts that are displayed in long results rely on stored information # in the index databases. The compiled default only stores 512 characters of # text from each document (this excludes any HTML markup...) If you plan on # using the excerpts you probably want to make this larger. The only concern # here is that more disk space is going to be needed to store the additional # information. Since disk space is cheap (! :-)) you might want to set this # to a value so that a large percentage of the documents that you are going # to be indexing are stored completely in the database. At SDSU we found # that by setting this value to about 50k the index would get 97% of all # documents completely and only 3% was cut off at 50k. You probably want to # experiment with this value. # Note that if you want to set this value low, you probably want to set the # excerpt_show_top attribute to false so that the top excerpt_length characters # of the document are always shown. # max_head_length: 10000 # # To limit network connections, ht://Dig will only pull up to a certain limit # of bytes. This prevents the indexing from dying because the server keeps # sending information. However, several FAQs happen because people have files # bigger than the default limit of 100KB. This sets the default a bit higher. # (see <http://www.htdig.org/FAQ.html> for more) # max_doc_size: 200000 # # Depending on your needs, you might want to enable some of the fuzzy search # algorithms. There are several to choose from and you can use them in any # combination you feel comfortable with. Each algorithm will get a weight # assigned to it so that in combinations of algorithms, certain algorithms get # preference over others. Note that the weights only affect the ranking of # the results, not the actual searching. # The available algorithms are: # exact # endings # synonyms # soundex # metaphone # By default only the "exact" algorithm is used with weight 1. # Note that if you are going to use any of the algorithms other than "exact", # you need to use the htfuzzy program to generate the databases that each # algorithm requires. # search_algorithm: exact:1 endings:0.1 # # The following are the templates used in the builtin search results # The default is to use compiled versions of these files, which produces # slightly faster results. However, uncommenting these lines makes it # very easy to change the format of search results. # See <http://www.htdig.org/hts_templates.html for more details. # # template_map: Long long ${common_dir}/long.html \ # Short short ${common_dir}/short.html # template_name: long # # The following are used to change the text for the page index. # The defaults are just boring text numbers. These images spice # up the result pages quite a bit. (Feel free to do whatever, though) # no_next_page_text: prev_page_text: <img src=www.weihenstephan.org/gif/buttonl.gif border=0 align=middle width=30 height=30 alt=prev> no_prev_page_text: page_number_text: "<img src=www.weihenstephan.org/gif/button1.gif border=0 align=middle width=30 height=30 alt=1>" \ "<img src=www.weihenstephan.org/gif/button2.gif border=0 align=middle width=30 height=30 alt=2>" \ "<img src=www.weihenstephan.org/gif/button3.gif border=0 align=middle width=30 height=30 alt=3>" \ "<img src=www.weihenstephan.org/gif/button4.gif border=0 align=middle width=30 height=30 alt=4>" \ "<img src=www.weihenstephan.org/gif/button5.gif border=0 align=middle width=30 height=30 alt=5>" \ "<img src=www.weihenstephan.org/gif/button6.gif border=0 align=middle width=30 height=30 alt=6>" \ "<img src=www.weihenstephan.org/gif/button7.gif border=0 align=middle width=30 height=30 alt=7>" \ "<img src=www.weihenstephan.org/gif/button8.gif border=0 align=middle width=30 height=30 alt=8>" \ "<img src=www.weihenstephan.org/gif/button9.gif border=0 align=middle width=30 height=30 alt=9>" \ "<img src=www.weihenstephan.org/gif/button10.gif border=0 align=middle width=30 height=30 alt=10>"
------------------------------------ To unsubscribe from the htdig mailing list, send a message to [EMAIL PROTECTED] You will receive a message to confirm this.
