Total archive size is ~110,000 messages. Growth is currently under 1000 per day. There may be room for improving search indexing efficiency (incrementallity?), which could deliver tangible benefits, as you mentioned.
I chose htDig because it appeared to beat out the competition by being cleanly implemented, documented, robust, credible, customizable, well supported, actively maintained, very fast at searching, linux compatible, open source, widely used, and installable via RPM. Its biggest drawbacks are that indexing (as currently configured) takes time, and that it uses a good chunk of disk space for its indexes. (I'd rather buy more disk space than a bigger CPU, though) As for the suggestions about re-organziation to improve customizability, you are fundamentally right. My design focus was service (www.mail-archive.com) oriented as opposed to product oriented. If the focus is product oriented, re-organization to support customization would be very helpful. I am not currently planning a re-organization of this sort, as doing a good job, while not compromising simplicity, will be difficult and time consuming. My energies are still service oriented. However, don't let that stop you, and if you make clean changes, please send 'em in! As to your specific suggestions, I think keeping the rcfile intact (as opposed to generated in pieces) might be important in keeping things understandable. However, internal organization of that file and embedded comments might be improved [i.e. organize the file into separate sections (along the lines you mentioned?) and document interactions] Jeff
