Hi,

On Fri, 9 Jun 2000, Budd, S wrote:

> We index using 3.1.3  
> 
> htmerge: Total documents: 177428
> htmerge: Total doc db size (in K): 1676650
> from  181 servers.  It takes about 28 hours
> with one initial dig and another update dig
> two hours later.

How are you doing the dig -- each server individually with its own
configuration file and  then merging all into one  big database at
the end? Or somehow else..?


> -----Original Message-----
> From: Albert Lunde [mailto:[EMAIL PROTECTED]]
> Sent: Friday, June 09, 2000 5:11 PM
> To: [EMAIL PROTECTED]
> Subject: [htdig] suggestions for large multi-server indexing?
 
> (1) What are the are the pros and cons of doing a single big index
> (giving it starting URLs across all servers) vs. doing a number of
> small indexes and merging them?

I'd like to hear your comments on this!

-Harold




------------------------------------
To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED]
You will receive a message to confirm this.

Reply via email to