Re: [htdig] How Long???

[Pat Lennon]

Well it finally finished about 1 hour after i sent the first E-mail. To my
surprise the databases are approx 150 meg. I had figured on at least 500 meg. I
am using the ht://Dig 3.2.0b2. I  think it's the beta version. As far as the
time it took, i ran vmstat and top while inthe process and my hardware is a
definate factor. The processor is slow...ram is low. Basicly I ran out of
memory then started swapping out to disk..then became i/o bound waiting on I/O.
I have a 4 cylinder when I need a V8.  :>) .

Any how I will upgrade later...

Another question .. after the htdig/htmerge I pasted the search.html into the
index.html file. Then I played a game of who has permission. Finally I got it
to work...Approx 1-2 hours messin around. I notice that what ever i search on
the result "Scores" are all the same 1 star. Also the "Sort by Title" is out of
order. Is this a bug or a bad setup by me?


thanks


Pat

Jason Meyering wrote:

> You might want to check if you've got a server_wait_time setting.  Here's a
> description from http://www.htdig.org/attrs.html#server_wait_time
>
> This attribute tells htdig to ensure a server has had a delay (in seconds)
> from the beginning of the last connection. This can be used to prevent
> "server abuse" by digging without delay. It's recommended to set this to
> 10-30 (seconds) when indexing servers that you don't monitor yourself.
> Additionally, this attribute can slow down local indexing if set, which may
> or may not be what you intended.
>
> -Original Message-
> From: Pat Lennon [mailto:[EMAIL PROTECTED]]
> Sent: Monday, January 22, 2001 4:29 PM
> To: Ing. Noel Vargas Baltodano
> Cc: [EMAIL PROTECTED]; [EMAIL PROTECTED]
> Subject: Re: [htdig] How Long???
>
> WOW!! 5 minutes I have the turtle version..RedHAt Linux 6.1 P150 64 meg
> ram. It's benn running for approx 20 hours now.  :>)
>
> -P
>
> "Ing. Noel Vargas Baltodano" wrote:
>
> > Hi Pat:
> >
> > It depends on what kind of hardware and resources it's running. Ours has
> > 10 times less than that and runs in about 5 minutes. Since our own
> > pages change radically every day, I'm running htdig to build the database
> > from scratch every day.
> >
> > --
> >
> > Noel Vargas Baltodano
> > [EMAIL PROTECTED]
> >
> > Gerente de Sistemas
> > Nicatechnologies, S.A.
> > http://www.nicatech.com.ni
> >
> > 
> > To unsubscribe from the htdig mailing list, send a message to
> > [EMAIL PROTECTED]
> > You will receive a message to confirm this.
> > List archives:  <http://www.htdig.org/mail/menu.html>
> > FAQ:<http://www.htdig.org/FAQ.html>
>
> 
> To unsubscribe from the htdig mailing list, send a message to
> [EMAIL PROTECTED]
> You will receive a message to confirm this.
> List archives:  <http://www.htdig.org/mail/menu.html>
> FAQ:<http://www.htdig.org/FAQ.html>



To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED]
You will receive a message to confirm this.
List archives:  <http://www.htdig.org/mail/menu.html>
FAQ:<http://www.htdig.org/FAQ.html>

Re: [htdig] How Long???

[Pat Lennon]

WOW!! 5 minutes I have the turtle version..RedHAt Linux 6.1 P150 64 meg
ram. It's benn running for approx 20 hours now.  :>)

-P

"Ing. Noel Vargas Baltodano" wrote:

> Hi Pat:
>
> It depends on what kind of hardware and resources it's running. Ours has
> 10 times less than that and runs in about 5 minutes. Since our own
> pages change radically every day, I'm running htdig to build the database
> from scratch every day.
>
> --
>
> Noel Vargas Baltodano
> [EMAIL PROTECTED]
>
> Gerente de Sistemas
> Nicatechnologies, S.A.
> http://www.nicatech.com.ni
>
> 
> To unsubscribe from the htdig mailing list, send a message to
> [EMAIL PROTECTED]
> You will receive a message to confirm this.
> List archives:  
> FAQ:



To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED]
You will receive a message to confirm this.
List archives:  
FAQ:

[htdig] How Long???

[Pat Lennon]

I am running htdig against my webserver. It holds approx 1 gig of books
in html and pdf. How long can i expect to wait before it finishes. I'm
just lookin for an approximate # here.


Thanks


PAt



To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED]
You will receive a message to confirm this.
List archives:  
FAQ:

[htdig] Memory requriements

[Pat Lennon]

I have a Linux box with approx 1 gig of html and pdf books. I want to
use htdig for the search engine. I dont want to assume to much
butwill 1 additional gig of hard disk cover the size of the index
database. I figure double may be a safe starting point. Also what type
of memory requirements should i consider at a minimum? The hardware is a
Cyrix 150 64 meg ram redhat 6.2 apache webserver. I know this is a vague
question...I would just like some reasonable starting points???



Thanks much

Pat



To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED]
You will receive a message to confirm this.
List archives:  
FAQ:

[htdig] size of DB question

[Pat Lennon - Unified Tech]

I have a small server at my home office. In it I have approx 35 books
and faqs. Some are in .pdf but most are html. The size of the filesystem
taken up my the books is approx 525meg. If I were to compile htdig as a
search engine for my server. By the way its a linux server running
apache web server on a 486dx4120mhz with only 36 meg ram. How much space
would the database  or bases need to be able to do a search of all books
for a word or phrase.

 Now that I mention it will lI be wasting my time with a search engine
on such a old system with little resource. I am the only 1 that will be
searching ,so many users is not a problem. Any feed back is appreciated
thanks

PAt
[EMAIL PROTECTED]



To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED]
You will receive a message to confirm this.