k, try the search engine now ... I just found a 'missing index' on one of the critical tables, and I'm getting more realistic speeds on search results ...
On Thu, 4 Sep 2003, Marc G. Fournier wrote: > > go for it, point it at archives.postgresql.org though, since that is the > major part of the search engine > > On Thu, 4 Sep 2003, scott.marlowe wrote: > > > On Tue, 2 Sep 2003, Marc G. Fournier wrote: > > > > > > > > okay, first off ... what URL? I've been working on, and testing, archives > > > all week, and altho getting things down below a 2min search appears to be > > > near impossible (anyone know something *better* then mnogosearch that will > > > handle >250k URLs and growing ... ? we tried ht/Dig before, and the > > > resources it suck'd were outrageous) ... > > > > Hi Marc, I use htdig at work to index a rather large web site and it > > doesn't use resources all that bad. My htdig db directory is only 250 > > megs and it screams. Are you sure it was that bad? > > > > Would it be ok if I pointed a test instance of htdig at postgresql.org at > > night and indexed it to get an idea of how much space it'll take to index > > it? I'm a huge fan of htdig/ warts and all, so I'd kinda like to see if > > it can be made to work. > > > > > > ---------------------------(end of broadcast)--------------------------- > TIP 2: you can get off all lists at once with the unregister command > (send "unregister YourEmailAddressHere" to [EMAIL PROTECTED]) > ---------------------------(end of broadcast)--------------------------- TIP 4: Don't 'kill -9' the postmaster
