Re: [htdig] Indexing problems

2001-01-02 Thread Geoff Hutchison
At 6:03 AM +0100 1/3/01, peter karlsson wrote: >I seem to have some problem with htdig indexing my site; it does index >and update the pages it initially indexed, but it never finds any new >pages, even if they are linked from the previously indexed pages. Does your server send a Last-Modified-Si

[htdig] Indexing problems

2001-01-02 Thread peter karlsson
Hi! I seem to have some problem with htdig indexing my site; it does index and update the pages it initially indexed, but it never finds any new pages, even if they are linked from the previously indexed pages. I'm using the rundig.sh script # rundig.sh # a script to drive ht://Dig updates # Co

Re: [htdig] unix directory index duplication

2001-01-02 Thread Geoff Hutchison
At 9:27 PM -0500 1/2/01, pc wrote: >While watching verbore output during htdig, I noticed that the process is >often processing urls like http:/foo.bar/doc/?M=D, http:/foo.bar/doc/?D=A, >http:/foo.bar/doc/?N=A, and http:/foo.bar/doc/?N=D. This appears to be This is because your Apache server has

Re: [htdig] Remote Request?

2001-01-02 Thread Geoff Hutchison
Based on what you say, you'll probably want to have some sort of "wrapper" CGI. This can take the user's query through the search server and then call htsearch on the index servers using something like ssh to execute htsearch remotely. (I would say rsh since more people are familiar with usin

[htdig] unix directory index duplication

2001-01-02 Thread pc
While watching verbore output during htdig, I noticed that the process is often processing urls like http:/foo.bar/doc/?M=D, http:/foo.bar/doc/?D=A, http:/foo.bar/doc/?N=A, and http:/foo.bar/doc/?N=D. This appears to be creating a significant amount of duplication and I would like to prevent this

[htdig] compiling on IRIX64 6.5

2001-01-02 Thread Dave Salisbury
addendum: I forgot to mention that after the warnings comes a long list of error messages. thanks Dave -- ld32: WARNING 131: Multiply defined weak symbol:(__tf6Object) in Endings.o and Synonym.o (2nd definition ignored). ld32: WARNING 131: Multipl

[htdig] compiling on IRIX64 6.5

2001-01-02 Thread Dave Salisbury
When compiling 3.1.5 on IRIX 6.5 I get bad things. I've tried a myriad of configur options and makefile changes but to no avail. Any help is appreciated! Dave - things are fine till this line: g++ -o htfuzzy -L../htlib -L../htcommon -L../d

Re: [htdig] Options to htdig

2001-01-02 Thread Douglas Kline
OK. Thanks for the additional info. > On Fri, 29 Dec 2000, Douglas Kline wrote: > > > I've been running some tests and my results don't seem consistent with your > > description. > > I think a better way of saying this is "my description wasn't very good." > > Let me put it this way: > -a

Re: [htdig] Indexing a database

2001-01-02 Thread Geoff Hutchison
On Mon, 1 Jan 2001, SMantscheff wrote: > 1) How does htDig recognize that a document has changed? By a meta > tag? By its content? By a header? What information do I have to send > so that htDig knows the document's time? By the Last-Modified: header sent by the server. If a date exists in the d

Re: [htdig] time spent for specific search

2001-01-02 Thread Geoff Hutchison
On Tue, 2 Jan 2001, Sasa Mutic wrote: > is there a way I could get information on time spent for specific > search from htdig so that I can use that information in search results > page ? No, but that's not a bad idea. As a workaround, you could use a shell, perl or other wrapper and time htsea

Re: [htdig] Remote Request?

2001-01-02 Thread Geoff Hutchison
On Tue, 2 Jan 2001, Mike Paradis wrote: > If I could just send a small network request and receive the results, > that would be much more efficient. I'm not quite sure that I follow you exactly. But I think you're asking for something along the lines of the ExternalTransport code in the 3.2 bran

[htdig] Indexing german pages

2001-01-02 Thread Radoy Pavlov
Hello, I have some questions regarding german language. Following the example in FAQ I've made my htdig.conf, extracted GermanWords.zip in $COMMON_DIR/german and edited htdig.conf. I've done this: rerun of rundig rerun of htfuzzy endings Still htdig cant find any words with umlauts (äöü etc), alt

[htdig] time spent for specific search

2001-01-02 Thread Sasa Mutic
hello,   is there a way I could get information on time spent for specific search from htdig so that I can use that information in search results page ?   regards,   Sasa Mutic

[htdig] Remote Request?

2001-01-02 Thread Mike Paradis
In my application, I could use some sort of remote search request. In other words, just having the database remote is not good enough. It takes quite a while to actually go through the big database over a network connection of course. If I could just send a small network request and receive the

Re: [htdig] Slow Responses

2001-01-02 Thread Malcolm Austen
On Mon, 1 Jan 2001, Mike Paradis wrote: + Granted, this is probably a good sizes dbase. + The problem is the amount of time it takes for a return on a search. Searches can +take + about 10 seconds or more to return and this is with only one user searching. If you haven't any specific cause to k