Hi list

My rebol stuff search engine now has more than 10000 
entries, and works pretty fast thanks to DocKimbels mysql 
protocol.

Here's a problem:
Some websites work both with and without the www prefix 
(ex. www.rebol.com and just plain and simple rebol.com). 
Sometimes this gives double records in my DB (ex. 
http://www.oops-as.no/cgi-bin/rebsearch.r?q=mysql : you'll 
see that both http://www.softinnov.com/bdd.html and 
http://softinnov.com/bdd.html appears).

Is there a way to detect such behaviour on a server? Or do 
I have to compare my incoming document to whatever 
documents I already have in the DB that _might_ be the 
same document?

Thnaks,
Hallvard

Prętera censeo Carthaginem esse delendam
-- 
To unsubscribe from this list, just send an email to
[EMAIL PROTECTED] with unsubscribe as the subject.

Reply via email to