Re: MySQL as spider database.

2001-02-27 Thread John Jensen
Okay, so I'm slow getting caught up on this list. ht::/Dig is practically useless! Having done an extensive search on college websites tracking down essential details on the schools and their programs, I have run across a number that use ht::/Dig. In every single case, ht::/Dig returned the mo

Re: MySQL as spider database.

2001-02-26 Thread Dave Hodgkinson
Vahan Yerkanian <[EMAIL PROTECTED]> writes: > My task is to implement several custom word parsing/modification > before writing the keywords into the database, as well as I just > want to have my own code ;-) Ah, OK. You could always just hack the spidering part of ht://Dig? -- Dave Hodgkinso

Re: MySQL as spider database.

2001-02-25 Thread Vahan Yerkanian
Dave Hodgkinson wrote: > > Out of interest, what's unacceptable about ht::/Dig for you? > -- > Dave Hodgkinson, http://www.hodgkinson.org > Editor-in-chief, The Highway Star http://www.deep-purple.com > Apache, mod_perl, MySQL, Sybase hired gun for, wel

Re: MySQL as spider database.

2001-02-25 Thread Dave Hodgkinson
Vahan Yerkanian <[EMAIL PROTECTED]> writes: > Atle Veka wrote: > > > > Why not use something that's already created for you, and is probably > > *much* faster than your solution :) > > Oh... if it really was an acceptable choice, I won't post this question. > :)) Out of interest, what's unacce

Re: MySQL as spider database.

2001-02-23 Thread Vahan Yerkanian
Ed Carp wrote: > > Have you tried the full text search capabilities yet? Might work in your case - >docs at http://www.mysql.com/doc/M/y/MySQL_full-text_search.html Yeah I tried them, but it doesn't work on substring search, only phrase search, e.g. MATCH Keywords AGAINST('vid orce') wont find

Re: MySQL as spider database.

2001-02-23 Thread Ed Carp
Vahan Yerkanian ([EMAIL PROTECTED]) writes: > I'm in process of writing a web page indexer, which retrieves > pages from a preset URL list, strips them from HTML tags, and > inserts the text into a database. Now what I'm puzzled with is > the table structure which holds the text information. Sett

Re: MySQL as spider database.

2001-02-23 Thread Vahan Yerkanian
Atle Veka wrote: > > Why not use something that's already created for you, and is probably > *much* faster than your solution :) Oh... if it really was an acceptable choice, I won't post this question. :)) > One example is ht://Dig (htdig.org). > > Atle -- Vahan Yerkanian

Re: MySQL as spider database.

2001-02-23 Thread Atle Veka
Why not use something that's already created for you, and is probably *much* faster than your solution :) One example is ht://Dig (htdig.org). Atle On Sat, 24 Feb 2001, Vahan Yerkanian wrote: > Greetings All! > > I'm in process of writing a web page indexer, which retrieves > pages from a