large table performance for WHERE queries

2004-01-15 Thread Gregory Newby
I'm using MySQL for an information retrieval application where word occurrences are indexed. It seems that performance is not as good as I would expect (it seems nearly linear with the number of rows). Any advice would be welcome. I'll lay out a lot of detail. Some details follow. The basic

Re: large table performance for WHERE queries

2004-01-15 Thread Brent Baisley
It sounds like you are trying to do full text searching, but you implemented it manually. Was MySQL's full text indexing not sufficient for your needs or am I totally missing what you are trying to do? On Jan 15, 2004, at 1:53 PM, Gregory Newby wrote: I'm using MySQL for an information

Re: large table performance for WHERE queries

2004-01-15 Thread Gregory Newby
On Thu, Jan 15, 2004 at 02:52:30PM -0500, Brent Baisley wrote: It sounds like you are trying to do full text searching, but you implemented it manually. Was MySQL's full text indexing not sufficient for your needs or am I totally missing what you are trying to do? You're absolutely right:

Re: large table performance for WHERE queries

2004-01-15 Thread Joe Shear
It looks like having a multiple-column index would help more than having a number of individual indices, at least for the example query. An index on (termid, docid, whichpara, offset) might work better than just having one on termid. joe On Thu, 2004-01-15 at 10:53, Gregory Newby wrote: I'm

RE: large table performance for WHERE queries

2004-01-15 Thread Lopez David E-r9374c
] Subject: large table performance for WHERE queries I'm using MySQL for an information retrieval application where word occurrences are indexed. It seems that performance is not as good as I would expect (it seems nearly linear with the number of rows). Any advice would be welcome. I'll lay out