Re: Full-Text problems

2006-06-21 Thread Brent Baisley
Perhaps the searches that return nothing are actually matching more than 50% of the record in the table. 

From the manual:

In addition, words that are present in more than 50% of the rows are considered 
common and do not match.

- Original Message - 
From: Taco Fleur [EMAIL PROTECTED]

To: mysql@lists.mysql.com
Sent: Wednesday, June 21, 2006 12:21 AM
Subject: Full-Text problems



Hi all,

I am experiencing some issues with Full-Text and was hoping someone could
shed some light on the following.

I have some content which I know contains for example the word news, the
table is MyISAM, the column type is LONGTEXT, there is an index on the
column of FULLTEXT.

I have adjusted the system variables so that the minimum word length is 2
(ft_min_word_len = 2) and the stop word file is set to (ft_stopword_file =
'')

Can anyone tell me why it is not picking up the word news plus some others?

I have verified that the system picked up the new variable settings with
SHOW VARIABLES

I have also deleted everything in that table and reinserted the content,
which I hope rebuilds the table?

Other words that do not appear are;
- dealer
- sign in
- contact

I have verified that it returns other results, i.e. when searching on words
like;
- headline
- engineering
- user
- her

The query is as below

SELECTI.indexIdentity
 , I.webpageIdentity
 , I.content
 , I.indexDate
 , MATCH ( I.content ) AGAINST ( '#form.searchString#' ) AS score
 , W.universalResourceLocator
 , W.title
 FROMtbl_index I
 INNER JOIN   tbl_webpage W
 ON I.webpageIdentity = W.webpageIdentity
 WHEREMATCH ( I.content ) AGAINST ( '#form.searchString#' )
 ORDER BY   score DESC;

The content is text I gathered from our webpages, I am basically trying to
create a site search.
Any help is much appreciated.

Kind regards,


Taco Fleur 


Free Call 1800 032 982 or Mobile 0421 851 786
Pacific Fox  http://www.pacificfox.com.au/ http://www.pacificfox.com.au an
industry leader with commercial IT experience since 1994 .

* 

Web Design and Development 
* 


Accept online Credit Card payments www.commerceengine.com.au
http://www.commerceengine.com.au/  
* 


SMS Solutions, including developer API
* 


Domain Registration, .COM for as low as fifteen dollars a year,
.COM.AU for fifty dollars two years!





--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



RE: Full-Text problems

2006-06-21 Thread Taco Fleur
Is there any way to test this?
I doubt it is 50%, some of these words only appear once or twice within the
content. 


Kind regards,
 

Taco Fleur 

Free Call 1800 032 982 or Mobile 0421 851 786
Pacific Fox http://www.pacificfox.com.au an industry leader with commercial
IT experience since 1994 .

*   
Web Design and Development 
*   
Accept online Credit Card payments www.commerceengine.com.au 
*   
SMS Solutions, including developer API
*   
Domain Registration, .COM for as low as fifteen dollars a year,
.COM.AU for fifty dollars two years!


-Original Message-
From: Brent Baisley [mailto:[EMAIL PROTECTED] 
Sent: Wednesday, 21 June 2006 10:24 PM
To: [EMAIL PROTECTED]; mysql@lists.mysql.com
Subject: Re: Full-Text problems

Perhaps the searches that return nothing are actually matching more than
50% of the record in the table. 
From the manual:
In addition, words that are present in more than 50% of the rows are
considered common and do not match.

- Original Message -
From: Taco Fleur [EMAIL PROTECTED]
To: mysql@lists.mysql.com
Sent: Wednesday, June 21, 2006 12:21 AM
Subject: Full-Text problems


 Hi all,
 
 I am experiencing some issues with Full-Text and was hoping someone could
 shed some light on the following.
 
 I have some content which I know contains for example the word news, the
 table is MyISAM, the column type is LONGTEXT, there is an index on the
 column of FULLTEXT.
 
 I have adjusted the system variables so that the minimum word length is 2
 (ft_min_word_len = 2) and the stop word file is set to (ft_stopword_file =
 '')
 
 Can anyone tell me why it is not picking up the word news plus some
others?
 
 I have verified that the system picked up the new variable settings with
 SHOW VARIABLES
 
 I have also deleted everything in that table and reinserted the content,
 which I hope rebuilds the table?
 
 Other words that do not appear are;
 - dealer
 - sign in
 - contact
 
 I have verified that it returns other results, i.e. when searching on
words
 like;
 - headline
 - engineering
 - user
 - her
 
 The query is as below
 
 SELECTI.indexIdentity
  , I.webpageIdentity
  , I.content
  , I.indexDate
  , MATCH ( I.content ) AGAINST ( '#form.searchString#' ) AS score
  , W.universalResourceLocator
  , W.title
  FROMtbl_index I
  INNER JOIN   tbl_webpage W
  ON I.webpageIdentity = W.webpageIdentity
  WHEREMATCH ( I.content ) AGAINST ( '#form.searchString#' )
  ORDER BY   score DESC;
 
 The content is text I gathered from our webpages, I am basically trying to
 create a site search.
 Any help is much appreciated.
 
 Kind regards,
 
 
 Taco Fleur 
 
 Free Call 1800 032 982 or Mobile 0421 851 786
 Pacific Fox  http://www.pacificfox.com.au/ http://www.pacificfox.com.au
an
 industry leader with commercial IT experience since 1994 .
 
 * 
 
 Web Design and Development 
 * 
 
 Accept online Credit Card payments www.commerceengine.com.au
 http://www.commerceengine.com.au/  
 * 
 
 SMS Solutions, including developer API
 * 
 
 Domain Registration, .COM for as low as fifteen dollars a year,
 .COM.AU for fifty dollars two years!
 
 


-- 
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:
http://lists.mysql.com/[EMAIL PROTECTED]




-- 
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



Re: Full-Text problems

2006-06-21 Thread Brent Baisley
It's not necessarily the word appearing in more than 50% of thre records. If you search result returns more than 50% of the records, 
mysql considers the result irrlevant and doesn't return anything.

You can kind of test it by using LIKE.

SELECT count(*) from table where field like %dealer% or field like %contact%

Remember, by default full text will find records that contain any of the words you are searching on. If you want to find only 
records that contain all the words, you need to do full text boolean search.


- Original Message - 
From: Taco Fleur [EMAIL PROTECTED]

To: mysql@lists.mysql.com
Cc: 'Brent Baisley' [EMAIL PROTECTED]
Sent: Wednesday, June 21, 2006 8:51 AM
Subject: RE: Full-Text problems



Is there any way to test this?
I doubt it is 50%, some of these words only appear once or twice within the
content.


Kind regards,


Taco Fleur

Free Call 1800 032 982 or Mobile 0421 851 786
Pacific Fox http://www.pacificfox.com.au an industry leader with commercial
IT experience since 1994 .

*
Web Design and Development
*
Accept online Credit Card payments www.commerceengine.com.au
*
SMS Solutions, including developer API
*
Domain Registration, .COM for as low as fifteen dollars a year,
.COM.AU for fifty dollars two years!


-Original Message-
From: Brent Baisley [mailto:[EMAIL PROTECTED]
Sent: Wednesday, 21 June 2006 10:24 PM
To: [EMAIL PROTECTED]; mysql@lists.mysql.com
Subject: Re: Full-Text problems

Perhaps the searches that return nothing are actually matching more than
50% of the record in the table.
From the manual:
In addition, words that are present in more than 50% of the rows are
considered common and do not match.

- Original Message -
From: Taco Fleur [EMAIL PROTECTED]
To: mysql@lists.mysql.com
Sent: Wednesday, June 21, 2006 12:21 AM
Subject: Full-Text problems



Hi all,

I am experiencing some issues with Full-Text and was hoping someone could
shed some light on the following.

I have some content which I know contains for example the word news, the
table is MyISAM, the column type is LONGTEXT, there is an index on the
column of FULLTEXT.

I have adjusted the system variables so that the minimum word length is 2
(ft_min_word_len = 2) and the stop word file is set to (ft_stopword_file =
'')

Can anyone tell me why it is not picking up the word news plus some

others?


I have verified that the system picked up the new variable settings with
SHOW VARIABLES

I have also deleted everything in that table and reinserted the content,
which I hope rebuilds the table?

Other words that do not appear are;
- dealer
- sign in
- contact

I have verified that it returns other results, i.e. when searching on

words

like;
- headline
- engineering
- user
- her

The query is as below

SELECTI.indexIdentity
 , I.webpageIdentity
 , I.content
 , I.indexDate
 , MATCH ( I.content ) AGAINST ( '#form.searchString#' ) AS score
 , W.universalResourceLocator
 , W.title
 FROMtbl_index I
 INNER JOIN   tbl_webpage W
 ON I.webpageIdentity = W.webpageIdentity
 WHEREMATCH ( I.content ) AGAINST ( '#form.searchString#' )
 ORDER BY   score DESC;

The content is text I gathered from our webpages, I am basically trying to
create a site search.
Any help is much appreciated.

Kind regards,


Taco Fleur

Free Call 1800 032 982 or Mobile 0421 851 786
Pacific Fox  http://www.pacificfox.com.au/ http://www.pacificfox.com.au

an

industry leader with commercial IT experience since 1994 .

*

Web Design and Development
*

Accept online Credit Card payments www.commerceengine.com.au
http://www.commerceengine.com.au/
*

SMS Solutions, including developer API
*

Domain Registration, .COM for as low as fifteen dollars a year,
.COM.AU for fifty dollars two years!





--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:
http://lists.mysql.com/[EMAIL PROTECTED]






--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



RE: Full-Text problems

2006-06-21 Thread Taco Fleur
Is there any way to override this functionality?
It becomes a real pain, I have to start doing weird stuff to overcome this
limitation, if it would just return the results whether its more than 50% or
not, I would be fine. Is there no way to do this? Thanks. 


Kind regards,
 

Taco Fleur 

Free Call 1800 032 982 or Mobile 0421 851 786
Pacific Fox http://www.pacificfox.com.au an industry leader with commercial
IT experience since 1994 .

*   Web Design and Development 
*   Accept online Credit Card payments www.commerceengine.com.au 
*   SMS Solutions, including developer API
*   Domain Registration, .COM for as low as fifteen dollars a year,
.COM.AU for fifty dollars two years!


-Original Message-
From: Brent Baisley [mailto:[EMAIL PROTECTED] 
Sent: Thursday, 22 June 2006 2:07 AM
To: [EMAIL PROTECTED]; mysql@lists.mysql.com
Subject: Re: Full-Text problems

It's not necessarily the word appearing in more than 50% of thre records. If
you search result returns more than 50% of the records, mysql considers the
result irrlevant and doesn't return anything.
You can kind of test it by using LIKE.

SELECT count(*) from table where field like %dealer% or field like
%contact%

Remember, by default full text will find records that contain any of the
words you are searching on. If you want to find only records that contain
all the words, you need to do full text boolean search.



-- 
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



Full-Text problems

2006-06-20 Thread Taco Fleur
Hi all,
 
I am experiencing some issues with Full-Text and was hoping someone could
shed some light on the following.
 
I have some content which I know contains for example the word news, the
table is MyISAM, the column type is LONGTEXT, there is an index on the
column of FULLTEXT.
 
I have adjusted the system variables so that the minimum word length is 2
(ft_min_word_len = 2) and the stop word file is set to (ft_stopword_file =
'')
 
Can anyone tell me why it is not picking up the word news plus some others?
 
I have verified that the system picked up the new variable settings with
SHOW VARIABLES
 
I have also deleted everything in that table and reinserted the content,
which I hope rebuilds the table?
 
Other words that do not appear are;
- dealer
- sign in
- contact
 
I have verified that it returns other results, i.e. when searching on words
like;
- headline
- engineering
- user
- her
 
The query is as below
 
SELECTI.indexIdentity
  , I.webpageIdentity
  , I.content
  , I.indexDate
  , MATCH ( I.content ) AGAINST ( '#form.searchString#' ) AS score
  , W.universalResourceLocator
  , W.title
  FROMtbl_index I
  INNER JOIN   tbl_webpage W
  ON I.webpageIdentity = W.webpageIdentity
  WHEREMATCH ( I.content ) AGAINST ( '#form.searchString#' )
  ORDER BY   score DESC;
 
The content is text I gathered from our webpages, I am basically trying to
create a site search.
Any help is much appreciated.
 
Kind regards,
 

Taco Fleur 

Free Call 1800 032 982 or Mobile 0421 851 786
Pacific Fox  http://www.pacificfox.com.au/ http://www.pacificfox.com.au an
industry leader with commercial IT experience since 1994 .

*   

Web Design and Development 
*   

Accept online Credit Card payments www.commerceengine.com.au
http://www.commerceengine.com.au/  
*   

SMS Solutions, including developer API
*   

Domain Registration, .COM for as low as fifteen dollars a year,
.COM.AU for fifty dollars two years!