RE: Search Engine type search
I'm using ASP (VB Script) at the moment for my webpages. From: [EMAIL PROTECTED] To: [EMAIL PROTECTED]; mysql@lists.mysql.com Subject: RE: Search Engine type search Date: Wed, 23 Aug 2006 16:36:19 -0400 That's a tough one. Basically, you need a spell checker plug-in for your application, I don't think there's much hope of doing this in MySQL alone. You might find a spell checker that uses MySQL for a back end, of course, but I doubt it. Doing a search on Google, I found some open-source spell checkers (http://www.thefreecountry.com/sourcecode/spellcheckers.shtml, et al). I don't know what language you are using, so I can't go further than that. Regards, Jerry Schwartz Global Information Incorporated 195 Farmington Ave. Farmington, CT 06032 860.674.8796 / FAX: 860.674.8341 -Original Message- From: Neil Tompkins [mailto:[EMAIL PROTECTED] Sent: Wednesday, August 23, 2006 4:02 PM To: mysql@lists.mysql.com Subject: RE: Search Engine type search OK, I appear to be getting somewhere with the FULL TEXT search. Does anyone have any good resources about producing search engine type results ? for example if some enters a search phrase like londn how would I suggest the word london ? -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED] _ Be one of the first to try Windows Live Mail. http://ideas.live.com/programpage.aspx?versionId=5d21c51a-b161-4314-9b0e-4911fb2b2e6d
Re: Search Engine type search
Chris wrote: The most common next search becomes the did you mean. Yes, that might work well, but I wouldn't use it out of the box. I would send a report to a human first to use that information instead of doing it automatically. Imagine someone searching for cous (instead of cows) and than, search for sex. As sex is by far the most searched it's probable that it becomes the next search (specially after dubious words such as cow). Now imagine your son searching for cows for his school homework... :) cheers, --renato -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
RE: Search Engine type search
Yeah, my customer wasn't too pleased when his product search could only find certain colors. ;) Regards, Jerry Schwartz Global Information Incorporated 195 Farmington Ave. Farmington, CT 06032 860.674.8796 / FAX: 860.674.8341 -Original Message- From: Chris [mailto:[EMAIL PROTECTED] Sent: Wednesday, August 23, 2006 10:47 PM To: Jerry Schwartz Cc: Neil Tompkins; mysql@lists.mysql.com Subject: Re: Search Engine type search Jerry Schwartz wrote: Actually, by default a full text search ignores words that are three characters or less, not less than three characters. I found this out by searching on red. Ahh, oops :) Thanks! -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
RE: Search Engine type search
Thanks for the info. I think that problem was the fact I only had a couple of records. When creating the FULLINDEX field, does anything else happen to the field, other than the fact you can search FULLINDEX. The reason I ask is because I have about 1600 text fields which I want to apply this to. Thanks Neil Date: Wed, 23 Aug 2006 12:34:10 +1000 From: [EMAIL PROTECTED] To: [EMAIL PROTECTED] CC: mysql@lists.mysql.com Subject: Re: Search Engine type search Neil Tompkins wrote: I followed the instructions, but when doing a search I get no results returned. here is my table CREATE TABLE /*!32300 IF NOT EXISTS*/ MyTest ( id int(10) unsigned NOT NULL auto_increment, title varchar(200) , body text , PRIMARY KEY (id), INDEX title (title,body));I created FULL INDEX, but for some reason it is not showing above ? Do a show create table tablename; does it show up then? A full text index will only be used once a table is populated (less than 3 or 4 rows it won't use it at all). See http://dev.mysql.com/doc/refman/5.1/en/fulltext-search.html and http://dev.mysql.com/doc/refman/5.1/en/fulltext-restrictions.html and finally some words will not be included in a full text search automatically: http://dev.mysql.com/doc/refman/5.1/en/fulltext-stopwords.html -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED] _ Be one of the first to try Windows Live Mail. http://ideas.live.com/programpage.aspx?versionId=5d21c51a-b161-4314-9b0e-4911fb2b2e6d
Re: Search Engine type search
Neil Tompkins wrote: Thanks for the info. I think that problem was the fact I only had a couple of records. When creating the FULLINDEX field, does anything else happen to the field, other than the fact you can search FULLINDEX. The reason I ask is because I have about 1600 text fields which I want to apply this to. The only thing that happens is the index is created - same as any other type of index. One other thing - in case the restrictions page didn't mention this, fulltext by default ignores words which are less than 3 characters long. You can change this, it'll be in the docs somewhere - ft_min_word_len. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
RE: Search Engine type search
Actually, by default a full text search ignores words that are three characters or less, not less than three characters. I found this out by searching on red. Regards, Jerry Schwartz Global Information Incorporated 195 Farmington Ave. Farmington, CT 06032 860.674.8796 / FAX: 860.674.8341 One other thing - in case the restrictions page didn't mention this, fulltext by default ignores words which are less than 3 characters long. You can change this, it'll be in the docs somewhere - ft_min_word_len. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
RE: Search Engine type search
OK, I appear to be getting somewhere with the FULL TEXT search. Does anyone have any good resources about producing search engine type results ? for example if some enters a search phrase like londn how would I suggest the word london ? From: [EMAIL PROTECTED] To: [EMAIL PROTECTED]; [EMAIL PROTECTED] CC: mysql@lists.mysql.com Subject: RE: Search Engine type search Date: Wed, 23 Aug 2006 12:18:59 -0400 Actually, by default a full text search ignores words that are three characters or less, not less than three characters. I found this out by searching on red. Regards, Jerry Schwartz Global Information Incorporated 195 Farmington Ave. Farmington, CT 06032 860.674.8796 / FAX: 860.674.8341 One other thing - in case the restrictions page didn't mention this, fulltext by default ignores words which are less than 3 characters long. You can change this, it'll be in the docs somewhere - ft_min_word_len. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe: http://lists.mysql.com/[EMAIL PROTECTED] _ Be one of the first to try Windows Live Mail. http://ideas.live.com/programpage.aspx?versionId=5d21c51a-b161-4314-9b0e-4911fb2b2e6d
RE: Search Engine type search
OK, I appear to be getting somewhere with the FULL TEXT search. Does anyone have any good resources about producing search engine type results ? for example if some enters a search phrase like londn how would I suggest the word london ? Hi Neil, That's a completely different thing, but very common to see both together. I'd say a good way of doing this is to have a from/to table and when the user search for from and to have more results (replace and search to check) you show him a did you mean box with the new word in bold. It's really hard to extract that information from searches anyway so the best you can do, as far as I know, is to monitor the common mistakes by looking into logs and adding terms to that table manually. cheers, --renato -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
RE: Search Engine type search
That's a tough one. Basically, you need a spell checker plug-in for your application, I don't think there's much hope of doing this in MySQL alone. You might find a spell checker that uses MySQL for a back end, of course, but I doubt it. Doing a search on Google, I found some open-source spell checkers (http://www.thefreecountry.com/sourcecode/spellcheckers.shtml, et al). I don't know what language you are using, so I can't go further than that. Regards, Jerry Schwartz Global Information Incorporated 195 Farmington Ave. Farmington, CT 06032 860.674.8796 / FAX: 860.674.8341 -Original Message- From: Neil Tompkins [mailto:[EMAIL PROTECTED] Sent: Wednesday, August 23, 2006 4:02 PM To: mysql@lists.mysql.com Subject: RE: Search Engine type search OK, I appear to be getting somewhere with the FULL TEXT search. Does anyone have any good resources about producing search engine type results ? for example if some enters a search phrase like londn how would I suggest the word london ? -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Search Engine type search
Jerry Schwartz wrote: Actually, by default a full text search ignores words that are three characters or less, not less than three characters. I found this out by searching on red. Ahh, oops :) Thanks! -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Search Engine type search
Neil Tompkins wrote: OK, I appear to be getting somewhere with the FULL TEXT search. Does anyone have any good resources about producing search engine type results ? for example if some enters a search phrase like londn how would I suggest the word london ? I was listening to a podcast a while ago that explained this (can't find the reference sorry) and basically what they do is if the search term contains no results or only a few results, log what the person types in next to search for. The most common next search becomes the did you mean. Whether that's true or not I don't know but it's a pretty simple idea and would work reasonably well. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Search Engine type search
On my website I'm looking to add a search box. I have a number of different database fields. Does anyone have any recommendations about how I can perform a search engine type search including the text fields. Regards Neil _ Be one of the first to try Windows Live Mail. http://ideas.live.com/programpage.aspx?versionId=5d21c51a-b161-4314-9b0e-4911fb2b2e6d
Re: Search Engine type search
Neil Tompkins wrote: I have a number of different database fields. Does anyone have any recommendations about how I can perform a search engine type search including the text fields. Full-Text Search: http://dev.mysql.com/doc/refman/5.0/en/fulltext-search.html cheers, --renato -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
RE: Search Engine type search
I followed the instructions, but when doing a search I get no results returned. here is my table CREATE TABLE /*!32300 IF NOT EXISTS*/ MyTest ( id int(10) unsigned NOT NULL auto_increment, title varchar(200) , body text , PRIMARY KEY (id), INDEX title (title,body)); I created FULL INDEX, but for some reason it is not showing above ? Any ideas Neil Date: Tue, 22 Aug 2006 11:54:43 +0100 From: [EMAIL PROTECTED] To: [EMAIL PROTECTED] CC: mysql@lists.mysql.com Subject: Re: Search Engine type search Neil Tompkins wrote: I have a number of different database fields. Does anyone have any recommendations about how I can perform a search engine type search including the text fields. Full-Text Search: http://dev.mysql.com/doc/refman/5.0/en/fulltext-search.html cheers, --renato -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe: http://lists.mysql.com/[EMAIL PROTECTED] _ Be one of the first to try Windows Live Mail. http://ideas.live.com/programpage.aspx?versionId=5d21c51a-b161-4314-9b0e-4911fb2b2e6d
Re: Search Engine type search
On Tue, Aug 22, 2006 at 10:42:52AM +, Neil Tompkins wrote: On my website I'm looking to add a search box. I have a number of different database fields. Does anyone have any recommendations about how I can perform a search engine type search including the text fields. Have you looked at for exampole mnogosearch? Regards Neil _ Be one of the first to try Windows Live Mail. http://ideas.live.com/programpage.aspx?versionId=5d21c51a-b161-4314-9b0e-4911fb2b2e6d -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean. -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Search Engine type search
Neil Tompkins wrote: I followed the instructions, but when doing a search I get no results returned. here is my table CREATE TABLE /*!32300 IF NOT EXISTS*/ MyTest ( id int(10) unsigned NOT NULL auto_increment, title varchar(200) , body text , PRIMARY KEY (id), INDEX title (title,body)); I created FULL INDEX, but for some reason it is not showing above ? Do a show create table tablename; does it show up then? A full text index will only be used once a table is populated (less than 3 or 4 rows it won't use it at all). See http://dev.mysql.com/doc/refman/5.1/en/fulltext-search.html and http://dev.mysql.com/doc/refman/5.1/en/fulltext-restrictions.html and finally some words will not be included in a full text search automatically: http://dev.mysql.com/doc/refman/5.1/en/fulltext-stopwords.html -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]