-----Original Message----- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] Sent: Tuesday, May 25, 2004 8:52 AM To: [EMAIL PROTECTED] Cc: James Drabb; [EMAIL PROTECTED] Subject: Re: FULLTEXT and large database
> One thing that ocurs to me is that, if you are using it for syslog type > data, the data being logged will have a relatively samll "vocabulary". > No tesxt-based indexing system will handle this very well. Like looking > up a very common name in a telephone directory, you will get a lot of > hits which will then have to be searched linearly for the right one. And > linear search of meven a subset of a buig database is bad news, because > the records will be physically scattered and not amenable to caching. > > *If* it is true that your data is highly repetitive, could you arrange > to factor out the repetitive bits? For example, if there ate only 20 > record types can you parse out the type and convert it to an integer? > Alec The syslog app is proprietary/closed source which I cannot change. The main column that admins are interested in is MsgText text which has specific error/info/warning messages such as: %PIX-4-106023: Deny udp src inside:10.1.5.242/137 dst core:146.217.142.101/137 by access-group "inside_in" May 25 09:59:40 trend.darden.com MSWinEventLog<009>0<009>Security<009> 14445084<009>Tue May 25 09:59:34 2004<009>593<009>Security<009> IUSR_TREND<009>User<009>Success Audit<009>TREND<009>Detailed Tracking <009><009>A process has exited: Process ID: 32036 Image File Name: C:OfficescanPCCSRVWebCGIcgiRqHotFix.exe User Name: IUSR_TREND Domain: TREND Logon ID: (XXXXXX) <009>418997 Thanks again, Jim Drabb -- =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- =- He who receives an idea from me, receives instruction himself without lessening mine; as he who lights his taper at mine, receives light without darkening me. -- Thomas Jefferson; 1813 =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- =- James Drabb JR Senior Programmer Analyst Darden Restaurants Business Systems JDrabb at Darden dot com -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe: http://lists.mysql.com/[EMAIL PROTECTED]
