Re: 4.0.15 FULLTEXT INDEX

2003-10-09 Thread Sergei Golubchik
Hi!

On Oct 07, Dathan Vance Pattishall wrote:
 I have to drop the FULLTEXT INDEX added to a set of dbs containing a
 TEXT field with an average of 6K of text added to each row, at a growth
 of 250K rows added a day to a set of 100 tables. The reason for the drop
 is due to table corruption and non-related query slowdown.
  
 If mysql.com is interested in this issue, I can send a copy the table
 format etc. In the meantime I have to drop the FULL TEXT INDEX.

Yes, sure, we're interested!
We even have a public bug database on http://bugs.mysql.com/
where one can report a bug, and follow the progress of his bugreport.
Actually http://bugs.mysql.com/ is The preferred place to report a bug.
  
 DELETES and Frequent UPDATES of a FULLTEXT INDEX column, IMO are the
 root cause of table corruption and query slow down time. 

Can you create a test case for this ?
  
 The reason for this opinion is based on the situation where after adding
 the FULL TEXT INDEX to the body of each user's message, table corruption
 occurred everyday, and query time of non related queries to a full text

What are these non-related queries ?

 column multiplied by 10 or more. The application made frequents updates
 to a table and a batch job or a user action would cause deletes.
  
 Here are the corruption errors.
 Can't open file: 'messages_06.MYI'. (errno: 145)

% perror 145
145 = Table was marked as crashed and should be repaired

So, unfortunately, it does not say anything about the reason of
corruption.

 The fix
 REPAIR TABLE messages_06;

What does REPAIR say ?
 
 I would see dead lock queries as well: Explanation below.
  
 Prior to the FULL TEXT INDEX queries normally took no more then a
 second. These same queries took nearly 5 min before I killed them.

What queries ?

 The stuck state was either waiting for table (btw no alter/flush
 change was going on) or Locked, but not locked on any particular
 query. The second granularity that show full processlist displays
 did not indicate which query was the problem. 

What does SHOW PROCESSLIST show ?
  
Regards,
Sergei

-- 
   __  ___ ___   __
  /  |/  /_ __/ __/ __ \/ /   Sergei Golubchik [EMAIL PROTECTED]
 / /|_/ / // /\ \/ /_/ / /__  MySQL AB, Senior Software Developer
/_/  /_/\_, /___/\___\_\___/  Osnabrueck, Germany
   ___/  www.mysql.com

-- 
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



4.0.15 FULLTEXT INDEX

2003-10-07 Thread Dathan Vance Pattishall
I have to drop the FULLTEXT INDEX added to a set of dbs containing a
TEXT field with an average of 6K of text added to each row, at a growth
of 250K rows added a day to a set of 100 tables. The reason for the drop
is due to table corruption and non-related query slowdown.
 
DELETES and Frequent UPDATES of a FULLTEXT INDEX column, IMO are the
root cause of table corruption and query slow down time. 
 
The reason for this opinion is based on the situation where after adding
the FULL TEXT INDEX to the body of each user's message, table corruption
occurred everyday, and query time of non related queries to a full text
column multiplied by 10 or more. The application made frequents updates
to a table and a batch job or a user action would cause deletes.
 
Here are the corruption errors.
Can't open file: 'messages_06.MYI'. (errno: 145)


The fix
REPAIR TABLE messages_06;
 
I would see dead lock queries as well: Explanation below.
 
Prior to the FULL TEXT INDEX queries normally took no more then a
second. These same queries took nearly 5 min before I killed them. The
stuck state was either waiting for table (btw no alter/flush change was
going on) or Locked, but not locked on any particular query. The second
granularity that show full processlist displays did not indicate which
query was the problem. 
 
 
If mysql.com is interested in this issue, I can send a copy the table
format etc. In the meantime I have to drop the FULL TEXT INDEX.
 
 
 
 
- Dathan Vance Pattishall
  - Sr. Programmer and mySQL DBA for FriendFinder Inc.
  - http://friendfinder.com/go/p40688