Re: big table corruption
Have a look at your /var/log/messages for messages around the time the table crashes . It really should not crash this much. Is there a quota system on your box ? I once had a table marked corrupt and though I tried hard to find where the problem is, I was not able to. Eventually, it turned out that the user had exceeded the quota set for her. The crashes happin when the program runs, and puts in new data, 4 times per day, crash once a day ususally no quota's on the system -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: big table corruption
matt_lists wrote: every few days I get one of these MySql: Can't open file: 'mrf.MYI' (errno: 145) For more information, see Help and Support Center at http://www.mysql.com. Checking table: './db/mrf' For more information, see Help and Support Center at http://www.mysql.com. Recovering table: './db/mrf' For more information, see Help and Support Center at http://www.mysql.com. always recovers fine I guess, nothing gets wrote to the .err file 3 more of the same table crashing last night Have a look at your /var/log/messages for messages around the time the table crashes . It really should not crash this much. Is there a quota system on your box ? I once had a table marked corrupt and though I tried hard to find where the problem is, I was not able to. Eventually, it turned out that the user had exceeded the quota set for her. -- Raj Shekhar, System Administrator Media Web India http://www.netphotograph.com -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: big table corruption
matt_lists wrote: Raj Shekhar wrote: Mark Maggelet wrote: Hi, I have a big table (900k rows, 200M MYD, 200M MYI) with a fulltext index on it. The table gets corrupted every 1 week or so and I have to repair it. I've tried upgrading to newer versions of mysql 3 times but the problem persists. I think it may have something to do with the raid 1 mirror but I can't really tell. Does anyone have any ideas? Not sure if this would apply in your case but have a look at the discussion on http://bugs.mysql.com/bug.php?id=563 . Some useful hints provided there. Regards I have the same problem, with 4.1.9 always the same table, very simple setup every day 5 times the table has a set of records deleted, and then reloaded from the text files we recieve from the old mainframe delete from mrf where site='site1' then "load data concurrent infile blah blah" for 5 separate sites that's it, it's queried at a low load via websites every few days I get one of these MySql: Can't open file: 'mrf.MYI' (errno: 145) For more information, see Help and Support Center at http://www.mysql.com. Checking table: './db/mrf' For more information, see Help and Support Center at http://www.mysql.com. Recovering table: './db/mrf' For more information, see Help and Support Center at http://www.mysql.com. always recovers fine I guess, nothing gets wrote to the .err file 3 more of the same table crashing last night -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: big table corruption
Raj Shekhar wrote: Mark Maggelet wrote: Hi, I have a big table (900k rows, 200M MYD, 200M MYI) with a fulltext index on it. The table gets corrupted every 1 week or so and I have to repair it. I've tried upgrading to newer versions of mysql 3 times but the problem persists. I think it may have something to do with the raid 1 mirror but I can't really tell. Does anyone have any ideas? Not sure if this would apply in your case but have a look at the discussion on http://bugs.mysql.com/bug.php?id=563 . Some useful hints provided there. Regards I have the same problem, with 4.1.9 always the same table, very simple setup every day 5 times the table has a set of records deleted, and then reloaded from the text files we recieve from the old mainframe delete from mrf where site='site1' then "load data concurrent infile blah blah" for 5 separate sites that's it, it's queried at a low load via websites every few days I get one of these MySql: Can't open file: 'mrf.MYI' (errno: 145) For more information, see Help and Support Center at http://www.mysql.com. Checking table: './db/mrf' For more information, see Help and Support Center at http://www.mysql.com. Recovering table: './db/mrf' For more information, see Help and Support Center at http://www.mysql.com. always recovers fine I guess, nothing gets wrote to the .err file -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: big table corruption
Mark Maggelet wrote: Hi, I have a big table (900k rows, 200M MYD, 200M MYI) with a fulltext index on it. The table gets corrupted every 1 week or so and I have to repair it. I've tried upgrading to newer versions of mysql 3 times but the problem persists. I think it may have something to do with the raid 1 mirror but I can't really tell. Does anyone have any ideas? Not sure if this would apply in your case but have a look at the discussion on http://bugs.mysql.com/bug.php?id=563 . Some useful hints provided there. Regards -- Raj Shekhar, System Administrator Media Web India http://www.netphotograph.com -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: big table corruption
Random hardware failures will NOT only impact a single file. The only thing that I know that will consistantly fail at the same spot is s/w. On Mon, 03 Jan 2005 16:32:31 -0800, Mark Maggelet <[EMAIL PROTECTED]> wrote: > Thanks Mike, > It's hardware raid, but I don't know the manufacturer. I could try to > find out but if the problem is the hardware there isn't much I can do > about it anyway without turning it into a big project. > > I'm not really expecting to solve this, I'm just hoping for some advice > on what the problem is most likely to be (raid,kernel or mysql) or maybe > there is a variable that I can tweak. > > The thing that makes me think it's mysql is that it always happens to > the same table (out of 300 or so). The table it happens to has the most > reads by far but not many writes. > > any other tips are appreciated. > thanks, > - Mark > > mos wrote: > > > At 12:37 PM 1/3/2005, you wrote: > > > >> Hi, > >> I have a big table (900k rows, 200M MYD, 200M MYI) with a fulltext > >> index on it. The table gets corrupted every 1 week or so and I have to > >> repair it. I've tried upgrading to newer versions of mysql 3 times but > >> the problem persists. I think it may have something to do with the > >> raid 1 mirror but I can't really tell. > >> > >> Does anyone have any ideas? > >> Thanks, > >> - Mark > >> > > > > Mark, > > This might help > > http://www.google.com/search?hl=en&q=mysql+raid+corruption&btnG=Google+Search&meta= > > > > You can also check the groups > > http://groups-beta.google.com/groups?q=mysql+raid+corruption&start=10&hl=en&lr=&; > > > > > > You may want to try and narrow down the results by also > > supplying your Raid hardware/software that you're using. It could also > > be processor/OS related. > > > > Mike > > > > -- > MySQL General Mailing List > For list archives: http://lists.mysql.com/mysql > To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED] > > -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: big table corruption
Thanks Mike, It's hardware raid, but I don't know the manufacturer. I could try to find out but if the problem is the hardware there isn't much I can do about it anyway without turning it into a big project. I'm not really expecting to solve this, I'm just hoping for some advice on what the problem is most likely to be (raid,kernel or mysql) or maybe there is a variable that I can tweak. The thing that makes me think it's mysql is that it always happens to the same table (out of 300 or so). The table it happens to has the most reads by far but not many writes. any other tips are appreciated. thanks, - Mark mos wrote: At 12:37 PM 1/3/2005, you wrote: Hi, I have a big table (900k rows, 200M MYD, 200M MYI) with a fulltext index on it. The table gets corrupted every 1 week or so and I have to repair it. I've tried upgrading to newer versions of mysql 3 times but the problem persists. I think it may have something to do with the raid 1 mirror but I can't really tell. Does anyone have any ideas? Thanks, - Mark Mark, This might help http://www.google.com/search?hl=en&q=mysql+raid+corruption&btnG=Google+Search&meta= You can also check the groups http://groups-beta.google.com/groups?q=mysql+raid+corruption&start=10&hl=en&lr=&; You may want to try and narrow down the results by also supplying your Raid hardware/software that you're using. It could also be processor/OS related. Mike -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: big table corruption
At 12:37 PM 1/3/2005, you wrote: Hi, I have a big table (900k rows, 200M MYD, 200M MYI) with a fulltext index on it. The table gets corrupted every 1 week or so and I have to repair it. I've tried upgrading to newer versions of mysql 3 times but the problem persists. I think it may have something to do with the raid 1 mirror but I can't really tell. Does anyone have any ideas? Thanks, - Mark Mark, This might help http://www.google.com/search?hl=en&q=mysql+raid+corruption&btnG=Google+Search&meta= You can also check the groups http://groups-beta.google.com/groups?q=mysql+raid+corruption&start=10&hl=en&lr=&; You may want to try and narrow down the results by also supplying your Raid hardware/software that you're using. It could also be processor/OS related. Mike -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: big table corruption
Thanks Heikki,
check table gives me this:
mysql> check table resourcesback;
++---+--++
| Table | Op| Msg_type | Msg_text |
++---+--++
| edplanet.resourcesback | check | warning | Table is marked as crashed |
| edplanet.resourcesback | check | error| Found 91296 keys of 91297 |
| edplanet.resourcesback | check | error| Corrupt|
++---+--++
mysql version is: mysql-standard-4.0.21-pc-linux-i686
but I had similar problems with:
mysql-standard-4.0.18-pc-linux-i686 and
mysql-standard-4.1.1-alpha-pc-linux-i686
show create table says:
CREATE TABLE `resourcesback` (
`id` int(11) NOT NULL auto_increment,
`url` varchar(255) NOT NULL default '',
`title` varchar(255) NOT NULL default '',
`keywords` text NOT NULL,
`description` varchar(255) NOT NULL default '',
`rating` tinyint(4) NOT NULL default '0',
`grade` set('Pre-K','K-2','3-5','6-8','9-12','Higher Ed') default NULL,
`media` varchar(255) NOT NULL default '',
`image` varchar(255) NOT NULL default '',
`imageexists` enum('Y','N') NOT NULL default 'N',
`imagewidth` int(11) NOT NULL default '0',
`imageheight` int(11) NOT NULL default '0',
`controversial` enum('Y','N') NOT NULL default 'N',
`contents` set('audio','video','images') default NULL,
`timelinestart` int(11) NOT NULL default '0',
`timelineend` int(11) NOT NULL default '0',
`reviewer` varchar(255) default NULL,
`day` date default NULL,
`status` varchar(255) NOT NULL default 'active',
PRIMARY KEY (`id`),
UNIQUE KEY `url` (`url`),
KEY `media` (`media`),
FULLTEXT KEY `title` (`title`,`description`,`keywords`)
) TYPE=MyISAM
OS is RedHat 9 - 2.4.20-8smp
I'd rather not upload the crashed table because it is really big and it
has some sensitive data.
Thanks,
- Mark
Heikki Tuuri wrote:
Mark,
- Original Message - From: "Mark Maggelet"
<[EMAIL PROTECTED]>
Newsgroups: mailing.database.myodbc
Sent: Monday, January 03, 2005 8:36 PM
Subject: big table corruption
Hi,
I have a big table (900k rows, 200M MYD, 200M MYI) with a fulltext index
on it. The table gets corrupted every 1 week or so and I have to repair
it. I've tried upgrading to newer versions of mysql 3 times but the
problem persists. I think it may have something to do with the raid 1
mirror but I can't really tell.
Does anyone have any ideas?
it should not get corrupt. Please file a very detailed bug report to
bugs.mysql.com, if you are willing to upload the corrupt files via ftp
for further analysis.
What does CHECK TABLE print about the corruption? What MySQL version?
What is SHOW CREATE TABLE like? What OS?
Thanks,
- Mark
Best regards,
Heikki Tuuri
Innobase Oy
Foreign keys, transactions, and row level locking for MySQL
InnoDB Hot Backup - a hot backup tool for InnoDB which also backs up
MyISAM tables
http://www.innodb.com/order.php
--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: big table corruption
Mark, - Original Message - From: "Mark Maggelet" <[EMAIL PROTECTED]> Newsgroups: mailing.database.myodbc Sent: Monday, January 03, 2005 8:36 PM Subject: big table corruption Hi, I have a big table (900k rows, 200M MYD, 200M MYI) with a fulltext index on it. The table gets corrupted every 1 week or so and I have to repair it. I've tried upgrading to newer versions of mysql 3 times but the problem persists. I think it may have something to do with the raid 1 mirror but I can't really tell. Does anyone have any ideas? it should not get corrupt. Please file a very detailed bug report to bugs.mysql.com, if you are willing to upload the corrupt files via ftp for further analysis. What does CHECK TABLE print about the corruption? What MySQL version? What is SHOW CREATE TABLE like? What OS? Thanks, - Mark Best regards, Heikki Tuuri Innobase Oy Foreign keys, transactions, and row level locking for MySQL InnoDB Hot Backup - a hot backup tool for InnoDB which also backs up MyISAM tables http://www.innodb.com/order.php -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
big table corruption
Hi, I have a big table (900k rows, 200M MYD, 200M MYI) with a fulltext index on it. The table gets corrupted every 1 week or so and I have to repair it. I've tried upgrading to newer versions of mysql 3 times but the problem persists. I think it may have something to do with the raid 1 mirror but I can't really tell. Does anyone have any ideas? Thanks, - Mark -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
