RE: on big mysql .MYD files and linux's 2GB file size limit
-Original Message- From: Eric Gunnett [mailto:[EMAIL PROTECTED] Depends on what file system you are running that is a ext2 limit if you move to ext3 or reiser you should be fine. But then a default config on MySQL will run into a 4.29 Gig limit, which you can change. Ext2 has not had a 2 gig filesize limit for a long time. I've created files as large as 16 gigabytes on ext2fs with no problems. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: on big mysql .MYD files and linux's 2GB file size limit
David Brodbeck wrote: Ext2 has not had a 2 gig filesize limit for a long time. 32-bit file offsets are still the default in Linux on 32-bit systems, so these systems will still have the 2GB limit by default. You have to compile your programs with special options to get 64-bit offsets. I'm certain MySQL does this. I'm just pointing out that it's just as incorrect to say that there is a 2GB limit as to say flat out that there is no limit. The truth is more complicated than either statement. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: File size limit exceeded, Linux/MySQl-4.0.20-i686-icc
Nathan Boeger [EMAIL PROTECTED] wrote: Its accessed over the net by the web servers. I don't think we would have file contentions. Actually, we just replaced the mysql binary with an older 4.0.16 version that we compiled and used before we started to use the 4.0,20-i686-icc. Now the db is working without any problems. I wonder if others have had problems with this particular binary. Please try on MySQL official binary version which is not compiled by icc. I.e. download mysql-standard-4.0.20-pc-linux-i686.tar.gz If everything will be ok on this build then it's a bug in icc and it definitely needs to be reported. You can contact me by email in this case or directly open a bug in http://bugs.mysql.com Thank you! -- For technical support contracts, goto https://order.mysql.com/?ref=ensita This email is sponsored by Ensita.net http://www.ensita.net/ __ ___ ___ __ / |/ /_ __/ __/ __ \/ /Egor Egorov / /|_/ / // /\ \/ /_/ / /__ [EMAIL PROTECTED] /_/ /_/\_, /___/\___\_\___/ MySQL AB / Ensita.net ___/ www.mysql.com -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
on big mysql .MYD files and linux's 2GB file size limit
Is the 2GB filesize limit in linux still there? Specially in Gentoo and Debian linux? If so, how can this be addressed when your mysql's .MYD files reach 2GB? Is there any way MySQL can split really big .MYD files? Regards, Shannon __ Do you Yahoo!? Yahoo! Mail - 50x more storage than other providers! http://promotions.yahoo.com/new_mail -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: on big mysql .MYD files and linux's 2GB file size limit
Depends on what file system you are running that is a ext2 limit if you move to ext3 or reiser you should be fine. But then a default config on MySQL will run into a 4.29 Gig limit, which you can change. Eric Gunnett System Administrator Zoovy, Inc. [EMAIL PROTECTED] Shannon R. [EMAIL PROTECTED] 08/02/04 06:58PM Is the 2GB filesize limit in linux still there? Specially in Gentoo and Debian linux? If so, how can this be addressed when your mysql's .MYD files reach 2GB? Is there any way MySQL can split really big .MYD files? Regards, Shannon __ Do you Yahoo!? Yahoo! Mail - 50x more storage than other providers! http://promotions.yahoo.com/new_mail -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED] -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
File size limit exceeded, Linux/MySQl-4.0.20-i686-icc
Hello everybody, We have a few Linux/MySQL boxes and recently we have been having some problems with one of our databases. We have checked out the usual things (hardware, disk quotas, table limits etc...) and we have spent several days looking over newsgroups and other postings with no luck. We are hoping that someone could offer some ideas. What we are seeing is the database shuts down with the following error: File size limit exceeded and thats all we get. After we repair the db and bring it up a few minutes later MySQL shuts down, again, with that same error and all the web servers get the usual 145 error. We are aware that the file size limit on Linux/2.4.x/ext3/MySQL is much larger than our database, right now only 17Gb, but what other reasons would mysql shutdown with File size limit exceeded errors? Details Server: RedHat 7.3 kernel: 2.4.20-20 dual Xeon, using ext3 Database size: 17Gb Index file size: 500Mb MySQL: MySQl-4.0.20-i686-icc binary downloaded from mysql.com our tables are myisam only (no innodb). I was going to post this to the bugs list but we cannot really reproduce it. Any help would be appreciated! -nb -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
RE: File size limit exceeded, Linux/MySQl-4.0.20-i686-icc
How is this table accessed and updated? Do you have file contention issues? Is the MySQL message 145? -Original Message- From: Nathan Boeger To: [EMAIL PROTECTED] Sent: 7/30/04 9:40 AM Subject: File size limit exceeded, Linux/MySQl-4.0.20-i686-icc Hello everybody, We have a few Linux/MySQL boxes and recently we have been having some problems with one of our databases. We have checked out the usual things (hardware, disk quotas, table limits etc...) and we have spent several days looking over newsgroups and other postings with no luck. We are hoping that someone could offer some ideas. What we are seeing is the database shuts down with the following error: File size limit exceeded and thats all we get. After we repair the db and bring it up a few minutes later MySQL shuts down, again, with that same error and all the web servers get the usual 145 error. We are aware that the file size limit on Linux/2.4.x/ext3/MySQL is much larger than our database, right now only 17Gb, but what other reasons would mysql shutdown with File size limit exceeded errors? Details Server: RedHat 7.3 kernel: 2.4.20-20 dual Xeon, using ext3 Database size: 17Gb Index file size: 500Mb MySQL: MySQl-4.0.20-i686-icc binary downloaded from mysql.com our tables are myisam only (no innodb). I was going to post this to the bugs list but we cannot really reproduce it. Any help would be appreciated! -nb -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe: http://lists.mysql.com/[EMAIL PROTECTED] -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: File size limit exceeded, Linux/MySQl-4.0.20-i686-icc
Its accessed over the net by the web servers. I don't think we would have file contentions. Actually, we just replaced the mysql binary with an older 4.0.16 version that we compiled and used before we started to use the 4.0,20-i686-icc. Now the db is working without any problems. I wonder if others have had problems with this particular binary. -nb Victor Pendleton wrote: How is this table accessed and updated? Do you have file contention issues? Is the MySQL message 145? -Original Message- From: Nathan Boeger To: [EMAIL PROTECTED] Sent: 7/30/04 9:40 AM Subject: File size limit exceeded, Linux/MySQl-4.0.20-i686-icc Hello everybody, We have a few Linux/MySQL boxes and recently we have been having some problems with one of our databases. We have checked out the usual things (hardware, disk quotas, table limits etc...) and we have spent several days looking over newsgroups and other postings with no luck. We are hoping that someone could offer some ideas. What we are seeing is the database shuts down with the following error: File size limit exceeded and thats all we get. After we repair the db and bring it up a few minutes later MySQL shuts down, again, with that same error and all the web servers get the usual 145 error. We are aware that the file size limit on Linux/2.4.x/ext3/MySQL is much larger than our database, right now only 17Gb, but what other reasons would mysql shutdown with File size limit exceeded errors? Details Server: RedHat 7.3 kernel: 2.4.20-20 dual Xeon, using ext3 Database size: 17Gb Index file size: 500Mb MySQL: MySQl-4.0.20-i686-icc binary downloaded from mysql.com our tables are myisam only (no innodb). I was going to post this to the bugs list but we cannot really reproduce it. Any help would be appreciated! -nb -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
file size limit
here a file size limit in my sql
Re: file size limit
At 18:59 -0400 8/31/02, qlarry wrote: here a file size limit in my sql What? - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: file size limit
Paul et al, At 18:59 -0400 8/31/02, qlarry wrote: here a file size limit in my sql What? I think that loosely should translate as Where is a file size limit in MySQL which I would then interpret as Is there a file size limit in MySQL. All MyISAM tables are stored on the local file system so it is dependant on the file system and operating system you are running. Or to put it another way, your MyISAM table (MySQL's default type) are stored as files, and it is your operating system that limits the file size and not MySQL. As for other types such as BDB and InnoDB I don't know the answer. I hope this helps. DSL -- Say you'll share with me one love, one lifetime Lead me, save me from my solitude. Say you'll want me with you, here beside you Anywhere you go let me go too... (Webber/Hart/Black) - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: file size limit
At 5:19 +0200 9/1/02, David Lloyd wrote: Paul et al, At 18:59 -0400 8/31/02, qlarry wrote: here a file size limit in my sql What? I think that loosely should translate as Where is a file size limit in MySQL which I would then interpret as Is there a file size limit in MySQL. All MyISAM tables are stored on the local file system so it is dependant on the file system and operating system you are running. Or to put it another way, your MyISAM table (MySQL's default type) are stored as files, and it is your operating system that limits the file size and not MySQL. As for other types such as BDB and InnoDB I don't know the answer. ISAM: minimum of 4GB per file (MyISAM internal limit) or OS file size limit. MyISAM: same, except that by using AVE_ROW_LENGTH and MAX_ROWS you can bump the MyISAM internal limit to approx 8 terabytes. BDB: minimum of at least 2 TB (MyISAM internal limit) or OS file size limit. InnoDB: depends on size of InnoDB tablespace. By default, max tablespace size is 4 billion pages x 16KB per page. But all InnoDB tables compete for space inside this tablespace. I hope this helps. DSL -- Say you'll share with me one love, one lifetime Lead me, save me from my solitude. Say you'll want me with you, here beside you Anywhere you go let me go too... (Webber/Hart/Black) - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
file size limit hitting when LOAD DATA INFILE
Hi, all: I use MySQL 3.23.47, RH linux 7.2, file size limit is 4G. When LOAD DATA INFILE to a table whose file size is 4G, it fails and mysql_error(...) reports Lost connection to MySQL server during query. How can I clearly know the failed reason is just hit the 4G file size limit? If the 4G file size limit is hit, I have two ways to resolve it: (1) create a new table and LOAD DATA INFILE into this new table. (2) backup this table and clear it and reload. However, these two ways are troubled and not good. Dose some one have a effective way that just LOAD DATA INFILE without hitting file size limit? Dose MERGE Table help it here? Thanks in advanse. B.R. Buding - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
file size limit hitting when LOAD DATA INFILE
Hi, all: I use MySQL 3.23.47, RH linux 7.2, file size limit is 4G. When LOAD DATA INFILE to a table whose file size is 4G, it fails and mysql_error(...) reports Lost connection to MySQL server during query. How can I clearly know the failed reason is just hit the 4G file size limit? If the 4G file size limit is hit, I have two ways to resolve it: (1) create a new table and LOAD DATA INFILE into this new table. (2) backup this table and clear it and reload. However, these two ways are troubled and not good. Dose some one have a effective way that just LOAD DATA INFILE without hitting file size limit? Dose MERGE Table help it here? Thanks in advance. B.R. Buding - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: file size limit hitting when LOAD DATA INFILE
Yes, MERGE Tables is useful for getting around the file size limit problem. However, Linux 7.2(Kernel 2.4.x), MySql 3.23.47 supports file sizes greater than 4GB. Mysql 3.23 by defaul will create tables that can grow only upto 4G but these can be altered using ALTER TABLE. You willl need to alter AVG_ROW_LENGTH and MAX_ROWS, the product of which is the file size that will be supported. http://www.mysql.com/doc/T/a/Table_size.html Also, if you do not want to go that route, you can use MERGE tables which will merge 2 or more underlying tables, say, AAA1 AAA2 into AAA. so you can either refer to AAA or indivually to AAA1 and AAA2. Generally, you want to refer to AAA while quering and the indiviudal tables while inserting/updating data. Regards, Bhavin. - Original Message - From: Buding Chen [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Monday, June 24, 2002 7:23 PM Subject: file size limit hitting when LOAD DATA INFILE Hi, all: I use MySQL 3.23.47, RH linux 7.2, file size limit is 4G. When LOAD DATA INFILE to a table whose file size is 4G, it fails and mysql_error(...) reports Lost connection to MySQL server during query. How can I clearly know the failed reason is just hit the 4G file size limit? If the 4G file size limit is hit, I have two ways to resolve it: (1) create a new table and LOAD DATA INFILE into this new table. (2) backup this table and clear it and reload. However, these two ways are troubled and not good. Dose some one have a effective way that just LOAD DATA INFILE without hitting file size limit? Dose MERGE Table help it here? Thanks in advance. B.R. Buding - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
