Re: Database Size Limit
On Mon, Jan 14, 2002 at 11:52:35AM -0800, Aaron Brick wrote: in specific reference to linux, you are speaking of the 2.4 kernel, glibc 2.2, and ext{2,3} filesystem? is it the case that large files are correctly addressed (ie, seamlessly) on such systems? Yes. -- Jeremy D. Zawodny, [EMAIL PROTECTED] Technical Yahoo - Yahoo Finance Desk: (408) 349-7878 Fax: (408) 349-5454 Cell: (408) 685-5936 MySQL 3.23.41-max: up 14 days, processed 335,914,046 queries (270/sec. avg) - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: Database Size Limit
in specific reference to linux, you are speaking of the 2.4 kernel, glibc 2.2, and ext{2,3} filesystem? is it the case that large files are correctly addressed (ie, seamlessly) on such systems? this is the impression i have got from the limited research i've done. looking for a generalized solution, aaron. so said [EMAIL PROTECTED] in 2.0K bytes at Sun, Jan 13, 2002: The size limitation is becauseof the operating system parameters. In order to use tables larger then 3 GB, use either Redhat 7.2 or Solaris 8. These operating systems allow file sizes greater then 2 GB. For the most part I achievedtables sizes using these operating system of greater the 50 GB. Benjamin Arai [EMAIL PROTECTED] On Fri, 11 Jan 2002, Demirchyan Oganes-AOD098 wrote: Hello everyone, I guess I have the similar question, that has been brought up. I have 36 InnoDB tables, and I have allocated two 2GB partitions for my data. Provided I have very big hard drive, how many partitions at 2GB each could I allocate? As many as my hard drive can handle? I also have questions with regards, to a table size. In my case it will be (4GB)/36 bytes per table? Is it distributed uniformly, or some tables can grow bigger on the expense of the others (if some only have limited data, and others keep having new data inserted into them). Sincerely, Oganes Demirchyan Motorola Life Science 757 S.Raymond Pasadena, CA 91105 Tel: 626-584-5900 email: [EMAIL PROTECTED] - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php /\ | Aaron Brick (415) 206 - 4685 | | [EMAIL PROTECTED] Room 3501C, SFGH | Programmer Analyst, Functional Genomics Core Sandler Center for Basic Research in Asthma Lung Biology Center, Department of Medicine San Francisco General Hospital University of California, San Francisco - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: Database Size Limit
Oganes, are your really using disk partitions as InnoDB data files? If you use raw disk partitions, then the operating system may put a limit on the number of them, for example, 16. But usually InnoDB data files will be just ordinary files of the file system. The number of data files is restricted by the maximum parameter line length in my.cnf, which is maybe 2048 bytes. Thus you can define hundreds of InnoDB data files. With very big databases it is probably easiest to use an operating system which supports 4 GB files, so that you can make your data files bigger than 2 GB or 4 GB. InnoDB reuses the space in its tablespace (tablespace = all the data files concatenated). Thus space which is freed from one table is available for other tables to use. Best regards, Heikki Tuuri Innobase Oy --- Order technical MySQL/InnoDB support at https://order.mysql.com/ See http://www.innodb.com for the online manual and latest news on InnoDB Benjamin Arai wrote in message ... The size limitation is becauseof the operating system parameters. In order to use tables larger then 3 GB, use either Redhat 7.2 or Solaris 8. These operating systems allow file sizes greater then 2 GB. For the most part I achievedtables sizes using these operating system of greater the 50 GB. Benjamin Arai [EMAIL PROTECTED] On Fri, 11 Jan 2002, Demirchyan Oganes-AOD098 wrote: Hello everyone, I guess I have the similar question, that has been brought up. I have 36 InnoDB tables, and I have allocated two 2GB partitions for my data. Provided I have very big hard drive, how many partitions at 2GB each could I allocate? As many as my hard drive can handle? I also have questions with regards, to a table size. In my case it will be (4GB)/36 bytes per table? Is it distributed uniformly, or some tables can grow bigger on the expense of the others (if some only have limited data, and others keep having new data inserted into them). Sincerely, Oganes Demirchyan Motorola Life Science 757 S.Raymond Pasadena, CA 91105 Tel: 626-584-5900 email: [EMAIL PROTECTED] - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: Database Size Limit
The size limitation is becauseof the operating system parameters. In order to use tables larger then 3 GB, use either Redhat 7.2 or Solaris 8. These operating systems allow file sizes greater then 2 GB. For the most part I achievedtables sizes using these operating system of greater the 50 GB. Benjamin Arai [EMAIL PROTECTED] On Fri, 11 Jan 2002, Demirchyan Oganes-AOD098 wrote: Hello everyone, I guess I have the similar question, that has been brought up. I have 36 InnoDB tables, and I have allocated two 2GB partitions for my data. Provided I have very big hard drive, how many partitions at 2GB each could I allocate? As many as my hard drive can handle? I also have questions with regards, to a table size. In my case it will be (4GB)/36 bytes per table? Is it distributed uniformly, or some tables can grow bigger on the expense of the others (if some only have limited data, and others keep having new data inserted into them). Sincerely, Oganes Demirchyan Motorola Life Science 757 S.Raymond Pasadena, CA 91105 Tel: 626-584-5900 email: [EMAIL PROTECTED] - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: Database Size Limit
I disagree. The 4GB slowdown is usualy caused by indexing problems associated with the OS having increased overhead when looking up and inserting data. I have eliminated this slowdown in Solaris and Linux be re-indexing the entire database once it becomes larger then 4GB. This fixes the problem from what I could tell. I would also like to note that if there was a pointer issue when switching to 64 bit pointers, it would only effect perfomance on computer with less then sufficent amounts of processing power to calculate the larger pointers. Benjamin Arai [EMAIL PROTECTED] On Fri, 11 Jan 2002, James Montebello wrote: This is speculation: They're slower because many operations have to be done using 64 bit values rather than 32 bit values. You set the flag by setting the max data size when creating the table. You can also alter this after the table is created with ALTER TABLE. The doc suggests you're setting the actual maximum size, but if you set the size to even 1 byte past 4GB (at least on Solaris), it immediately flips to a value way above 4GB, which is probably the Solaris limit (may be 2TB, I forget). Not sure what it does on Linux. We saw a significant performance decrease on Solaris when we tried to use max table sizes above 4GB, and assume it's because of an internal switch from 32-bit pointers to 64-bit pointers. May not make nearly as much of a performance difference on a real 64-bit processor and OS. james montebello On Fri, 11 Jan 2002, Aaron Brick wrote: Yes and no. With 3.23, the MyISAM format will, by default, have a 4GB limit (32 bits). You can set flags on the table to allow a 64-bit table, and you'll generally hit an OS or physical limitation long before you run out of space. The downside of the 64-bit version is it's considerably slower. Better to split large datasets up into sub-4GB units. why are operations on the 4GB tables slower? and, incidentally, where is that flag set? thanks, aaron brick. /\ | Aaron Brick (415) 206 - 4685 | | [EMAIL PROTECTED] Room 3501C, SFGH | Programmer Analyst, Functional Genomics Core Sandler Center for Basic Research in Asthma Lung Biology Center, Department of Medicine San Francisco General Hospital University of California, San Francisco - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: Database Size Limit
Hello everyone, I guess I have the similar question, that has been brought up. I have 36 InnoDB tables, and I have allocated two 2GB partitions for my data. Provided I have very big hard drive, how many partitions at 2GB each could I allocate? As many as my hard drive can handle? I also have questions with regards, to a table size. In my case it will be (4GB)/36 bytes per table? Is it distributed uniformly, or some tables can grow bigger on the expense of the others (if some only have limited data, and others keep having new data inserted into them). Sincerely, Oganes Demirchyan Motorola Life Science 757 S.Raymond Pasadena, CA 91105 Tel: 626-584-5900 email: [EMAIL PROTECTED] - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: Database Size Limit
On Thu, 10 Jan 2002, Dan Nelson wrote: In the last episode (Jan 11), Manish Mehta said: As we know that MySql support maximum of 4 GB data per table. Actually, http://www.mysql.com/doc/T/a/Table_size.html says that only Mysql 3.22 had a 4gb table size. With 3.23, the real limit is how big a file your OS can handle. Yes and no. With 3.23, the MyISAM format will, by default, have a 4GB limit (32 bits). You can set flags on the table to allow a 64-bit table, and you'll generally hit an OS or physical limitation long before you run out of space. The downside of the 64-bit version is it's considerably slower. Better to split large datasets up into sub-4GB units. james montebello - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: Database Size Limit
Yes and no. With 3.23, the MyISAM format will, by default, have a 4GB limit (32 bits). You can set flags on the table to allow a 64-bit table, and you'll generally hit an OS or physical limitation long before you run out of space. The downside of the 64-bit version is it's considerably slower. Better to split large datasets up into sub-4GB units. why are operations on the 4GB tables slower? and, incidentally, where is that flag set? thanks, aaron brick. /\ | Aaron Brick (415) 206 - 4685 | | [EMAIL PROTECTED] Room 3501C, SFGH | Programmer Analyst, Functional Genomics Core Sandler Center for Basic Research in Asthma Lung Biology Center, Department of Medicine San Francisco General Hospital University of California, San Francisco - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: Database Size Limit
This is speculation: They're slower because many operations have to be done using 64 bit values rather than 32 bit values. You set the flag by setting the max data size when creating the table. You can also alter this after the table is created with ALTER TABLE. The doc suggests you're setting the actual maximum size, but if you set the size to even 1 byte past 4GB (at least on Solaris), it immediately flips to a value way above 4GB, which is probably the Solaris limit (may be 2TB, I forget). Not sure what it does on Linux. We saw a significant performance decrease on Solaris when we tried to use max table sizes above 4GB, and assume it's because of an internal switch from 32-bit pointers to 64-bit pointers. May not make nearly as much of a performance difference on a real 64-bit processor and OS. james montebello On Fri, 11 Jan 2002, Aaron Brick wrote: Yes and no. With 3.23, the MyISAM format will, by default, have a 4GB limit (32 bits). You can set flags on the table to allow a 64-bit table, and you'll generally hit an OS or physical limitation long before you run out of space. The downside of the 64-bit version is it's considerably slower. Better to split large datasets up into sub-4GB units. why are operations on the 4GB tables slower? and, incidentally, where is that flag set? thanks, aaron brick. /\ | Aaron Brick (415) 206 - 4685 | | [EMAIL PROTECTED] Room 3501C, SFGH | Programmer Analyst, Functional Genomics Core Sandler Center for Basic Research in Asthma Lung Biology Center, Department of Medicine San Francisco General Hospital University of California, San Francisco - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Database Size Limit
Hi, As we know that MySql support maximum of 4 GB data per table. Now the question arise that what is the maximum limit of Database in MySQL. Manish Mehta E-mail: [EMAIL PROTECTED] - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: Database size limit
Well, my server is running on Mandrake 8.0. We're trying to implement database hosting at our site, therefore people should probably have database spaces between 10-50 MB. In Microsoft SQL server you can limit the size of a database when creating it. Is it possible in MySQL ? VVM Ravikumar Sarma Chengalvala wrote: No need to worry.On NT each table can have upto4GB.Database there is predefined limit.It can go even upro 20GB or more also. --- Ali Kemal YURTSEVEN [EMAIL PROTECTED] wrote: Hi, I'm new in this list and new to MySQL also. What I want to know is how to limit the size of a database. Thanks. -- Ali Kemal YURTSEVEN Is Net A.S. Iletisim Uzmani - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php Do You Yahoo!? Get your free @yahoo.co.uk address at http://mail.yahoo.co.uk or your free @yahoo.ie address at http://mail.yahoo.ie -- Ali Kemal YURTSEVEN Is Net A.S. Iletisim Uzmani - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: Database size limit
Hi, For most of the platforms Mysql has reasonably enough space for each table itself(in GB).Database wise, also there should not be any problem for the database size you are mentioning.For sure,I can say that I have not worked on Mandrake.But, I feel the size you have mentioned should not be a problem. Regards, Ravi --- Ali Kemal YURTSEVEN [EMAIL PROTECTED] wrote: Well, my server is running on Mandrake 8.0. We're trying to implement database hosting at our site, therefore people should probably have database spaces between 10-50 MB. In Microsoft SQL server you can limit the size of a database when creating it. Is it possible in MySQL ? VVM Ravikumar Sarma Chengalvala wrote: No need to worry.On NT each table can have upto4GB.Database there is predefined limit.It can go even upro 20GB or more also. --- Ali Kemal YURTSEVEN [EMAIL PROTECTED] wrote: Hi, I'm new in this list and new to MySQL also. What I want to know is how to limit the size of a database. Thanks. -- Ali Kemal YURTSEVEN Is Net A.S. Iletisim Uzmani - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php Do You Yahoo!? Get your free @yahoo.co.uk address at http://mail.yahoo.co.uk or your free @yahoo.ie address at http://mail.yahoo.ie -- Ali Kemal YURTSEVEN Is Net A.S. Iletisim Uzmani - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php Do You Yahoo!? Get your free @yahoo.co.uk address at http://mail.yahoo.co.uk or your free @yahoo.ie address at http://mail.yahoo.ie - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Database size limit
Hi, I'm new in this list and new to MySQL also. What I want to know is how to limit the size of a database. Thanks. -- Ali Kemal YURTSEVEN Is Net A.S. Iletisim Uzmani - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: Database size limit
No need to worry.On NT each table can have upto4GB.Database there is predefined limit.It can go even upro 20GB or more also. --- Ali Kemal YURTSEVEN [EMAIL PROTECTED] wrote: Hi, I'm new in this list and new to MySQL also. What I want to know is how to limit the size of a database. Thanks. -- Ali Kemal YURTSEVEN Is Net A.S. Iletisim Uzmani - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php Do You Yahoo!? Get your free @yahoo.co.uk address at http://mail.yahoo.co.uk or your free @yahoo.ie address at http://mail.yahoo.ie - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php