Re: Database Size Limit

2002-01-17 Thread Jeremy Zawodny

On Mon, Jan 14, 2002 at 11:52:35AM -0800, Aaron Brick wrote:

 in specific reference to linux, you are speaking of the 2.4 kernel,
 glibc 2.2, and ext{2,3} filesystem? is it the case that large files
 are correctly addressed (ie, seamlessly) on such systems?

Yes.
-- 
Jeremy D. Zawodny, [EMAIL PROTECTED]
Technical Yahoo - Yahoo Finance
Desk: (408) 349-7878   Fax: (408) 349-5454   Cell: (408) 685-5936

MySQL 3.23.41-max: up 14 days, processed 335,914,046 queries (270/sec. avg)

-
Before posting, please check:
   http://www.mysql.com/manual.php   (the manual)
   http://lists.mysql.com/   (the list archive)

To request this thread, e-mail [EMAIL PROTECTED]
To unsubscribe, e-mail [EMAIL PROTECTED]
Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php




Re: Database Size Limit

2002-01-14 Thread Aaron Brick

in specific reference to linux, you are speaking of the 2.4 kernel, glibc
2.2, and ext{2,3} filesystem? is it the case that large files are correctly
addressed (ie, seamlessly) on such systems? this is the impression i have
got from the limited research i've done.

looking for a generalized solution,

aaron.


so said [EMAIL PROTECTED] in 2.0K bytes at Sun, Jan 13, 2002:

 The size limitation is becauseof the operating system parameters.  In
 order to use tables larger then 3 GB, use either Redhat 7.2 or Solaris 8.
 These operating systems allow file sizes greater then 2 GB.  For the most
 part I achievedtables sizes using these operating system of greater the 50
 GB.
 
 Benjamin Arai
 [EMAIL PROTECTED]
 
 On Fri, 11 Jan 2002, Demirchyan Oganes-AOD098 wrote:
 
  Hello everyone,
 
  I guess I have the similar question, that has been brought up.
 
  I have 36 InnoDB tables, and I have allocated two 2GB partitions for my data.
 
  Provided I have very big hard drive, how many partitions at 2GB each could I 
allocate?  As many as my hard drive can handle?
 
  I also have questions with regards, to a table size.  In my case it will be 
(4GB)/36 bytes per table?  Is it distributed uniformly, or some tables can grow 
bigger on the expense of the others (if some only have limited data, and others keep 
having new data inserted into them).
 
  Sincerely,
 
  Oganes Demirchyan
  Motorola Life Science
  757 S.Raymond
  Pasadena, CA  91105
  Tel: 626-584-5900
  email: [EMAIL PROTECTED]
 
 
  -
  Before posting, please check:
 http://www.mysql.com/manual.php   (the manual)
 http://lists.mysql.com/   (the list archive)
 
  To request this thread, e-mail [EMAIL PROTECTED]
  To unsubscribe, e-mail [EMAIL PROTECTED]
  Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
 
 
 
 -
 Before posting, please check:
http://www.mysql.com/manual.php   (the manual)
http://lists.mysql.com/   (the list archive)
 
 To request this thread, e-mail [EMAIL PROTECTED]
 To unsubscribe, e-mail [EMAIL PROTECTED]
 Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
 
 



   /\
  |   Aaron Brick (415) 206 - 4685   |
  |   [EMAIL PROTECTED] Room 3501C, SFGH   |

  Programmer Analyst, Functional Genomics Core  
   Sandler Center for Basic Research in Asthma
   Lung Biology Center, Department of Medicine
San Francisco General Hospital
   University of California, San Francisco

-
Before posting, please check:
   http://www.mysql.com/manual.php   (the manual)
   http://lists.mysql.com/   (the list archive)

To request this thread, e-mail [EMAIL PROTECTED]
To unsubscribe, e-mail [EMAIL PROTECTED]
Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php




Re: Database Size Limit

2002-01-13 Thread Heikki Tuuri

Oganes,

are your really using disk partitions as InnoDB data files? If you use raw
disk partitions, then the operating system may put a limit on the number of
them, for example, 16.

But usually InnoDB data files will be just ordinary files of the file
system. The number of data files is restricted by the maximum parameter line
length in my.cnf, which is maybe 2048 bytes. Thus you can define hundreds of
InnoDB data files.

With very big databases it is probably easiest to use an operating system
which supports  4 GB files, so that you can make your data files bigger
than 2 GB or 4 GB.

InnoDB reuses the space in its tablespace (tablespace = all the data files
concatenated). Thus space which is freed from one table is available for
other tables to use.

Best regards,

Heikki Tuuri
Innobase Oy
---
Order technical MySQL/InnoDB support at https://order.mysql.com/
See http://www.innodb.com for the online manual and latest news on InnoDB


Benjamin Arai wrote in message ...
The size limitation is becauseof the operating system parameters.  In
order to use tables larger then 3 GB, use either Redhat 7.2 or Solaris 8.
These operating systems allow file sizes greater then 2 GB.  For the most
part I achievedtables sizes using these operating system of greater the 50
GB.

Benjamin Arai
[EMAIL PROTECTED]

On Fri, 11 Jan 2002, Demirchyan Oganes-AOD098 wrote:

 Hello everyone,

 I guess I have the similar question, that has been brought up.

 I have 36 InnoDB tables, and I have allocated two 2GB partitions for my
data.

 Provided I have very big hard drive, how many partitions at 2GB each
could I allocate?  As many as my hard drive can handle?

 I also have questions with regards, to a table size.  In my case it will
be (4GB)/36 bytes per table?  Is it distributed uniformly, or some tables
can grow bigger on the expense of the others (if some only have limited
data, and others keep having new data inserted into them).

 Sincerely,

 Oganes Demirchyan
 Motorola Life Science
 757 S.Raymond
 Pasadena, CA  91105
 Tel: 626-584-5900
 email: [EMAIL PROTECTED]





-
Before posting, please check:
   http://www.mysql.com/manual.php   (the manual)
   http://lists.mysql.com/   (the list archive)

To request this thread, e-mail [EMAIL PROTECTED]
To unsubscribe, e-mail [EMAIL PROTECTED]
Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php




Re: Database Size Limit

2002-01-12 Thread Benjamin Arai

The size limitation is becauseof the operating system parameters.  In
order to use tables larger then 3 GB, use either Redhat 7.2 or Solaris 8.
These operating systems allow file sizes greater then 2 GB.  For the most
part I achievedtables sizes using these operating system of greater the 50
GB.

Benjamin Arai
[EMAIL PROTECTED]

On Fri, 11 Jan 2002, Demirchyan Oganes-AOD098 wrote:

 Hello everyone,

 I guess I have the similar question, that has been brought up.

 I have 36 InnoDB tables, and I have allocated two 2GB partitions for my data.

 Provided I have very big hard drive, how many partitions at 2GB each could I 
allocate?  As many as my hard drive can handle?

 I also have questions with regards, to a table size.  In my case it will be (4GB)/36 
bytes per table?  Is it distributed uniformly, or some tables can grow bigger on the 
expense of the others (if some only have limited data, and others keep having new 
data inserted into them).

 Sincerely,

 Oganes Demirchyan
 Motorola Life Science
 757 S.Raymond
 Pasadena, CA  91105
 Tel: 626-584-5900
 email: [EMAIL PROTECTED]


 -
 Before posting, please check:
http://www.mysql.com/manual.php   (the manual)
http://lists.mysql.com/   (the list archive)

 To request this thread, e-mail [EMAIL PROTECTED]
 To unsubscribe, e-mail [EMAIL PROTECTED]
 Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php



-
Before posting, please check:
   http://www.mysql.com/manual.php   (the manual)
   http://lists.mysql.com/   (the list archive)

To request this thread, e-mail [EMAIL PROTECTED]
To unsubscribe, e-mail [EMAIL PROTECTED]
Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php




Re: Database Size Limit

2002-01-12 Thread Benjamin Arai

I disagree.  The 4GB slowdown is usualy caused by indexing problems
associated with the OS having increased overhead when looking up and
inserting data.  I have eliminated this slowdown in Solaris and Linux be
re-indexing the entire database once it becomes larger then 4GB.  This
fixes the problem from what I could tell.

I would also like to note that if there was a pointer issue when switching
to 64 bit pointers, it would only effect perfomance on computer with less
then sufficent amounts of processing power to calculate the larger
pointers.

Benjamin Arai
[EMAIL PROTECTED]

On Fri, 11 Jan 2002, James Montebello wrote:


 This is speculation:

 They're slower because many operations have to be done using 64 bit
 values rather than 32 bit values.  You set the flag by setting the max
 data size when creating the table.  You can also alter this after the
 table is created with ALTER TABLE.  The doc suggests you're setting the
 actual maximum size, but if you set the size to even 1 byte past 4GB
 (at least on Solaris), it immediately flips to a value way above 4GB,
 which is probably the Solaris limit (may be 2TB, I forget).  Not sure
 what it does on Linux.

 We saw a significant performance decrease on Solaris when we tried to
 use max table sizes above 4GB, and assume it's because of an internal
 switch from 32-bit pointers to 64-bit pointers.  May not make nearly as
 much of a performance difference on a real 64-bit processor and OS.

 james montebello

 On Fri, 11 Jan 2002, Aaron Brick wrote:

   Yes and no.  With 3.23, the MyISAM format will, by default, have a 4GB
   limit (32 bits).  You can set flags on the table to allow a 64-bit table,
   and you'll generally hit an OS or physical limitation long before you
   run out of space.  The downside of the 64-bit version is it's considerably
   slower.  Better to split large datasets up into sub-4GB units.
 
  why are operations on the 4GB tables slower?
 
  and, incidentally, where is that flag set?
 
  thanks,
 
  aaron brick.
 
 
  
 /\
|   Aaron Brick (415) 206 - 4685   |
|   [EMAIL PROTECTED] Room 3501C, SFGH   |
 
Programmer Analyst, Functional Genomics Core
 Sandler Center for Basic Research in Asthma
 Lung Biology Center, Department of Medicine
  San Francisco General Hospital
 University of California, San Francisco
 
  -
  Before posting, please check:
 http://www.mysql.com/manual.php   (the manual)
 http://lists.mysql.com/   (the list archive)
 
  To request this thread, e-mail [EMAIL PROTECTED]
  To unsubscribe, e-mail [EMAIL PROTECTED]
  Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
 


 -
 Before posting, please check:
http://www.mysql.com/manual.php   (the manual)
http://lists.mysql.com/   (the list archive)

 To request this thread, e-mail [EMAIL PROTECTED]
 To unsubscribe, e-mail [EMAIL PROTECTED]
 Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php



-
Before posting, please check:
   http://www.mysql.com/manual.php   (the manual)
   http://lists.mysql.com/   (the list archive)

To request this thread, e-mail [EMAIL PROTECTED]
To unsubscribe, e-mail [EMAIL PROTECTED]
Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php




Re: Database Size Limit

2002-01-11 Thread Demirchyan Oganes-AOD098

Hello everyone,

I guess I have the similar question, that has been brought up.

I have 36 InnoDB tables, and I have allocated two 2GB partitions for my data.

Provided I have very big hard drive, how many partitions at 2GB each could I allocate? 
 As many as my hard drive can handle?

I also have questions with regards, to a table size.  In my case it will be (4GB)/36 
bytes per table?  Is it distributed uniformly, or some tables can grow bigger on the 
expense of the others (if some only have limited data, and others keep having new data 
inserted into them).

Sincerely,
 
Oganes Demirchyan
Motorola Life Science
757 S.Raymond
Pasadena, CA  91105
Tel: 626-584-5900
email: [EMAIL PROTECTED]


-
Before posting, please check:
   http://www.mysql.com/manual.php   (the manual)
   http://lists.mysql.com/   (the list archive)

To request this thread, e-mail [EMAIL PROTECTED]
To unsubscribe, e-mail [EMAIL PROTECTED]
Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php




Re: Database Size Limit

2002-01-11 Thread James Montebello

On Thu, 10 Jan 2002, Dan Nelson wrote:

 In the last episode (Jan 11), Manish Mehta said:
  As we know that MySql support maximum of 4 GB data per table.
 
 Actually, http://www.mysql.com/doc/T/a/Table_size.html says that only
 Mysql 3.22 had a 4gb table size.  With 3.23, the real limit is how big
 a file your OS can handle.

Yes and no.  With 3.23, the MyISAM format will, by default, have a 4GB
limit (32 bits).  You can set flags on the table to allow a 64-bit table,
and you'll generally hit an OS or physical limitation long before you 
run out of space.  The downside of the 64-bit version is it's considerably
slower.  Better to split large datasets up into sub-4GB units. 

james montebello



-
Before posting, please check:
   http://www.mysql.com/manual.php   (the manual)
   http://lists.mysql.com/   (the list archive)

To request this thread, e-mail [EMAIL PROTECTED]
To unsubscribe, e-mail [EMAIL PROTECTED]
Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php




Re: Database Size Limit

2002-01-11 Thread Aaron Brick

 Yes and no.  With 3.23, the MyISAM format will, by default, have a 4GB
 limit (32 bits).  You can set flags on the table to allow a 64-bit table,
 and you'll generally hit an OS or physical limitation long before you 
 run out of space.  The downside of the 64-bit version is it's considerably
 slower.  Better to split large datasets up into sub-4GB units. 

why are operations on the 4GB tables slower?

and, incidentally, where is that flag set?

thanks,

aaron brick.



   /\
  |   Aaron Brick (415) 206 - 4685   |
  |   [EMAIL PROTECTED] Room 3501C, SFGH   |

  Programmer Analyst, Functional Genomics Core  
   Sandler Center for Basic Research in Asthma
   Lung Biology Center, Department of Medicine
San Francisco General Hospital
   University of California, San Francisco

-
Before posting, please check:
   http://www.mysql.com/manual.php   (the manual)
   http://lists.mysql.com/   (the list archive)

To request this thread, e-mail [EMAIL PROTECTED]
To unsubscribe, e-mail [EMAIL PROTECTED]
Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php




Re: Database Size Limit

2002-01-11 Thread James Montebello


This is speculation:

They're slower because many operations have to be done using 64 bit
values rather than 32 bit values.  You set the flag by setting the max
data size when creating the table.  You can also alter this after the
table is created with ALTER TABLE.  The doc suggests you're setting the
actual maximum size, but if you set the size to even 1 byte past 4GB
(at least on Solaris), it immediately flips to a value way above 4GB,
which is probably the Solaris limit (may be 2TB, I forget).  Not sure
what it does on Linux.

We saw a significant performance decrease on Solaris when we tried to
use max table sizes above 4GB, and assume it's because of an internal
switch from 32-bit pointers to 64-bit pointers.  May not make nearly as
much of a performance difference on a real 64-bit processor and OS.

james montebello

On Fri, 11 Jan 2002, Aaron Brick wrote:

  Yes and no.  With 3.23, the MyISAM format will, by default, have a 4GB
  limit (32 bits).  You can set flags on the table to allow a 64-bit table,
  and you'll generally hit an OS or physical limitation long before you 
  run out of space.  The downside of the 64-bit version is it's considerably
  slower.  Better to split large datasets up into sub-4GB units. 
 
 why are operations on the 4GB tables slower?
 
 and, incidentally, where is that flag set?
 
 thanks,
 
 aaron brick.
 
 
 
/\
   |   Aaron Brick (415) 206 - 4685   |
   |   [EMAIL PROTECTED] Room 3501C, SFGH   |
 
   Programmer Analyst, Functional Genomics Core  
Sandler Center for Basic Research in Asthma
Lung Biology Center, Department of Medicine
 San Francisco General Hospital
University of California, San Francisco
 
 -
 Before posting, please check:
http://www.mysql.com/manual.php   (the manual)
http://lists.mysql.com/   (the list archive)
 
 To request this thread, e-mail [EMAIL PROTECTED]
 To unsubscribe, e-mail [EMAIL PROTECTED]
 Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
 


-
Before posting, please check:
   http://www.mysql.com/manual.php   (the manual)
   http://lists.mysql.com/   (the list archive)

To request this thread, e-mail [EMAIL PROTECTED]
To unsubscribe, e-mail [EMAIL PROTECTED]
Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php




Database Size Limit

2002-01-10 Thread Manish Mehta

Hi,

As we know that MySql support maximum of 4 GB data per table. 

Now the question arise that what is the maximum limit of Database in MySQL.
 
Manish Mehta
E-mail: [EMAIL PROTECTED]



-
Before posting, please check:
   http://www.mysql.com/manual.php   (the manual)
   http://lists.mysql.com/   (the list archive)

To request this thread, e-mail [EMAIL PROTECTED]
To unsubscribe, e-mail [EMAIL PROTECTED]
Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php




Re: Database size limit

2001-06-19 Thread Ali Kemal YURTSEVEN

Well, my server is running on Mandrake 8.0. We're trying to implement
database hosting at our site, therefore people should probably have
database spaces between 10-50 MB.
In Microsoft SQL server you can limit the size of a database when
creating it. Is it possible in MySQL ?


VVM Ravikumar Sarma Chengalvala wrote:
 
 No need to worry.On NT each table can have
 upto4GB.Database there is predefined limit.It can go
 even upro 20GB or more also.
 
 --- Ali Kemal YURTSEVEN [EMAIL PROTECTED]
 wrote: Hi,
 
I'm new in this list and new to MySQL also. What I
  want to know is how
  to limit the size of a database.
 
Thanks.
 
  --
  Ali Kemal YURTSEVEN
  Is Net A.S.
 
  Iletisim Uzmani
 
 
 -
  Before posting, please check:
 http://www.mysql.com/manual.php   (the manual)
 http://lists.mysql.com/   (the list
  archive)
 
  To request this thread, e-mail
  [EMAIL PROTECTED]
  To unsubscribe, e-mail
 
 [EMAIL PROTECTED]
  Trouble unsubscribing? Try:
  http://lists.mysql.com/php/unsubscribe.php
 
 
 
 Do You Yahoo!?
 Get your free @yahoo.co.uk address at http://mail.yahoo.co.uk
 or your free @yahoo.ie address at http://mail.yahoo.ie

-- 
Ali Kemal YURTSEVEN
Is Net A.S.

Iletisim Uzmani

-
Before posting, please check:
   http://www.mysql.com/manual.php   (the manual)
   http://lists.mysql.com/   (the list archive)

To request this thread, e-mail [EMAIL PROTECTED]
To unsubscribe, e-mail [EMAIL PROTECTED]
Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php




Re: Database size limit

2001-06-19 Thread VVM Ravikumar Sarma Chengalvala

Hi,
For most of the platforms Mysql has reasonably enough
space for each table itself(in GB).Database wise, also
there should not be any problem for the database size
you are mentioning.For sure,I can say that I have not
worked on Mandrake.But, I feel the size you have
mentioned should not be a problem.
Regards,
Ravi
--- Ali Kemal YURTSEVEN [EMAIL PROTECTED]
wrote: Well, my server is running on Mandrake 8.0.
We're
 trying to implement
 database hosting at our site, therefore people
 should probably have
 database spaces between 10-50 MB.
 In Microsoft SQL server you can limit the size of a
 database when
 creating it. Is it possible in MySQL ?
 
 
 VVM Ravikumar Sarma Chengalvala wrote:
  
  No need to worry.On NT each table can have
  upto4GB.Database there is predefined limit.It can
 go
  even upro 20GB or more also.
  
  --- Ali Kemal YURTSEVEN
 [EMAIL PROTECTED]
  wrote: Hi,
  
 I'm new in this list and new to MySQL
 also. What I
   want to know is how
   to limit the size of a database.
  
 Thanks.
  
   --
   Ali Kemal YURTSEVEN
   Is Net A.S.
  
   Iletisim Uzmani
  
  
 

-
   Before posting, please check:
  http://www.mysql.com/manual.php   (the
 manual)
  http://lists.mysql.com/   (the list
   archive)
  
   To request this thread, e-mail
   [EMAIL PROTECTED]
   To unsubscribe, e-mail
  
 

[EMAIL PROTECTED]
   Trouble unsubscribing? Try:
   http://lists.mysql.com/php/unsubscribe.php
  
  
 


  Do You Yahoo!?
  Get your free @yahoo.co.uk address at
 http://mail.yahoo.co.uk
  or your free @yahoo.ie address at
 http://mail.yahoo.ie
 
 -- 
 Ali Kemal YURTSEVEN
 Is Net A.S.
 
 Iletisim Uzmani
 

-
 Before posting, please check:
http://www.mysql.com/manual.php   (the manual)
http://lists.mysql.com/   (the list
 archive)
 
 To request this thread, e-mail
 [EMAIL PROTECTED]
 To unsubscribe, e-mail

[EMAIL PROTECTED]
 Trouble unsubscribing? Try:
 http://lists.mysql.com/php/unsubscribe.php
 



Do You Yahoo!?
Get your free @yahoo.co.uk address at http://mail.yahoo.co.uk
or your free @yahoo.ie address at http://mail.yahoo.ie

-
Before posting, please check:
   http://www.mysql.com/manual.php   (the manual)
   http://lists.mysql.com/   (the list archive)

To request this thread, e-mail [EMAIL PROTECTED]
To unsubscribe, e-mail [EMAIL PROTECTED]
Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php




Database size limit

2001-06-18 Thread Ali Kemal YURTSEVEN

Hi,

I'm new in this list and new to MySQL also. What I want to know is how
to limit the size of a database. 

Thanks.

--  
Ali Kemal YURTSEVEN
Is Net A.S.

Iletisim Uzmani

-
Before posting, please check:
   http://www.mysql.com/manual.php   (the manual)
   http://lists.mysql.com/   (the list archive)

To request this thread, e-mail [EMAIL PROTECTED]
To unsubscribe, e-mail [EMAIL PROTECTED]
Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php




Re: Database size limit

2001-06-18 Thread VVM Ravikumar Sarma Chengalvala

No need to worry.On NT each table can have
upto4GB.Database there is predefined limit.It can go
even upro 20GB or more also.

--- Ali Kemal YURTSEVEN [EMAIL PROTECTED]
wrote: Hi,
 
   I'm new in this list and new to MySQL also. What I
 want to know is how
 to limit the size of a database. 
 
   Thanks.
 
 --
 Ali Kemal YURTSEVEN
 Is Net A.S.
 
 Iletisim Uzmani
 

-
 Before posting, please check:
http://www.mysql.com/manual.php   (the manual)
http://lists.mysql.com/   (the list
 archive)
 
 To request this thread, e-mail
 [EMAIL PROTECTED]
 To unsubscribe, e-mail

[EMAIL PROTECTED]
 Trouble unsubscribing? Try:
 http://lists.mysql.com/php/unsubscribe.php
 



Do You Yahoo!?
Get your free @yahoo.co.uk address at http://mail.yahoo.co.uk
or your free @yahoo.ie address at http://mail.yahoo.ie

-
Before posting, please check:
   http://www.mysql.com/manual.php   (the manual)
   http://lists.mysql.com/   (the list archive)

To request this thread, e-mail [EMAIL PROTECTED]
To unsubscribe, e-mail [EMAIL PROTECTED]
Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php