Re: How to have a table very very big?

2001-03-16 Thread Mario Latens

Thank you for your response (I said right?!? sorry for my little english!)
what you say is very interesting!!!
Where can I read more about RAID_TYPE ecc... (the 3 solution you said?)?

Now I'm writing the program in C and I have not meet this problem but I 
will :-(

Just for curiosity: I have to study the flow of data in a net : I'm working 
in a network desing. If somebody  is doing that or is interested we can
exchange experiences and  suggestions.
Thank you again.
Mario.



Il 16:51, gioved 15 marzo 2001, scrivesti:
 Hi Mario,
 I think I had the same problem as you, and got som help...
 You have three ways of doing this:
 1. Switch to a FileSystem that supports bigger Files

 2. Use MERGE, create a lot of small tables and use MERGE
 in you select Querys, The manual is quit god at explaining
 how to do this, but I'll think you will find the limitations
 about INSERT as irritating as I

 3. Use the --with-raid option. This is what I do. You need to
 recompile the mysqld using --with-raid when configuering it.
 This way you can create tables Using: RAID_TYPE=1 RAID_CHUNKS=XX
 RAID_CHUNKSIZE=YY
 The RAID_CHUNKS tells the mysql how many separate files it will
 split the DB into. IE. RAID_CHUNKS=100 will create 100 datafiles,
 wich each can be 2GB = 2 000 GB. More about this in CREATE TABLE.
 The problem with this is the indexfile, wich now is the problem (max 2GB)
 But I'll will reach that in about 2 weeks so ill figure something out by
 then.

 /roger

 I have to store data for Internet desining (10-20 Gb at Day)
 so I have to use a data base very fast: MySql is fast?
 
 I have to put 10-20 Gb of data every day: but I can have a table only of
 2Gb
 (I know that reading manual of Mysql).
 How to do a table so big?
 
 Thank you in advance, Rino.
 
 -
 Before posting, please check:
 http://www.mysql.com/manual.php   (the manual)
 http://lists.mysql.com/   (the list archive)
 
 To request this thread, e-mail [EMAIL PROTECTED]
 To unsubscribe, e-mail
 [EMAIL PROTECTED]
 Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php

 _
 Get Your Private, Free E-mail from MSN Hotmail at http://www.hotmail.com.


 -
 Before posting, please check:
http://www.mysql.com/manual.php   (the manual)
http://lists.mysql.com/   (the list archive)

 To request this thread, e-mail [EMAIL PROTECTED]
 To unsubscribe, e-mail
 [EMAIL PROTECTED] Trouble
 unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php

-
Before posting, please check:
   http://www.mysql.com/manual.php   (the manual)
   http://lists.mysql.com/   (the list archive)

To request this thread, e-mail [EMAIL PROTECTED]
To unsubscribe, e-mail [EMAIL PROTECTED]
Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php




Re: How to have a table very very big?

2001-03-16 Thread Roger Westin

Hi again,
Theres not much written in the manual about RAID_X but you'll find
it under CREATE TABLE

Thank you for your response (I said right?!? sorry for my little english!)
what you say is very interesting!!!
Where can I read more about RAID_TYPE ecc... (the 3° solution you said?)?

Now I'm writing the program in C and I have not meet this problem but I
will :-(

Just for curiosity: I have to study the flow of data in a net : I'm working
in a network desing. If somebody  is doing that or is interested we can
exchange experiences and  suggestions.
Thank you again.
Mario.



Il 16:51, giovedì 15 marzo 2001, scrivesti:
  Hi Mario,
  I think I had the same problem as you, and got som help...
  You have three ways of doing this:
  1. Switch to a FileSystem that supports bigger Files
 
  2. Use MERGE, create a lot of small tables and use MERGE
  in you select Querys, The manual is quit god at explaining
  how to do this, but I'll think you will find the limitations
  about INSERT as irritating as I
 
  3. Use the --with-raid option. This is what I do. You need to
  recompile the mysqld using --with-raid when configuering it.
  This way you can create tables Using: RAID_TYPE=1 RAID_CHUNKS=XX
  RAID_CHUNKSIZE=YY
  The RAID_CHUNKS tells the mysql how many separate files it will
  split the DB into. IE. RAID_CHUNKS=100 will create 100 datafiles,
  wich each can be 2GB = 2 000 GB. More about this in CREATE TABLE.
  The problem with this is the indexfile, wich now is the problem (max 
2GB)
  But I'll will reach that in about 2 weeks so ill figure something out by
  then.
 
  /roger
 
  I have to store data for Internet desining (10-20 Gb at Day)
  so I have to use a data base very fast: MySql is fast?
  
  I have to put 10-20 Gb of data every day: but I can have a table only 
of
  2Gb
  (I know that reading manual of Mysql).
  How to do a table so big?
  
  Thank you in advance, Rino.
  
  -
  Before posting, please check:
  http://www.mysql.com/manual.php   (the manual)
  http://lists.mysql.com/   (the list archive)
  
  To request this thread, e-mail [EMAIL PROTECTED]
  To unsubscribe, e-mail
  [EMAIL PROTECTED]
  Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
 
  
_
  Get Your Private, Free E-mail from MSN Hotmail at 
http://www.hotmail.com.
 
 
  -
  Before posting, please check:
 http://www.mysql.com/manual.php   (the manual)
 http://lists.mysql.com/   (the list archive)
 
  To request this thread, e-mail [EMAIL PROTECTED]
  To unsubscribe, e-mail
  [EMAIL PROTECTED] Trouble
  unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php

_
Get Your Private, Free E-mail from MSN Hotmail at http://www.hotmail.com.


-
Before posting, please check:
   http://www.mysql.com/manual.php   (the manual)
   http://lists.mysql.com/   (the list archive)

To request this thread, e-mail [EMAIL PROTECTED]
To unsubscribe, e-mail [EMAIL PROTECTED]
Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php




Re: How to have a table very very big?

2001-03-15 Thread Roger Westin

Hi Mario,
I think I had the same problem as you, and got som help...
You have three ways of doing this:
1. Switch to a FileSystem that supports bigger Files

2. Use MERGE, create a lot of small tables and use MERGE
in you select Querys, The manual is quit god at explaining
how to do this, but I'll think you will find the limitations
about INSERT as irritating as I

3. Use the --with-raid option. This is what I do. You need to
recompile the mysqld using --with-raid when configuering it.
This way you can create tables Using: RAID_TYPE=1 RAID_CHUNKS=XX
RAID_CHUNKSIZE=YY
The RAID_CHUNKS tells the mysql how many separate files it will
split the DB into. IE. RAID_CHUNKS=100 will create 100 datafiles,
wich each can be 2GB = 2 000 GB. More about this in CREATE TABLE.
The problem with this is the indexfile, wich now is the problem (max 2GB)
But I'll will reach that in about 2 weeks so ill figure something out by 
then.

/roger





I have to store data for Internet desining (10-20 Gb at Day)
so I have to use a data base very fast: MySql is fast?

I have to put 10-20 Gb of data every day: but I can have a table only of 
2Gb
(I know that reading manual of Mysql).
How to do a table so big?

Thank you in advance, Rino.

-
Before posting, please check:
http://www.mysql.com/manual.php   (the manual)
http://lists.mysql.com/   (the list archive)

To request this thread, e-mail [EMAIL PROTECTED]
To unsubscribe, e-mail 
[EMAIL PROTECTED]
Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php


_
Get Your Private, Free E-mail from MSN Hotmail at http://www.hotmail.com.


-
Before posting, please check:
   http://www.mysql.com/manual.php   (the manual)
   http://lists.mysql.com/   (the list archive)

To request this thread, e-mail [EMAIL PROTECTED]
To unsubscribe, e-mail [EMAIL PROTECTED]
Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php




Re: How to have a table very very big?

2001-03-15 Thread Eric Fitzgerald

I saw that someone already gave you some suggestions, but the reply seemed
to lack a bit of WHY you have that limitation, so I thought I would explain.

The 2Gb limitation is not in MySQL.  It's in your operating system.  If you
read some of your OS's docs, you can see how to get around this problem
either by installing a filesystem patch or by switching to a different file
system.  You may not even HAVE this limitation, again the only way to really
know is to check with your OS's docs.


- Original Message -
From: "Mario Latens" [EMAIL PROTECTED]
To: [EMAIL PROTECTED]
Sent: Thursday, March 15, 2001 12:49 AM
Subject: How to have a table very very big?


 I have to store data for Internet desining (10-20 Gb at Day)
 so I have to use a data base very fast: MySql is fast?

 I have to put 10-20 Gb of data every day: but I can have a table only of
2Gb
 (I know that reading manual of Mysql).
 How to do a table so big?

 Thank you in advance, Rino.

 -
 Before posting, please check:
http://www.mysql.com/manual.php   (the manual)
http://lists.mysql.com/   (the list archive)

 To request this thread, e-mail [EMAIL PROTECTED]
 To unsubscribe, e-mail [EMAIL PROTECTED]
 Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php





-
Before posting, please check:
   http://www.mysql.com/manual.php   (the manual)
   http://lists.mysql.com/   (the list archive)

To request this thread, e-mail [EMAIL PROTECTED]
To unsubscribe, e-mail [EMAIL PROTECTED]
Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php