At 05:32 PM 6/22/2005, you wrote:
Hi,

I use MySQL for years with very much respect of it's stability and performance. But in these years one of my servers has grown to several hundreds of databases with approximately 50 tables in each of the databases.

Some of these database have tables containing more than a million records, which will still grow. Actually I expect them to grow even to more than 10 million records. Storing these records is no problem, but querying them becomes more and more difficult within a reasonable time. The total size of all databases is about 40 GB and will grow constantly. So, the MySQL-cluster seems no solutions since all data must be kept into memory.

I am looking for a scalable solution where I can put more hardware, if necessary, for more performance. Is there some way to "loadbalance" select-queries over multiple servers? When I look at the "google-technology", they have a lot of machines, each of them storing some chunks of data. So each server handles just a little piece of the request. It would be great if there is such technique for MySQL, splitting up the databases in chunks over several machines. Firing a query should result in a query to all machines, which return their results. The "master-process" collects all chunks of data from the machines and returns the total results to my application.

If I run into performance trouble in the future, it should be a matter of placing some more hardware to solve the problem.

Any ideas, suggestions or solutions?

Thanx.

El.


El,
Show us some of your queries and table structures. How many rows are returned? Are you trying to return all 10 million rows at once?

Mike

--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:    http://lists.mysql.com/[EMAIL PROTECTED]

Reply via email to