Re: Tons of records - archive, or what?

2007-04-13 Thread Will Tomlinson
> How many indexes do you have setup on the table? I had a table with > about 6 million records that I inherited and it only had an index It has all the pertinent fields included in indexes. I believe about 8-10 fields in the one main output table. All tables have all the indexes that are nee

Re: Tons of records - archive, or what?

2007-04-13 Thread Dana Kowalski
ok now that I'm a bit more coherent. if you go to gaiaionline.com/forum you can see the msg board counts etc without needing to register. - Gaia has 998,523,683 articles posted with 6,899,737 registered users. - Most users ever online was 86,738 on Thu Jan 04, 2007 3:00 pm - There are

Re: Tons of records - archive, or what?

2007-04-13 Thread Dana Kowalski
How many indexes do you have setup on the table? I had a table with about 6 million records that I inherited and it only had an index setup on the primary key. It caused about 300-3000ms overhead on any page that accessed it. It took me a couple days but once I found it and added the indexes tha

Re: Tons of records - archive, or what?

2007-04-12 Thread Will Tomlinson
Just joined up thanks for the info dana! I did find some performance info thru googling. I can't even query 200,000 records without my db givin out. Weird! Thanks,Will ~| Upgrade to Adobe ColdFusion MX7 The most significant

Re: Tons of records - archive, or what?

2007-04-12 Thread Dana Kowalski
sorry for the typos, I've been under the weather all week lol. anyhow the url is really http://www.gaiaonline.com/ now. sorry. ~| Upgrade to Adobe ColdFusion MX7 The most significant release in over 10 years. Upgrade & see new fe

Re: Tons of records - archive, or what?

2007-04-12 Thread Dana Kowalski
If you are properly configured and indexed on your SQL machine it won't be as a big a problem as you may think. For some good insight visit http://go-gaia.com and phpbb.com. The founder of that site posoted some mysql tuning tips but they can apply to other Dbs as well. Go-Gaia is a roleplaying

Re: Tons of records - archive, or what?

2007-04-12 Thread Tom Chiverton
On Wednesday 11 Apr 2007, Will Tomlinson wrote: > I have a mySQL db that has lotsa joins, lotsa filters, etc., and could > potentially accumulate millions of records over a year or two. The db > revolves around school semesters. Will queries always want to include all the data, or only the most re

Tons of records - archive, or what?

2007-04-11 Thread Will Tomlinson
Hey, I have a mySQL db that has lotsa joins, lotsa filters, etc., and could potentially accumulate millions of records over a year or two. The db revolves around school semesters. I'm worried about performance issues as time goes on. But I need to keep these records searchable. I've come u