Consulting job: Scaling MySQL

2010-08-04 Thread Santiago Bazerque
the website becomes more personalized our caching options are more limited. What I need is someone to: - Validate that the general direction we are taking is a sensible one (replication schema, backups, etc) for our scaling requirements. - Once we have everything set up, provide assitence

Re: SCALING INSERT

2010-01-26 Thread Shawn Green
Krishna Chandra Prajapati wrote: Hi shawn, As the data grows to 20 millions the insert rate will become very slow. In such case i am getting 2000 insert/seconds only. Therefore my objective is not achieved. I cannot slow up the insert rate of 10,000/second. I am getting data (inserted by us

Re: SCALING INSERT

2010-01-23 Thread Alexander Kolesen
If you only need very fast INSERTs, you might try to use ARCHIVE storage engine ( http://dev.mysql.com/tech-resources/articles/storage-engine.html ). It was developed for handling INSERTs very fast. Many peoples use it, for example, for storing logs. > Hi list, > > I want to insert 1 records/s

Re: SCALING INSERT

2010-01-23 Thread fsb
non-linearity in the insert rate means you have indexes on some columns. depending on your situation, mysql can be more efficient if drop those indexes, do bulk inserts, and then add the indexes again. On 1/23/10 5:02 AM, "Krishna Chandra Prajapati" wrote: > Hi shawn, > > As the data grows to

Re: SCALING INSERT

2010-01-23 Thread Krishna Chandra Prajapati
Hi shawn, As the data grows to 20 millions the insert rate will become very slow. In such case i am getting 2000 insert/seconds only. Therefore my objective is not achieved. I cannot slow up the insert rate of 10,000/second. I am getting data (inserted by users at this rate) Is there any other

Re: SCALING INSERT

2010-01-22 Thread walter harms
Krishna Chandra Prajapati schrieb: > Hi list, > > I want to insert 1 records/sec into table. There can be n number of > tables with unique data in each. What are the possible ways to do ? > i prefer mysqlimport. just sort your output into a file that is named like the table you wish to i

Re: SCALING INSERT

2010-01-21 Thread Shawn Green
Krishna Chandra Prajapati wrote: Hi list, I want to insert 1 records/sec into table. There can be n number of tables with unique data in each. What are the possible ways to do ? Thanks, Krishna The manual is your friend. It doesn't hurt to consult it. INSERT ... http://dev.mysql.com/doc

SCALING INSERT

2010-01-21 Thread Krishna Chandra Prajapati
Hi list, I want to insert 1 records/sec into table. There can be n number of tables with unique data in each. What are the possible ways to do ? Thanks, Krishna

Re: Scaling Mysql

2009-08-24 Thread Krishna Chandra Prajapati
Friday, August 21, 2009 9:23 PM > To: wha...@bfs.de > Cc: MySQL > Subject: Re: Scaling Mysql > > Hi wharms, > > Yor are right. It's some kind of queue mechanism. Right now i am working i > telco company (We used to send sms) > > Users will be inserting recor

RE: Scaling Mysql

2009-08-24 Thread Gavin Towey
Have you looked at MySQL cluster? It was created specifically for telco needs. -Original Message- From: Krishna Chandra Prajapati [mailto:prajapat...@gmail.com] Sent: Friday, August 21, 2009 9:23 PM To: wha...@bfs.de Cc: MySQL Subject: Re: Scaling Mysql Hi wharms, Yor are right. It&#

Re: Scaling Mysql

2009-08-21 Thread Krishna Chandra Prajapati
Hi wharms, Yor are right. It's some kind of queue mechanism. Right now i am working i telco company (We used to send sms) Users will be inserting records into send_sms @ 30,000msg/min Then those record will be updated and moved to alt_send_sms and deleted from send_sms. After that 30,000msg/min

RE: Scaling Mysql

2009-08-21 Thread mos
I forgot. It's all done in one sql statement. Mike -Original Message- From: Jerry Schwartz [mailto:jschwa...@the-infoshop.com] Sent: Friday, August 21, 2009 8:32 AM To: 'mos'; 'MySQL' Subject: RE: Scaling Mysql > >Krishna, > Rather than copying

RE: Scaling Mysql

2009-08-21 Thread Jerry Schwartz
>-Original Message- >From: Gavin Towey [mailto:gto...@ffn.com] >Sent: Friday, August 21, 2009 2:45 PM >To: Jerry Schwartz; 'mos'; 'MySQL' >Subject: RE: Scaling Mysql > >RENAME statement is atomic, and you can specify multiple tables to rename a

RE: Scaling Mysql

2009-08-21 Thread Gavin Towey
hwa...@the-infoshop.com] Sent: Friday, August 21, 2009 8:32 AM To: 'mos'; 'MySQL' Subject: RE: Scaling Mysql > >Krishna, > Rather than copying rows from one table to another, and deleting the >previous rows, why not just do: > >1) create table send_sms_emp

RE: Scaling Mysql

2009-08-21 Thread Jerry Schwartz
> >Krishna, > Rather than copying rows from one table to another, and deleting the >previous rows, why not just do: > >1) create table send_sms_empty like send_sms; > >2) rename table send_sms to send_sms_full;rename send_sms_empty to send_sms; > >3) insert into alt_send_sms select * from send_

Re: Scaling Mysql

2009-08-21 Thread mos
At 01:30 AM 8/21/2009, Krishna Chandra Prajapati wrote: Hi list, I have two tables send_sms and alt_send_sms. Users are inserting records into send_sms @ 500/sec ie 3/min. After applying some updates to send_sms data are transferred to alt_send_sms and deleted from send sms. The same thing i

Re: Scaling Mysql

2009-08-21 Thread walter harms
Krishna Chandra Prajapati schrieb: > Hi list, > > I have two tables send_sms and alt_send_sms. Users are inserting records > into send_sms @ 500/sec ie 3/min. After applying some updates to > send_sms data are transferred to alt_send_sms and deleted from send sms. The > same thing is happeni

Scaling Mysql

2009-08-20 Thread Krishna Chandra Prajapati
Hi list, I have two tables send_sms and alt_send_sms. Users are inserting records into send_sms @ 500/sec ie 3/min. After applying some updates to send_sms data are transferred to alt_send_sms and deleted from send sms. The same thing is happening with alt_send_sms table. Is it possible to in

Re: Scaling with Replication

2008-04-06 Thread Baron Schwartz
Hi, On Tue, Apr 1, 2008 at 5:39 PM, Michael Katz <[EMAIL PROTECTED]> wrote: > In a replication environment with 1 master and a 2 slaves, does the > entire database always have to be stored on the master? I understand > that slaves can come on and off line but I am not sure if the master > must

Scaling with Replication

2008-04-01 Thread Michael Katz
In a replication environment with 1 master and a 2 slaves, does the entire database always have to be stored on the master? I understand that slaves can come on and off line but I am not sure if the master must always store a complete copy of DB. Thanks, MK -- MySQL General Mailing List For li

MySQL Camp: Proven Scaling offering Free Ride

2006-10-18 Thread Jeremy Cole
Scaling would like to sponsor airfare and hotel for one person to attend who could not otherwise make it. Read more about it here: http://jcole.us/blog/archives/2006/10/18/want-a-free-ride-to-mysql-camp/ If you're interested in attending on our dime, follow the directions in that post

Re: scaling

2003-06-23 Thread chad pratt
awesome yes I will be an eager consumer. -C - Original Message - From: "Jeremy Zawodny" <[EMAIL PROTECTED]> To: "chad pratt" <[EMAIL PROTECTED]> Cc: <[EMAIL PROTECTED]> Sent: Monday, June 23, 2003 9:01 PM Subject: Re: scaling > On Mon, Jun

Re: scaling

2003-06-23 Thread Jeremy Zawodny
On Mon, Jun 30, 2003 at 11:44:30PM -0400, chad pratt wrote: > thanks for the invite. I am too poor to attend. The slides will all be on-line within a day of the talk, if that's of any help. -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy

Re: scaling

2003-06-23 Thread chad pratt
thanks for the invite. I am too poor to attend. -C - Original Message - From: "Jeremy Zawodny" <[EMAIL PROTECTED]> To: "chad pratt" <[EMAIL PROTECTED]> Cc: <[EMAIL PROTECTED]> Sent: Monday, June 23, 2003 6:58 PM Subject: Re: scaling > On Sa

Re: scaling

2003-06-23 Thread Jeremy Zawodny
On Sat, Jun 28, 2003 at 10:53:48PM -0400, chad pratt wrote: > > What are the gotchas with respect to scaling? Come to OSCON and find out! http://conferences.oreillynet.com/cs/os2003/view/e_sess/4502 Sorry. They ask that speakers promote their talks on a relevant mailling list if they

scaling

2003-06-21 Thread chad pratt
I have some general questions regarding a number of things.. I am not looking for "what's wrong with my code?" type answers, just some friendly advice from anyone who want's to answer. HEre goes: What are the gotchas with respect to scaling? What am I going to wish I di

Scaling MySQL

2002-11-14 Thread Alec . Cawley
My application is intended to be scalable. In the eyes of the marketing departments, it should be scalable from zero to infinity. But we all know that this is not possible indefinitely - at some point you reach a bottleneck. In the case of my system, that bottleneck will eventually be the MySQL wri

Re: scaling/tuning problem

2001-11-04 Thread Jeremy Zawodny
On Fri, Nov 02, 2001 at 03:37:53PM -0800, another oracle dba wrote: > Hi. > > I have a query which completes in about 9 sec when executed alone, > but the time grows dramatically when I execute several similar > queries at the same time. If I execute 3 queries the time grows to > 27-40sec, for 5

scaling/tuning problem

2001-11-02 Thread another oracle dba
Hi. I have a query which completes in about 9 sec when executed alone, but the time grows dramatically when I execute several similar queries at the same time. If I execute 3 queries the time grows to 27-40sec, for 5 queries - toabout 1min, for 20 queries ran simultaniously the time jumps to 2-4

Re: Re: Scaling mysql

2001-03-03 Thread vinod panicker
r" <[EMAIL PROTECTED]> From:"Jason Landry" <[EMAIL PROTECTED]> Date:Sat, 3 Mar 2001 03:38:10 -0600 CC:<[EMAIL PROTECTED]> Subject: Re: Scaling mysql Have you considered replication? There's a pretty good chapter in the MySQL manual on how to objectively determine

Re: Scaling mysql

2001-03-03 Thread Jason Landry
t;[EMAIL PROTECTED]> To: <[EMAIL PROTECTED]> Cc: <[EMAIL PROTECTED]> Sent: Friday, March 02, 2001 1:24 PM Subject: Scaling mysql > hey, > i'm having a problem with scaling a mysql server. This is the situation... i have a database with 5 tables containing user data.

Scaling mysql

2001-03-03 Thread vinod panicker
hey, i'm having a problem with scaling a mysql server. This is the situation... i have a database with 5 tables containing user data. Except one, all the other tables have only 2 fields. This data is queried often and needs to be accessed by multiple web servers. Each table

RE: The scaling question?

2001-01-11 Thread Ralf R. Kotowski
On 11 Jan 2001, at 19:18, Chris Murley wrote: > Thanks for you help, can anyone tell me what the file size limit is under > windows?? win 200 or win me? > I think the filesize limit on Win OS'es is 2 GB, video editors have that problem, thats why some implement their own filesystems. Ralf R. K

RE: The scaling question?

2001-01-11 Thread Chris Murley
om: Chris Murley [SMTP:[EMAIL PROTECTED]] > > Sent: Friday, January 12, 2001 12:54 PM > > To: [EMAIL PROTECTED] > > Subject:The scaling question? > > > > > > I know everyone on this list has discussed scaling over and over. > > > > I am

RE: The scaling question?

2001-01-11 Thread Quentin Bennett
anuary 12, 2001 12:54 PM > To: [EMAIL PROTECTED] > Subject: The scaling question? > > > I know everyone on this list has discussed scaling over and over. > > I am only in a need of a simple anwser. > > > Can mysql handle a database with 20,000,000 records?

Re: The scaling question?

2001-01-11 Thread William R. Mussatto
> Subject: The scaling question? > > > I know everyone on this list has discussed scaling over and over. > > I am only in a need of a simple anwser. > > > Can mysql handle a database with 20,000,000 records? > > There will be several tables(about 10) each with

The scaling question?

2001-01-11 Thread Chris Murley
I know everyone on this list has discussed scaling over and over. I am only in a need of a simple anwser. Can mysql handle a database with 20,000,000 records? There will be several tables(about 10) each with no more that 4 columns. In each table there will be 20 million records. These