RE: InnoDB and rsync

2011-01-25 Thread Robinson, Eric
> > You need to quiesce the InnoDb background threads. One technique is > > mentioned here: > > http://dev.mysql.com/doc/refman/5.5/en/innodb-multiple-tablesp > aces.html > > > > Look for the section talking about "clean" backups. > > Now we're talkin. I'll check it out. > > I read that secti

RE: InnoDB and rsync

2011-01-25 Thread Robinson, Eric
> > I'm starting to worry that you may be right. I know FLUSH > TABLES WITH > > READ LOCK does not work as expected with InnoDB, but is > there really > > no way to put InnoDB into a state where all changes have > been flushed > > to disk and it is safe to rsync the directory? Is stopping >

RE: InnoDB and rsync

2011-01-25 Thread Robinson, Eric
> On 1/25/2011 10:45, Robinson, Eric wrote: > >>> There is a very good reason: it is the phenomenon of row > drift. The > >>> master and slave can appear to be in good sync, but often > it is not > >>> actually the case. > >> > >> ... sounds interesting; have you got any document explaining thi

Re: InnoDB and rsync

2011-01-25 Thread Shawn Green (MySQL)
On 1/25/2011 09:00, Robinson, Eric wrote: ... I'm starting to worry that you may be right. I know FLUSH TABLES WITH READ LOCK does not work as expected with InnoDB, but is there really no way to put InnoDB into a state where all changes have been flushed to disk and it is safe to rsync the direc

Re: InnoDB and rsync

2011-01-25 Thread Shawn Green (MySQL)
On 1/25/2011 10:45, Robinson, Eric wrote: There is a very good reason: it is the phenomenon of row drift. The master and slave can appear to be in good sync, but often it is not actually the case. ... sounds interesting; have you got any document explaining this phenomenon? AFAIK, the things th

RE: InnoDB and rsync

2011-01-25 Thread Robinson, Eric
> 240 mysql-instances on 3 physical hosts? > what crazy setup is this please? Processors average 90% idle, peaks are low, iowait is low, the system is not swapping, response time is good, and our users are happy all around the country. What is crazy about that? > The whole world can work with

Re: InnoDB and rsync

2011-01-25 Thread Reindl Harald
Am 25.01.2011 18:38, schrieb Robinson, Eric: >> 240 mysql-servers? >> why there is no consolidation? > > I said 240+ mysql *instances*, not servers. It's actually just 3 > physical servers (not counting standby cluster nodes). 240 mysql-instances on 3 physical hosts? what crazy setup is this ple

Re: Slow query on MySQL4 server doing simple inner join of two InnoDB tables

2011-01-25 Thread Kendall Gifford
On Mon, Jan 24, 2011 at 6:43 PM, Gavin Towey wrote: > If you show the EXPLAIN SELECT .. output, and the table structure, someone > will be able to give a more definite answer. > > Thanks for the reply Gavin. I actually did place this info in my very first message on this thread, along with my bas

RE: InnoDB and rsync

2011-01-25 Thread Robinson, Eric
> 240 mysql-servers? > why there is no consolidation? I said 240+ mysql *instances*, not servers. It's actually just 3 physical servers (not counting standby cluster nodes). > > just need a way to make the same thing work with InnoDB. > > this is simply impossible That is very unfortunate. Di

Re: InnoDB and rsync

2011-01-25 Thread Reindl Harald
Am 25.01.2011 16:56, schrieb Robinson, Eric: > You say that like it doesn't mean a huge amount of additional work, > expense, and complexity. We currently have 240+ master MySQL instances > and are adding them at a rate of several per week. 240 mysql-servers? why there is no consolidation? > B

RE: InnoDB and rsync

2011-01-25 Thread Robinson, Eric
> nobody cares if they are binary replica as long > as the data is consistent and ident Like I said, I'm no expert on this, but my approach seems like the only way to 100% absolutely sure that the data on the slave is in fact consistent and identical to the data on tha master. > so start another

RE: InnoDB and rsync

2011-01-25 Thread Robinson, Eric
> > There is a very good reason: it is the phenomenon of row drift. The > > master and slave can appear to be in good sync, but often it is not > > actually the case. > > ... sounds interesting; have you got any document explaining > this phenomenon? AFAIK, the things that (silently) break > r

RE: InnoDB and rsync

2011-01-25 Thread Jerry Schwartz
>-Original Message- >From: vegiv...@gmail.com [mailto:vegiv...@gmail.com] On Behalf Of Johan De >Meersman >Sent: Tuesday, January 25, 2011 9:56 AM >To: Reindl Harald >Cc: Robinson, Eric; mysql@lists.mysql.com >Subject: Re: InnoDB and rsync > >> jesus christ nobody cares if they are binary r

Re: InnoDB and rsync

2011-01-25 Thread Reindl Harald
Am 25.01.2011 15:56, schrieb Johan De Meersman: >> jesus christ nobody cares if they are binary replica as long >> as the data is consistent and ident >> > > Actually, I can see this being an issue if you're using LVM snapshot backups > or another similar technique - if the datafiles aren't all i

RE: InnoDB and rsync

2011-01-25 Thread Robinson, Eric
> Why don't you use a Maatkit solution like mk-checksum to > ensure that your slaves have identical data with the master? I looked at Maatkit a year or so ago. It looked pretty interesting, but then I started reading the disclaimers carefully and they scared the bejeepers out of me. Warnings abou

Re: InnoDB and rsync

2011-01-25 Thread Steve Musumeche
On 1/25/2011 8:00 AM, Robinson, Eric wrote: your whole solution is crippled because why in the world are you killing your salves and reinit them without any reason daily? There is a very good reason: it is the phenomenon of row drift. The master and slave can appear to be in good sync, but often

Re: InnoDB and rsync

2011-01-25 Thread Johan De Meersman
> jesus christ nobody cares if they are binary replica as long > as the data is consistent and ident > Actually, I can see this being an issue if you're using LVM snapshot backups or another similar technique - if the datafiles aren't all identical you won't be able to restore to any machine from

Re: InnoDB and rsync

2011-01-25 Thread Reindl Harald
Am 25.01.2011 15:00, schrieb Robinson, Eric: >> your whole solution is crippled because why in the world are >> you killing your salves and reinit them without any reason daily? > > There is a very good reason: it is the phenomenon of row drift. The > master and slave can appear to be in good sy

Re: InnoDB and rsync

2011-01-25 Thread Johan De Meersman
On Tue, Jan 25, 2011 at 3:00 PM, Robinson, Eric wrote: > > your whole solution is crippled because why in the world are > > you killing your salves and reinit them without any reason daily? > > There is a very good reason: it is the phenomenon of row drift. The > Interesting. I never heard of tha

Re: InnoDB and rsync

2011-01-25 Thread Mattia Merzi
2011/1/25 Robinson, Eric : >> your whole solution is crippled because why in the world are >> you killing your salves and reinit them without any reason daily? > There is a very good reason: it is the phenomenon of row drift. The > master and slave can appear to be in good sync, but often it is not

RE: InnoDB and rsync

2011-01-25 Thread Robinson, Eric
> your whole solution is crippled because why in the world are > you killing your salves and reinit them without any reason daily? There is a very good reason: it is the phenomenon of row drift. The master and slave can appear to be in good sync, but often it is not actually the case. For this re

Data Wizard for MySQL 11.1 released

2011-01-25 Thread SQL Maestro Team
Hi! SQL Maestro Group announces the release of Data Wizard for MySQL 11.1, a powerful Windows GUI solution for MySQL data management. The new version is immediately available at http://www.sqlmaestro.com/products/mysql/datawizard/ Data Wizard for MySQL provides you with a number of easy-to-use w

Re: InnoDB and rsync

2011-01-25 Thread Reindl Harald
Am 25.01.2011 05:37, schrieb Robinson, Eric: > Is there a way to safely backup an InnoDB database using rsync? Not without stop mysqld Foregt it, do not try it and stop searching if you do not waste time If you understand how innodb works you will see that this is not possible by design your w