Re: [BackupPC-users] mysql streaming

2013-04-26 Thread Timothy J Massey
wrote on 04/26/2013 06:27:32 PM: > My point is that even with o(100) files/copies which assuming you are > backing up multiple versions means you have far fewer distinct files > -- you may be better off just writing a script... I get your point, though I would ask you to define "better"... > Ba

Re: [BackupPC-users] mysql streaming

2013-04-26 Thread Les Mikesell
On Fri, Apr 26, 2013 at 5:31 PM, wrote: > > > Precisely... if you just have a few (as in o(100)) large database > files then you don't need all the complexity of BackupPC which comes > at the cost of speed, etc. And the pooling part which is perhaps the > main differentiator of BackupPC probably

Re: [BackupPC-users] mysql streaming

2013-04-26 Thread backuppc
Les Mikesell wrote at about 16:29:10 -0500 on Friday, April 26, 2013: > On Fri, Apr 26, 2013 at 3:46 PM, Lord Sporkton > wrote: > > As mentioned we have multiple customers and departments. It's not just one > > server. Also 50g data bases aren't the largest. We have ones upto 200g > > indivi

Re: [BackupPC-users] mysql streaming

2013-04-26 Thread backuppc
Timothy J Massey wrote at about 17:20:13 -0400 on Friday, April 26, 2013: > wrote on 04/26/2013 05:04:07 PM: > > > If you are indeed talking about files in the 50-200GB range, you are > > not going to fit more than a handful of files per TB disk... even if > > you have a RAID array of multip

Re: [BackupPC-users] mysql streaming

2013-04-26 Thread Les Mikesell
On Fri, Apr 26, 2013 at 3:46 PM, Lord Sporkton wrote: > As mentioned we have multiple customers and departments. It's not just one > server. Also 50g data bases aren't the largest. We have ones upto 200g > individual dbs. Also we're using scsi drives which cost a pretty penny. I think you are mis

Re: [BackupPC-users] mysql streaming

2013-04-26 Thread Timothy J Massey
wrote on 04/26/2013 05:04:07 PM: > If you are indeed talking about files in the 50-200GB range, you are > not going to fit more than a handful of files per TB disk... even if > you have a RAID array of multiple disks, you are still probably > talking about only a small number of files. So, you ar

Re: [BackupPC-users] mysql streaming

2013-04-26 Thread backuppc
Lord Sporkton wrote at about 13:46:25 -0700 on Friday, April 26, 2013: > As mentioned we have multiple customers and departments. It's not just one > server. Also 50g data bases aren't the largest. We have ones upto 200g > individual dbs. Also we're using scsi drives which cost a pretty penny.

Re: [BackupPC-users] mysql streaming

2013-04-26 Thread Lord Sporkton
As mentioned we have multiple customers and departments. It's not just one server. Also 50g data bases aren't the largest. We have ones upto 200g individual dbs. Also we're using scsi drives which cost a pretty penny. On Apr 26, 2013 1:31 PM, "Arnold Krille" wrote: > On Thu, 25 Apr 2013 14:45:50

Re: [BackupPC-users] mysql streaming

2013-04-26 Thread Timothy J Massey
Arnold Krille wrote on 04/26/2013 04:27:44 PM: > On Thu, 25 Apr 2013 14:45:50 -0700 Lord Sporkton > wrote: > > I'm currently backing up mysql by way of dumping the DB to a flat > > file then backing up the flat file. Which works well in most cases > > except when someone has a database that is b

Re: [BackupPC-users] mysql streaming

2013-04-26 Thread Arnold Krille
On Thu, 25 Apr 2013 14:45:50 -0700 Lord Sporkton wrote: > I'm currently backing up mysql by way of dumping the DB to a flat > file then backing up the flat file. Which works well in most cases > except when someone has a database that is bigger than 50% of the > hdd. Or really bigger than around s

Re: [BackupPC-users] mysql streaming

2013-04-25 Thread Lord Sporkton
At this point I have realized two things. 1) tar accepts a stream of filenames in, not a data stream. 2) backuppc expects specifically a tar stream, not just a file stream(with a list of files preceding the data). To that end I have thrown out the idea of using tar and I have resorted to writing m

Re: [BackupPC-users] mysql streaming

2013-04-25 Thread Adam Goryachev
On 26/04/13 14:39, Les Mikesell wrote: > On Thu, Apr 25, 2013 at 6:09 PM, Lord Sporkton wrote: >> I'm aware of zmanda and several other backup options however at this time >> this is what we have and this is what we are trying to leverage. Perhaps it >> will turn out that writing to a flat file is

Re: [BackupPC-users] mysql streaming

2013-04-25 Thread Les Mikesell
On Thu, Apr 25, 2013 at 6:09 PM, Lord Sporkton wrote: > I'm aware of zmanda and several other backup options however at this time > this is what we have and this is what we are trying to leverage. Perhaps it > will turn out that writing to a flat file is the only option. But the nature > of the ba

Re: [BackupPC-users] mysql streaming

2013-04-25 Thread Sabuj Pattanayek
> could get it to work. Tar is of course capable of accepting either stream or > file as input and mysqldump is capable of outputing to either stream or > file. I suppose I will just have to play around with it more maybe. Please show an example of where you can stream data directly into tar

Re: [BackupPC-users] mysql streaming

2013-04-25 Thread Lord Sporkton
ckuppc-users@lists.sourceforge.net> > Sent: Thursday, April 25, 2013 6:35:20 PM > Subject: Re: [BackupPC-users] mysql streaming > > > > It is on linux yes. That is not out of the question, but it would be > preferred for management purposes to do it though the command in backu

Re: [BackupPC-users] mysql streaming

2013-04-25 Thread Mark Rosedale
level backup, this way you can backup >directly from the db without running a dump. I think zmanda might do what you >are looking for. - Original Message - From: "Lord Sporkton" To: "General list for user discussion, questions and support" Sent: Thursday, A

Re: [BackupPC-users] mysql streaming

2013-04-25 Thread Lord Sporkton
It is on linux yes. That is not out of the question, but it would be preferred for management purposes to do it though the command in backuppc. Its not just one server, its dozens and growing. Its also multiple customers and departments. On 25 April 2013 14:53, Sabuj Pattanayek wrote: > Does yo

Re: [BackupPC-users] mysql streaming

2013-04-25 Thread Sabuj Pattanayek
Does your mysql db live on a unix system? If so, why not use automysqlbackup and just have it dump to your backup system over NFS? On Thu, Apr 25, 2013 at 4:45 PM, Lord Sporkton wrote: > I'm currently backing up mysql by way of dumping the DB to a flat file then > backing up the flat file. Which

[BackupPC-users] mysql streaming

2013-04-25 Thread Lord Sporkton
I'm currently backing up mysql by way of dumping the DB to a flat file then backing up the flat file. Which works well in most cases except when someone has a database that is bigger than 50% of the hdd. Or really bigger than around say 35% of the hdd if you account for system files and a reasonabl

Re: [BackupPC-users] mysql addon or plugin?

2011-03-28 Thread Igor Sverkos
Hi, > [...] > 6 let BPC capture the dump It is possible to tell BackupPC, just to backup the dump? How? -- Regards, Igor -- Enable your software for Intel(R) Active Management Technology to meet the growing manageabil

Re: [BackupPC-users] mysql addon or plugin?

2011-03-26 Thread Les Mikesell
On 3/26/11 12:56 PM, hans...@gmail.com wrote: > I may be wrong here, more reading than experience in this particular > area, but my understanding is that it would still recommend making > sure nothing's writing to the database while the dump is taken. > > For a heavily used transactional systems wi

Re: [BackupPC-users] mysql addon or plugin?

2011-03-26 Thread hansbkk
I may be wrong here, more reading than experience in this particular area, but my understanding is that it would still recommend making sure nothing's writing to the database while the dump is taken. For a heavily used transactional systems with complex relational structures, IMO it's possible tha

Re: [BackupPC-users] mysql addon or plugin?

2011-03-26 Thread Doug Lytle
hans...@gmail.com wrote: > If you want > to really minimize the downtime, then using LVM snapshotting is a good > option. > > 1. shut down the service > 2 take the snapshot > Just an addition to this, If using the XFS file system, snapshotting will cause LVM to preform an file system freeze,

Re: [BackupPC-users] mysql addon or plugin?

2011-03-25 Thread hansbkk
MySQLdump is a good tool, there are others, but usually the whole process is scripted to fit the local environment. Just like many mail servers, databases should be quiescent (the server stopped) while the dump takes place to ensure consistency. If you want to really minimize the downtime, then us

[BackupPC-users] mysql addon or plugin?

2011-03-25 Thread Lord Sporkton
I have seen some examples of using a local backup script to dumpmysql to a local dir, then backup that local dir via BPC, but i was hoping for something a little more robust. I was looking into replacing the tar commands that pipe back to ssh with a mysqldump command so it pipes one big sqldump fil

Re: [BackupPC-users] Mysql backup on windows XP

2010-04-07 Thread Mark Maciolek
hi, http://www.winforums.com/showthread.php?t=8943 On 4/7/2010 11:19 AM, Jonathan dumaresq wrote: > Hi all, > > I have several mysql serv on linux based OS. Now I have to backup a Windows > mysql based system. On Linux I have use a script that do a dump everyday > etc... > > But, On windows I h

Re: [BackupPC-users] Mysql backup on windows XP

2010-04-07 Thread John Moorhouse
Have a look at this, a colleague used it but I haven't http://www.jijenik.com/projects/mysqlbackup/ Ta John On 7 Apr 2010, at 16:19, Jonathan dumaresq wrote: > Hi all, > > I have several mysql serv on linux based OS. Now I have to backup a Windows > mysql based system. On Linux I have use a

Re: [BackupPC-users] Mysql backup on windows XP

2010-04-07 Thread Michael Stowe
> Hi all, > > I have several mysql serv on linux based OS. Now I have to backup a > Windows > mysql based system. On Linux I have use a script that do a dump everyday > etc... > > But, On windows I have no Idea of how to handle this. > > Anyone here can point me out the right direction. > > Jonatha

[BackupPC-users] Mysql backup on windows XP

2010-04-07 Thread Jonathan dumaresq
Hi all, I have several mysql serv on linux based OS. Now I have to backup a Windows mysql based system. On Linux I have use a script that do a dump everyday etc... But, On windows I have no Idea of how to handle this. Anyone here can point me out the right direction. Jonathan -

Re: [BackupPC-users] MySQL

2009-11-12 Thread Brent Clark
Hiya I find mylvmbackup to work very well. Basically locks mysql, uses / creates lvm snapshotting. release mysql lock, mount lvmsnapshot (at this stage, mysql is left to its own devices), and then you can tar the snapshot. It works with both MYISAM and innodb. I use mylvmbackup up with DumpPr

Re: [BackupPC-users] MySQL

2009-11-12 Thread Timothy Murphy
Weber Gyula wrote: > I'm using mysql slaves on my backup server, with daily snapshots. The > script make dumps for each table, and a full weekly snapshot. That's > because the table-based restore script doesn't care the order which makes > sense if you use view -s or other special things. > > Hov

Re: [BackupPC-users] MySQL

2009-11-12 Thread Tyler J. Wagner
On Thursday 12 November 2009 15:10:39 Timothy Murphy wrote: > What is the best way to use BackupPC to backup a MySQL database? A very easy way is install webmin. Login once to webmin and click MySQL server, and it will prompt you for an admin user's login and save it in a file only root can rea

Re: [BackupPC-users] MySQL

2009-11-12 Thread Weber Gyula
I'm using mysql slaves on my backup server, with daily snapshots. The script make dumps for each table, and a full weekly snapshot. That's because the table-based restore script doesn't care the order which makes sense if you use view -s or other special things. Hovever, i think mysql replicat

Re: [BackupPC-users] MySQL

2009-11-12 Thread Johan Cwiklinski
95 > -Original Message- > From: Timothy Murphy [mailto:gayle...@eircom.net] > Sent: 12 November 2009 15:11 > To: backuppc-users@lists.sourceforge.net > Subject: [BackupPC-users] MySQL > > What

Re: [BackupPC-users] MySQL

2009-11-12 Thread Michael Stowe
Yes, you can use dumppreusercmd or dumppresharecmd to do so. > Doug Lytle wrote: > >> I use mysqldump to a directory and then have that backed up using >> BackupPC via rsync. > > Thanks, that sounds the simplest solution. > Is there any way to tell BackupPC to run mysqldump > before the nightly b

Re: [BackupPC-users] MySQL

2009-11-12 Thread Timothy Murphy
Doug Lytle wrote: > I use mysqldump to a directory and then have that backed up using > BackupPC via rsync. Thanks, that sounds the simplest solution. Is there any way to tell BackupPC to run mysqldump before the nightly backup? -- Timothy Murphy e-mail: gayleard /at/ eircom.net tel: +353-86-

Re: [BackupPC-users] MySQL

2009-11-12 Thread Doug Lytle
Timothy Murphy wrote: > What is the best way to use BackupPC to backup a MySQL database? > > I use mysqldump to a directory and then have that backed up using BackupPC via rsync. Doug -- Ben Franklin quote: "Those who would give up Essential Liberty to purchase a little Temporary Safet

Re: [BackupPC-users] MySQL

2009-11-12 Thread James Wells
Administrator t:  +44 (0) 1904 780030 w: www.webcertain.com WebCertain Group Limited - Company No. 06721395 -Original Message- From: Timothy Murphy [mailto:gayle...@eircom.net] Sent: 12 November 2009 15:11 To: backuppc-users@lists.sourceforge.net Subject: [BackupPC-users] MySQL What is the

[BackupPC-users] MySQL

2009-11-12 Thread Timothy Murphy
What is the best way to use BackupPC to backup a MySQL database? -- Timothy Murphy e-mail: gayleard /at/ eircom.net tel: +353-86-2336090, +353-1-2842366 s-mail: School of Mathematics, Trinity College, Dublin 2, Ireland --

Re: [BackupPC-users] MySQL dump backup example scripts request

2009-07-07 Thread Admiral Beotch
Good call! I didnt notice this because I'm only backing up 60M of data, which took about 90 seconds. A significantly larger database would have been killed with this. By separating the commands, everything completes within 30 seconds - and that's even with an additional PGP command! Thanks! --

Re: [BackupPC-users] MySQL dump backup example scripts request

2009-07-06 Thread Boltris Alexandr
Admiral Beotch пишет: > I use a cron job that backups my databases on a daily/weekly basis and > then depend on backuppc to grab those static files - the backup of mysql > is not dependant on the DumpPreUserCmd in backuppc. The command I have > cron'd is: > > mysqldump --opt --all-databases -u

Re: [BackupPC-users] MySQL dump backup example scripts request

2009-07-06 Thread Adam Goryachev
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Philip Tait wrote: > I have done some searching, and have not been able to find a > complete working example for properly backing up a MySQL database > with BackupPC. > > If someone would be willing to share their working DumpPreUserCmd > and DumpPostU

Re: [BackupPC-users] MySQL dump backup example scripts request

2009-07-06 Thread Ryan Manikowski
Check this thread: http://www.backupcentral.com/phpBB2/two-way-mirrors-of-external-mailing-lists-3/backuppc-21/mysqldump-92269/ Ryan Manikowski | System Administrator :703.677.8499: ryan.manikow...@2ergo.com 2ergo – Digital leaders in a mobile world Mobile Excellence Award - Best Innovator M

Re: [BackupPC-users] MySQL dump backup example scripts request

2009-07-06 Thread Ryan Knapper
On Mon, Jul 6, 2009 at 13:44, Philip Tait wrote: > I have done some searching, and have not been able to find a complete > working example for properly backing up a MySQL database with BackupPC. > > If someone would be willing to share their working DumpPreUserCmd and > DumpPostUserCmd setup for

Re: [BackupPC-users] MySQL dump backup example scripts request

2009-07-06 Thread Admiral Beotch
I use a cron job that backups my databases on a daily/weekly basis and then depend on backuppc to grab those static files - the backup of mysql is not dependant on the DumpPreUserCmd in backuppc. The command I have cron'd is: mysqldump --opt --all-databases -u root | gzip -9 > /backups/mySQL-AllDB

[BackupPC-users] MySQL dump backup example scripts request

2009-07-06 Thread Philip Tait
I have done some searching, and have not been able to find a complete working example for properly backing up a MySQL database with BackupPC. If someone would be willing to share their working DumpPreUserCmd and DumpPostUserCmd setup for creating MySQL database dumps for backup, thus saving me som

Re: [BackupPC-users] mysql files

2008-04-12 Thread Mufit Eribol
Ryan Manikowski wrote: > Mufit, > > Have a look here: > > http://projects.frozenpc.net/autopgsqlbackup/ > > Ryan Thanks, Ryan. - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's excitin

Re: [BackupPC-users] mysql files

2008-04-12 Thread Ryan Manikowski
Mufit, Have a look here: http://projects.frozenpc.net/autopgsqlbackup/ Ryan Mufit Eribol wrote: > Ryan Manikowski wrote: >> Here's the mysql backup script that runs via the BackupPC dumppre >> command prior to backing up our database servers: >> >> http://sourceforge.net/projects/automysqlbac

Re: [BackupPC-users] mysql files

2008-04-12 Thread Mufit Eribol
Ryan Manikowski wrote: > Here's the mysql backup script that runs via the BackupPC dumppre > command prior to backing up our database servers: > > http://sourceforge.net/projects/automysqlbackup/ > > > Ryan Thank you for the link. Is there any script similar to this for postgresql? Mufit

Re: [BackupPC-users] mysql files

2008-04-11 Thread Renke Brausse
Hi Nils, > > as I'm lazy I never excluded the mysql storage from backup - so far no > > problems in 1,5 years. > > There is no need to exclude them from your backup, as BackupPC reading > them will not cause any problems, but those backed up files may not be > usable when restored. I misread

Re: [BackupPC-users] mysql files

2008-04-11 Thread Nils Breunese (Lemonbit)
Renke Brausse wrote: >> Thanks for that link, but i wanted to know if it is possible that >> just >> backuppc performing the backup of mysql files, if that can cause an >> issue with teh files while the server is running, IE like corrupting >> .myd files or stuff like that? > > as I'm lazy I nev

Re: [BackupPC-users] mysql files

2008-04-11 Thread Tino Schwarze
On Fri, Apr 11, 2008 at 11:35:27AM -0400, Rob Morin wrote: > Thanks for that link, but i wanted to know if it is possible that just > backuppc performing the backup of mysql files, if that can cause an > issue with teh files while the server is running, IE like corrupting > .myd files or stuff

Re: [BackupPC-users] mysql files

2008-04-11 Thread Martin Leben
Rob Morin wrote: > Thanks for that link, but i wanted to know if it is possible that just > backuppc performing the backup of mysql files, if that can cause an > issue with teh files while the server is running, IE like corrupting > .myd files or stuff like that? Hi Rob, No, BackupPC will not

Re: [BackupPC-users] mysql files

2008-04-11 Thread Ryan Manikowski
Sent: Friday, April 11, 2008 11:52 AM To: backuppc-users@lists.sourceforge.net Subject: Re: [BackupPC-users] mysql files Rob Morin wrote: > Thanks for that link, but i wanted to know if it is possible that just > backuppc performing the backup of mysql files, if that can cause an > issue

Re: [BackupPC-users] mysql files

2008-04-11 Thread Renke Brausse
Hi Rob, > Thanks for that link, but i wanted to know if it is possible that just > backuppc performing the backup of mysql files, if that can cause an > issue with teh files while the server is running, IE like corrupting > .myd files or stuff like that? as I'm lazy I never excluded the mysql

Re: [BackupPC-users] mysql files

2008-04-11 Thread Ronnie Gilkey
Rob Morin wrote: Nils Breunese (Lemonbit) wrote: Op 11 apr 2008, om 14:27 heeft Rob Morin het volgende geschreven: Is it possible that backuppc can mulch mysql files while doing a backup? Should i be excluding mysql files from the backup, mind i do night mysqldumps anyways... An

Re: [BackupPC-users] mysql files

2008-04-11 Thread Nils Breunese (Lemonbit)
Rob Morin wrote: > Thanks for that link, but i wanted to know if it is possible that > just backuppc performing the backup of mysql files, if that can > cause an issue with teh files while the server is running, IE like > corrupting .myd files or stuff like that? Backing up the live databa

Re: [BackupPC-users] mysql files

2008-04-11 Thread Rob Morin
Nils Breunese (Lemonbit) wrote: > Op 11 apr 2008, om 14:27 heeft Rob Morin het volgende geschreven: > > >> Is it possible that backuppc can mulch mysql files while doing a >> backup? >> >> Should i be excluding mysql files from the backup, mind i do night >> mysqldumps anyways... >> >> Any su

Re: [BackupPC-users] mysql files

2008-04-11 Thread Nils Breunese (Lemonbit)
Op 11 apr 2008, om 14:27 heeft Rob Morin het volgende geschreven: > Is it possible that backuppc can mulch mysql files while doing a > backup? > > Should i be excluding mysql files from the backup, mind i do night > mysqldumps anyways... > > Any suggestions? See the example here: http://backup

[BackupPC-users] mysql files

2008-04-11 Thread Rob Morin
Is it possible that backuppc can mulch mysql files while doing a backup? Should i be excluding mysql files from the backup, mind i do night mysqldumps anyways... Any suggestions? -- Rob Morin Dido Internet Inc. Montreal,Canada http://www.dido.ca 514-990-

Re: [BackupPC-users] mysql backup isn't working

2006-11-08 Thread daniel berteaud
You should save mysql databases this way. The best way is to use a pre-dump script whcih dump tha database you want. For exemple: mysqldump mysqldump --add-drop-table -A -Q > /home/backup/mysql.sql This command will dump all the mysql databases and save them as a mysql script in /home/backup. Then

[BackupPC-users] mysql backup isn't working

2006-11-08 Thread Mikael Lammentausta
Title: mysql backup isn't working Backups of the host below (backup_client) works fine for the two first folders, but not for /var/lib/mysql. I tried to manually rsync this folder to /tmp/backup as the user backuppc, and it worked. I wonder why it doesn't when the backupPC daemon does it. Any