[Bacula-users] Perfomance improvement moving from mysql 5.0 to 5.1 or 5.5?
Hello We are using bacula 5.0.3 with mysql 5.0.77 on RHEL 5.7 x64. We are backing tens millons of file and we are staring to see performance problems with mysql. Our server has 6 GB of ram and 1 quad core Intel Xeon E5520 @2.27 Ghz. We have converted from MyISAM to InnoDB in our mysql, and we have seen some performance improvements. Doe anybody know if migrating mysql 5.0 to 5.1 or 5.5 will improve performance with innodb? We have tried to migrate from mysql to postgresql with no luck (http://mtu.net/~jpschewe/blog/2010/06/migrating-bacula-from-mysql-to-postgresql/) though. Maybe more ram would increase also performance? We are using my-innodb-heavy-4G.cnf as mysql config file. Regards Maria -- EMC VNX: the world's simplest storage, starting under $10K The only unified storage solution that offers unified management Up to 160% more powerful than alternatives and 25% more efficient. Guaranteed. http://p.sf.net/sfu/emc-vnx-dev2dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Perfomance improvement moving from mysql 5.0 to 5.1 or 5.5?
On 08/28/11 09:22, Maria Arrea wrote: Hello We are using bacula 5.0.3 with mysql 5.0.77 on RHEL 5.7 x64. We are backing tens millons of file and we are staring to see performance problems with mysql. Our server has 6 GB of ram and 1 quad core Intel Xeon E5520 @2.27 Ghz. We have converted from MyISAM to InnoDB in our mysql, and we have seen some performance improvements. Doe anybody know if migrating mysql 5.0 to 5.1 or 5.5 will improve performance with innodb? Oracle claims on the basis of their benchmarks that MySQL 5.5 is 150% faster on Linux than MySQL 5.1, and 1500% faster on Windows. Maybe more ram would increase also performance? We are using my-innodb-heavy-4G.cnf as mysql configfile. How much RAM is in the machine? Most of the default config files are next to worthless. Remember that MySQL started out as a SQL DB designed for acceptable performance on machines with less than 32MB of RAM and a single 32-bit CPU core of at most a couple of hundred MHz. Is your MySQL running on a dedicated server, or does it share a box with other applications? On a dedicated MySQL server, as a rule of thumb, 80%-90% of total system RAM should be allocated to MySQL, with 75% of total system RAM in the InnoDB buffer pool. -- Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355 ala...@caerllewys.net ala...@metrocast.net p...@co.ordinate.org Renaissance Man, Unix ronin, Perl hacker, SQL wrangler, Free Stater It's not the years, it's the mileage. -- EMC VNX: the world's simplest storage, starting under $10K The only unified storage solution that offers unified management Up to 160% more powerful than alternatives and 25% more efficient. Guaranteed. http://p.sf.net/sfu/emc-vnx-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Perfomance improvement moving from mysql 5.0 to 5.1 or 5.5?
On Sun, Aug 28, 2011 at 03:22:01PM +0200, Maria Arrea wrote: We are using bacula 5.0.3 with mysql 5.0.77 on RHEL 5.7 x64. We are backing tens millons of file and we are staring to see performance problems with mysql. Our server has 6 GB of ram and 1 quad core Intel Xeon E5520 @2.27 Ghz. I went from 1. 4GB MySQL 5.1 MyISAM via 2. 16GB MySQL MyISAM via 3. 16GB MySQL InnoDB to 4. 8GB PostgreSQL 9.0 9M files in last full backup, 2TB data, 35 clients. See Message-ID: 20110811154047.ga27...@r2d2.s.lihas.de Subject: Re: [Bacula-users] Performance with many files 2011-08-11 and 2011-07-06 for the background. Postgres works so far, but I am only at month 4 of 13 now. A noteable difference is the time needed for spooling jobs to one of my 1GB-sized File-volumes. At the beginning it had been 3*1GB/minute with MySQL, but the performance constantly decreased and in the end it had been 1GB/3minutes with otherwise unchanged disk-parameters (iSCSI-volume). With Postgres I run at 2-3*1GB/minute for 1 month now. The limit is the iSCSI-part, which I will get rid of soon. Regards, Adrian -- LiHAS - Adrian Reyer - Hessenwiesenstraße 10 - D-70565 Stuttgart Fon: +49 (7 11) 78 28 50 90 - Fax: +49 (7 11) 78 28 50 91 Mail: li...@lihas.de - Web: http://lihas.de Linux, Netzwerke, Consulting Support - USt-ID: DE 227 816 626 Stuttgart -- EMC VNX: the world's simplest storage, starting under $10K The only unified storage solution that offers unified management Up to 160% more powerful than alternatives and 25% more efficient. Guaranteed. http://p.sf.net/sfu/emc-vnx-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula doesn't restore my windows xp client !
Hi everybody,
I use bacula 5.0.3 for backup files from linux client and windows client.
My backup system:
One server debian lenny proxmox 1.8 with bacula-dir, bacula-fd,
bacula-sd running on and one virtual machine running windows xp with
bacula-win 5.0.3 running on .
The backup device is a usb disk NTFS mounted on debian via ntfs-3g.
The backup file run fine and the volumes are created but when I want to
restore a client windows , I see the files and I mark them (that's good)
and
the restore is ok, I have no error but no files appears in the restore
folder !
28-Aug 10:27 proxmox-lespointus-dir JobId 2: Start Restore Job
RestoreFilesCristal2.2011-08-28_10.27.56_03
28-Aug 10:27 proxmox-lespointus-dir JobId 2: Using Device UsbStorageIrris
28-Aug 10:27 proxmox-lespointus-sd JobId 2: Ready to read from volume
Full-0001 on device UsbStorageIrris (/mnt/backup/bacula/irris).
28-Aug 10:27 proxmox-lespointus-sd JobId 2: Forward spacing Volume
Full-0001 to file:block 0:220.
28-Aug 10:31 proxmox-lespointus-sd JobId 2: End of Volume at file 0 on
device UsbStorageIrris (/mnt/backup/bacula/irris), Volume Full-0001
28-Aug 10:31 proxmox-lespointus-sd JobId 2: End of all volumes.
28-Aug 10:31 proxmox-lespointus-dir JobId 2: Bacula
proxmox-lespointus-dir 5.0.3 (04Aug10): 28-Aug-2011 10:31:43
Build OS: x86_64-unknown-linux-gnu debian 5.0.8
JobId: 2
Job: RestoreFilesCristal2.2011-08-28_10.27.56_03
Restore Client: vm-lespointus-fd
Start time: 28-Aug-2011 10:27:58
End time: 28-Aug-2011 10:31:43
Files Expected: 8,804
Files Restored: 8,804
Bytes Restored: 1,639,794,121
Rate: 7288.0 KB/s
FD Errors: 0
FD termination status: OK
SD termination status: OK
Termination: Restore OK
28-Aug 10:31 proxmox-lespointus-dir JobId 2: Begin pruning Jobs older
than 6 months .
28-Aug 10:31 proxmox-lespointus-dir JobId 2: No Jobs found to prune.
28-Aug 10:31 proxmox-lespointus-dir JobId 2: Begin pruning Jobs.
28-Aug 10:31 proxmox-lespointus-dir JobId 2: No Files found to prune.
28-Aug 10:31 proxmox-lespointus-dir JobId 2: End auto prune.
The FileSet :
FileSet {
Name = FileCristal2Backup
Enable VSS = yes
Include {
Options {
signature = MD5
#compression = GZIP
IgnoreCase = yes
}
File = C:/cristal2
}
}
The restore client debian is good !
I really searched on the web but I found nothing to solve my problem.
Any help is welcome.
Thank by advance.
--
EMC VNX: the world's simplest storage, starting under $10K
The only unified storage solution that offers unified management
Up to 160% more powerful than alternatives and 25% more efficient.
Guaranteed. http://p.sf.net/sfu/emc-vnx-dev2dev___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula 5.0.3 doesn't restore client wndows xp on usb disk.
Hello the world,
I use bacula 5.0.3 for backup files from linux client and windows client.
My backup system:
One serveur debian lenny proxmox 1.8 with bacula-dir, bacula-fd, bacula-sd
running on and one virtual machine running windows xp with bacula-win 5.0.3
running on .
The backup device is a usb disk NTFS mounted on debian via ntfs-3g.
The backup file run fine and the volumes are created but when I want to
restore a client windows backup, the restore is ok but no files appears in the
restore folder !
28-Aug 10:27 proxmox-lespointus-dir JobId 2: Start Restore Job
RestoreFilesCristal2.2011-08-28_10.27.56_03
28-Aug 10:27 proxmox-lespointus-dir JobId 2: Using Device UsbStorageIrris
28-Aug 10:27 proxmox-lespointus-sd JobId 2: Ready to read from volume
Full-0001 on device UsbStorageIrris (/mnt/backup/bacula/irris).
28-Aug 10:27 proxmox-lespointus-sd JobId 2: Forward spacing Volume Full-0001
to file:block 0:220.
28-Aug 10:31 proxmox-lespointus-sd JobId 2: End of Volume at file 0 on device
UsbStorageIrris (/mnt/backup/bacula/irris), Volume Full-0001
28-Aug 10:31 proxmox-lespointus-sd JobId 2: End of all volumes.
28-Aug 10:31 proxmox-lespointus-dir JobId 2: Bacula proxmox-lespointus-dir
5.0.3 (04Aug10): 28-Aug-2011 10:31:43
Build OS: x86_64-unknown-linux-gnu debian 5.0.8
JobId: 2
Job:RestoreFilesCristal2.2011-08-28_10.27.56_03
Restore Client: vm-lespointus-fd
Start time: 28-Aug-2011 10:27:58
End time: 28-Aug-2011 10:31:43
Files Expected: 8,804
Files Restored: 8,804
Bytes Restored: 1,639,794,121
Rate: 7288.0 KB/s
FD Errors: 0
FD termination status: OK
SD termination status: OK
Termination:Restore OK
28-Aug 10:31 proxmox-lespointus-dir JobId 2: Begin pruning Jobs older than 6
months .
28-Aug 10:31 proxmox-lespointus-dir JobId 2: No Jobs found to prune.
28-Aug 10:31 proxmox-lespointus-dir JobId 2: Begin pruning Jobs.
28-Aug 10:31 proxmox-lespointus-dir JobId 2: No Files found to prune.
28-Aug 10:31 proxmox-lespointus-dir JobId 2: End auto prune.
The FileSet :
FileSet {
Name = FileCristal2Backup
Enable VSS = yes
Include {
Options {
signature = MD5
#compression = GZIP
IgnoreCase = yes
}
File = C:/cristal2
}
}
The restore client debian is good !
I really searched on the web but I found nothing to solve my problem.
Any help is welcome.
Thank for advance.
+--
|This was sent by steevechar...@gmail.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
+--
--
EMC VNX: the world's simplest storage, starting under $10K
The only unified storage solution that offers unified management
Up to 160% more powerful than alternatives and 25% more efficient.
Guaranteed. http://p.sf.net/sfu/emc-vnx-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula doesn't restore my windows xp client !
On Sun, Aug 28, 2011 at 05:40:31PM -0400, Admin wrote: I use bacula 5.0.3 for backup files from linux client and windows client. My backup system: One server debian lenny proxmox 1.8 with bacula-dir, bacula-fd, bacula-sd running on and one virtual machine running windows xp with bacula-win 5.0.3 running on . The backup device is a usb disk NTFS mounted on debian via ntfs-3g. The backup file run fine and the volumes are created but when I want to restore a client windows , I see the files and I mark them (that's good) and the restore is ok, I have no error but no files appears in the restore folder ! The problem with your problem description is that no one knows what do you call the restore folder hence it's hard to make educated guesses about what went wrong: FD does not create the files or FD does create (replace ?) the files in a place you do not expect it to. In any case, a way to go would be to run the FD command in foreground on vm-lespointus-fd or at least check its log file after the restore job finishes (or first increase the log verbosity using the -v and/or -d command-line options of the FD program) -- I expect it to log where it has been directed to restore the files. That said, I personally had no problems restoring a bunch of files on a Windows 2003 server and Windows XP, using Bacula 5.0.3 running on a Debian system. -- EMC VNX: the world's simplest storage, starting under $10K The only unified storage solution that offers unified management Up to 160% more powerful than alternatives and 25% more efficient. Guaranteed. http://p.sf.net/sfu/emc-vnx-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula Upgrade from Debian Lenny to Squeeze (2.4.4 to 5.0.2)
Thanks for your answers. Meanwhile I upgraded our postgresql bacula server. The database wasn't upgraded automatically. I had to use the SQL scripts in /usr/share/dbconfig-common/data/bacula-director-pgsql/upgrade/pgsql/ to upgrade, first with /usr/share/dbconfig-common/data/bacula-director-pgsql/upgrade/pgsql/3.0.0 (which took approx. one hour) and then /usr/share/dbconfig-common/data/bacula-director-pgsql/upgrade/pgsql/5.0.0 (only 2 minutes or so). I hadn't to do any change to the config. All seems to be working now. -- EMC VNX: the world's simplest storage, starting under $10K The only unified storage solution that offers unified management Up to 160% more powerful than alternatives and 25% more efficient. Guaranteed. http://p.sf.net/sfu/emc-vnx-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
