Re: [Bacula-users] Bacula database is getting too long
Il 13/01/2012 15:30, Honia A ha scritto: > Thanks for your reply. I just checked the permissions of the bacula > folder and see the following: > > root@servername:/var/lib <mailto:root@servername:/var/lib># ls -l > drwx-- 2 baculabacula 4096 2012-01-13 09:24 bacula IMHO it should suffice. > > Is this sufficient? I've noticed the mysql error no longer shows up but > the BackupCatalog job still returns error: > > 1650 Full 0 0 Error12-Jan-12 21:55 BackupCatalog > > How can I find out what's causing this error? > > Thank you in advance > * > ** > * Well, I'd start reading the job log... HTH > > >> Date: Fri, 13 Jan 2012 10:58:39 +0100 >> From: mrom...@ottotecnica.com >> To: bacula-users@lists.sourceforge.net >> Subject: Re: [Bacula-users] Bacula database is getting too long >> >> Il 12/01/2012 21:03, Honia A ha scritto: >> > After seeing your post I did some research and just ran this to change >> > the ownership but didn't help: chown root:bacula > /var/lib/bacula/bacula.sql >> > >> >> The problem is not the permission bits on bacula.sql file, but rather >> those of /var/lib/bacula folder. >> >> If the process that is trying to create the bacula.sql file is run as >> user "bacula", then /var/lib/bacula should be owned by user "bacula", >> who should have rwx access permission. Or, if user "bacula" is part of >> group "bacula", /var/lib/bacula could be owned by root:bacula, provided >> group permission is rwx as well. >> >> -- >> Marcello Romani >> >> > -- >> RSA(R) Conference 2012 >> Mar 27 - Feb 2 >> Save $400 by Jan. 27 >> Register now! >> http://p.sf.net/sfu/rsa-sfdev2dev2 >> ___ >> Bacula-users mailing list >> Bacula-users@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/bacula-users -- Marcello Romani -- RSA(R) Conference 2012 Mar 27 - Feb 2 Save $400 by Jan. 27 Register now! http://p.sf.net/sfu/rsa-sfdev2dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula database is getting too long
Thanks for your reply. I just checked the permissions of the bacula folder and see the following: root@servername:/var/lib# ls -l drwx-- 2 baculabacula 4096 2012-01-13 09:24 bacula Is this sufficient? I've noticed the mysql error no longer shows up but the BackupCatalog job still returns error: 1650 Full 0 0 Error12-Jan-12 21:55 BackupCatalog How can I find out what's causing this error? Thank you in advance > Date: Fri, 13 Jan 2012 10:58:39 +0100 > From: mrom...@ottotecnica.com > To: bacula-users@lists.sourceforge.net > Subject: Re: [Bacula-users] Bacula database is getting too long > > Il 12/01/2012 21:03, Honia A ha scritto: > > After seeing your post I did some research and just ran this to change > > the ownership but didn't help: chown root:bacula /var/lib/bacula/bacula.sql > > > > The problem is not the permission bits on bacula.sql file, but rather > those of /var/lib/bacula folder. > > If the process that is trying to create the bacula.sql file is run as > user "bacula", then /var/lib/bacula should be owned by user "bacula", > who should have rwx access permission. Or, if user "bacula" is part of > group "bacula", /var/lib/bacula could be owned by root:bacula, provided > group permission is rwx as well. > > -- > Marcello Romani > > -- > RSA(R) Conference 2012 > Mar 27 - Feb 2 > Save $400 by Jan. 27 > Register now! > http://p.sf.net/sfu/rsa-sfdev2dev2 > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users -- RSA(R) Conference 2012 Mar 27 - Feb 2 Save $400 by Jan. 27 Register now! http://p.sf.net/sfu/rsa-sfdev2dev2___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula database is getting too long
Il 12/01/2012 21:03, Honia A ha scritto: > After seeing your post I did some research and just ran this to change > the ownership but didn't help: chown root:bacula /var/lib/bacula/bacula.sql > The problem is not the permission bits on bacula.sql file, but rather those of /var/lib/bacula folder. If the process that is trying to create the bacula.sql file is run as user "bacula", then /var/lib/bacula should be owned by user "bacula", who should have rwx access permission. Or, if user "bacula" is part of group "bacula", /var/lib/bacula could be owned by root:bacula, provided group permission is rwx as well. -- Marcello Romani -- RSA(R) Conference 2012 Mar 27 - Feb 2 Save $400 by Jan. 27 Register now! http://p.sf.net/sfu/rsa-sfdev2dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula database is getting too long
After seeing your post I did some research and just ran this to change the ownership but didn't help: chown root:bacula /var/lib/bacula/bacula.sql The output is: drwx-- 2 baculabacula 4096 2012-01-12 14:37 bacula And -rw-r--r-- 1 root bacula 209927918 2012-01-12 13:45 bacula.sql root@servername:/var/lib/bacula# cd /etc/bacula/scripts root@servername:/etc/bacula/scripts# ls -l total 72 -rw-r--r-- 1 root root 296 2010-03-23 16:27 btraceback.gdb -rwxr-xr-x 1 root root 112 2010-03-23 16:27 delete_catalog_backup -rwxr-xr-x 1 root root 9012 2010-03-23 16:27 disk-changer -rwxr-xr-x 1 root root 16948 2010-03-23 16:27 dvd-handler -rwxr-xr-x 1 root root 2047 2010-03-23 16:27 make_catalog_backup -rw-r--r-- 1 root root 1646 2010-03-23 16:27 make_catalog_backup_awk -rwxr-xr-x 1 root root 4106 2010-03-23 16:27 make_catalog_backup.pl -rwxr-xr-x 1 root root 6899 2010-03-23 16:27 mtx-changer -rwxr-xr-x 1 root root 1506 2010-03-23 16:27 mtx-changer.conf -rw-r--r-- 1 root root 90 2010-03-23 16:27 query.sql Date: Thu, 12 Jan 2012 18:49:08 +0200 From: ja...@iki.fi To: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Bacula database is getting too long 12.1.2012 18:10, Honia A kirjoitti: > Thanks everyone. The permission denied error below started to occur when > I followed the instruction and cleaned up the bacula.sql file. > > 12-Jan 05:39 babar-dir JobId 1639: shell command: run BeforeJob > "/etc/bacula/scripts/make_catalog_backup.pl MyCatalog" > 12-Jan 05:39 babar-dir JobId 1639: BeforeJob: sh: cannot create > /var/lib/bacula/bacula.sql: Permission denied > 12-Jan 05:39 babar-dir JobId 1639: Error: Runscript: BeforeJob returned > non-zero status=2. ERR=Child exited with code 2 > 12-Jan 05:39 babar-dir JobId 1639: Error: Bacula babar-dir 5.0.1 > (24Feb10): 12-Jan-2012 05:39:13 > > These were the commands I ran to cleanup the database: > > mysqldump -f --opt bacula > bacula.sql > mysql bacula < bacula.sql > rm -f bacula.sql > > How can I test and find out what's wrong here? When I had shut down the > backup server, everything was fine. Looks like something is holiding up > the servers until 8 AM or so, just can't tell what that is. > > I'd appreciate your help, > h* * > The process running bacula-fd can't create your bacula.sql dump file. > 12-Jan 05:39 babar-dir JobId 1639: BeforeJob: sh: cannot create > /var/lib/bacula/bacula.sql: Permission denied Who owns the folder /var/lib/bacula? What kind of permissions are allowed there for the process running bacula-dir? Bacula-dir is run by user bacula normally. -- You're currently going through a difficult transition period called "Life." -- RSA(R) Conference 2012 Mar 27 - Feb 2 Save $400 by Jan. 27 Register now! http://p.sf.net/sfu/rsa-sfdev2dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- RSA(R) Conference 2012 Mar 27 - Feb 2 Save $400 by Jan. 27 Register now! http://p.sf.net/sfu/rsa-sfdev2dev2___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula database is getting too long
12.1.2012 18:10, Honia A kirjoitti: > Thanks everyone. The permission denied error below started to occur when > I followed the instruction and cleaned up the bacula.sql file. > > 12-Jan 05:39 babar-dir JobId 1639: shell command: run BeforeJob > "/etc/bacula/scripts/make_catalog_backup.pl MyCatalog" > 12-Jan 05:39 babar-dir JobId 1639: BeforeJob: sh: cannot create > /var/lib/bacula/bacula.sql: Permission denied > 12-Jan 05:39 babar-dir JobId 1639: Error: Runscript: BeforeJob returned > non-zero status=2. ERR=Child exited with code 2 > 12-Jan 05:39 babar-dir JobId 1639: Error: Bacula babar-dir 5.0.1 > (24Feb10): 12-Jan-2012 05:39:13 > > These were the commands I ran to cleanup the database: > > mysqldump -f --opt bacula > bacula.sql > mysql bacula < bacula.sql > rm -f bacula.sql > > How can I test and find out what's wrong here? When I had shut down the > backup server, everything was fine. Looks like something is holiding up > the servers until 8 AM or so, just can't tell what that is. > > I'd appreciate your help, > h* * > The process running bacula-fd can't create your bacula.sql dump file. > 12-Jan 05:39 babar-dir JobId 1639: BeforeJob: sh: cannot create > /var/lib/bacula/bacula.sql: Permission denied Who owns the folder /var/lib/bacula? What kind of permissions are allowed there for the process running bacula-dir? Bacula-dir is run by user bacula normally. -- You're currently going through a difficult transition period called "Life." signature.asc Description: OpenPGP digital signature -- RSA(R) Conference 2012 Mar 27 - Feb 2 Save $400 by Jan. 27 Register now! http://p.sf.net/sfu/rsa-sfdev2dev2___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula database is getting too long
Thanks everyone. The permission denied error below started to occur when I followed the instruction and cleaned up the bacula.sql file. 12-Jan 05:39 babar-dir JobId 1639: shell command: run BeforeJob "/etc/bacula/scripts/make_catalog_backup.pl MyCatalog" 12-Jan 05:39 babar-dir JobId 1639: BeforeJob: sh: cannot create /var/lib/bacula/bacula.sql: Permission denied 12-Jan 05:39 babar-dir JobId 1639: Error: Runscript: BeforeJob returned non-zero status=2. ERR=Child exited with code 2 12-Jan 05:39 babar-dir JobId 1639: Error: Bacula babar-dir 5.0.1 (24Feb10): 12-Jan-2012 05:39:13 These were the commands I ran to cleanup the database: mysqldump -f --opt bacula > bacula.sql mysql bacula < bacula.sql rm -f bacula.sql How can I test and find out what's wrong here? When I had shut down the backup server, everything was fine. Looks like something is holiding up the servers until 8 AM or so, just can't tell what that is. I'd appreciate your help, h > From: bwal...@artsci.utoronto.ca > To: bacula-users@lists.sourceforge.net > Date: Thu, 12 Jan 2012 10:33:32 -0500 > Subject: Re: [Bacula-users] Bacula database is getting too long > > Excerpts from Martin Simmons's message of Thu Jan 12 10:25:02 -0500 2012: > > > > The mail server's name is Gauss and although I have it setup babar > > > (name of the backup server where has bacula installed) to start at > > > 20:05 every night, the mail server will not be accessible until > > > 8:15 AM and by that I mean people at work cannot get their > > > messages or send messages because the server is not responding. > > > > This is very unlikely to be caused by Bacula. > > Agreed, but if there are, say, network issues, bacula could exacerbate > a problem that flies under the radar during normal operation. I'd be > checking the network settings on every device from the NIC to the > backup server and running some performance tools while bacula is not > active to see if you experience the same degradation. > > HTH > -Ben > -- > Ben Walton > Systems Programmer - CHASS > University of Toronto > C:416.407.5610 | W:416.978.4302 > > > -- > RSA(R) Conference 2012 > Mar 27 - Feb 2 > Save $400 by Jan. 27 > Register now! > http://p.sf.net/sfu/rsa-sfdev2dev2 > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users -- RSA(R) Conference 2012 Mar 27 - Feb 2 Save $400 by Jan. 27 Register now! http://p.sf.net/sfu/rsa-sfdev2dev2___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula database is getting too long
Excerpts from Martin Simmons's message of Thu Jan 12 10:25:02 -0500 2012: > > The mail server's name is Gauss and although I have it setup babar > > (name of the backup server where has bacula installed) to start at > > 20:05 every night, the mail server will not be accessible until > > 8:15 AM and by that I mean people at work cannot get their > > messages or send messages because the server is not responding. > > This is very unlikely to be caused by Bacula. Agreed, but if there are, say, network issues, bacula could exacerbate a problem that flies under the radar during normal operation. I'd be checking the network settings on every device from the NIC to the backup server and running some performance tools while bacula is not active to see if you experience the same degradation. HTH -Ben -- Ben Walton Systems Programmer - CHASS University of Toronto C:416.407.5610 | W:416.978.4302 -- RSA(R) Conference 2012 Mar 27 - Feb 2 Save $400 by Jan. 27 Register now! http://p.sf.net/sfu/rsa-sfdev2dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula database is getting too long
> On Thu, 12 Jan 2012 09:29:47 -0500, Honia A said: > > The mail server's name is Gauss and although I have it setup babar (name of > the backup server where has bacula installed) to start at 20:05 every night, > the mail server will not be accessible until 8:15 AM and by that I mean > people at work cannot get their messages or send messages because the server > is not responding. This is very unlikely to be caused by Bacula. __Martin -- RSA(R) Conference 2012 Mar 27 - Feb 2 Save $400 by Jan. 27 Register now! http://p.sf.net/sfu/rsa-sfdev2dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula database is getting too long
The backup catalog did not run because of a permission denied error on the /var/lib/bacula/ folder. > 12-Jan 05:39 babar-dir JobId 1639: shell command: run BeforeJob > "/etc/bacula/scripts/make_catalog_backup.pl MyCatalog" > 12-Jan 05:39 babar-dir JobId 1639: BeforeJob: sh: cannot create > /var/lib/bacula/bacula.sql: Permission denied > 12-Jan 05:39 babar-dir JobId 1639: Error: Runscript: BeforeJob returned > non-zero status=2. ERR=Child exited with code 2 > 12-Jan 05:39 babar-dir JobId 1639: Error: Bacula babar-dir 5.0.1 (24Feb10): -- RSA(R) Conference 2012 Mar 27 - Feb 2 Save $400 by Jan. 27 Register now! http://p.sf.net/sfu/rsa-sfdev2dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula database is getting too long
2012/1/12 Honia A : > Thanks for everyone's helpful responses. > > I was handed this backup server which has bacula installed and looks like > there was no maintenance work ever done to it. The backupcatalog job is the > one with error every morning: > Error 12-Jan-12 05:39 BackupCatalog > > I typed the command "messages" in bconsole to get the messages and > pasted that below. Is there anywhere else I should be looking to get > specifically the logs for backupcatalog? > > The mail server's name is Gauss and although I have it setup babar (name of > the backup server where has bacula installed) to start at 20:05 every night, > the mail server will not be accessible until 8:15 AM and by that I mean > people at work cannot get their messages or send messages because the server > is not responding. > > Thanks in advance for youe help, here's the output of messages: > > 11-Jan 20:11 babar-dir JobId 1637: Begin pruning Jobs older than 6 months . > 11-Jan 20:11 babar-dir JobId 1637: Pruned 1 Job for client athena-fd from > catalog. > 11-Jan 20:11 babar-dir JobId 1637: Begin pruning Jobs. > 11-Jan 20:11 babar-dir JobId 1637: No Files found to prune. > 11-Jan 20:11 babar-dir JobId 1637: End auto prune. > 11-Jan 20:11 babar-dir JobId 1638: Start Backup JobId 1638, > Job=Gauss.2012-01-11_20.05.00_44 > 11-Jan 20:11 babar-dir JobId 1638: Using Device "GaussFileStorage" > 11-Jan 20:18 gauss-fd JobId 1638: DIR and FD clocks differ by 395 seconds, > FD automatically compensating. > 11-Jan 20:11 babar-sd JobId 1638: Volume "Gauss-0258" previously written, > moving to end of data. > 11-Jan 20:11 babar-sd JobId 1638: Ready to append to end of Volume > "Gauss-0258" size=187238097 > 11-Jan 20:40 babar-sd JobId 1638: User defined maximum volume capacity > 4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss). > 11-Jan 20:40 babar-sd JobId 1638: End of medium on Volume "Gauss-0258" > Bytes=4,499,994,102 Blocks=69,755 at 11-Jan-2012 20:40. > 11-Jan 20:40 babar-dir JobId 1638: There are no more Jobs associated with > Volume "Gauss-0259". Marking it purged. > 11-Jan 20:40 babar-dir JobId 1638: All records pruned from Volume > "Gauss-0259"; marking it "Purged" > 11-Jan 20:40 babar-dir JobId 1638: Recycled volume "Gauss-0259" > 11-Jan 20:40 babar-sd JobId 1638: Labeled new Volume "Gauss-0259" on device > "GaussFileStorage" (/home/backup/gauss). > 11-Jan 20:40 babar-sd JobId 1638: Wrote label to prelabeled Volume > "Gauss-0259" on device "GaussFileStorage" (/home/backup/gauss) > 11-Jan 20:40 babar-sd JobId 1638: New volume "Gauss-0259" mounted on device > "GaussFileStorage" (/home/backup/gauss) at 11-Jan-2012 20:40. > 11-Jan 21:07 babar-sd JobId 1638: User defined maximum volume capacity > 4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss). > 11-Jan 21:07 babar-sd JobId 1638: End of medium on Volume "Gauss-0259" > Bytes=4,499,970,069 Blocks=69,754 at 11-Jan-2012 21:07. > 11-Jan 21:07 babar-dir JobId 1638: There are no more Jobs associated with > Volume "Gauss-0260". Marking it purged. > 11-Jan 21:07 babar-dir JobId 1638: All records pruned from Volume > "Gauss-0260"; marking it "Purged" > 11-Jan 21:07 babar-dir JobId 1638: Recycled volume "Gauss-0260" > 11-Jan 21:07 babar-sd JobId 1638: Labeled new Volume "Gauss-0260" on device > "GaussFileStorage" (/home/backup/gauss). > 11-Jan 21:07 babar-sd JobId 1638: Wrote label to prelabeled Volume > "Gauss-0260" on device "GaussFileStorage" (/home/backup/gauss) > 11-Jan 21:07 babar-sd JobId 1638: New volume "Gauss-0260" mounted on device > "GaussFileStorage" (/home/backup/gauss) at 11-Jan-2012 21:07. > 11-Jan 21:33 babar-sd JobId 1638: User defined maximum volume capacity > 4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss). > 11-Jan 21:33 babar-sd JobId 1638: End of medium on Volume "Gauss-0260" > Bytes=4,499,970,013 Blocks=69,754 at 11-Jan-2012 21:33. > 11-Jan 21:33 babar-dir JobId 1638: There are no more Jobs associated with > Volume "Gauss-0261". Marking it purged. > 11-Jan 21:33 babar-dir JobId 1638: All records pruned from Volume > "Gauss-0261"; marking it "Purged" > 11-Jan 21:33 babar-dir JobId 1638: Recycled volume "Gauss-0261" > 11-Jan 21:33 babar-sd JobId 1638: Labeled new Volume "Gauss-0261" on device > "GaussFileStorage" (/home/backup/gauss). > 11-Jan 21:33 babar-sd JobId 1638: Wrote label to prelabeled Volume > "Gauss-0261" on device "GaussFileStorage" (/home/backup/gauss) > 11-Jan 21:33 babar-sd JobId 1638: New volume "Gauss-0261" mounted on device > "GaussFileStorage" (/home/backup/gauss) at 11-Jan-2012 21:33. > 11-Jan 21:58 babar-sd JobId 1638: User defined maximum volume capacity > 4,500,000,000 exceeded on device "GaussFileStorage" (/home/backup/gauss). > 11-Jan 21:58 babar-sd JobId 1638: End of medium on Volume "Gauss-0261" > Bytes=4,499,970,051 Blocks=69,754 at 11-Jan-2012 21:58. > 11-Jan 21:58 babar-dir JobId 1638: There are no more Jobs associated with > Volume "Gauss-0262". Marking it purged. > 11-Jan 21:
Re: [Bacula-users] Bacula database is getting too long
:39 babar-dir JobId 1638: End auto prune.
12-Jan 05:39 babar-dir JobId 1639: shell command: run BeforeJob
"/etc/bacula/scripts/make_catalog_backup.pl MyCatalog"
12-Jan 05:39 babar-dir JobId 1639: BeforeJob: sh: cannot create
/var/lib/bacula/bacula.sql: Permission denied
12-Jan 05:39 babar-dir JobId 1639: Error: Runscript: BeforeJob returned
non-zero status=2. ERR=Child exited with code 2
12-Jan 05:39 babar-dir JobId 1639: Error: Bacula babar-dir 5.0.1 (24Feb10):
12-Jan-2012 05:39:13
Build OS: x86_64-pc-linux-gnu ubuntu 10.04
JobId: 1639
Job:BackupCatalog.2012-01-11_21.55.00_45
Backup Level: Full
Client: "babar-fd" 5.0.1 (24Feb10)
x86_64-pc-linux-gnu,ubuntu,10.04
FileSet:"Catalog" 2011-02-03 01:10:00
Pool: "File" (From Job resource)
Catalog:"MyCatalog" (From Client resource)
Storage:"File" (From Job resource)
Scheduled time: 11-Jan-2012 21:55:00
Start time: 12-Jan-2012 05:39:13
End time: 12-Jan-2012 05:39:13
Elapsed time: 0 secs
Priority: 11
FD Files Written: 0
SD Files Written: 0
FD Bytes Written: 0 (0 B)
SD Bytes Written: 0 (0 B)
Rate: 0.0 KB/s
Software Compression: None
VSS:no
Encryption: no
Accurate: no
Volume name(s):
Volume Session Id: 0
Volume Session Time:0
Last Volume Bytes: 0 (0 B)
Non-fatal FD errors:1
SD Errors: 0
FD termination status:
SD termination status:
Termination:*** Backup Error ***
12-Jan 08:37 babar-dir JobId 0: Fatal error: bsock.c:135 Unable to connect to
Client: applecrisps-fd on applecrisps:9102. ERR=Interrupted system call
> Date: Thu, 12 Jan 2012 10:57:56 +
> From: mar...@lispworks.com
> To: bacula-users@lists.sourceforge.net
> Subject: Re: [Bacula-users] Bacula database is getting too long
>
> >>>>> On Wed, 11 Jan 2012 14:21:52 -0500, Honia A said:
> >
> > I'm backing up a handful number of Unix boxes, they all get backed up very
> > quickly but we can't access them due to the BackupCatalog job being very
> > slow. When I read online, I see people said it's because of the database
> > size getting larger and larger.
> >
> > I cancel the backup catalog job and all the servers become accessible. This
> > is the configuration for catalog:
> >
> > # This is the backup of the catalog
> > FileSet {
> > Name = "Catalog"
> > Include {
> > Options {
> > signature = MD5
> > }
> > File = "/var/lib/bacula/bacula.sql"
> > }
> > }
> >
> > All backups finish around 5 AM but all the servers remain inaccessible until
> > 8:30 or so. The last job running is that backup job so I thought the process
> > getting slower and slower everyday might have something to do with the size
> > of th ebacula.sql file.
>
> The bacula.sql you showed in your first email was written at 05:23, so it
> seems unlikely that Bacula was doing anything at 8:30.
>
> Please post the log output from the BackupCatalog job.
>
> Also, can you describe exactly what you mean by inaccessible?
>
> __Martin
>
> --
> RSA(R) Conference 2012
> Mar 27 - Feb 2
> Save $400 by Jan. 27
> Register now!
> http://p.sf.net/sfu/rsa-sfdev2dev2
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
--
RSA(R) Conference 2012
Mar 27 - Feb 2
Save $400 by Jan. 27
Register now!
http://p.sf.net/sfu/rsa-sfdev2dev2___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula database is getting too long
> On Wed, 11 Jan 2012 14:21:52 -0500, Honia A said:
>
> I'm backing up a handful number of Unix boxes, they all get backed up very
> quickly but we can't access them due to the BackupCatalog job being very
> slow. When I read online, I see people said it's because of the database
> size getting larger and larger.
>
> I cancel the backup catalog job and all the servers become accessible. This
> is the configuration for catalog:
>
> # This is the backup of the catalog
> FileSet {
> Name = "Catalog"
> Include {
> Options {
> signature = MD5
> }
> File = "/var/lib/bacula/bacula.sql"
> }
> }
>
> All backups finish around 5 AM but all the servers remain inaccessible until
> 8:30 or so. The last job running is that backup job so I thought the process
> getting slower and slower everyday might have something to do with the size
> of th ebacula.sql file.
The bacula.sql you showed in your first email was written at 05:23, so it
seems unlikely that Bacula was doing anything at 8:30.
Please post the log output from the BackupCatalog job.
Also, can you describe exactly what you mean by inaccessible?
__Martin
--
RSA(R) Conference 2012
Mar 27 - Feb 2
Save $400 by Jan. 27
Register now!
http://p.sf.net/sfu/rsa-sfdev2dev2
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula database is getting too long
On 01/11/12 14:21, Honia A wrote: > I'm backing up a handful number of Unix boxes, they all get backed up > very quickly but we can't access them due to the BackupCatalog job being > very slow. When I read online, I see people said it's because of the > database size getting larger and larger. 200MB is NOTHING. My company has customers with MySQl Dbs approachint 1TB. Have you looked at your MySQL configuration? I'm going to go out on a limb here and take a wild guess that your MySQL instance was installed long ago using a default configuration file, then never upgraded and never tuned. You don't want to know how many production websites I've seen trying to run off MySQL instances with "small to medium server" configuration files that were written back when a "large server" was one that had more than 32MB of RAM. -- Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355 ala...@caerllewys.net ala...@metrocast.net p...@co.ordinate.org Renaissance Man, Unix ronin, Perl hacker, SQL wrangler, Free Stater It's not the years, it's the mileage. -- Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex infrastructure or vast IT resources to deliver seamless, secure access to virtual desktops. With this all-in-one solution, easily deploy virtual desktops for less than the cost of PCs and save 60% on VDI infrastructure costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula database is getting too long
On Wed, Jan 11, 2012 at 2:45 PM, John Drescher wrote:
> 2012/1/11 Honia A :
>> I'm backing up a handful number of Unix boxes, they all get backed up very
>> quickly but we can't access them due to the BackupCatalog job being very
>> slow. When I read online, I see people said it's because of the database
>> size getting larger and larger.
>>
>> I cancel the backup catalog job and all the servers become accessible. This
>> is the configuration for catalog:
>>
>>
>> # This is the backup of the catalog
>> FileSet {
>> Name = "Catalog"
>> Include {
>> Options {
>> signature = MD5
>> }
>> File = "/var/lib/bacula/bacula.sql"
>> }
>> }
>>
>
> There is really nothing you can do with the bacula config files to change
> that.
>
I forgot a couple of things.
1. You may want to optimize your database and check it with dbcheck.
This will remove orphaned data from the database
2. You may want to reduce your file and job retention periods. This
will clear old metadata out of the database quicker.
John
--
Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex
infrastructure or vast IT resources to deliver seamless, secure access to
virtual desktops. With this all-in-one solution, easily deploy virtual
desktops for less than the cost of PCs and save 60% on VDI infrastructure
costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula database is getting too long
2012/1/11 Honia A :
> I'm backing up a handful number of Unix boxes, they all get backed up very
> quickly but we can't access them due to the BackupCatalog job being very
> slow. When I read online, I see people said it's because of the database
> size getting larger and larger.
>
> I cancel the backup catalog job and all the servers become accessible. This
> is the configuration for catalog:
>
>
> # This is the backup of the catalog
> FileSet {
> Name = "Catalog"
> Include {
> Options {
> signature = MD5
> }
> File = "/var/lib/bacula/bacula.sql"
> }
> }
>
There is really nothing you can do with the bacula config files to change that.
>
> All backups finish around 5 AM but all the servers remain inaccessible until
> 8:30 or so. The last job running is that backup job so I thought the process
> getting slower and slower everyday might have something to do with the size
> of th ebacula.sql file.
>
>
You really need to tune your mysql database / filesystem the db is on.
My database is ~39GB and the catalog job takes less than 10 minutes to
complete. Although I am using postgres instead of mysql both databases
should be tuned in a lot of cases since the defaults are very low for
for a modern machine with 8GB+ of ram.
John
--
Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex
infrastructure or vast IT resources to deliver seamless, secure access to
virtual desktops. With this all-in-one solution, easily deploy virtual
desktops for less than the cost of PCs and save 60% on VDI infrastructure
costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula database is getting too long
I'm backing up a handful number of Unix boxes, they all get backed up very
quickly but we can't access them due to the BackupCatalog job being very slow.
When I read online, I see people said it's because of the database size getting
larger and larger.
I cancel the backup catalog job and all the servers become accessible. This is
the configuration for catalog:
# This is the backup of the catalog
FileSet {
Name = "Catalog"
Include {
Options {
signature = MD5
}
File = "/var/lib/bacula/bacula.sql"
}
}
All backups finish around 5 AM but all the servers remain inaccessible until
8:30 or so. The last job running is that backup job so I thought the process
getting slower and slower everyday might have something to do with the size of
th ebacula.sql file.
> Date: Wed, 11 Jan 2012 14:10:13 -0500
> From: s...@vgersoft.com
> To: bacula-users@lists.sourceforge.net
> Subject: Re: [Bacula-users] Bacula database is getting too long
>
> On Wed, 11 Jan 2012, Honia A wrote:
>
> > But when I checked the size of the database it's still really large:
> >
> > root@servername:/var/lib/bacula# ls -l
> > -rw--- 1 bacula bacula 208285783 2012-01-10 05:23 bacula.sql
>
> Depending on what you are backing up, that is not really all that big.
> Mine is about 20 times that size.
>
> -s
>
> --
> Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex
> infrastructure or vast IT resources to deliver seamless, secure access to
> virtual desktops. With this all-in-one solution, easily deploy virtual
> desktops for less than the cost of PCs and save 60% on VDI infrastructure
> costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
--
Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex
infrastructure or vast IT resources to deliver seamless, secure access to
virtual desktops. With this all-in-one solution, easily deploy virtual
desktops for less than the cost of PCs and save 60% on VDI infrastructure
costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula database is getting too long
On Wed, 11 Jan 2012, Honia A wrote: > But when I checked the size of the database it's still really large: > > root@servername:/var/lib/bacula# ls -l > -rw--- 1 bacula bacula 208285783 2012-01-10 05:23 bacula.sql Depending on what you are backing up, that is not really all that big. Mine is about 20 times that size. -s -- Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex infrastructure or vast IT resources to deliver seamless, secure access to virtual desktops. With this all-in-one solution, easily deploy virtual desktops for less than the cost of PCs and save 60% on VDI infrastructure costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula database is getting too long
[CODE] root@servername:/etc/init.d# du -sh /var/lib/mysql/bacula/ 814M/var/lib/mysql/bacula/ [/CODE] I just reset MySQL root password but can't really see user bacula's db password in bacula-dir.conf as it appears to be encrypted. I just followed the instruction found here: http://www.bacula.org/en/dev-manual/main/main/Catalog_Maintenance.html and ran the following commands: [QUOTE] mysqldump -f --opt bacula > bacula.sql mysql bacula < bacula.sql rm -f bacula.sql [/QUOTE] But when I checked the size of the database it's still really large: [QUOTE] root@servername:/var/lib# cd bacula root@servername:/var/lib/bacula# ls -l -rw--- 1 bacula bacula 208285783 2012-01-10 05:23 bacula.sql [/QUOTE] Maybe I didn't do this correctly? Please help, Thank you in advance > From: bwal...@artsci.utoronto.ca > To: bacula-users@lists.sourceforge.net > Date: Wed, 11 Jan 2012 13:19:07 -0500 > Subject: Re: [Bacula-users] Bacula database is getting too long > > Excerpts from Honia A's message of Wed Jan 11 13:11:45 -0500 2012: > > > I have been handed this server by the previous IT guy and don't have > > the info required to access the MySQL database. > > The mysql password for the account bacula uses should be available to > you in the Catalog stanza of the bacula-dir.conf file (or another file > that it includes). Search for dbpassword. > > If you don't have the root password to your mysql instance, you can > reset that by following something like: > http://www.cyberciti.biz/tips/recover-mysql-root-password.html > > Thanks > -Ben > -- > Ben Walton > Systems Programmer - CHASS > University of Toronto > C:416.407.5610 | W:416.978.4302 > > > -- > Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex > infrastructure or vast IT resources to deliver seamless, secure access to > virtual desktops. With this all-in-one solution, easily deploy virtual > desktops for less than the cost of PCs and save 60% on VDI infrastructure > costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users -- Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex infrastructure or vast IT resources to deliver seamless, secure access to virtual desktops. With this all-in-one solution, easily deploy virtual desktops for less than the cost of PCs and save 60% on VDI infrastructure costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula database is getting too long
Hi Ben, I found bacula mysql password in bacula-dir.conf file but I think it's encrypted. So can't tell what the password is... Thanks for the instruction, I reset MySQL root password. Now, would you pelase let me know how I can retrieve bacula db password and also how to compact the size of the bacula.sql? Thanks, h > From: bwal...@artsci.utoronto.ca > To: bacula-users@lists.sourceforge.net > Date: Wed, 11 Jan 2012 13:19:07 -0500 > Subject: Re: [Bacula-users] Bacula database is getting too long > > Excerpts from Honia A's message of Wed Jan 11 13:11:45 -0500 2012: > > > I have been handed this server by the previous IT guy and don't have > > the info required to access the MySQL database. > > The mysql password for the account bacula uses should be available to > you in the Catalog stanza of the bacula-dir.conf file (or another file > that it includes). Search for dbpassword. > > If you don't have the root password to your mysql instance, you can > reset that by following something like: > http://www.cyberciti.biz/tips/recover-mysql-root-password.html > > Thanks > -Ben > -- > Ben Walton > Systems Programmer - CHASS > University of Toronto > C:416.407.5610 | W:416.978.4302 > > > -- > Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex > infrastructure or vast IT resources to deliver seamless, secure access to > virtual desktops. With this all-in-one solution, easily deploy virtual > desktops for less than the cost of PCs and save 60% on VDI infrastructure > costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users -- Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex infrastructure or vast IT resources to deliver seamless, secure access to virtual desktops. With this all-in-one solution, easily deploy virtual desktops for less than the cost of PCs and save 60% on VDI infrastructure costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula database is getting too long
Excerpts from Honia A's message of Wed Jan 11 13:11:45 -0500 2012: > I have been handed this server by the previous IT guy and don't have > the info required to access the MySQL database. The mysql password for the account bacula uses should be available to you in the Catalog stanza of the bacula-dir.conf file (or another file that it includes). Search for dbpassword. If you don't have the root password to your mysql instance, you can reset that by following something like: http://www.cyberciti.biz/tips/recover-mysql-root-password.html Thanks -Ben -- Ben Walton Systems Programmer - CHASS University of Toronto C:416.407.5610 | W:416.978.4302 -- Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex infrastructure or vast IT resources to deliver seamless, secure access to virtual desktops. With this all-in-one solution, easily deploy virtual desktops for less than the cost of PCs and save 60% on VDI infrastructure costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula database is getting too long
Hi all,
I have been using Bacula to backup several servers. Recently, the backupcatalog
job takes so long to finish. I'm pretty sure it's related to the size of
bacula.sql file.
Code:ls root@servername:/var/lib/bacula# ls -l
-rw--- 1 bacula bacula 208285783 2012-01-10 05:23 bacula.sqlI've been
reading bacula catalog manual here:
http://www.bacula.org/3.0.x-manuals/...og/catalog.pdf
and in the 1.2 Compacting Your MySQL Database section, it's talking about
compacting the database:
I have been handed this server by the previous IT guy and don't have the info
required to access the MySQL database.
This is the part of bacula-dir.conf which has the reference to the bacula.sql:
Code:# This is the backup of the catalog
FileSet {
Name = "Catalog"
Include {
Options {
signature = MD5
}
File = "/var/lib/bacula/bacula.sql"
}
}Can someone please let me know how I can compact the bacula database?
Thanks,
h
--
Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex
infrastructure or vast IT resources to deliver seamless, secure access to
virtual desktops. With this all-in-one solution, easily deploy virtual
desktops for less than the cost of PCs and save 60% on VDI infrastructure
costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
