[Bacula-users] Moved to new NFS storage
Hi guys, Please could someone assist me. I'm very new to Bacula and urgently need to get previously working backups running again. I didn't install Bacula nor do I know much about it and I currently have two issues that I need help with if possible please... To give you some background details first... CentOS release 6.3 (Final) bacula-director-mysql-5.0.0-12.el6.x86_64 bacula-client-5.0.0-12.el6.x86_64 bacula-storage-common-5.0.0-12.el6.x86_64 bacula-console-5.0.0-12.el6.x86_64 bacula-docs-5.0.0-12.el6.x86_64 bacula-common-5.0.0-12.el6.x86_64 bacula-director-common-5.0.0-12.el6.x86_64 bacula-traymonitor-5.0.0-12.el6.x86_64 bacula-console-bat-5.0.0-12.el6.x86_64 bacula-storage-mysql-5.0.0-12.el6.x86_64 mysql-5.1.61-4.el6.x86_64 Webmin is used to admin the Bacula and backups. The existing NAS which was mounted locally via NFS died, so we've lost all backup data, and we've implemented a new empty NAS and mounted it locally again via NFS in the same Storage destination as before /mnt/nas/bacula 1.) How do I go about removing all previous records of backups out of Bacula and get new clean first time backups to run? There's currently a mismatch between what Bacula says it has in terms of backups and what shows on the local NFS filesystem presumably because the MySQL DB's still have the old records. 2.) My backup guest that has Bacula installed on it is dangerously short of space (200MB free) and /var/spool/bacula/ is taking up most of the space 12GB and then then /var/lib/mysql/bacula/Log.MYD (10GB) is also a culprit. I presume this is all old catalog data/records that's stored in the above mysql databases, how can I go about delete/cleaning this up without losing my Backup Clients, or will question one above solve both issues? Apologies for sounding very vague on the above, unfortunately this is all extremely new to me and I've battled finding documentation on the above problems so far, but I urgently need to get backups working. Any help is greatly appreciated. Thank you Regards. Neil Wilson. -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] backing up to S3
Hey guys, I was really excited when I upgraded my bacula server to CentOS 7 and installed the latest version of s3fs. Because I found that I was able to mount an s3 bucket to my local file system with the right user id and permissions to use with bacula. My old server was a centos 5.9 host and that version of s3fs wouldn't allow you to set the uid/gid for the directory you're mounting to. And what I've found is that backing up to S3 with these latest versions works GREAT!! I am able to create tapes on my S3 mounted backup directory. And the backups complete without any complaint from the bacula system. However the problem comes in restoring files. Because what I've found is that the restores will fail even if you are restoring just one tiny file. I tried restoring a resolv.conf file. What happens is that the s3fs directory disconnects from s3 and bacula gives a 'waiting for mount request' that seems to go on forever. If I do a listing of the directory at this point, on the command line outside the bacula environment I get a 'transport disconnected' error. I'm not sure why backing up to S3 is fine but restoring is not. What I'd like to know is if there are any other alternatives to S3FS out there that would allow you to mount an S3 bucket on your local file systems and use it for backups and restores. Also I'm wondering if there's any optimizations or changes that anyone may know about that I can do to S3FS to allow this to work? Thanks, Tim -- GPG me!! gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backing up to S3
Also I'm wondering if there's any optimizations or changes that anyone may know about that I can do to S3FS to allow this to work? Just in time: you can always try to download your volumes using AWS web interface. Thanks, Tim Cheers, === Heitor Medrado de Faria - LPIC-III | ITIL-F | Bacula Systems Certified Administrator II I'm a Bacula/SysAdmin looking for a job in USA or Europe. Please recommend me. Need Bacula training? https://www.udemy.com/bacula-backup-software/?couponCode=bacula-list +55 61 8268-4220 Site: www.bacula.com.br | FB: heitor.faria === -- GPG me!! gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users-- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backing up to S3
Hey guys, Hey Tim, I was really excited when I upgraded my bacula server to CentOS 7 and installed the latest version of s3fs. Because I found that I was able to mount an s3 bucket to my local file system with the right user id and permissions to use with bacula. My old server was a centos 5.9 host and that version of s3fs wouldn't allow you to set the uid/gid for the directory you're mounting to. And what I've found is that backing up to S3 with these latest versions works GREAT!! I am able to create tapes on my S3 mounted backup directory. And the backups complete without any complaint from the bacula system. However the problem comes in restoring files. Because what I've found is that the restores will fail even if you are restoring just one tiny file. I tried restoring a resolv.conf file. What happens is that the s3fs directory disconnects from s3 and bacula gives a 'waiting for mount request' that seems to go on forever. s3fs takes a time to sync, uses cache and as any mapping protocol has performance limitation. I think you can debug it with -d and -f flag (not sure though). If I do a listing of the directory at this point, on the command line outside the bacula environment I get a 'transport disconnected' error. I'm not sure why backing up to S3 is fine but restoring is not. What I'd like to know is if there are any other alternatives to S3FS out there that would allow you to mount an S3 bucket on your local file systems and use it for backups and restores. Yes. I would hire a EC2 Linux machine to deploy a remote Bacula storage daemon. You can still use your S3 bucket as Archive Device. Also I'm wondering if there's any optimizations or changes that anyone may know about that I can do to S3FS to allow this to work? Thanks, Tim Cheers, === Heitor Medrado de Faria - LPIC-III | ITIL-F | Bacula Systems Certified Administrator II I'm a Bacula/SysAdmin looking for a job in USA or Europe. Please recommend me. Need Bacula training? https://www.udemy.com/bacula-backup-software/?couponCode=bacula-list +55 61 8268-4220 Site: www.bacula.com.br | FB: heitor.faria === -- GPG me!! gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users-- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backing up to S3
On 6/10/2015 3:50 PM, Tim Dunphy wrote: Hey guys, I was really excited when I upgraded my bacula server to CentOS 7 and installed the latest version of s3fs. Because I found that I was able to mount an s3 bucket to my local file system with the right user id and permissions to use with bacula. My old server was a centos 5.9 host and that version of s3fs wouldn't allow you to set the uid/gid for the directory you're mounting to. And what I've found is that backing up to S3 with these latest versions works GREAT!! I am able to create tapes on my S3 mounted backup directory. And the backups complete without any complaint from the bacula system. However the problem comes in restoring files. Because what I've found is that the restores will fail even if you are restoring just one tiny file. I tried restoring a resolv.conf file. What happens is that the s3fs directory disconnects from s3 and bacula gives a 'waiting for mount request' that seems to go on forever. If I do a listing of the directory at this point, on the command line outside the bacula environment I get a 'transport disconnected' error. I'm not sure why backing up to S3 is fine but restoring is not. What I'd like to know is if there are any other alternatives to S3FS out there that would allow you to mount an S3 bucket on your local file systems and use it for backups and restores. Also I'm wondering if there's any optimizations or changes that anyone may know about that I can do to S3FS to allow this to work? Are you using directories created by some s3 tool? I believe s3fs still does not have a directory structure and directories are handled differently by implementations of different s3 tools. The lack of a true directory structure likely cause this, and explain why ls also fails. Try it with only writing volume files to the root of the s3 bucket and only mounting the s3 root on the local filesystem. -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Moved to new NFS storage
Hello Neil, If you do not have any jobs/volumes/files from the old Catalog to keep in this new one installation (I´m supposing you lost all your backup data), you can start with an empty Catalog database an your old conf files. All the clients, jobs/filsets, schedules, etc., information are on your configuration files and will be used in your new installation. Best regards, Ana On Wed, Jun 10, 2015 at 4:57 AM, Neil nwilson...@gmail.com wrote: Hi guys, Please could someone assist me. I'm very new to Bacula and urgently need to get previously working backups running again. I didn't install Bacula nor do I know much about it and I currently have two issues that I need help with if possible please... To give you some background details first... CentOS release 6.3 (Final) bacula-director-mysql-5.0.0-12.el6.x86_64 bacula-client-5.0.0-12.el6.x86_64 bacula-storage-common-5.0.0-12.el6.x86_64 bacula-console-5.0.0-12.el6.x86_64 bacula-docs-5.0.0-12.el6.x86_64 bacula-common-5.0.0-12.el6.x86_64 bacula-director-common-5.0.0-12.el6.x86_64 bacula-traymonitor-5.0.0-12.el6.x86_64 bacula-console-bat-5.0.0-12.el6.x86_64 bacula-storage-mysql-5.0.0-12.el6.x86_64 mysql-5.1.61-4.el6.x86_64 Webmin is used to admin the Bacula and backups. The existing NAS which was mounted locally via NFS died, so we've lost all backup data, and we've implemented a new empty NAS and mounted it locally again via NFS in the same Storage destination as before /mnt/nas/bacula 1.) How do I go about removing all previous records of backups out of Bacula and get new clean first time backups to run? There's currently a mismatch between what Bacula says it has in terms of backups and what shows on the local NFS filesystem presumably because the MySQL DB's still have the old records. 2.) My backup guest that has Bacula installed on it is dangerously short of space (200MB free) and /var/spool/bacula/ is taking up most of the space 12GB and then then /var/lib/mysql/bacula/Log.MYD (10GB) is also a culprit. I presume this is all old catalog data/records that's stored in the above mysql databases, how can I go about delete/cleaning this up without losing my Backup Clients, or will question one above solve both issues? Apologies for sounding very vague on the above, unfortunately this is all extremely new to me and I've battled finding documentation on the above problems so far, but I urgently need to get backups working. Any help is greatly appreciated. Thank you Regards. Neil Wilson. -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Could not connect to server Director daemon ....
Hello Olaf,
I was not refering to the names for user and password. Instead, the
directives user and password for Catalog definition. I noticed in your
post that you defined Catalog using the keywords dbuser and dbpassword,
instead of using user and password. Like bellow:
Catalog {
Name = MyCatalog
dbname = bacula
dbuser = bacula
dbpassword =
}
Best regards,
Ana
On Wed, Jun 10, 2015 at 2:54 PM, olx69 ope-li...@gmx.de wrote:
Hello Ana,
Hello Olaf,
There are some directive keywords mismatch (user and password):
Catalog {
Name = MyCatalog
dbname = bacula
user = bacula
password =
}
it's SQLite3 DB, does the user/password matter? Even if I set the user =
it doesn't change it.
Thank you,
Olaf
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Could not connect to server Director daemon ....
Hello Ana,
Hello Olaf,
There are some directive keywords mismatch (user and password):
Catalog {
Name = MyCatalog
dbname = bacula
user = bacula
password =
}
it's SQLite3 DB, does the user/password matter? Even if I set the user =
it doesn't change it.
Thank you,
Olaf
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backing up to S3
Hey there Heitor! Nice to hear from ya bud!! I actually did get this to work. The key that lead to success was to add a 'use_cache' option. I basically assigned a 10GB EBS volume just to use as a cache. It was just an experiment, and I planned on getting did of the 10GB EBS and get one much smaller to use later. But what I found is that the 10GB volume filled up to 8.5GB during backups and restores! Everything worked, but it appears that a large cache is the only answer. Almost defeats the purpose of using S3, but not quite I hope. I think what was happening previously was that S3FS was hitting some sort of default cache limit and dying out. It'll be interesting to see how this pans out. Cuz I was planning on adding a number of new hosts to backups that I previously couldn't afford to due to the expense of storing my backup tapes on EBS. S3 is way cheaper. I can let you guys know how it goes if you're intetested. Thanks, Tim On Wed, Jun 10, 2015 at 4:40 PM, Heitor Faria hei...@bacula.com.br wrote: Also I'm wondering if there's any optimizations or changes that anyone may know about that I can do to S3FS to allow this to work? Just in time: you can always try to download your volumes using AWS web interface. Thanks, Tim Cheers, === Heitor Medrado de Faria - LPIC-III | ITIL-F | Bacula Systems Certified Administrator II I'm a Bacula/SysAdmin looking for a job in USA or Europe. Please recommend me. Need Bacula training? https://www.udemy.com/bacula-backup-software/?couponCode=bacula-list +55 61 %2B55%2061%202021-82608268-4220 %2B55%2061%208268-4220 Site: www.bacula.com.br | FB: heitor.faria http://www.facebook.com/heitor.faria === -- GPG me!! gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- GPG me!! gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backing up to S3
This is very interesting, I'm very interested in learning more. So, let me see if I understand this properly: 1. You get an S3 account 2. You install s3fs (from github) 3. There is a config option in the s3fs to use a cache, and somehow you specify the EBS volume as the cache 4. Bacula is then configured to back up to the s3fs I'm sure there is more details, and am eager to learn about this. I'm going to have a few weeks to learn about it while I recover from surgery next week (donating a kidney), so will be watching for your reply. Thanks Jonathan Bayer On 6/10/2015 6:32 PM, Tim Dunphy wrote: Hey there Heitor! Nice to hear from ya bud!! I actually did get this to work. The key that lead to success was to add a 'use_cache' option. I basically assigned a 10GB EBS volume just to use as a cache. It was just an experiment, and I planned on getting did of the 10GB EBS and get one much smaller to use later. But what I found is that the 10GB volume filled up to 8.5GB during backups and restores! Everything worked, but it appears that a large cache is the only answer. Almost defeats the purpose of using S3, but not quite I hope. I think what was happening previously was that S3FS was hitting some sort of default cache limit and dying out. It'll be interesting to see how this pans out. Cuz I was planning on adding a number of new hosts to backups that I previously couldn't afford to due to the expense of storing my backup tapes on EBS. S3 is way cheaper. I can let you guys know how it goes if you're intetested. Thanks, Tim On Wed, Jun 10, 2015 at 4:40 PM, Heitor Faria hei...@bacula.com.br mailto:hei...@bacula.com.br wrote: Also I'm wondering if there's any optimizations or changes that anyone may know about that I can do to S3FS to allow this to work? Just in time: you can always try to download your volumes using AWS web interface. Thanks, Tim Cheers, === Heitor Medrado de Faria - LPIC-III | ITIL-F | Bacula Systems Certified Administrator II I'm a Bacula/SysAdmin looking for a job in USA or Europe. Please recommend me. Need Bacula training? https://www.udemy.com/bacula-backup-software/?couponCode=bacula-list +55 61 tel:%2B55%2061%202021-82608268-4220 tel:%2B55%2061%208268-4220 Site: www.bacula.com.br http://www.bacula.com.br/ | FB: heitor.faria http://www.facebook.com/heitor.faria === -- GPG me!! gpg --keyserver pool.sks-keyservers.net http://pool.sks-keyservers.net --recv-keys F186197B -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net mailto:Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- GPG me!! gpg --keyserver pool.sks-keyservers.net http://pool.sks-keyservers.net --recv-keys F186197B -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Windows client VSS
Hello. Could you send your job log with error. It should describe what is
going on.
Best regards
9 cze 2015 12:09 PM More, Ankush ankush.m...@capgemini.com napisał(a):
Hi Pavel,
We didn't find any error in VSS list writers all the VSS writers are
stable and no error in event log.
All the windows 2003 servers are having issue with bacula backup VSS
enabling.
NT backup is running successfully with VSS enabled on all the windows 2003.
Thank you,
Ankush
*From:* Pavel Bychikhin [mailto:pbychik...@yahoo.com]
*Sent:* 09 June 2015 13:44
*To:* More, Ankush; bacula-users@lists.sourceforge.net
*Subject:* Re: [Bacula-users] Windows client VSS
Hi Ankush,
In win 2003 the VSS service might be disabled or misconfigured. Please
take a look:
To check if everything is working:
*vssadmin list writers*
This has to provide a listing of writers. If there is no listing and
errors in the Event log then:
(http://support.microsoft.com/kb/940184):
Delete
HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\EventSystem\{26c409cc-ae86-11d1-b616-00805fc79216}\Subscriptions
and Restart:
COM+ Event System
COM+ System Application
Microsoft Software Shadow Copy Provider
Volume Shadow Copy
or Restart Windows
If previous step doesn't work then:
(http://support.microsoft.com/kb/940032)
Apply MicrosoftFixit50633.msi or manually do:
cd /d %windir%\system32
Net stop vss
Net stop swprv
regsvr32 ole32.dll
regsvr32 oleaut32.dll
regsvr32 vss_ps.dll
vssvc /register
regsvr32 /i swprv.dll
regsvr32 /i eventcls.dll
regsvr32 es.dll
regsvr32 stdprov.dll
regsvr32 vssui.dll
regsvr32 msxml.dll
regsvr32 msxml3.dll
regsvr32 msxml4.dll
Note The last command may not run successfully.
If previous step doesn't work then:
(http://support.microsoft.com/kb/940349)
Apply WindowsServer2003.WindowsXP-KB940349-v3-x64-ENU.exe for x64 system
And, possibly, do previous steps after that.
Best regards,
Pavel
Original Message
*Subject: *Re: [Bacula-users] Windows client VSS
*From: *More, Ankush ankush.m...@capgemini.com
ankush.m...@capgemini.com
*To: *bacula-users@lists.sourceforge.net
bacula-users@lists.sourceforge.net bacula-users@lists.sourceforge.net
*Date: *08.06.2015 16:47
Hi Team,
Bacula backup successful on windows 2008 with VSS enabled.
windows 2003 client backup failed with VSS enabled.
Is VSS support on windows 2003?
Thank you,
Ankush
*From:* More, Ankush
*Sent:* 08 June 2015 17:07
*To:* 'bacula-users@lists.sourceforge.net'
*Subject:* Windows client VSS
Hi Team,
Hi Team,
We are running Bacula server(7.0.5) on RHEL 6.x.
If I disable VSS then Windows client get backup and if I enable VSS
(default is enable) backup failed.
I need backup with VSS enable.
Is Bacula support all windows version with VSS enable?
Thank you,
Ankush
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
