Re: [Bacula-users] What to exclude?

2016-01-27 Thread Michael Munger 
Your answer is appreciated. And, I was trying to keep my question limited to 
what I wanted to know, but you bring up a good point: bacula is only part of 
the strategy. These systems are cloned with Clonezilla, the image of which sits 
on the shelf as a base. We use RAID 5/6/10 depending on how critical the 
machine is to slow the impact of a disk failure.

So, the restoration process would actually go: restore from clonezilla image, 
then restore from bacula.

But, I would prefer that bacula was as complete as possible in case there was 
an issue with the original image.

None of these machines are SSDs because SSDs fail instantly and 
catastrophically. And while the speed is sexy, the way they fail is ... not. 
But, that's neither here nor there. Just a personal choice for me.

Michael Munger, dCAP, MCPS, MCNPS, MBSS
High Powered Help, Inc.
Microsoft Certified Professional
Microsoft Certified Small Business Specialist
Digium Certified Asterisk Professional
mich...@highpoweredhelp.com


-Original Message-
From: Dimitri Maziuk [mailto:dmaz...@bmrb.wisc.edu] 
Sent: Wednesday, January 27, 2016 5:02 PM
To: bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] What to exclude?

On 01/27/2016 03:42 PM, Michael Munger wrote:
> TLDR; = what can I safely exclude from a bacula backup of a Linux
server and still be able to fully recover (bare metal) from a disaster?

Not an answer to your question, but we are
- using raid-1s for system disks,
- using SSDs for system disks,
- dd'ing the system disk before the machine goes into service and keeping the 
copy on the shelf,
- backing up /etc and crontabs and not caring about the rest of /.

I'll pick any of the above over a bare metal recovery from a backup system (SSD 
being the best option ATM).

FWIW
--
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu


--
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311=/4140
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] What to exclude?

2016-01-27 Thread compdoc 
> what can I safely exclude from a bacula backup of a Linux server and still
be able to fully recover (bare metal) from a disaster?

I would think with bare metal recovery you couldn't afford to exclude
anything. As for myself, I tend to replace the failed part and install from
scratch, then restore the applications and settings. Installing from scratch
lets me know the condition of the hardware. It should install smoothly and
with no crashes/freezes/unexplained occurrences. 

The purpose of each server can determine what directories gets backed up.
For my Ubuntu Server running Bacula, using caja/nautilus I actually looked
through the directories  and found all I want are these:

File = /boot/grub
File = /etc
File = /home
File = /root
File = /sbin
File = /opt
File = /var/crash
File = /var/log

Btw, if you have bacula spooling to /var while you're trying to back it up,
expect unexplained occurrences.  


--
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311=/4140
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] What to exclude?

2016-01-27 Thread compdoc 
> what can I safely exclude from a bacula backup of a Linux server and 
> still be able to fully recover (bare metal) from a disaster?

Oh, and don't forget mysql. 





--
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311=/4140
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] What to exclude?

2016-01-27 Thread Heitor Faria 
Hello Michael: bacula director client stock fileset exlude is a good starting 
point if you want to restore a full linux box (/tmp, /proc, /.journal etc.).
Already did full restores this way.

Regards,
===
Heitor Medrado de Faria - LPIC-III | ITIL-F |  Bacula Systems Certified 
Administrator II
Do you need Bacula training? http://bacula.us/video-classes/
+55 61 8268-4220
Site: http://bacula.us FB: heitor.faria
===

Enviado por TypeApp



Em 27 de jan de 2016 20:17, pelo 20:17, Michael Munger 
 escrito:
>Your answer is appreciated. And, I was trying to keep my question
>limited to what I wanted to know, but you bring up a good point: bacula
>is only part of the strategy. These systems are cloned with Clonezilla,
>the image of which sits on the shelf as a base. We use RAID 5/6/10
>depending on how critical the machine is to slow the impact of a disk
>failure.
>
>So, the restoration process would actually go: restore from clonezilla
>image, then restore from bacula.
>
>But, I would prefer that bacula was as complete as possible in case
>there was an issue with the original image.
>
>None of these machines are SSDs because SSDs fail instantly and
>catastrophically. And while the speed is sexy, the way they fail is ...
>not. But, that's neither here nor there. Just a personal choice for me.
>
>Michael Munger, dCAP, MCPS, MCNPS, MBSS
>High Powered Help, Inc.
>Microsoft Certified Professional
>Microsoft Certified Small Business Specialist
>Digium Certified Asterisk Professional
>mich...@highpoweredhelp.com
>
>
>-Original Message-
>From: Dimitri Maziuk [mailto:dmaz...@bmrb.wisc.edu]
>Sent: Wednesday, January 27, 2016 5:02 PM
>To: bacula-users@lists.sourceforge.net
>Subject: Re: [Bacula-users] What to exclude?
>
>On 01/27/2016 03:42 PM, Michael Munger wrote:
>> TLDR; = what can I safely exclude from a bacula backup of a Linux
>server and still be able to fully recover (bare metal) from a disaster?
>
>Not an answer to your question, but we are
>- using raid-1s for system disks,
>- using SSDs for system disks,
>- dd'ing the system disk before the machine goes into service and
>keeping the copy on the shelf,
>- backing up /etc and crontabs and not caring about the rest of /.
>
>I'll pick any of the above over a bare metal recovery from a backup
>system (SSD being the best option ATM).
>
>FWIW
>--
>Dimitri Maziuk
>Programmer/sysadmin
>BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu
>
>
>--
>Site24x7 APM Insight: Get Deep Visibility into Application Performance
>APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
>Monitor end-to-end web transactions and take corrective actions now
>Troubleshoot faster and improve end-user experience. Signup Now!
>http://pubads.g.doubleclick.net/gampad/clk?id=267308311=/4140
>___
>Bacula-users mailing list
>Bacula-users@lists.sourceforge.net
>https://lists.sourceforge.net/lists/listinfo/bacula-users
--
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311=/4140___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] What to exclude?

2016-01-27 Thread Michael Munger 
Good reminder. I am using a ClientBeforerunJob script to dump all the 
databases to .sql files before backing up.


On 01/27/2016 06:57 PM, compdoc wrote:
>> what can I safely exclude from a bacula backup of a Linux server and
>> still be able to fully recover (bare metal) from a disaster?
> Oh, and don't forget mysql.
>
>
>
>
>
> --
> Site24x7 APM Insight: Get Deep Visibility into Application Performance
> APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
> Monitor end-to-end web transactions and take corrective actions now
> Troubleshoot faster and improve end-user experience. Signup Now!
> http://pubads.g.doubleclick.net/gampad/clk?id=267308311=/4140
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users


--
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311=/4140
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Restoring: error 2800 at end of tape

2016-01-27 Thread Andrea Venturoli 
On 01/22/16 12:56, Martin Simmons wrote:

> I don't see how it could use an IPv6 address if --disable-ipv6 is specified.
> Did you recompile and reinstall the bacula-client port or just bacula-server?
> The IPv6 support is in bacula-client, which installs libbac.so.

Doh! That's the problem!
I didn't think I needed to rebuild the client in order to deactivate 
IPv6 on the server.

Tried this and it solved.



  bye & Thanks
av.

--
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311=/4140
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] bacula.Job does not exist

2016-01-27 Thread Michael Munger 
Not sure where to report this, so, please someone reply so I can submit the 
corrected files.

I downloaded the latest version of Bacula, and compiled from source. After 
running the various scripts to create the MySQL databases, I got a few errors, 
but ignored them at first.

Then, when trying to run the initial backup that comes pre-configured in the 
configs, I got this error:

27-Jan 11:39 d8-dir JobId 0: Fatal error: sql_create.c:86 Create DB Job record 
INSERT INTO Job 
(Job,Name,Type,Level,JobStatus,SchedTime,JobTDate,ClientId,Comment) VALUES 
('BackupClient1.2016-01-27_11.39.03_06','BackupClient1','B','I','C','2016-01-27 
11:39:01',1453912741,1,'') failed. ERR=Table 'bacula.Job' doesn't exist

Turns out, the errors (listed below) were causing the corresponding tables to 
not be created.

ERROR 1067 (42000) at line 91: Invalid default value for 'CleaningDate'
ERROR 1067 (42000) at line 111: Invalid default value for 'SchedTime'
ERROR 1067 (42000) at line 145: Invalid default value for 'SchedTime'
ERROR 1067 (42000) at line 187: Invalid default value for 'Date'
ERROR 1067 (42000) at line 201: Invalid default value for 'CreateTime'
ERROR 1067 (42000) at line 225: Invalid default value for 'FirstWritten'
ERROR 1067 (42000) at line 321: Invalid default value for 'Time'

The problem is the default value for certain DATETIME fields.

To fix the issue, I did a find and replace over the make_mysql_tables file:
s/DATETIME DEFAULT 0/DATETIME/g

Then, I dropped the database, and re-ran these scripts:
./create_mysql_database 
./grant_mysql_privileges 
./make_mysql_tables 

The database was re-created, and all is well.

As a side note, the instructions for creating the MySQL database is ... well 
... lacking. If this was hosted on Github, I would just fork it, add it for you 
guys, and then submit a merge request. But I don't know how to do that on 
Sourceforge. 

At anyrate, Please advise where I send this so that it can be fixed. (I'm happy 
to submit my files as a patch - I already did the work!).

Michael Munger, dCAP, MCPS, MCNPS, MBSS
High Powered Help, Inc.
Microsoft Certified Professional
Microsoft Certified Small Business Specialist
Digium Certified Asterisk Professional
mich...@highpoweredhelp.com
--
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311=/4140
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Remote backup through NAT?

2016-01-27 Thread Michael Munger 
Just as a follow up, moving to 7.4.x solved the problem. The secret is FD 
Storage Address.

For future searchers / Googlers:

The FD Storage  Address is defined for a given client, and that client will 
then use it to send all the storage requests to.

Thus:
   If FD Storage Address is defined for a client:
a. It should show the WAN address for the firewall / border device to 
your network
b. You must have port forwarding set appropriately


Michael Munger, dCAP, MCPS, MCNPS, MBSS
High Powered Help, Inc.
Microsoft Certified Professional
Microsoft Certified Small Business Specialist
Digium Certified Asterisk Professional
mich...@highpoweredhelp.com

From: Wanderlei Huttel [mailto:wanderleihut...@gmail.com] 
Sent: Tuesday, January 26, 2016 4:32 PM
To: Michael Munger
Cc: bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] Remote backup through NAT?

Hello Michael

I'm not sure if is it possible in older versions like yours.
Take a look below

--
New Features in 7.2.0

FD Storage Address

When the Director is behind a NAT, in a WAN area, to connect to the 
StorageDaemon, the Director uses an ``external'' ip address, and the FileDaemon 
should use an ``internal'' IP address to contact the StorageDaemon.

The normal way to handle this situation is to use a canonical name such as 
``storage-server'' that will be resolved on the Director side as the WAN 
address and on the Client side as the LAN address. This is now possible to 
configure this parameter using the new directive FDStorageAddress in the 
Storage or Client resource.

Storage {
     Name = storage1
     Address = 65.1.1.1
     FD Storage Address = 10.0.0.1
     SD Port = 9103
     ...
}
 Client {
      Name = client1
      Address = 65.1.1.2
      FD Storage Address = 10.0.0.1
      FD Port = 9102
      ...
 }
Note that using the Client FDStorageAddress directive will not allow to use 
multiple Storage Daemon, all Backup or Restore requests will be sent to the 
specified FDStorageAddress.
--

Bacula is already in 7.4.0 version.
It's highly recommended upgrading.

Best Regards
Wanderlei


2016-01-26 19:00 GMT-02:00 Michael Munger :
Hello everyone, this is my first time mailing this list, so guidance on 
etiquette is welcomed.

TLDR; = I have a server outside the firewall (john-fd is on 173.165.161.165) 
trying to backup to a storage daemon inside my LAN (d8-sd is on 
192.168.250.202). I have port forwarded (in my Monowall) tcp/9103, and I can 
successfully telnet from the remote server to the local sd. But, the console is 
forever saying: "...waiting on storage file" when I run the job.

What I've done:
* Scoured the docs and tutorials
* Exhausted Google (and DuckDuckGo)
* Confirmed The software versions are all 5.6.2 (learned that one the hard way 
dealing with a Windows client!)
* Shutdown bacula-sd and confirmed telnet no longer connects, and when I 
restart bacula-sd it DOES connect.
* shutdown the firewall (everywhere - for testing) no joy
* opened 9101 and 9102 on our firewall and forwarded them to 192.168.250.202 
just in case any bacula service wants to communicate.
* used netstat -tanop to watch the telnet connections come in from the remote 
server to confirm that NAT is working properly.

What I think is going on:
D8-FD (the file director on the server where bacula-sd, the pools, and volumes 
reside) can connect to the remote server, and can issue commands to run the 
backup job. But, when the remote fd tries to connect back (through the firewall 
from "outside -> in") to the storage daemon, it's failing - despite the fact 
that the NAT is setup properly, and I can telnet through it.

That doesn't make sense to me because it should either work or be broken. So, 
I'm thinking that if I can telnet to it, then the remote fd should also be able 
to work with it. Nmap also shows the port as open and reachable.

How else can I troubleshoot this "waiting on storage" problem?

PS. I am about 18 hours in to working with Bacula. Fantastic product, but don't 
be afraid to assume I have missed something rudimentary. I have two machines on 
the LAN working and backing up, so I have had some success, but it's still 
possible I've missed something simple...

Michael Munger, dCAP, MCPS, MCNPS, MBSS
High Powered Help, Inc.
Microsoft Certified Professional
Microsoft Certified Small Business Specialist
Digium Certified Asterisk Professional
mich...@highpoweredhelp.com


--
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!

Re: [Bacula-users] error compilation bacula 7.4 with postgresql version 9.3.9

2016-01-27 Thread Michael Munger 
Configure cannot find libpq-fe.h.

On your system, execute the following (as root):

1. updatedb
2. locate libpq-fe.h

This should show you where the devel files are installed on your system. Once 
you have that, you can make a symlink that points a “standard” location to 
where your files actually are. 

Suppose locate show you that libpq-fe.h is in /usr/something/random/pgsql, then 
you would execute:

ln -s /usr/something/random/pgsql /usr/include/pgsql

Thereby allowing configure to find libpq-fe.h in /usr/include/pgsql as 
/usr/include/pgsql/libpq-fe.h

In the alternative, you can use:

--with-postgresql=/usr/something/random/pgsql

Michael Munger, dCAP, MCPS, MCNPS, MBSS
High Powered Help, Inc.
Microsoft Certified Professional
Microsoft Certified Small Business Specialist
Digium Certified Asterisk Professional
mich...@highpoweredhelp.com

From: Hector Javier Agudelo Corredor [mailto:hej...@gmail.com] 
Sent: Wednesday, January 27, 2016 3:41 PM
To: bacula-users@lists.sourceforge.net
Subject: [Bacula-users] error compilation bacula 7.4 with postgresql version 
9.3.9



Install postgres but when compiling Bacula 9.3.10 7.4 to install it with the 
command ./configure --with-postgresql. ihave this error 

checking for PostgreSQL support... no
configure: error: Unable to find libpq-fe.h in standard locations
[root@bacula74web bacula-7.4.0]#

This error is resolved by installing the postgresql-devel but 8.4

 
yum install postgresql-devel


By making the default CentOS version 8.4 but I install PostgreSQL 9.4 is 
already installed and postgresql-devel version 9.3. But if I do not install 
this default is the 8.4 does not compile me to install.

see bacula1.jpg

What should I do to let me run with libraries of version 9.3 of PostgreSQL?

i saw the file configuration  y the library libpq-fe.h its not there.

thanks for your help

-- 
HECTOR 
--
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311=/4140
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] error compilation bacula 7.4 with postgresql version 9.3.9

2016-01-27 Thread Michael Munger 
Then you need to download the source for postgres 9.4 and compile from source, 
making sure that it installs the headers in the appropriate place.


Michael Munger, dCAP, MCPS, MCNPS, MBSS
High Powered Help, Inc.
Microsoft Certified Professional
Microsoft Certified Small Business Specialist
Digium Certified Asterisk Professional
mich...@highpoweredhelp.com

From: Hector Javier Agudelo Corredor [mailto:hej...@gmail.com]
Sent: Wednesday, January 27, 2016 4:18 PM
To: Michael Munger
Cc: bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] error compilation bacula 7.4 with postgresql 
version 9.3.9

Hi michael

I look for this file, but not actually appears if I install the 
postgresql-devel 8.4.


[root@bacula74web bacula-7.4.0]#  find / -iname libpq-fe.h
[root@bacula74web bacula-7.4.0]#

but when i install postgresql-devel 8.4 de psql is 8.4 with database 9.4

i need psql 9.4





2016-01-27 15:53 GMT-05:00 Michael Munger 
>:
Configure cannot find libpq-fe.h.

On your system, execute the following (as root):

1. updatedb
2. locate libpq-fe.h

This should show you where the devel files are installed on your system. Once 
you have that, you can make a symlink that points a “standard” location to 
where your files actually are.

Suppose locate show you that libpq-fe.h is in /usr/something/random/pgsql, then 
you would execute:

ln -s /usr/something/random/pgsql /usr/include/pgsql

Thereby allowing configure to find libpq-fe.h in /usr/include/pgsql as 
/usr/include/pgsql/libpq-fe.h

In the alternative, you can use:

--with-postgresql=/usr/something/random/pgsql

Michael Munger, dCAP, MCPS, MCNPS, MBSS
High Powered Help, Inc.
Microsoft Certified Professional
Microsoft Certified Small Business Specialist
Digium Certified Asterisk Professional
mich...@highpoweredhelp.com

From: Hector Javier Agudelo Corredor 
[mailto:hej...@gmail.com]
Sent: Wednesday, January 27, 2016 3:41 PM
To: 
bacula-users@lists.sourceforge.net
Subject: [Bacula-users] error compilation bacula 7.4 with postgresql version 
9.3.9



Install postgres but when compiling Bacula 9.3.10 7.4 to install it with the 
command ./configure --with-postgresql. ihave this error

checking for PostgreSQL support... no
configure: error: Unable to find libpq-fe.h in standard locations
[root@bacula74web bacula-7.4.0]#

This error is resolved by installing the postgresql-devel but 8.4


yum install postgresql-devel


By making the default CentOS version 8.4 but I install PostgreSQL 9.4 is 
already installed and postgresql-devel version 9.3. But if I do not install 
this default is the 8.4 does not compile me to install.

see bacula1.jpg

What should I do to let me run with libraries of version 9.3 of PostgreSQL?

i saw the file configuration  y the library libpq-fe.h its not there.

thanks for your help

--
HECTOR



--
HECTOR
--
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311=/4140___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] What to exclude?

2016-01-27 Thread Michael Munger 
TLDR; = what can I safely exclude from a bacula backup of a Linux server and 
still be able to fully recover (bare metal) from a disaster?

Details:
I am looking for a best practice here, and I am working from two sources:

1. 
http://www.bacula.org/5.0.x-manuals/en/main/main/Disaster_Recovery_Using_Bac.html#SECTION00396
2. https://wiki.debian.org/FilesystemHierarchyStandard

In order to recover a client machine that is a linux server (not the bacula-dir 
or bacula-sd) in accordance with Bacula docs, I have setup the FileSet for such 
a server as noted below. 

FileSet {
Name = "Example Linux Server"
Include {
Options {
signature = SHA1
compression = GZIP
}

File = /
}

Exclude {
/opt/bacula/working
/tmp
/proc
/sys
/.journal
/.fsck
/media
}
}

My reasons for excluding these are as follows:

/opt/bacula/working 
Not needed - just pid files and temp stuff.
/tmp
no point in backing up temp files
/proc
can't backup processes
/sys
This is the filesystem point for exporting kernel objects. Kernel does 
this on the fly. No point in backing it up.

.journal
not needed. journal log file.

.fsck
not needed. fsck log file

/media
no reason to backup external devices (unless you have a reason, which I 
don't.)


It should be noted, that I am using ClientRunBeforeJob to dump MySQL databases 
to /var/local/mysqlbackups, so I have indepdenent copies of them there, but 
since I am NOT excluding /var/lib/mysql, the raw databases should also be 
recoverable from bare metal.

Does anyone have a different (better) best practice?

Michael Munger, dCAP, MCPS, MCNPS, MBSS
High Powered Help, Inc.
Microsoft Certified Professional
Microsoft Certified Small Business Specialist
Digium Certified Asterisk Professional
mich...@highpoweredhelp.com



--
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311=/4140
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Remote backup through NAT?

2016-01-27 Thread Wesley Render 

I had a lot of problems getting my setup to work over NAT too.  If you  
want email me directly and I can provide my full configs/help out.  I  
think what ended up fixing it for me was updating all of the Bacula  
components to 7.2.0.  I had a real struggle trying to get it to work  
with 5.x too.

Here is what I would recommend:

-  For consistency make sure you are running all Bacula 7.2.0 on all  
computers. (Not sure if this is possible for Microsoft Windows Clients)
-  On your firewall for the internal lan where your bacula server and  
storage daemon is. Open/Forward ports 9101-9103.
-  In your bacula server for the "client" definition, make sure the  
"Address" is that of the public IP, or hostname of the client server.   
Mine looks like this:
#  On the Bacula Server #
Client {
Name = web221.mydomain.com-fd
Password = mypassword
Address = web221.mydomain.com
FDPort = 9102
Catalog = MyCatalog
File Retention = 30 days
Job Retention = 6 months
TLS Enable = yes
TLS Require = yes
TLS Certificate = /etc/bacula/certs/web221.mydomain.com.crt
TLS Key = /etc/bacula/certs/web221.mydomain.com-daemon.key
TLS CA Certificate File = /etc/bacula/certs/cacert.pem
AutoPrune = yes
}

-  On the client's bacula-fd.conf mine looks like this:

#  On the Linux Client #
Director {
   Name = bacula-dir
   Password = mypassword
   TLS Certificate = /etc/bacula/certs/web221.mydomain.com.crt
   TLS Key = /etc/bacula/certs/web221.mydomain.com-daemon.key
   TLS CA Certificate File = /etc/bacula/certs/cacert.pem
   TLS Enable = yes
   TLS Require = yes
}

FileDaemon {
   Name = web221.mydomain.com-fd
   FDport = 9102
   WorkingDirectory = /var/spool/bacula
   Pid Directory = /var/run
   Maximum Concurrent Jobs = 20
# Plugin Directory = /usr/lib64/bacula
   TLS Enable = yes
   TLS Require = yes
   TLS Certificate = /etc/bacula/certs/web221.mydomain.com.crt
   TLS Key = /etc/bacula/certs/web221.mydomain.com-daemon.key
   TLS CA Certificate File = /etc/bacula/certs/cacert.pem
   PKI Signatures = Yes# Enable Data Signing
   PKI Encryption = Yes# Enable Data Encryption
   PKI Keypair =  
"/etc/bacula/bacula_disk_keys/fd-web221.mydomain.com.pem"# Public  
and Private Keys
   PKI Master Key = "/etc/bacula/bacula_disk_keys/master.cert"#  
ONLY the Public Key
}





-- 
Wesley Render, Consultant
OtherData
www.otherdata.com


--
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311=/4140
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Remote backup through NAT?

2016-01-27 Thread Michael Munger 
This is REALLY helpful. 

I have it working on some public services that are physically attached to our 
network, so I haven't enabled SSL (because it never leaves the office), but my 
next step is to do it with some remote datacenter boxes, and the SSL configs 
you have just sent are invaluable time savers. Thanks!


Michael Munger, dCAP, MCPS, MCNPS, MBSS
High Powered Help, Inc.
Microsoft Certified Professional
Microsoft Certified Small Business Specialist
Digium Certified Asterisk Professional
mich...@highpoweredhelp.com


-Original Message-
From: Wesley Render [mailto:wren...@otherdata.com] 
Sent: Wednesday, January 27, 2016 4:21 PM
To: bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] Remote backup through NAT?


I had a lot of problems getting my setup to work over NAT too.  If you want 
email me directly and I can provide my full configs/help out.  I think what 
ended up fixing it for me was updating all of the Bacula components to 7.2.0.  
I had a real struggle trying to get it to work with 5.x too.

Here is what I would recommend:

-  For consistency make sure you are running all Bacula 7.2.0 on all computers. 
(Not sure if this is possible for Microsoft Windows Clients)
-  On your firewall for the internal lan where your bacula server and storage 
daemon is. Open/Forward ports 9101-9103.
-  In your bacula server for the "client" definition, make sure the  
"Address" is that of the public IP, or hostname of the client server.   
Mine looks like this:
#  On the Bacula Server #
Client {
Name = web221.mydomain.com-fd
Password = mypassword
Address = web221.mydomain.com
FDPort = 9102
Catalog = MyCatalog
File Retention = 30 days
Job Retention = 6 months
TLS Enable = yes
TLS Require = yes
TLS Certificate = /etc/bacula/certs/web221.mydomain.com.crt
TLS Key = /etc/bacula/certs/web221.mydomain.com-daemon.key
TLS CA Certificate File = /etc/bacula/certs/cacert.pem AutoPrune = yes }

-  On the client's bacula-fd.conf mine looks like this:

#  On the Linux Client #
Director {
   Name = bacula-dir
   Password = mypassword
   TLS Certificate = /etc/bacula/certs/web221.mydomain.com.crt
   TLS Key = /etc/bacula/certs/web221.mydomain.com-daemon.key
   TLS CA Certificate File = /etc/bacula/certs/cacert.pem
   TLS Enable = yes
   TLS Require = yes
}

FileDaemon {
   Name = web221.mydomain.com-fd
   FDport = 9102
   WorkingDirectory = /var/spool/bacula
   Pid Directory = /var/run
   Maximum Concurrent Jobs = 20
# Plugin Directory = /usr/lib64/bacula
   TLS Enable = yes
   TLS Require = yes
   TLS Certificate = /etc/bacula/certs/web221.mydomain.com.crt
   TLS Key = /etc/bacula/certs/web221.mydomain.com-daemon.key
   TLS CA Certificate File = /etc/bacula/certs/cacert.pem
   PKI Signatures = Yes# Enable Data Signing
   PKI Encryption = Yes# Enable Data Encryption
   PKI Keypair =  
"/etc/bacula/bacula_disk_keys/fd-web221.mydomain.com.pem"# Public  
and Private Keys
   PKI Master Key = "/etc/bacula/bacula_disk_keys/master.cert"#  
ONLY the Public Key
}





--
Wesley Render, Consultant
OtherData
www.otherdata.com


--
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311=/4140
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

--
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311=/4140
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] What to exclude?

2016-01-27 Thread Dimitri Maziuk 
On 01/27/2016 03:42 PM, Michael Munger wrote:
> TLDR; = what can I safely exclude from a bacula backup of a Linux
server and still be able to fully recover (bare metal) from a disaster?

Not an answer to your question, but we are
- using raid-1s for system disks,
- using SSDs for system disks,
- dd'ing the system disk before the machine goes into service and
keeping the copy on the shelf,
- backing up /etc and crontabs and not caring about the rest of /.

I'll pick any of the above over a bare metal recovery from a backup
system (SSD being the best option ATM).

FWIW
-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
--
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311=/4140___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] What to exclude?

2016-01-27 Thread Michael Munger 
Having setup and just tested, I ran into the "will not descend into different 
file systems" issue as mentioned in this post: 
http://bacula.10910.n7.nabble.com/Will-not-descend-from-into-dev-td57408.html, 
and it gives a very good reason for explicitly defining what to include.

So, I have amended my previous file set to now explicitly INCLUDE:

/bin/
/boot/
/etc/
/home/
/lib/
/opt/
/root/
/sbin/
/srv/
/usr/
/var/

While still excluding the other items.

Does anyone see an issue with this? (Trying to figure out if this is good 
enough now... before I have to recover and realize something is not quite 
right...).

Michael Munger, dCAP, MCPS, MCNPS, MBSS
High Powered Help, Inc.
Microsoft Certified Professional
Microsoft Certified Small Business Specialist
Digium Certified Asterisk Professional
mich...@highpoweredhelp.com


-Original Message-
From: Michael Munger [mailto:mich...@highpoweredhelp.com] 
Sent: Wednesday, January 27, 2016 4:43 PM
To: bacula-users@lists.sourceforge.net
Subject: [Bacula-users] What to exclude?

TLDR; = what can I safely exclude from a bacula backup of a Linux server and 
still be able to fully recover (bare metal) from a disaster?

Details:
I am looking for a best practice here, and I am working from two sources:

1. 
http://www.bacula.org/5.0.x-manuals/en/main/main/Disaster_Recovery_Using_Bac.html#SECTION00396
2. https://wiki.debian.org/FilesystemHierarchyStandard

In order to recover a client machine that is a linux server (not the bacula-dir 
or bacula-sd) in accordance with Bacula docs, I have setup the FileSet for such 
a server as noted below. 

FileSet {
Name = "Example Linux Server"
Include {
Options {
signature = SHA1
compression = GZIP
}

File = /
}

Exclude {
/opt/bacula/working
/tmp
/proc
/sys
/.journal
/.fsck
/media
}
}

My reasons for excluding these are as follows:

/opt/bacula/working 
Not needed - just pid files and temp stuff.
/tmp
no point in backing up temp files
/proc
can't backup processes
/sys
This is the filesystem point for exporting kernel objects. Kernel does 
this on the fly. No point in backing it up.

.journal
not needed. journal log file.

.fsck
not needed. fsck log file

/media
no reason to backup external devices (unless you have a reason, which I 
don't.)


It should be noted, that I am using ClientRunBeforeJob to dump MySQL databases 
to /var/local/mysqlbackups, so I have indepdenent copies of them there, but 
since I am NOT excluding /var/lib/mysql, the raw databases should also be 
recoverable from bare metal.

Does anyone have a different (better) best practice?

Michael Munger, dCAP, MCPS, MCNPS, MBSS
High Powered Help, Inc.
Microsoft Certified Professional
Microsoft Certified Small Business Specialist Digium Certified Asterisk 
Professional mich...@highpoweredhelp.com



--
Site24x7 APM Insight: Get Deep Visibility into Application Performance APM + 
Mobile APM + RUM: Monitor 3 App instances at just $35/Month Monitor end-to-end 
web transactions and take corrective actions now Troubleshoot faster and 
improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311=/4140
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

--
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311=/4140
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Remote backup through NAT?

2016-01-27 Thread Josh Fisher 



On 1/26/2016 5:08 PM, Michael Munger wrote:


Wanderlei:

Thanks for the reply!

I’ll upgrade. I was just using the Debian repo versions because that 
was what was there.


I already had to downgrade the Windows client because it wouldn’t 
connect to 5.6.2.


So, now, I’ll re-upgrade everything to 7.4



That's a good idea in any case. As for the remote server to be backed 
up, I have had good results using OpenVPN tunneling. This allows the 
remote server to be assigned an IP on the SD's LAN. To both SD and DIR 
the remote server appears to be a local machine, and in addition the 
traffic is already encrypted and requires no TLS setup in Bacula.




Michael Munger, dCAP, MCPS, MCNPS, MBSS
High Powered Help, Inc.
Microsoft Certified Professional
Microsoft Certified Small Business Specialist
Digium Certified Asterisk Professional
mich...@highpoweredhelp.com 

*From:*Wanderlei Huttel [mailto:wanderleihut...@gmail.com]
*Sent:* Tuesday, January 26, 2016 4:32 PM
*To:* Michael Munger
*Cc:* bacula-users@lists.sourceforge.net
*Subject:* Re: [Bacula-users] Remote backup through NAT?

Hello Michael

I'm not sure if is it possible in older versions like yours.

Take a look below

--

New Features in 7.2.0

FD Storage Address

When the Director is behind a NAT, in a WAN area, to connect to the 
StorageDaemon, the Director uses an ``external'' ip address, and the 
FileDaemon should use an ``internal'' IP address to contact the 
StorageDaemon.


The normal way to handle this situation is to use a canonical name 
such as ``storage-server'' that will be resolved on the Director side 
as the WAN address and on the Client side as the LAN address. This is 
now possible to configure this parameter using the new directive 
FDStorageAddress in the Storage or Client resource.


Storage {

 Name = storage1

 Address = 65.1.1.1

 FD Storage Address = 10.0.0.1

 SD Port = 9103

 ...

}

 Client {

  Name = client1

  Address = 65.1.1.2

  FD Storage Address = 10.0.0.1

  FD Port = 9102

  ...

 }

Note that using the Client FDStorageAddress directive will not allow 
to use multiple Storage Daemon, all Backup or Restore requests will be 
sent to the specified FDStorageAddress.


--

Bacula is already in 7.4.0 version.

It's highly recommended upgrading.

Best Regards

Wanderlei

2016-01-26 19:00 GMT-02:00 Michael Munger >:


Hello everyone, this is my first time mailing this list, so guidance 
on etiquette is welcomed.


TLDR; = I have a server outside the firewall (john-fd is on 
173.165.161.165) trying to backup to a storage daemon inside my LAN 
(d8-sd is on 192.168.250.202). I have port forwarded (in my Monowall) 
tcp/9103, and I can successfully telnet from the remote server to the 
local sd. But, the console is forever saying: "...waiting on storage 
file" when I run the job.


What I've done:
* Scoured the docs and tutorials
* Exhausted Google (and DuckDuckGo)
* Confirmed The software versions are all 5.6.2 (learned that one the 
hard way dealing with a Windows client!)
* Shutdown bacula-sd and confirmed telnet no longer connects, and when 
I restart bacula-sd it DOES connect.

* shutdown the firewall (everywhere - for testing) no joy
* opened 9101 and 9102 on our firewall and forwarded them to 
192.168.250.202 just in case any bacula service wants to communicate.
* used netstat -tanop to watch the telnet connections come in from the 
remote server to confirm that NAT is working properly.


What I think is going on:
D8-FD (the file director on the server where bacula-sd, the pools, and 
volumes reside) can connect to the remote server, and can issue 
commands to run the backup job. But, when the remote fd tries to 
connect back (through the firewall from "outside -> in") to the 
storage daemon, it's failing - despite the fact that the NAT is setup 
properly, and I can telnet through it.


That doesn't make sense to me because it should either work or be 
broken. So, I'm thinking that if I can telnet to it, then the remote 
fd should also be able to work with it. Nmap also shows the port as 
open and reachable.


How else can I troubleshoot this "waiting on storage" problem?

PS. I am about 18 hours in to working with Bacula. Fantastic product, 
but don't be afraid to assume I have missed something rudimentary. I 
have two machines on the LAN working and backing up, so I have had 
some success, but it's still possible I've missed something simple...


Michael Munger, dCAP, MCPS, MCNPS, MBSS
High Powered Help, Inc.
Microsoft Certified Professional
Microsoft Certified Small Business Specialist
Digium Certified Asterisk Professional
mich...@highpoweredhelp.com