Re: [Bacula-users] bat install questions

2017-08-30 Thread Simone Caronni
Hi,

you might as well use pre-built binaries:



On Wed, Aug 30, 2017 at 1:29 AM, Heitor Faria  wrote:

> List,
>
> Hello, Jerry,
>
> I am still trying to resolve my 9.0.3 install from a week or so ago.  I
> have had to rebuild the server due to numerous problems.  I am using the
> same configure command that I have in the past.
>
> Centos 7 bld 1611 , mariadb 5.5.52
>
> ./configure --sbindir=/usr/bacula/bin --sysconfdir=/usr/bacula/bin
> --with-pid-dir=/var/run/bacula --with-subsys-dir=/var/run/bacula/working
> --enable-smartalloc --with-mysql --with-working-dir=/usr/bacula/bin/working
> --with-dump-email=email.com --with-job-email=email.com --with-smtp-host=
> email.com --enable-bat
>
> I have the depkgs-qt installed in the bacula-9.0.3 directory and have the
> qt path set up like so:
>
> Last time I built bat from source this is what worked (besides Bacula
> regular configure, make, make install and make install-autostart commands):
>
> 
> ===
> yum install qt-devel qt
> ln /usr/bin/qmake-qt4 /usr/bin/qmake
> cd src/bacula-*/src/qt-console/tray-monitor/
> qmake
> make
> make install
> cd ../../../
> 
> ===
>
> Regards,
> --
> 
> ===
> Heitor Medrado de Faria | EB-1 Visa | LPIC-III | ITIL-F | EMC 05-001| Bacula
> Systems Certified Administrator II
> • Bacula Enterprise does not charge per backup size and has plugins for
> many applications. In the USA: http://bacula.us/
> • Do you need Bacula training? http://bacula.us/video-classes/
> +55 61 98268-4220 <+55%2061%2098268-4220> | http://bacula.us
> 
> ===
>
> 
> --
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
>


-- 
You cannot discover new oceans unless you have the courage to lose sight of
the shore (R. W. Emerson).

http://xkcd.com/229/
http://negativo17.org/
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bat install questions

2017-08-30 Thread Simone Caronni
On Wed, Aug 30, 2017 at 9:28 AM, Simone Caronni 
wrote:

> Hi,
>
> you might as well use pre-built binaries:
>

Sorry, keyboard error :/
Damn gmail.

https://copr.fedorainfracloud.org/coprs/slaanesh/Bacula/

Those are exactly the same builds in Fedora that will eventually go into
RHEL. I make sure that every release builds on all supported Fedora and
CentOS/RHEL releases.
Upgrades in place from bundled packages in the distribution is supported,
just make sure to update the database.

Regards,
--Simone



-- 
You cannot discover new oceans unless you have the courage to lose sight of
the shore (R. W. Emerson).

http://xkcd.com/229/
http://negativo17.org/
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] cloud command?

2017-08-30 Thread KEN SAWADA
Hello Faria


Thank you for your reply. You can use it in Bacula Enterprise. understood.
Thank you!

Regards,

2017-08-28 21:42 GMT+09:00 Heitor Faria :

> Hello, Ken,
>
> I installed bacula 9.0.3.
> I saw bconsole's help and found a cloud command.
> Is this a command that can be backed up to AWS, Azure, etc?
> Sample configuration file could not be found on bacula.org.
> Do you have samples?
>
> Community Bacula  9.0.x has now support to different Storage Drivers, that
> allow special backup data reducing techniques (e.g. aligned volumes for
> deduplicative FS) or special device support, such as Cloud Object Storage.
> However, the Cloud S3 Driver itself is not included in Community Bacula at
> this time. It is available only in Bacula Enterprise Edition.
>
> Regards,
> --
> 
> ===
> Heitor Medrado de Faria | EB-1 Visa | LPIC-III | ITIL-F | EMC 05-001| Bacula
> Systems Certified Administrator II
> • Bacula Enterprise does not charge per backup size and has plugins for
> many applications. In the USA: http://bacula.us/
> • Do you need Bacula training? http://bacula.us/video-classes/
> +55 61 98268-4220 <+55%2061%2098268-4220> | http://bacula.us
> 
> ===
>
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] cloud command?

2017-08-30 Thread KEN SAWADA
Hello Kern


Thank you for your reply.

Thank you for telling me the release time.
I am looking forward to it.


Regards,

2017-08-29 1:23 GMT+09:00 Kern Sibbald :

> The cloud driver has not yet been released.  I expect that it will be out
> in January 2018.
>
> Kern
>
> On 08/28/2017 10:13 AM, KEN SAWADA wrote:
>
> Hi!
>
> I installed bacula 9.0.3.
> I saw bconsole's help and found a cloud command.
> Is this a command that can be backed up to AWS, Azure, etc?
> Sample configuration file could not be found on bacula.org.
> Do you have samples?
>
>
>
> --
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
>
>
>
> ___
> Bacula-users mailing 
> listBacula-users@lists.sourceforge.nethttps://lists.sourceforge.net/lists/listinfo/bacula-users
>
>
>
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] How to handle periods when wanting to preserve long time backups

2017-08-30 Thread Martin Simmons
> On Tue, 29 Aug 2017 16:18:45 +0200, Egoitz Aurrekoetxea said:
> 
> I wanted to be doing two kind of different backups. I do explain. One of 
> them is the daily backup. The daily backup consists on :
> 
> 
> - Monday -> Full backup
> 
> - rest of the days -> Inc backup
> 
> 
> I keep this backups and catalogs during three weeks but seting the 
> following retention periods :
> 
> 
> - File retention = 21 days
> 
> - Job retention = 22 days
> 
> - Volume retention = 23 days
> 
> 
> But now is when the second kind of backup comes
> 
> 
> I wanted too, to preserve the following backups too :
> 
> 
> - One full backup per month
> 
> - One inc backup per week
> 
> Keep them for two years. So, obviously I need to set different retention 
> periods for this backup. I have though using a different pool and 
> catalog and using different file, job and volume retention but I have
> seen that File retention is per client assigned. So I can't set two 
> different file retention for the same client even when I use different 
> catalogs for each backup kind. How would you recommend me to handle this
> task with Bacula?.

Assuming you have a fixed number of volumes in the daily backup pool (i.e. you
are not using Label Format), then you can set the file and job retention in
the client to 2 years.  Since the volume retention in the daily pool is
shorter, it will take precedence over the file and job retention in the
client.  The file and jobs records for the second kind of backup will be
retained for 2 years.

This is described in the documentation for Volume Retention in
http://www.bacula.org/9.0.x-manuals/en/main/Configuring_Director.html#SECTION001815

__Martin

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Retention Period not working?

2017-08-30 Thread sachin.holikar
Hello Expert,

We have been using Bacula Version: 7.4.0.
Recently we introduced Offsite backup pool with N no. of tapes. The
retention periods are as follows,
File Retention : 92 Days
Job Retention : 92 Days
Volume Retention : 365 Days
Every month we take offsite backup and the respective tapes move out of the
library manually.  And replace them with the oldest backup tapes.
I use 3 sets for this so that I delete the oldest tapes from this pool and
add the tapes from next-backup-cycle set (which was previously kept aside).
In order to verify , I tried to do restore for one of the hosts and
surprised to found that it allows me to choose only from 1 Set.
Select the Client (1-17): 2
Automatically selected FileSet: ClientA_offsite_system
+---+---+--+---+
-++
| JobId | Level | JobFiles | JobBytes  | StartTime   |
VolumeName |
+---+---+--+---+
-++
| 2,854 | F |  137,373 | 5,130,634,026 | 2017-08-27 18:51:12 |
0001ABL4   |
+---+---+--+---+
-++
Whereas actually there should be atleast 2 more available backups done in
previous months , as indicated by the query,
query #5 {List all backups for a Client}
Choose a query (1-20): 5
Enter Client Name: ClientA
+---+++---+-
+--+---++
| JobId | Client | FileSet| Level | StartTime
| JobFiles | JobBytes  | VolumeName |
+---+++---+-
+--+---++
| 2,440 | ClientA-fd | ClientA_offsite_system | F | 2017-07-02 18:52:02
|  137,333 | 5,114,946,004 | 000193L4   |
| 2,652 | ClientA-fd | ClientA_offsite_system | F | 2017-07-30 18:52:40
|  137,354 | 5,123,225,649 | 000134L4   |
| 2,854 | ClientA-fd | ClientA_offsite_system | F | 2017-08-27 18:51:12
|  137,373 | 5,130,634,026 | 000191L4   |
+---+++---+-
+--+---++
As can be seen in the recors , there have been 3 backups done on
02-07-2017 and 30-07-2017 and 27-08-2017.
Then why am I being presented with only backup from 27-08-2017 at the
restore prompt?


Thanx in advance.


Regards,
Sachin
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Retention Period not working?

2017-08-30 Thread Wanderlei Huttel
Hello Sachin

Try to restore jobid=2440 until the screen to confirm and post all
information in the screen (since the begin)

Regards

*Wanderlei Hüttel*
http://www.huttel.com.br

2017-08-30 9:40 GMT-03:00 sachin.holikar :

> Hello Expert,
>
> We have been using Bacula Version: 7.4.0.
> Recently we introduced Offsite backup pool with N no. of tapes. The
> retention periods are as follows,
> File Retention : 92 Days
> Job Retention : 92 Days
> Volume Retention : 365 Days
> Every month we take offsite backup and the respective tapes move out of
> the library manually.  And replace them with the oldest backup tapes.
> I use 3 sets for this so that I delete the oldest tapes from this pool and
> add the tapes from next-backup-cycle set (which was previously kept aside).
> In order to verify , I tried to do restore for one of the hosts and
> surprised to found that it allows me to choose only from 1 Set.
> Select the Client (1-17): 2
> Automatically selected FileSet: ClientA_offsite_system
> +---+---+--+---+
> -++
> | JobId | Level | JobFiles | JobBytes  | StartTime   |
> VolumeName |
> +---+---+--+---+
> -++
> | 2,854 | F |  137,373 | 5,130,634,026 | 2017-08-27 18:51:12 |
> 0001ABL4   |
> +---+---+--+---+
> -++
> Whereas actually there should be atleast 2 more available backups done in
> previous months , as indicated by the query,
> query #5 {List all backups for a Client}
> Choose a query (1-20): 5
> Enter Client Name: ClientA
> +---+++---+-
> +--+---++
> | JobId | Client | FileSet| Level |
> StartTime   | JobFiles | JobBytes  | VolumeName |
> +---+++---+-
> +--+---++
> | 2,440 | ClientA-fd | ClientA_offsite_system | F | 2017-07-02
> 18:52:02 |  137,333 | 5,114,946,004 | 000193L4   |
> | 2,652 | ClientA-fd | ClientA_offsite_system | F | 2017-07-30
> 18:52:40 |  137,354 | 5,123,225,649 | 000134L4   |
> | 2,854 | ClientA-fd | ClientA_offsite_system | F | 2017-08-27
> 18:51:12 |  137,373 | 5,130,634,026 | 000191L4   |
> +---+++---+-
> +--+---++
> As can be seen in the recors , there have been 3 backups done on
> 02-07-2017 and 30-07-2017 and 27-08-2017.
> Then why am I being presented with only backup from 27-08-2017 at the
> restore prompt?
>
>
> Thanx in advance.
>
>
> Regards,
> Sachin
>
> 
> --
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
>
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Retention Period not working?

2017-08-30 Thread sachin.holikar
Thanx for the Response. Here is the Output. and the Directory listing is
correct.

*restore jobid=2440
Automatically selected Catalog: MyCatalog
Using Catalog "MyCatalog"
You have selected the following JobId: 2440

Building directory tree for JobId(s) 2440 ...
++
128,439 files inserted into the tree.

You are now entering file selection mode where you add (mark) and
remove (unmark) files to be restored. No files are initially added, unless
you used the "all" keyword on the command line.
Enter "done" to leave this mode.
cwd is: /
$ ls
...




On Wed, Aug 30, 2017 at 3:14 PM, Wanderlei Huttel  wrote:

> Hello Sachin
>
> Try to restore jobid=2440 until the screen to confirm and post all
> information in the screen (since the begin)
>
> Regards
>
> *Wanderlei Hüttel*
> http://www.huttel.com.br
>
> 2017-08-30 9:40 GMT-03:00 sachin.holikar :
>
>> Hello Expert,
>>
>> We have been using Bacula Version: 7.4.0.
>> Recently we introduced Offsite backup pool with N no. of tapes. The
>> retention periods are as follows,
>> File Retention : 92 Days
>> Job Retention : 92 Days
>> Volume Retention : 365 Days
>> Every month we take offsite backup and the respective tapes move out of
>> the library manually.  And replace them with the oldest backup tapes.
>> I use 3 sets for this so that I delete the oldest tapes from this pool
>> and add the tapes from next-backup-cycle set (which was previously kept
>> aside).
>> In order to verify , I tried to do restore for one of the hosts and
>> surprised to found that it allows me to choose only from 1 Set.
>> Select the Client (1-17): 2
>> Automatically selected FileSet: ClientA_offsite_system
>> +---+---+--+---+
>> -++
>> | JobId | Level | JobFiles | JobBytes  | StartTime   |
>> VolumeName |
>> +---+---+--+---+
>> -++
>> | 2,854 | F |  137,373 | 5,130,634,026 | 2017-08-27 18:51:12 |
>> 0001ABL4   |
>> +---+---+--+---+
>> -++
>> Whereas actually there should be atleast 2 more available backups done in
>> previous months , as indicated by the query,
>> query #5 {List all backups for a Client}
>> Choose a query (1-20): 5
>> Enter Client Name: ClientA
>> +---+++---+-
>> +--+---++
>> | JobId | Client | FileSet| Level |
>> StartTime   | JobFiles | JobBytes  | VolumeName |
>> +---+++---+-
>> +--+---++
>> | 2,440 | ClientA-fd | ClientA_offsite_system | F | 2017-07-02
>> 18:52:02 |  137,333 | 5,114,946,004 | 000193L4   |
>> | 2,652 | ClientA-fd | ClientA_offsite_system | F | 2017-07-30
>> 18:52:40 |  137,354 | 5,123,225,649 | 000134L4   |
>> | 2,854 | ClientA-fd | ClientA_offsite_system | F | 2017-08-27
>> 18:51:12 |  137,373 | 5,130,634,026 | 000191L4   |
>> +---+++---+-
>> +--+---++
>> As can be seen in the recors , there have been 3 backups done on
>> 02-07-2017 and 30-07-2017 and 27-08-2017.
>> Then why am I being presented with only backup from 27-08-2017 at the
>> restore prompt?
>>
>>
>> Thanx in advance.
>>
>>
>> Regards,
>> Sachin
>>
>> 
>> --
>> Check out the vibrant tech community on one of the world's most
>> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
>> ___
>> Bacula-users mailing list
>> Bacula-users@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/bacula-users
>>
>>
>
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Storage Daemon crashes on Debian 9 with Bacula release 7.4.4+dfsg-6

2017-08-30 Thread christian . garling

Hi all,

recently we updated our backup server from Debian 8 to Debian 9 with 
Bacula release 7.4.4+dfsg-6. After a few days we experienced some 
crashes of the Storage Daemon during the backup runs. When Bacula is 
idle no crash happens.


The log showed this:

Aug 26 06:03:15 s110180 bacula-sd[9035]: s110180-sd: dircmd.c:162-0 
Connection request from client failed.
Aug 26 06:04:15 s110180 bacula-sd[9035]: s110180-sd: dircmd.c:162-0 
Connection request from client failed.
Aug 26 06:05:15 s110180 bacula-sd[9035]: s110180-sd: dircmd.c:162-0 
Connection request from client failed.
Aug 26 06:05:40 s110180 bacula-sd[9035]: Bacula interrupted by signal 
11: Segmentation violation
Aug 26 06:05:40 s110180 bacula-sd[9035]: Kaboom! bacula-sd, s110180-sd 
got signal 11 - Segmentation violation at 26-Aug-2017 06:05:40. 
Attempting traceback.

Aug 26 06:05:40 s110180 bacula-sd[9035]: Kaboom! exepath=/usr/sbin/
Aug 26 06:05:40 s110180 bacula-sd[9035]: Bacula interrupted by signal 
11: Segmentation violation
Aug 26 06:05:40 s110180 bacula-sd[9035]: Calling: /usr/sbin/btraceback 
/usr/sbin/bacula-sd 9035 /var/lib/bacula
Aug 26 06:05:40 s110180 systemd[1]: bacula-sd.service: Main process 
exited, code=exited, status=1/FAILURE
Aug 26 06:05:40 s110180 systemd[1]: bacula-sd.service: Unit entered 
failed state.
Aug 26 06:05:40 s110180 systemd[1]: bacula-sd.service: Failed with 
result 'exit-code'.


Also I enabled btraceback with this result:

[New LWP 6596]
[New LWP 6617]
[New LWP 6622]
[New LWP 6625]
[New LWP 6723]
[Thread debugging using libthread_db enabled] Using host libthread_db 
library "/lib/x86_64-linux-gnu/libthread_db.so.1".

0x7fb00e1e43f3 in select () at ../sysdeps/unix/syscall-template.S:84
84  ../sysdeps/unix/syscall-template.S: No such file or directory.
$1 = 1093482802
$2 = 808530291
$3 = 994335848
$4 = 994335912
$5 = 0
$6 = 0
$7 = 264805061
$8 = 264805030
$9 = 264805023
$10 = 264805057
$11 = 808530291
$12 = 264805050
Environment variable "TestName" not defined.
#0  0x7fb00e1e43f3 in select () at 
../sysdeps/unix/syscall-template.S:84
#1  0x7fb00fc561ca in bnet_thread_server(dlist*, int, workq_tag*, 
void* (*)(void*)) () from /usr/lib/bacula/libbac-7.4.4.so

#2  0x557a39cd8a84 in ?? ()
#3  0x7fb00e1232b1 in __libc_start_main (main=0x557a39cd8130, 
argc=4, argv=0x7ffde08270e8, init=, fini=, 
rtld_fini=, stack_end=0x7ffde08270d8) at 
../csu/libc-start.c:291

#4  0x557a39cd8dba in ?? ()

Thread 6 (Thread 0x7fb0077fe700 (LWP 6723)):
#0  0x7fb00fa30b3a in __waitpid (pid=6731, stat_loc=0x7fb0077fd0ac, 
options=0) at ../sysdeps/unix/sysv/linux/waitpid.c:29
#1  0x7fb00fc74f7e in signal_handler () from 
/usr/lib/bacula/libbac-7.4.4.so

#2  
#3  0x7fb00fc77c69 in new_tls_connection(TLS_Context*, int) () from 
/usr/lib/bacula/libbac-7.4.4.so
#4  0x7fb00fc54e4d in bnet_tls_server(TLS_Context*, BSOCK*, alist*) 
() from /usr/lib/bacula/libbac-7.4.4.so

#5  0x557a39ce6ae9 in ?? ()
#6  0x557a39cfc2df in ?? ()
#7  0x557a39cf9890 in ?? ()
#8  0x7fb00fc7fd02 in workq_server () from 
/usr/lib/bacula/libbac-7.4.4.so
#9  0x7fb00fa27494 in start_thread (arg=0x7fb0077fe700) at 
pthread_create.c:333
#10 0x7fb00e1ebaff in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:97


Thread 5 (Thread 0x7fb007fff700 (LWP 6625)):
#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at 
../sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:225

#1  0x557a39cfb530 in ?? ()
#2  0x557a39cf9a4f in ?? ()
#3  0x7fb00fc7fd02 in workq_server () from 
/usr/lib/bacula/libbac-7.4.4.so
#4  0x7fb00fa27494 in start_thread (arg=0x7fb007fff700) at 
pthread_create.c:333
#5  0x7fb00e1ebaff in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:97


Thread 4 (Thread 0x7fb00c9bb700 (LWP 6622)):
#0  0x7fb00fa3020d in read () at 
../sysdeps/unix/syscall-template.S:84
#1  0x7fb00fc54ad7 in read_nbytes(BSOCK*, char*, int) () from 
/usr/lib/bacula/libbac-7.4.4.so
#2  0x7fb00fc5827f in BSOCK::recv() () from 
/usr/lib/bacula/libbac-7.4.4.so
#3  0x7fb00fc5443c in bget_msg(BSOCK*) () from 
/usr/lib/bacula/libbac-7.4.4.so
#4  0x7fb00fc54793 in GetMsg::bget_msg(bmessage**) () from 
/usr/lib/bacula/libbac-7.4.4.so

#5  0x557a39ce2e7b in ?? ()
#6  0x557a39cf9f8b in ?? ()
#7  0x557a39cfa530 in ?? ()
#8  0x557a39cfa76f in ?? ()
#9  0x557a39cfb350 in ?? ()
#10 0x557a39cf9a4f in ?? ()
#11 0x7fb00fc7fd02 in workq_server () from 
/usr/lib/bacula/libbac-7.4.4.so
#12 0x7fb00fa27494 in start_thread (arg=0x7fb00c9bb700) at 
pthread_create.c:333
#13 0x7fb00e1ebaff in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:97


Thread 3 (Thread 0x7fb00dbcf700 (LWP 6617)):
#0  0x7fb00fa3020d in read () at 
../sysdeps/unix/syscall-template.S:84
#1  0x7fb00fc54ad7 in read_nbytes(BSOCK*, char*, int) () from 
/usr/lib/bacula/libbac-7.4.4.so
#2  0x7fb00fc584a5 in BSOCK::recv() () from 
/usr/lib/bacula/libbac-7.4.4.so
#3  0x7fb00fc544

Re: [Bacula-users] Storage Daemon crashes on Debian 9 with Bacula release 7.4.4+dfsg-6

2017-08-30 Thread Sven Hartge
On 30.08.2017 15:19, christian.garl...@cg-networks.de wrote:

> We never had such a problem before the upgrade, so we are wondering what
> could be the reason for that.


Could you please add

deb http://deb.debian.org/debian-debug/ stretch-debug main contrib non-free

to your source.list and install the packages bacula-sd-dbgsym and
bacula-common-dbgsym. This should make the backtrace a bit more readable.

Grüße,
Sven.



signature.asc
Description: OpenPGP digital signature
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Deduplication Optimized Volumes. Lookup of symbol "BaculaSDdriver" undefined

2017-08-30 Thread Pedro Luis Balcázar
Hello everyone.
I am with version 9.0.3 and following the document "DeduplicationOptimized 
Volumes" I have encountered the error, see debug:

localhost.localdomain-sd: stored.c:609-0 calling init_dev Aligned-Disk
localhost.localdomain-sd: init_dev.c:116-0 init_dev dev_type=9
localhost.localdomain-sd: init_dev.c:152-0 Num drivers=15
localhost.localdomain-sd: init_dev.c:165-0 loadable=1 type=9 loaded=0 
name=aligned handle=0
localhost.localdomain-sd: init_dev.c:430-0 loadable=1 type=9 loaded=0 
name=aligned handle=0
localhost.localdomain-sd: init_dev.c:435-0 Open SD driver at 
/opt/bacula/plugins/bacula-sd-aligned-driver-9.0.3.so
localhost.localdomain-sd: init_dev.c:438-0 Driver=aligned handle=7f62cc005120
localhost.localdomain-sd: init_dev.c:440-0 Lookup "BaculaSDdriver" in 
driver=aligned
localhost.localdomain-sd: init_dev.c:442-0 Driver=aligned entry point=0
localhost.localdomain-sd: init_dev.c:448-0 Lookup of symbol "BaculaSDdriver" 
driver=/opt/bacula/plugins/bacula-sd-aligned-driver-9.0.3.so failed: 
ERR=/opt/bacula/plugins/bacula-sd-aligned-driver-9.0.3.so: undefined symbol: 
BaculaSDdriver
localhost.localdomain-sd: stored.c:611-0 SD init done Aligned-Disk
localhost.localdomain-sd: stored.c:613-0 Could not initialize SD device 
"Aligned-Disk"

Does anyone know what I can do to fix this error?

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Bacula Verification Procedures

2017-08-30 Thread Jim Richardson
All,

Background:  We have a large tape backup that run on a daily cycle.  Individual 
files range from a few Kilobytes to tens of Gigabytes.  The backup runs 
Saturday through Friday.  Saturday is the Full backup.  Each of the following 
days alternate from Differential and Incremental jobs.  The Full backup has 
approximately 2,413,000 files at 3.6 TB running in about 15 hours.  The 
Incrementals average 99,000 files at 158 GB in about 3 hours,  and the 
Differentials are from 92,000 to about 194,000 files at 126 GB to 293 GB in 
about 2 hours 25 mins to 3 hours perspectively throughout the week.  Due to 
time constraints we are not hashing the files (trials with MD5 added several 
hours to the full), and we are using hardware (LTO7) compression.  Backups are 
going nicely, but we need to implement best practice verification.

We currently have a verification process for smaller backup jobs.  We have 
setup an additional Verify VolumeToCatalog job scheduled to run after the 
backup job completes.  From what I understand it verifies the hashes in the 
catalog to the files in the volume.  If there are inconsistencies it errors.  
If it does we first attempt to rerun the verification, if it fails twice we 
rerun the backup and followup with another verify until success.

With the MD5 hash we do on the files when they are added to the catalog, and 
the Verification job we are pretty certain that the files we backed up did 
indeed get backed up, and that backup Volume is sound.  We are planning 
quarterly test restores to verify that that files in that volume can indeed be 
restored and those restored files do match the files we backed up.

So I am looking to the community to help with the following questions to save 
me from trial and error:


  1.  Is there a verification job or a sequence of jobs "built in" to Bacula 
that can accomplish an automated restore with an automated verification of 
Volume to Restore on Disk?
  2.  Will the VolumeToCatalog job verify Catalog files to the Tape without 
first hashing and when hardware compression is in place?
  3.  Is there a verification job or a sequence of jobs "built in" to Bacula 
that can accomplish an automated Restore with an automated Verification of Tape 
to Restore on Disk?
  4.  Are there other options or best practices to accomplish both a post job 
verification of Catalog to Volume and a periodic verification of Volume (Tape 
or Disk) to Restore on Disk?
  5.  Is there a Bacula Systems whitepaper that covers best practices for 
Verification and Testing of backups?

I have looked into DiskToCatalog this will not work.  (someone argue with me).  
It will compare files on the client disk to the catalog.  After 15 hours + 
verification run time many files have changes - archived, reached retention 
period and deleted, etc.  Ideally, I want a complete restore to different 
location and a verification that the files in the Catalog and the Volume are 
actually the files on disk after the Restore.

Thank you in advance.

Jim Richardson


CONFIDENTIALITY: This email (including any attachments) may contain 
confidential, proprietary and privileged information, and unauthorized 
disclosure or use is prohibited. If you received this email in error, please 
notify the sender and delete this email from your system. Thank you.
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] how Backup Hyper-V Virtual Machines

2017-08-30 Thread Jim Richardson
While I provide this option, I caveat with the fact that I also have Bacula 
client installed on the VM to backup either the system state for DCs or the 
applications running on the windows server on an alternate regular schedule.  I 
then use this Technet process to back up the VMs off hours.  Simply backing up 
the VMs is not enough.  I once a week back up the virtual machines using the 
below process.  I backup to an NFS share on my backup server, then I back up 
that to a tape for off site.

https://social.technet.microsoft.com/wiki/contents/articles/216.how-to-back-up-hyper-v-vms-from-the-host-using-windows-server-backup.aspx

For Vmware ESXi we use the following, again configuring this software to back 
up to an NFS share weekly and then putting that on tape for off-site.

http://www.thinware.net/Products/ThinwarevBackup/tabid/202/Default.aspx

Hope this helps.

Jim Richardson

From: Wanderlei Huttel [mailto:wanderleihut...@gmail.com]
Sent: Tuesday, August 29, 2017 12:45 PM
To: Bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] how Backup Hyper-V Virtual Machines

Hello Zainelabdeen
You can turn off the machines and make a copy of them with the scripts attached 
and turn them on again

# The FileSet example
FileSet {
  Name = "FileSet_VM_SRV_Intranet"
  Include {
Options {
   signature = md5
   compression = gzip
   onefs = no
   ignorecase = yes
   accurate = pins5
   verify = pins5
 }
 File = "C:/Hyper-V/Virtual Machines/CC1C79AE-715F-431D-AD53-CF9A7BAB7D9B"
 File = "C:/Hyper-V/Virtual 
Machines/CC1C79AE-715F-431D-AD53-CF9A7BAB7D9B.xml"
 File = "C:/Hyper-V/Virtual Hard Disks/servidor_debian_intranet.vhdx"
  }
}


# The Job Example
Job {
  Name = "Backup_VM_Servidor_Intranet"
  JobDefs = "Backup_Padrao"
  Client = srv_hyperv-fd
  FileSet = "FileSet_VM_SRV_Intranet"
  Schedule = "Agenda_VM_Diaria"
  ClientRunBeforeJob  = "powershell C:/'Program 
Files'/Bacula/scripts/stop_virtual_machine.ps1 SRV_INTRANET"
  ClientRunAfterJob   = "powershell C:/'Program 
Files'/Bacula/scripts/start_virtual_machine.ps1 SRV_INTRANET"
  Enabled = true
  Priority = 10
}



Or you can use wbadmin (Windows Server Backup) to make a hot backup and copy 
the files:
https://blogs.msdn.microsoft.com/virtual_pc_guy/2013/02/25/backing-up-hyper-v-virtual-machines-from-the-command-line/



Best regards

Wanderlei Hüttel
http://www.huttel.com.br

2017-08-29 14:30 GMT-03:00 Zainelabdeen S.A Elgraeed 
mailto:zainc...@gmail.com>>:
I install bacula client on Microsoft server 2012 R2 to backup my VM, I found a 
tutorial to do that on this link :
http://www.ithierarchy.com/ITH/Bacula/BaculaHyper-V

but not work for me.
what your suggestion to complete backup VM.
also, i need help for planning backup scheduling.

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

CONFIDENTIALITY: This email (including any attachments) may contain 
confidential, proprietary and privileged information, and unauthorized 
disclosure or use is prohibited. If you received this email in error, please 
notify the sender and delete this email from your system. Thank you.
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Retention Period not working?

2017-08-30 Thread Jim Richardson
Please dig into the rationale for “I delete the oldest tapes from this pool” ??

If you are manually deleting the tape Volume or changing the Pool, you are 
changing the Volume information, the restore wizard is linked to the “at the 
time of run” job, pool, and volume information in order to produce the list.  
This may be why you see the correct information when you specify the job id.  
If your retention for Volumes needs to be 365 days, as you have configured, let 
Bacula purge/recycle volumes.  I have found the easiest way is to use the 
‘Recycle Oldest Volume’ directive to recycle the oldest tapes in the Pool 
currently in your library.  If you are replacing 3 tapes every month and you 
have 36 tapes in rotation, the oldest 3 will be purged and recycled as the 
running jobs need them.  My experience is if you are replacing tapes and 
updating the slots appropriately there should never be a need to manually 
delete Volumes or change Pools.  Volumes physically moved to off site will move 
to Slot 0 “removed” until reinserted into your library.  They will naturally 
purge and recycle per configured retention periods and in a jam the oldest will 
be used to ensure the running job completes (say if the job grows to a fourth 
tape).  If you want to have a pool for just Off-Site monthlies create a pool 
for OffSite, use the pool override option in your schedule resource to assign 
it when the monthlies run.  When you return the tapes to the library the above 
‘Recycle Oldest Volume’ option will be sure they are recycled first.

I hope that helps.

Jim Richardson

From: sachin.holikar [mailto:sachin.holi...@gmail.com]
Sent: Wednesday, August 30, 2017 8:18 AM
To: Wanderlei Huttel 
Cc: bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] Retention Period not working?

Thanx for the Response. Here is the Output. and the Directory listing is 
correct.

*restore jobid=2440
Automatically selected Catalog: MyCatalog
Using Catalog "MyCatalog"
You have selected the following JobId: 2440

Building directory tree for JobId(s) 2440 ...  
++
128,439 files inserted into the tree.

You are now entering file selection mode where you add (mark) and
remove (unmark) files to be restored. No files are initially added, unless
you used the "all" keyword on the command line.
Enter "done" to leave this mode.
cwd is: /
$ ls
...





On Wed, Aug 30, 2017 at 3:14 PM, Wanderlei Huttel 
mailto:wanderleihut...@gmail.com>> wrote:
Hello Sachin

Try to restore jobid=2440 until the screen to confirm and post all information 
in the screen (since the begin)

Regards

Wanderlei Hüttel
http://www.huttel.com.br

2017-08-30 9:40 GMT-03:00 sachin.holikar 
mailto:sachin.holi...@gmail.com>>:
Hello Expert,

We have been using Bacula Version: 7.4.0.
Recently we introduced Offsite backup pool with N no. of tapes. The retention 
periods are as follows,
File Retention : 92 Days
Job Retention : 92 Days
Volume Retention : 365 Days
Every month we take offsite backup and the respective tapes move out of the 
library manually.  And replace them with the oldest backup tapes.
I use 3 sets for this so that I delete the oldest tapes from this pool and add 
the tapes from next-backup-cycle set (which was previously kept aside).
In order to verify , I tried to do restore for one of the hosts and surprised 
to found that it allows me to choose only from 1 Set.
Select the Client (1-17): 2
Automatically selected FileSet: ClientA_offsite_system
+---+---+--+---+-++
| JobId | Level | JobFiles | JobBytes  | StartTime   | VolumeName |
+---+---+--+---+-++
| 2,854 | F |  137,373 | 5,130,634,026 | 2017-08-27 18:51:12 | 0001ABL4   |
+---+---+--+---+-++
Whereas actually there should be atleast 2 more available backups done in 
previous months , as indicated by the query,
query #5 {List all backups for a Client}
Choose a query (1-20): 5
Enter Client Name: ClientA
+---+++---+-+--+---++
| JobId | Client | FileSet| Level | StartTime   | 
JobFiles | JobBytes  | VolumeName |
+---+++---+-+--+---++
| 2,440 | ClientA-fd | ClientA_offsite_system | F | 2017-07-02 18:52:02 |  
137,333 | 5,114,946,004 | 000193L4   |
| 2,652 | ClientA-fd | ClientA_offsite_system | F | 2017-07-30 18:52:40 |  
137,354 | 5,123,225,649 | 000134L4   |
| 2,854 | ClientA-fd | ClientA_offsite_system | F | 2017-08-27 18:51:12 |  
137,373 | 5,130,634,026 | 000191L4   |
+---+++---+-+--+---++
As can be seen in the recors , there have been 3 backups 

Re: [Bacula-users] Storage Daemon crashes on Debian 9 with Bacula release 7.4.4+dfsg-6

2017-08-30 Thread christian . garling

Am 2017-08-30 17:33, schrieb Sven Hartge:

On 30.08.2017 15:19, christian.garl...@cg-networks.de wrote:

We never had such a problem before the upgrade, so we are wondering 
what

could be the reason for that.



Could you please add

deb http://deb.debian.org/debian-debug/ stretch-debug main contrib 
non-free


to your source.list and install the packages bacula-sd-dbgsym and
bacula-common-dbgsym. This should make the backtrace a bit more 
readable.




Yes, here you can find a btraceback from last nigh with debug symbols:

[New LWP 24920]
[New LWP 20893]
[New LWP 20894]
[New LWP 20895]
[New LWP 20896]
[New LWP 20950]
[New LWP 21026]
[New LWP 21027]
[New LWP 21031]
[New LWP 21038]
[New LWP 21064]
[New LWP 21091]
[New LWP 21168]
[New LWP 21171]
[New LWP 21186]
[New LWP 21190]
[New LWP 21276]
[New LWP 21610]
[New LWP 21895]
[New LWP 21937]
[New LWP 21945]
[New LWP 22176]
[Thread debugging using libthread_db enabled] Using host libthread_db 
library "/lib/x86_64-linux-gnu/libthread_db.so.1".

0x7f9cdfd993f3 in select () at ../sysdeps/unix/syscall-template.S:84
84  ../sysdeps/unix/syscall-template.S: No such file or directory.
$1 = "31-Aug-2017 01:06:10\000\000\000\000\000\000\000\000\000"
$2 = 0x5644c1acb8c0  "s110180-sd"
$3 = 0x5644c2a61c68 "bacula-sd"
$4 = 0x5644c2a61ca8 "/usr/sbin/bacula-sd"
$5 = 0x0
$6 = '\000' 
$7 = 0x7f9ce183eac5 "7.4.4 (20 September 2016)"
$8 = 0x7f9ce183eaa6 "x86_64-pc-linux-gnu"
$9 = 0x7f9ce183ea9f "debian"
$10 = 0x7f9ce183eac1 "9.0"
$11 = "s110180", '\000' 
$12 = 0x7f9ce183eaba "debian 9.0"
Environment variable "TestName" not defined.
#0  0x7f9cdfd993f3 in select () at 
../sysdeps/unix/syscall-template.S:84
#1  0x7f9ce180b1ca in bnet_thread_server (addrs=, 
max_clients=201, client_wq=0x5644c1acba60 , 
handle_client_request=0x5644c188b5e0 ) 
at bnet_server.c:166
#2  0x5644c186aa84 in main (argc=, argv=out>) at stored.c:294


Thread 23 (Thread 0x7f9c86ffd700 (LWP 22176)):
#0  0x7f9ce15e5b3a in __waitpid (pid=pid@entry=22184, 
stat_loc=stat_loc@entry=0x7f9c86ffc0ac, options=options@entry=0) at 
../sysdeps/unix/sysv/linux/waitpid.c:29

#1  0x7f9ce1829f7e in signal_handler (sig=11) at signal.c:237
#2  
#3  new_tls_connection (ctx=0x0, fd=45) at tls.c:459
#4  0x7f9ce1809e4d in bnet_tls_server (ctx=, 
bsock=bsock@entry=0x5644c2adcc68, verify_list=verify_list@entry=0x0) at 
bnet.c:215
#5  0x5644c1878ae9 in authenticate_filed 
(jcr=jcr@entry=0x7f9cbc0008e8, fd=fd@entry=0x5644c2adcc68, FDVersion=0) 
at authenticate.c:197
#6  0x5644c188e2df in handle_client_connection 
(fd=fd@entry=0x5644c2adcc68) at hello.c:176
#7  0x5644c188b890 in handle_connection_request (arg=0x5644c2adcc68) 
at dircmd.c:170
#8  0x7f9ce1834d02 in workq_server (arg=0x5644c1acba60 ) 
at workq.c:326
#9  0x7f9ce15dc494 in start_thread (arg=0x7f9c86ffd700) at 
pthread_create.c:333
#10 0x7f9cdfda0aff in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:97


Thread 22 (Thread 0x7f9ca7fff700 (LWP 21945)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at 
../sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x7f9ce1828436 in rwl_writelock_p (rwl=rwl@entry=0x5644c1acbf20 
, file=file@entry=0x5644c18bb047 "reserve.c", 
line=line@entry=287) at rwlock.c:231
#2  0x5644c189e75e in _lock_reservations 
(file=file@entry=0x5644c18bb047 "reserve.c", line=line@entry=287) at 
reserve.c:80
#3  0x5644c18a1656 in use_device_cmd (jcr=) at 
reserve.c:287

#4  use_cmd (jcr=) at reserve.c:165
#5  0x5644c188ba4f in handle_connection_request (arg=0x5644c2ade638) 
at dircmd.c:226
#6  0x7f9ce1834d02 in workq_server (arg=0x5644c1acba60 ) 
at workq.c:326
#7  0x7f9ce15dc494 in start_thread (arg=0x7f9ca7fff700) at 
pthread_create.c:333
#8  0x7f9cdfda0aff in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:97


Thread 21 (Thread 0x7f9cc77fe700 (LWP 21937)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at 
../sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x7f9ce1828436 in rwl_writelock_p (rwl=rwl@entry=0x5644c1acbf20 
, file=file@entry=0x5644c18bb047 "reserve.c", 
line=line@entry=287) at rwlock.c:231
#2  0x5644c189e75e in _lock_reservations 
(file=file@entry=0x5644c18bb047 "reserve.c", line=line@entry=287) at 
reserve.c:80
#3  0x5644c18a1656 in use_device_cmd (jcr=) at 
reserve.c:287

#4  use_cmd (jcr=) at reserve.c:165
#5  0x5644c188ba4f in handle_connection_request (arg=0x5644c2ad6638) 
at dircmd.c:226
#6  0x7f9ce1834d02 in workq_server (arg=0x5644c1acba60 ) 
at workq.c:326
#7  0x7f9ce15dc494 in start_thread (arg=0x7f9cc77fe700) at 
pthread_create.c:333
#8  0x7f9cdfda0aff in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:97


Thread 20 (Thread 0x7f9ca67fc700 (LWP 21895)):
#0  0x7f9ce15e57dd in nanosleep () at 
../sysdeps/unix/syscall-template.S:84
#1  0x7f9ce1807597 in bmicrosleep (sec=sec@entry=5, 
usec=usec@entry=0) at bsys.c:178
#2  0x5644c188b874 in handle_connection_request (arg=0x5644c2a677d8) 
at dircm