Re: [Bacula-users] advice about tape drives

2024-04-22 Thread Sebastian Suchanek

Am 22.04.2024 um 16:58 schrieb Alan Polinsky:

[...]
I need to understand the backward capabilities of more recent drives.


As a rule of thumb, LTO drives can write to one previous generation of 
tapes and read from two previous generations of tapes. (There are some 
exceptions for LTO8 and LTO9.)



How high could I go with LTO based
machines while still maintaining the ability to read (and hopefully
write) those old LTO2 tapes?


LTO2 tapes can be read by LTO2, LTO3 and LTO4 drives and written by LTO2 
and LTO3 drives.



HTH,

Sebastian



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Addendum: Re: Backup Catalog

2022-10-19 Thread Sebastian Neumeier
Gary was faster than me. Sorry.   Sebastian 

Am 19-Oct-2022 12:34:45 +0200 schrieb g...@mcleod-schmidt.id.au: 
On 19/10/2022 21:07, Gina Costa wrote:
> Hi.
> 
> I'm using bacula 11, that has a default job "Backup Catalog" to make 
> backup of Bacula Catalog (database).
> When I run the job I get the following message:
> 
> shell command: run BeforeJob "/opt/bacula/scripts/make_catalog_backup.pl 
> MyCatalog"
> BeforeJob: sh: 1: cannot create /opt/bacula/working/bacula.sql: Permission 
> denied
> 
> 
> The directory /opt/bacula/scripts/ is configured with this privileges:
> 
> drwxrwxrwx 3 bacula www-data 4096 Oct 19 11:02 working
> 
> Anyone can help me
> 
Note the subtle difference:
/opt/bacula/working
versus:
/opt/bacula/scripts

Cheers,
Gary B-)

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users 

-
FreeMail powered by mail.de - MEHR SICHERHEIT, SERIOSITÄT UND KOMFORT
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Backup Catalog

2022-10-19 Thread Sebastian Neumeier
Hi Gina :) I didn't test it wether it might be the problem. But can it be that 
you mistaken the paths?   The error says: "cannot create 
/opt/BACULA/WORKING/bacula.sql". You wrote that you gave all users privilleges 
to "/opt/BACULA/SCRIPTS/". That is a different directory.   I'm no cyber 
security expert but as far what I read, giving all users privileges to a really 
important file is a bad idea. If I remember correctly giving that directory to 
the bacula user and giving privleges to the bacula user should be sufficient.   
If you can trust all users in the "www-data" group I would at least remove the 
write privilege of "others". It should look like this: rwxrwxr-x.   Like I 
said, I'm NOT a trained system adminstrator. Giving read and execute 
permissions to "others" and the "www-data" group also might be a bad idea in 
that case, so please take the advice with a huge grain of salt. (I'm a 
mechanical engineering/computational science and engineering studend running 
bacula for my home system and documents).   Best regards   Sebastian  

Am 19-Oct-2022 12:17:57 +0200 schrieb gina.co...@uc.pt: 
Hi.   I'm using bacula 11, that has a default job "Backup Catalog" to make 
backup of Bacula Catalog (database). When I run the job I get the following 
message:

shell command: run BeforeJob "/opt/bacula/scripts/make_catalog_backup.pl 
MyCatalog" BeforeJob: sh: 1: cannot create /opt/bacula/working/bacula.sql: 
Permission denied 

The directory /opt/bacula/scripts/ is configured with this privileges: 

 drwxrwxrwx 3 bacula www-data 4096 Oct 19 11:02 working 

Anyone can help me 

Thanks   Gina Costa

 Universidade de Coimbra * Administrao
SGSIIC-Servio de Gesto de Sistemas e Infraestruturas de Informao e Comunicao
Diviso de Infraestruturas de TIC
Rua do Arco da Traio | 3000-056 COIMBRA * PORTUGAL 
Tel.: +351 239 242 870 
E-mail: gina.co...@uc.pt
www.uc.pt/administracao

 Este e-mail pretende ser amigo do ambiente. Pondere antes de o imprimir! 
This e-mail is environment friendly. Please think twice before printing it!

-
FreeMail powered by mail.de - MEHR SICHERHEIT, SERIOSITÄT UND KOMFORT
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] I am missing Debs for Buster 32 bit (for Raspberry Pi machines running RaspiOS)

2022-08-26 Thread Sebastian Suchanek

Am 26.08.2022 um 14:19 schrieb Justin Case:
You mean the script will also work on RaspiOS 32 bit? (note: Raspbian != 
RasiOS)

[...]


To be honest, I've never heard of a system called "RaspiOS" exactly, but 
"Raspberry Pi OS" is definetly just a rename of what was formerly called 
"Raspbian" - as it also stated on the Raspberry homepage:


   https://www.raspberrypi.com/software/

Concerning your original question: Unfortunately, I don't run a 
Raspberry Pi on Buster, but I do run three of them under Raspberry Pi OS 
(a.k.a. Raspbian) Stretch and one under Bullseye. For both versions, 
Bacula came in the original Raspbian repository. (Bacula 7.4.4 on 
Stretch and Bacula 9.6.7 on Bullseye.) I've set up Bacula FDs on all of 
my RasPis from the respective Raspbian repository and they all work well.


Assuming that "RaspiOS" indeed is something different then "Raspberry Pi 
OS"/"Raspbian" - have you already checked the corresponding repository 
for Bacula?



HTH,

Sebastian


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula wiki down

2022-08-14 Thread Sebastian Neumeier
Hello th3penguinwhisperer, I don't keep track of the mailing list of bacula on 
a regular basis since I have a lot of work with university and my job, but 
there was a lot of traffic the last eight weeks or so.   I checked the 
bacula.org blog section for you and found a entry of the Bacula Release 13.0.1 
from the 5th of August 2022 (https://www.bacula.org/bacula-release-13-0-1/ ). I 
think bacula is alive.   You can head to the Manuals Page 
(https://www.bacula.org/documentation/documentation/ ) and have a look at the 
documentation. Maybe that helps to solve your problem. The html pages are up 
and running for me (germany). I suggest to write down the informations and save 
the sites/documentations you used to do your setup. At my job at the university 
we are exhorted(I already did it before) to do this and save the 
sites/documentations as html/pdfs, archive them with these informations and 
backup all files to be able to "jump back in time" in case links go dead or 
companies cease support of old software/hardware.   If you need enterprise 
support you can head to 
(https://www.baculasystems.com/corporate-data-backup-software-solutions/bacula-enterprise-data-backup-software/
 ).   If there should be a spot in the documentation you need a lot of 
additional sources to wrap your head around that means that the documentation 
most propably can be improved on that spot. Since bacula is open source 
software you can contribute your solution to the project. For a introduction on 
making contributions please head to 
(https://www.bacula.org/what-is-bacula/making-contributions/ ).   I don't know 
if the wiki got abandoned but bacula is alive. The date of the last version of 
the Main Reference Documentation is from the 4th of July 2022.   I hope that 
helps   Your's sincerely Sebastian 

Am 14-Aug-2022 19:41:57 +0200 schrieb th3penguinwhispe...@gmail.com: 
 Anyone or is this also a dead project? 
  On Sat, 23 Jul 2022 at 14:55, PenguinWhispererThe  wrote: 
  Hi,   I used to have an article linked here: 
https://wiki.bacula.org/doku.php?id=sshtunnel   However it seems the 
wiki.bacula.org domain is no longer working. Will it come back?   Thanks in 
advance. 

-
FreeMail powered by mail.de - MEHR SICHERHEIT, SERIOSITÄT UND KOMFORT
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Community binary registration leads to 404 page

2022-06-08 Thread Sebastian Elisa Pfeifer

Dear all,

I have a problem similar to the one Dirk had some days ago.

If I register at the deb and rpm download page 
(https://www.bacula.org/bacula-binary-package-download/), I receive the 
link in the Email as promised (code ends with ...8e). If I click the 
link I end up at a 404 page.
I tried to register again with two different Email accounts today and 
yesterday but received the same code that still causes a 404.


Am I doing something wrong or is there a problem with the page?

Greetings,
Sebastian Elisa

--
Sebastian Elisa Pfeifer

0 1 0
0 0 1
1 1 1

PGP Key ID:2D4C 0A7D F5F4 245E

https://sebastian-elisa-pfeifer.eu

Phone (DE):+49 221 596 19 4570
Phone (AT):  +43 681 1063 8878
Fax:  +43 1 22 600 45 - 10


OpenPGP_signature
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] How are "new" files determined?

2021-12-30 Thread Sebastian Suchanek
Hi everyone!

How exactly are "new" files, which have to be backed up, determined by
Bacula?

The reason for asking: Recently, I migrated my main data to a new set of
hard drives. I did so by using "rsync -aH" which *should* leave all file
timestamps etc. untouched. After the migration was finished, also all
paths etc. were exactly the same as before, just with a new set of HDDs
"underneath". However, in the next scheduled Bacula run (which was
scheduled as Incremental), Bacula stared to backup *everything* of the
abovementioned data.
(I cancelled the job and will resume doing backups on this particular
fileset with next regular Full backup which is scheduled for the
upcoming Sunday anyway.)

So - what went wrong here and how could this have been avoided?


Regards

Sebastian


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Problem with missing EOD/EOF on LTO-5 Tape

2021-02-26 Thread Sebastian Suchanek
Am 23.02.2021 um 15:11 schrieb Christian Lehmann:

> I have a problem with a single LTO-5 Tape drive (Tandberg LTO-5 HH).
> 
> I do backups spanning multiple Tapes, changing them manually.
> 
> So I configured the storage daemon that it is automatically pushing out
> the tape as soon as it is full.
> 
> So my users (and me) can see this and load a new/the next tape. Than
> bacula automatically mounts it and continue with the backup. This works
> fine.
> 
> But problems arise as soon as I have a tape, which is not full and I
> want to unload it (for example to label a new tape or to restart bacula
> or the server). If I just restart tape is pushed out as soon as bacula
> is shutting down or during the restart (it is also rewinded as
> expected). The same happens, if I "unmount" the tape using bconsole.
> [...]

At home, I'm running a tape library with LTO tapes for Bacula to do
backups on. But since I want to limit the noise and energy consumption
of the library, I only power on the library when backups are due and
shut it down again after the backups. I have this done automatically
with a few little scripts and a power switch which can be controlled via
TCP/IP. At first I ran into a lot of problems when tapes remained in the
LTO drives at shutdown until I figured out to use the "release" command
in bconsole console prior to shutdown. "unmount" also caused some
unexpected problems.

Long story short: have also tried the "release" command instead of the
"unmount" command?


Regards

Sebastian


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Backup of Windows clients - best practices?

2021-02-21 Thread Sebastian Suchanek
Hi all!

So far, I'm using Bacula to back up various Linux clients and it works
great. Now, I would like to add another client to be backup which is
running under Windows 10 Pro 64bit.

I already went through the "Windows" chapter of the Bacula main manual,
but this seems to be focusing more on older versions of Windows. The
main thing I took away from that was that it might be good idea to use
"Enable VSS = yes" in the fileset definition.

Aside from that - are there any best practices that I should follow when
backing up Windows clients? E.g. which paths should be included and
which should be excluded in the fileset(s)?
Or is it maybe a better idea to first create a system image with
Window's built-in image functionality and then back up the resulting
image file(s) via Bacula?
Any comments are appreciated.


Best regards

Sebastian


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] sqlite to postgres|maridb migration -- how to confirm success?

2020-12-23 Thread Sebastian Suchanek
Am 23.12.2020 um 05:21 schrieb Gary R. Schmidt:

> [...]
> I would suggest moving to PostgreSQL rather than MariaDB.
> 
> PostgreSQL is fully supported by Bacula, MariaDB has thrown up a few 
> nasties where is is not quite the same as MySQL, and those will probably 
> increase.
> [...]

Just out of curiosity: what "nasties" would that be? I'm running MariaDB
as a replacement for MySQL for some years now (both for Bacula and for
my own projects) and haven't had any issues so far.


Best regards

Sebastian


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Tape issue: less size than before for LTO-4 tapes

2020-03-13 Thread Sebastian Suchanek
Am 10.03.2020 um 09:26 schrieb Pierre Bernhardt:

> since beginning of this year a tape issue has been arrived my backups.
> All my LTO-4 Tapes will not fill any more to the ~ 760 GiByte than
> before. Only ~ 510-580 GiByte will be stored on the tapes which is
> shown by the list volume command.

Looks like a worn-out drive to me.


Best regards

Sebastian


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Why did Bacula not reuse an Error tape?

2019-06-03 Thread Sebastian Suchanek
Am 03.06.2019 um 12:15 schrieb Ian Douglas:
> On Monday, 03 June 2019 11:44:34 SAST Tilman Schmidt wrote:
> 
>> It's by design. The "Error" state for a tape means it's defective and should
>> not be used anymore. If you want Bacula to use it again (and i you are sure
>> what you are doing) you have to change its state manually from "Error" to
>> something else, eg. "Used".
> 
> So noted, thanks. 
> 
> I'm sure the tape is fine, the problem is that when we have power outages 
> during a backup my network goes down and then Bacula gets confused. 
> 
> I have UPS on bacula-dir machine and tape drive controller and tape drive, 
> just one LAN switch that still needs to be connected to a UPS... and that's 
> causing the problems.

Shouldn't such an "incident" cause a *job* error instead of Bacula
marking the *tape* as faulty?


Best regards

Sebastian



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Problems with LTO5 drive

2019-04-07 Thread Sebastian Suchanek
Hi all!

Currently, I'm running a Bacula installation that writes backups to a
LTO4 drive. This is all running perfectly fine.

Recently, I bought a second-hand LTO5 drive to beef up my storage
capacity a bit. But when I wanted to test the "new" drive, I came across
a somewhat strange problem: When I run btape with the "test" command,
everything seems to work fine. But when I try to run the "fill" command,
btape seems to succeed to write the volume name, but crahes immediately
when it try write "payload" data with a segmentation faul 11.
I'll attach the btraceback data below, but that's all greek to me.
Any idea what is going wrong here?


Best regards

Sebastian

-

/root/btape: No such file or directory.
[New LWP 24284]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
0x7fc1785b0b5a in __waitpid (pid=24397, stat_loc=0x7ffd9aef8b6c,
options=0) at ../sysdeps/unix/sysv/linux/waitpid.c:29
29  ../sysdeps/unix/sysv/linux/waitpid.c: No such file or directory.
$1 = 1093482288
$2 = 1885434978
$3 = 470585720
$4 = 470585784
$5 = 0
$6 = 0
$7 = 2021694149
$8 = 2021694118
$9 = 2021694111
$10 = 2021694145
$11 = 1701276020
$12 = 2021694138
Environment variable "TestName" not defined.
#0  0x7fc1785b0b5a in __waitpid (pid=24397, stat_loc=0x7ffd9aef8b6c,
options=0) at ../sysdeps/unix/sysv/linux/waitpid.c:29
#1  0x7fc1787f4f7e in signal_handler () from
/usr/lib/bacula/libbac-7.4.4.so
#2  
#3  0x55f81bdc7456 in ?? ()
#4  0x55f81bdbf759 in ?? ()
#5  0x7fc1770b12e1 in __libc_start_main (main=0x55f81bdbf1f0,
argc=4, argv=0x7ffd9aef9e88, init=, fini=,
rtld_fini=, stack_end=0x7ffd9aef9e78) at
../csu/libc-start.c:291
#6  0x55f81bdbfa3a in ?? ()

Thread 2 (Thread 0x7fc17684e700 (LWP 24284)):
#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at
../sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:225
#1  0x7fc1787ff361 in watchdog_thread () from
/usr/lib/bacula/libbac-7.4.4.so
#2  0x7fc1785a74a4 in start_thread (arg=0x7fc17684e700) at
pthread_create.c:456
#3  0x7fc177179d0f in clone () at
../sysdeps/unix/sysv/linux/x86_64/clone.S:97

Thread 1 (Thread 0x7fc178e37040 (LWP 24282)):
#0  0x7fc1785b0b5a in __waitpid (pid=24397, stat_loc=0x7ffd9aef8b6c,
options=0) at ../sysdeps/unix/sysv/linux/waitpid.c:29
#1  0x7fc1787f4f7e in signal_handler () from
/usr/lib/bacula/libbac-7.4.4.so
#2  
#3  0x55f81bdc7456 in ?? ()
#4  0x55f81bdbf759 in ?? ()
#5  0x7fc1770b12e1 in __libc_start_main (main=0x55f81bdbf1f0,
argc=4, argv=0x7ffd9aef9e88, init=, fini=,
rtld_fini=, stack_end=0x7ffd9aef9e78) at
../csu/libc-start.c:291
#6  0x55f81bdbfa3a in ?? ()
#0  0x7fc1785b0b5a in __waitpid (pid=24397, stat_loc=0x7ffd9aef8b6c,
options=0) at ../sysdeps/unix/sysv/linux/waitpid.c:29
29  in ../sysdeps/unix/sysv/linux/waitpid.c
resultvar = 18446744073709551104
sc_cancel_oldtype = 0
#1  0x7fc1787f4f7e in signal_handler () from
/usr/lib/bacula/libbac-7.4.4.so
No symbol table info available.
#2  
No locals.
#3  0x55f81bdc7456 in ?? ()
No symbol table info available.
#4  0x55f81bdbf759 in ?? ()
No symbol table info available.
#5  0x7fc1770b12e1 in __libc_start_main (main=0x55f81bdbf1f0,
argc=4, argv=0x7ffd9aef9e88, init=, fini=,
rtld_fini=, stack_end=0x7ffd9aef9e78) at
../csu/libc-start.c:291
291 ../csu/libc-start.c: No such file or directory.
result = 
unwind_buf = {cancel_jmp_buf = {{jmp_buf = {0, -8885532658628884604,
94524107651600, 140727202848384, 0, 0, -3406061076198258812,
-3403904697575602300}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0,
0x7ffd9aef9eb0, 0x7fc178e4d170}, data = {prev = 0x0, cleanup = 0x0,
canceltype = -1695572304}}}
not_first_call = 
#6  0x55f81bdbfa3a in ?? ()
No symbol table info available.
#0  0x in ?? ()
No symbol table info available.


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] MySQL files filling up the disk

2019-03-02 Thread Sebastian Suchanek
Am 02.03.2019 um 19:35 schrieb Shawn Rappaport:

> I'm running Bacula 9.06 on CentOS 7.5 with MariaDB version 5.5.56-2.
> The Bacula-web interface shows the DB is 69.10GB in size. However, the
> MySQL files on my server are consuming 442GB of disk space, which is
> starting to fill up the disk on my Director server. I see 374 mysql-bin
> files which are almost all 1.1GB in size.

Sounds like binary logfiles. Check, if binary logging is enabled in
MariaDB. You can limit the total size of binary logfiles or you can turn
it off altogether if you don't need it.

https://mariadb.com/kb/en/library/binary-log/

> I also see an ibdata1 file which is 73GB.

That's the actual database.

> Do I need to perform some sort of maintenance on the DB to get things under 
> control?

IMHO, a "OPTIMIZE TABLE" statement every now and then, especially for
the Bacula tables "Filename" and "FileSet" shouldn't hurt but shouldn't
be really required either.


HTH,

Sebastian



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Long pause with no logging or any activity at all

2019-02-16 Thread Sebastian Suchanek
Am 15.02.2019 um 16:10 schrieb William Muriithi:
>> have you tried the "stat client" command? If you run it a few times you 
>> should be able to spot if there's still data transfer activity.
> 
> Daemon started 12-Feb-19 11:53. Jobs: run=4 running=0.
>  Heap: heap=135,168 smbytes=586,060 max_bytes=639,633 bufs=465 max_bufs=515
>  Sizeof: boffset_t=8 size_t=8 debug=0 trace=0 
> Running Jobs:
> JobId 7 Job BackupClient2.2019-02-12_16.08.21_03 is running.
> Full Backup Job started: 12-Feb-19 16:08
> Files=14,795,540 Bytes=3,362,575,559,435 Bytes/sec=14,178,390 Errors=0
> Files Examined=14,795,541
> Processing file: 
> /export/eng/deuterium.eng.example.com/eng/tools/synopsys/pa-vrtzr/F-2011.06-SP1/SLS/linux/InnoGUI/wine/localdotwine/dosdevices/z:/export/eng/projects/cad_admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/tools/rhel5/subversion-1.6.18/subversion/libsvn_subr/.libs/libsvn_subr-1.so.0.0.0

That path looks a bit unsual, to say the least. Are you sure the
filesystem on the machine running the filedaemon isn't broken?

> [...] 
> Terminated Jobs:
>  JobId  LevelFiles  Bytes   Status   FinishedName 
> ==
>180  Full  0 0   Error11-Feb-19 13:53 BackupCatalog
>  3  Full  0 0   OK   12-Feb-19 14:09 BackupCatalog
>  4  Full 102.281 M  Error12-Feb-19 15:08 BackupClient1
>  5  Full  0 0   OK   12-Feb-19 15:10 BackupCatalog
>  6  Full  0 0   OK   12-Feb-19 15:58 BackupClient2
> 
> 
> That has been the status since yesterday
> 
> Strace is also silent, look as below since last night but one:
> [...]

Does the output of "messages" in the bacula console give any useful
information?


Best regards

Sebastian



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula-Web 8.2.0 released

2019-01-12 Thread Sebastian Suchanek
Am 07.01.2019 um 12:19 schrieb Davide Franco:
> Dear all,
> 
> I'm pleased to inform you that Bacula-Web 8.2.0 is available from now.
> 
> This version Include 2 new features and 7 bug fixes 
> 
> The release notes is available here 
> https://www.bacula-web.org/2019/01/06/bacula-web-8-2-0/
> [...]

Just as a very quick feedback: I just made the upgrade and all seems to
work well so far.


Best regards

Sebastian



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] mtx and mtx-changer not functioning

2019-01-12 Thread Sebastian Suchanek
Am 11.01.2019 um 23:13 schrieb Jeffrey R. Lang:
> In your mtx command output one thing I don't see is the Data Transfer Unit 
> (i.e. tape drive) associated with the tape library.
> [...]

Have a second look, there is a "Data Transfer Element" line in Richard's
output. It seems as if your mail client wrapped the line a bit strangely...


Best regards

Sebastian



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] mtx and mtx-changer not functioning

2019-01-11 Thread Sebastian Suchanek
Am 11.01.2019 um 14:49 schrieb Richard Couture:

>> Does mtx work when you explicitly specify the slots? I.e.:
>>
>> mtx -f /dev/sg3 load 1 0
>> mtx -f /dev/sg3 unload 1 0
>
> No

Then, in my opinion, the problem is somewhere outside of Bacula.
My best guess is that either your library and your version of mtx are
incompatible or your library is broken (e.g. faulty firmware).


Best regards

Sebastian



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] mtx and mtx-changer not functioning

2019-01-10 Thread Sebastian Suchanek
Am 11.01.2019 um 02:05 schrieb Richard Couture:

> [...]
> [root@LTOMag scripts]# mtx -f /dev/sg3 unload
> Unloading drive 0 into Storage Element 1...mtx: Request Sense: Long 
> Report=yes
> mtx: Request Sense: Valid Residual=no
> mtx: Request Sense: Error Code=70 (Current)
> mtx: Request Sense: Sense Key=Illegal Request
> mtx: Request Sense: FileMark=no
> mtx: Request Sense: EOM=no
> mtx: Request Sense: ILI=no
> mtx: Request Sense: Additional Sense Code = 53
> mtx: Request Sense: Additional Sense Qualifier = 01
> mtx: Request Sense: Field in Error = 00
> mtx: Request Sense: BPV=no
> mtx: Request Sense: Error in CDB=no
> mtx: Request Sense: SKSV=yes
> mtx: Request Sense: Field Pointer = 00 00
> MOVE MEDIUM from Element Address 256 to 4096 Failed
> [root@LTOMag scripts]#
> [...]

Does mtx work when you explicitly specify the slots? I.e.:

mtx -f /dev/sg3 load 1 0
mtx -f /dev/sg3 unload 1 0


Best regards

Sebastian



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] "ERR=database or disk is full" while building directory tree for restore

2018-12-27 Thread Sebastian Suchanek
Am 27.12.2018 um 08:32 schrieb Adam Nielsen:

> [...]
> MariaDB has already replaced MySQL in most Linux distributions, at
> least those aimed at the desktop.  There have been very few
> compatibility problems.  I am currently running Bacula with MariaDB on
> the Arch Linux distribution and haven't encountered any issues so far,
> but then my backups are only home-user sized.

Full-ACK. (Although I'm running Bacula and MariaDB on Debian, not on Arch.)
For reference: my Bacula database in MariaDB is currently ~1.5GB in
size, with ~6.5 mio. entries in the "File" table.

> As long as Bacula sticks
> to the common feature set and doesn't use any of the new
> Oracle-MySQL-specific features then it will probably continue to work
> just fine with both MySQL and MariaDB for some time yet, with no special
> maintenance effort.
> [...]

Yes, I'd assume that too.


Best regards

Sebastian



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Tape shoe-shining with spooling enabled - why?

2018-12-22 Thread Sebastian Suchanek
Am 22.12.2018 um 01:46 schrieb Adam Nielsen:

> I've been using Bacula for a number of years but recently got hold of
> an old tape autochanger with an LTO-4 drive, which I would like to use
> to have Bacula write to tape instead of my previous disk/file config.
> 
> I think I have everything set up, all the tapes are labelled and Bacula
> switches tapes when each one fills up, however after the first tape
> started writing at 80MB/sec, the rest of them only write at 60-65MB/sec.
> [...]

Are you sure that both the drive and the tapes are still in a decent
shape, not being worn-out? Have you tested the drive with btape? If yes,
what was the result?


Best regards

Sebastian


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Volume status "Used" vs. "Full"

2018-11-18 Thread Sebastian Suchanek
Hi everyone!

In my Bacula installation (v7.4.4, Debian), I have a certain Full backup
job that is configured to go to a pool of tapes. One run of this backup
job currently spans abot 2.5 tapes. In order to make handling of the
tapes a bit more easier (I'm taking them to an off-site storage and will
re-use them after a few months), I would like to have the last,
half-used tape of a job run not to be used for the beginning of the
subsequent job run. Therefore, I configured "Maximum Volume Jobs = 1"
for this pool.
In principle, this works as itended, but there's one thing that
irritates me: The first two tapes being used in a job run are not marked
as "Full" in the Bacula catalog (as I would've expected since they are
actually full), but as "Used".
Is this a bug or a feature? How can I configure that last half-used
volume from a job run isn't reused for the subsequent job run and at the
same time having actually full volumes marked as "Full"?


TIA,

Sebastian


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula-Web 8.1.0 release

2018-11-11 Thread Sebastian Suchanek
Am 11.11.2018 um 20:16 schrieb Maciolek, Mark:

Hi!

> These are my permissions for application.db
> 
> /var/www/html/bacula-web/application/assets/protected$ ls -al
> total 16
> drwxr-xr-- 2 www-data www-data 4096 Nov 10 04:22 .
> drwxr-xr-x 6 root root 4096 Nov 10 02:06 ..
> -rw-r- 1 www-data www-data 4096 Nov 10 04:22 application.db
> -rw-r--r-- 1 www-data root   98 Nov 10 02:06 .htaccess

It's pretty much the same on my installation:

| # ls -la
| total 24
| drwxrwxr-x 2 www-data www-data  4096 Nov 11 19:05 .
| drwxr-xr-x 6 www-data www-data  4096 Nov 10 08:06 ..
| -rw-r--r-- 1 www-data www-data 12288 Nov 11 19:05 application.db
| -rwxr-xr-x 1 www-data www-data98 Nov 10 08:06 .htaccess
| #

Just an additional read permission for everyone, but that shouldn't make
a difference with regard to this error.


> I still get the error
> Problem: Bad ownership / permissions for protected assets folder 
> (application/assets/protected)
> 
> 
> So what should they be?

What's your output of "ps aux | grep apache"?


Best regards

Sebastian



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula-Web 8.1.0 release

2018-11-11 Thread Sebastian Suchanek
Am 10.11.2018 um 11:41 schrieb Chris Wilkinson:

> I had trouble with the curl -o command but got it with wget instead.
> CURL just downloaded ~370 bytes.

Yes, me too. I guess it's because the manual states a HTTP address which
the server redirects to a HTTPS address which can't be handled by curl.

Also I've noticed some glitches in the upgrade manual at
http://docs.bacula-web.org/en/v8.1.0/02_install/upgrade.html#install-upgrade

- There are some typos around the "application" part in path names,
  e.g. "appication" and "appilcation". (Of course it's obvious when you
  read it and type in the command manually, but a pitfall when you try
  to copy and paste the commands.

- The upgrade manual doesn't mention to set the file ownership of
  /application/assets/protected/application.db back to the
  webserver user after restoring it from backup. If this isn't done,
  one get's an error message of bad file permissions.

Aside from this, the upgrade went smooth and also the new version itself
works fine - thanks!


Best regards

Sebastian



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Changing volume of running job?

2018-09-05 Thread Sebastian Suchanek
Am 05.09.2018 um 17:16 schrieb Martin Simmons:
>>>>>> On Tue, 4 Sep 2018 19:50:43 +0200, Sebastian Suchanek said:
>> 
>> [...]
>> The only thing that still puzzles me: When I just re-ran the aborted
>> job, Bacula didn't ask for a tape that isn't in the changer, but didn't
>> use the empty (and available) tape 1101 either. Instead, Bacula recycled
>> the full volume 1103. (For further details, please see the output of
>> "list media" in my previous e-mail.)
>> Any ideas why *that* happened?
> 
> It should prefer a volume with the Append status, so that is strange.  Is the
> Media.StorageID set correctly for tape 1101?

Yes, it should be.
When I added the volumes to the pool with "label barcode" commands,
something went wrong with some tapes (I can't remember what exactly), so
tape 1101 was skipped at first and added later. Therefore, the order of
the MediaID is not consistent with the order of the names of the volumes.


Best regards

Sebastian


--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Changing volume of running job?

2018-09-04 Thread Sebastian Suchanek
Am 04.09.2018 um 13:54 schrieb Martin Simmons:
>>>>>> On Mon, 3 Sep 2018 21:40:02 +0200, Sebastian Suchanek said:
>> Am 03.09.2018 um 21:15 schrieb Bill Arlofski:
>> > 
>> > [...]
>> > Bacula honors the "InChanger" field for volumes when choosing a volume.
>> > [...]
>> 
>> Well, that's the behaviour I would've expected - but Bacula didn't do so
>> in my case.
> 
> Does the Storage definition in your Director's bacula-dir.conf contain
> Autochanger = Yes?  The Director will ignore the InChanger field if this is
> missing, even if the bacula-sd has it configured as an autochanger.
> [...]

No, it wasn't. I added it and now it seems to work - thanks a lot!

The only thing that still puzzles me: When I just re-ran the aborted
job, Bacula didn't ask for a tape that isn't in the changer, but didn't
use the empty (and available) tape 1101 either. Instead, Bacula recycled
the full volume 1103. (For further details, please see the output of
"list media" in my previous e-mail.)
Any ideas why *that* happened?


Best regards

Sebastian


--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Changing volume of running job?

2018-09-03 Thread Sebastian Suchanek
Am 03.09.2018 um 21:15 schrieb Bill Arlofski:
> 
> Assuming this is a tape library with barcode reader, 

Yes, it is.

> you will need to let
> Bacula know which tapes are in the library:
> 
> * update slots storage= drive=
> 
> Bacula honors the "InChanger" field for volumes when choosing a volume.
> [...]

Well, that's the behaviour I would've expected - but Bacula didn't do so
in my case.

For better readability, here's the status of the pool with correct
linebreaks:

   https://suchanek.de/temp/listmedia.txt

As you can see, volume 1101 is empty and in the changer, while Bacula
asked for 1105, which is not in the changer (and also marked as such in
Bacula's catalog).


Best regards

Sebastian


--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Changing volume of running job?

2018-09-03 Thread Sebastian Suchanek
Am 03.09.2018 um 19:54 schrieb Tilman Schmidt:
> Am 03.09.2018 um 16:52 schrieb Sebastian Suchanek:
>> Hi everyone,
>> 
>> last night I encountered the following situation: a scheduled backup
>> started, using a certain backup pool (a set of tapes). From that pool,
>> Bacula (v7.4.4) selected an empty volume X, but since this was not in
>> the tapelibrary, Bacula kept asking for it. (Since I was ~250km away, I
>> couldn't do that.) However, another volume Y, which was also totally
>> empty, would have been available in the tapelibrary.
>> 
>> Basically, I have two question about this:
>> 1. Why does Bacula prefer an empty volume which is not available over
>>another empty volume that would have been available?
> 
> Because Bacula's idea of available is different from yours or mine. :-)
> To sort out the specifics you'd have to share the precise state of the
> volumes involved at the time, which is probably not available anymore.

The state is still available because I canceled the abovementioned job:

*list media pool=LTO11
Automatically selected Catalog: MyCatalog
Using Catalog "MyCatalog"
+-++---+-+-+--+--+-+--+---+---+-+---+
| MediaId | VolumeName | VolStatus | Enabled | VolBytes|
VolFiles | VolRetention | Recycle | Slot | InChanger | MediaType |
LastWritten | ExpiresIn |
+-++---+-+-+--+--+-+--+---+---+-+---+
|  14 | SU1102L1   | Full  |   1 | 106,528,859,136 |
55 |1,209,600 |   1 |   12 | 1 | LTO-1 | 2018-05-06
23:50:03 | 0 |
|  15 | SU1103L1   | Full  |   1 | 114,858,390,528 |
58 |1,209,600 |   1 |   13 | 1 | LTO-1 | 2018-08-05
21:31:25 | 0 |
|  16 | SU1104L1   | Full  |   1 | 109,644,788,736 |
54 |1,209,600 |   1 |   14 | 1 | LTO-1 | 2018-09-02
22:28:53 | 1,128,832 |
|  17 | SU1105L1   | Append|   1 |  64,512 |
0 |1,209,600 |   1 |0 | 0 | LTO-1 | -00-00
00:00:00 | NULL  |
|  18 | SU1101L1   | Append|   1 |  64,512 |
0 |1,209,600 |   1 |   11 | 1 | LTO-1 | -00-00
00:00:00 | NULL  |
|  19 | SU1106L1   | Append|   1 |  64,512 |
0 |1,209,600 |   1 |0 | 0 | LTO-1 | -00-00
00:00:00 | NULL  |
|  20 | SU1107L1   | Append|   1 |  64,512 |
0 |1,209,600 |   1 |0 | 0 | LTO-1 | -00-00
00:00:00 | NULL  |
|  21 | SU1108L1   | Append|   1 |  64,512 |
0 |1,209,600 |   1 |0 | 0 | LTO-1 | -00-00
00:00:00 | NULL  |
|  22 | SU1109L1   | Append|   1 |  64,512 |
0 |1,209,600 |   1 |0 | 0 | LTO-1 | -00-00
00:00:00 | NULL  |
|  23 | SU1110L1   | Append|   1 |  64,512 |
0 |1,209,600 |   1 |0 | 0 | LTO-1 | -00-00
00:00:00 | NULL  |
+-++---+-+-+--+--+-+--+---+---+-+---+
*

(Hopefully this works without broken linebreaks...)
The job in question actually started on volume "SU1104L1" and when that
volume had filled up, Bacula asked for "SU1105L1" instead of using
"SU1101L1".
Maybe that's because of the lower MediaId of SU1105L1 instead of SU1101L1?

>> 2. Is there any way to sort of re-direct an already running job to
>>another (available) volume?
> 
> What I do in similar situations is
> 
> 1. purge the volume I want Bacula to use
> 2. update the volume status of the volume I don't want Bacula to use to
> "Used".
> 
> Sometimes the process has to be repeated because Bacula would still
> recycle a different volume than the one I purged for it, but eventually,
> after re-setting all volumes to "Used" which Bacula chose, it will end
> up using the volume you want it to use.

How can I set a volume manually to "used" (and un-set it aftwards)?


Best regards

Sebastian


--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Changing volume of running job?

2018-09-03 Thread Sebastian Suchanek
Hi everyone,

last night I encountered the following situation: a scheduled backup
started, using a certain backup pool (a set of tapes). From that pool,
Bacula (v7.4.4) selected an empty volume X, but since this was not in
the tapelibrary, Bacula kept asking for it. (Since I was ~250km away, I
couldn't do that.) However, another volume Y, which was also totally
empty, would have been available in the tapelibrary.

Basically, I have two question about this:
1. Why does Bacula prefer an empty volume which is not available over
   another empty volume that would have been available?
2. Is there any way to sort of re-direct an already running job to
   another (available) volume?


Best regards

Sebastian

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula-Web 8.0.1 released

2018-07-03 Thread Sebastian Suchanek
Am 22.06.2018 um 17:45 schrieb bacula-...@dflc.ch:

Hi Davide!

> I'm pleased to inform you that Bacula-Web 8.0.1 is available now.

First of all, thank you for Bacula-Web and all the efforts you're
putting into it, I've been using it for some months now (v7.4.0) and I
like it a lot.
Recently, I upgraded to v8 - since the download of v8.0.1 was broken at
that time (it seems to fine again now), my following comments actually
refer to v8.0.0.

1. I couldn't find any hint in documentation on the default login
credentials after a fresh install or upgrade from an older version
without access control. Is that information really missing or have I
been too clumsy to find it? (I've managed to add my own credentials
directly to the sqlite database, though, so the problem is solved for me.)

2. My server is currently configured to show PHP deprecated warnings and
when I visit the Bacula login page, I'm getting the following warnings:

| Deprecated: Methods with the same name as their class will not be
| constructors in a future version of PHP; Smarty has a deprecated
| constructor in
/bacula-web/vendor/smarty/smarty/libs/Smarty.class.php on line 64
|
| Deprecated: Methods with the same name as their class will not be
| constructors in a future version of PHP; Smarty_Compiler has a
| deprecated constructor in
/bacula-web/vendor/smarty/smarty/libs/Smarty_Compiler.class.php on
line 35

Yes, I know it's just warnings and no errors, but from my personal
experience, if you don't fix it right now, you will be very suprised
when the "future PHP version" is released and put into production. ;-)

3. On the "general settings" page, I can't change any setting, all
options and input fields are inactive. Is this a problem with my
configuration (filesystem access rights maybe?) or is this page
currently just a dummy for future functionality in Bacula-web?

4. And, last but not least, a feature request: could you please
re-include the shortcuts that clicking on the pie charts for jobs and
pools takes you directly to the respective reports? I used these
shortcuts in v7.4.0 quite a lot...


Best regards

Sebastian

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Support bacula please help me

2018-05-09 Thread Sebastian Suchanek
Am 09.05.2018 um 09:30 schrieb Hang Vinh Nam:

> - Can you show me how to eliminate all backup error?

No, not really - sorry. But given the fact that your logs contain a lot
of "gethostbyname()" errors and "Error: Director's connection to SD for
this Job was lost." messages, my best guess is that your network is
misconfigured and/or seriously unstable.

> and how long should
> i set job retention for avoid hdd is full.

That's a question only you can answer, because it depends on several
factors that only you know:

- Total size of the data to be backed (determines the size of a Full
  backup job)
- Typical amount of data that changes per day/per week (determines the
  size of Incremental and Differential backup jobs)
- Space available on the device(s)/media that the backup jobs are
  stored to

> - How can i configure for bacula run full backup override last one. I
> set schedule backup run at first monday of month. And my desire, full
> backup on this month will override last month.

Having exactly on Full backup might be a bit tricky. I think, I would
try a configuration with a dedicated pool where the Full backups go to
which contains only a single volume and having set "Maximum Volume Jobs"
to 1.

But then, on the other hand, I would reconsider having only a single
Full backup job generation. Because in this configuration, your old Full
backup data is deleted at the very beginning of a new Full backup job.
This means that during the time between starting the next Full backup
job and successfully(!) completing it, you're left with no consistent
Full backup data at all. IMHO, this is Murphy's Law waiting to strike.


Regards

Sebastian


--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Autochanger not changing

2018-05-08 Thread Sebastian Suchanek
Am 08.04.2018 um 21:08 schrieb Sebastian Suchanek:

> [...]
> This makes me wonder if the problem is maybe caused by the LTO4 drive
> itself. But what I didn't mention so far: during my various trial runs
> around this problem, I also replaced the LTO4 drive with another one.
> (AFAIR both of them were the same Seagate model, though...)

JFTR: Finally, also the LTO4 drive works as expected. (Tested in the
meantime by two "live" backup jobs with ~2TB each.) The realy
funny/strange thing is: I only changed the Maximum block size from "1MB"
to "1048576" and reduced the Maximum file size from "40GB" to "10737418240".
Anyway - as long as it works, I don't care too much about the details. ;-)


Regards,

Sebastian

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Support bacula please help me

2018-05-08 Thread Sebastian Suchanek
Am 08.05.2018 um 09:26 schrieb Hang Vinh Nam:

> - I see compression job, but i don't understand why backup file on hdd
> is lager data on client as you see attach file.

Because, looking at the mailbox content you posted previously, Bacula
tried to write at least three backup jobs to the file "ANG1205-19042018"
- likely even more. Bacula did so because you configured it to keep
every single backup job for at least six month. (Can be seen in the
config screenshot you attached to your first message.)

As a sidenote, may I suggest that you try to track down and eliminate
all the errors you're getting in your backup jobs? It seems as up to
now, not a single Full backup was done successfully from that particular
client, so Bacula will try over and over again to do a Full backup -
which of course uses a lot of space in your backup storage.


HTH,

Sebastian

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Autochanger not changing

2018-04-13 Thread Sebastian Suchanek
Am 09.04.2018 um 17:46 schrieb Kern Sibbald:

Hi Kern!

> The output from lsscsi looks odd.  From what I see, I am not reassured 
> that both the tape drives are actually part one at a time and see if 
> physically the right tapes are mounted.

I'm afraid, I didn't fully understand what you meant to say here. But I
assume, you are wondering why the devices of the library are so
"distributed".
That I can explain at least partially: The reason is, that the way the
library is connected to the server is somewhat "unique".
The library is an Overland NEO2000 which, unlike most other libraries,
has a dedicated controller card with its own parallel SCSI connectors.
The LTO1 drive also has its own parallel SCSI connectors. The LTO4
drive, on the other hand, has a Fibre Channel connection. In order not
having to use two different host adapters (SCSI & FC), I installed a
FC-to-SCSI bridge in library. (An ATTO FibrBridge 2390C, relabled by
Overland.) On the server side, I'm using a dual channel FC controller
Emulex LPe 11002.
The LTO4 drive and the FibreBridge are connected directly to one of the
FC controller ports respectively.

Or, as a sketch:

-. .-
 Server  | | Library
 | +-.
 .---+  Fibre Channel  | |
 |   |=| LTO4 drive  |
 | FC HA | | |
 |   |==## +-'
 '---+  || |
 |  || +-.
-'  || | |
|| ,---+ LTO1 drive  |
|| |   | |
||SCSI |   +-'
|| |   |
|| |   +-.
|| '---+ |
|| | Controller  |
|| .---+ |
|| |   +-'
||SCSI |   |
|| |   +-.
|| '---+ |
|| | FibreBridge |
##=| |
  Fibre Channel+-'
   |
   '-

But I don't have the slightest clue why the kernel splits up the two
channels of the single FC controller into two non-consecutive controller
numbers (0 and 7). But this number asignment is persitent through system
reboots, though...

> [...]
> My experience on LTO-1 and LTO-4 drives is that 512K buffer sizes get 
> quite adequate performance so I am a bit skeptical about your need for 
> 1MB buffers, but that said, they should be OK.

Well, that's what I found out with some btape "speed" test runs:

https://hirnfasching.de/2018/02/19/geschwindigkeitsmessung-lto-4-laufwerk/

The blog post itself is in German - sorry for that - but the figures
should be understandable anyway.
OK, I have to admit "significantly" is a bit of an exaggeration when
comparing the 1MB values with the 512kB block size values, but 1MB does
result in a larger throughput after all.


Best regards

Sebastian


--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Autochanger not changing

2018-04-08 Thread Sebastian Suchanek
Am 07.04.2018 um 22:11 schrieb Dan Langille:
>> On Apr 1, 2018, at 11:12 AM, Sebastian Suchanek  wrote:
>> 
>> [...]
>> Any idea what exactly is going wrong here? What can I do to track down
>> the reason for this error? What can I do to fix it?
> 
> It is usually permissions. It it nearly always permission.

I agree - during my years of dealing with Linux, I've come across many
problems that were caused by permission issues of some sort.

> This might be your best bet: 
> https://dan.langille.org/2016/02/04/dell-tl4000-tape-library-running-btape-and-configuring-baculas-mtx-changer/
> [...]

I repeated almost all tests you described in your blog post (of course
adapted to my system):

- 8< -

bacula@tigersclaw:~$ lsscsi -g
[0:0:1:0]tapeHP   Ultrium 4-SCSI   H63H  /dev/st0   /dev/sg3
[1:0:0:0]diskATA  Samsung SSD 850  2B6Q  /dev/sda   /dev/sg0
[2:0:0:0]diskATA  WDC WD40EFRX-68W 0A82  /dev/sdb   /dev/sg1
[3:0:0:0]diskATA  WDC WD40EFRX-68W 0A82  /dev/sdc   /dev/sg2
[7:0:0:0]mediumx OVERLAND NEO Series   0616  /dev/sch0  /dev/sg4
[7:0:0:1]tapeSEAGATE  ULTRIUM06242-XXX 1603  /dev/st1   /dev/sg5

bacula@tigersclaw:~$ /usr/sbin/mtx -f /dev/sg4 inquiry
Product Type: Medium Changer
Vendor ID: 'OVERLAND'
Product ID: 'NEO Series  '
Revision: '0616'
Attached Changer API: No

bacula@tigersclaw:~$ /usr/sbin/tapeinfo -f /dev/nst0
mtx: Request Sense: Long Report=yes
mtx: Request Sense: Valid Residual=no
mtx: Request Sense: Error Code=0 (Unknown?!)
mtx: Request Sense: Sense Key=No Sense
mtx: Request Sense: FileMark=no
mtx: Request Sense: EOM=no
mtx: Request Sense: ILI=no
mtx: Request Sense: Additional Sense Code = 00
mtx: Request Sense: Additional Sense Qualifier = 00
mtx: Request Sense: BPV=no
mtx: Request Sense: Error in CDB=no
mtx: Request Sense: SKSV=no
INQUIRY Command Failed

bacula@tigersclaw:~$ /usr/sbin/tapeinfo -f /dev/sg3
Product Type: Tape Drive
Vendor ID: 'HP  '
Product ID: 'Ultrium 4-SCSI  '
Revision: 'H63H'
Attached Changer API: No
SerialNumber: 'HUE4020D8F'
MinBlock: 1
MaxBlock: 16777215
SCSI ID: 1
SCSI LUN: 0
Ready: yes
BufferedMode: yes
Medium Type: Not Loaded
Density Code: 0x46
BlockSize: 0
DataCompEnabled: yes
DataCompCapable: yes
DataDeCompEnabled: yes
CompType: 0x1
DeCompType: 0x1
BOP: yes
Block Position: 0
Partition 0 Remaining Kbytes: 799204
Partition 0 Size in Kbytes: 799204
ActivePartition: 0
EarlyWarningSize: 0
NumPartitions: 0
MaxPartitions: 0

bacula@tigersclaw:~$ /usr/sbin/tapeinfo -f /dev/sg4
Product Type: Medium Changer
Vendor ID: 'OVERLAND'
Product ID: 'NEO Series  '
Revision: '0616'
Attached Changer API: No
SerialNumber: '2B44300035'
SCSI ID: 0
SCSI LUN: 0
Ready: yes

bacula@tigersclaw:~$ /usr/sbin/mtx -f /dev/sg4 status
  Storage Changer /dev/sg4:2 Drives, 30 Slots ( 1 Import/Export )
Data Transfer Element 0:Full (Storage Element 1 Loaded):VolumeTag = SU1001L1
Data Transfer Element 1:Full (Storage Element 20 Loaded):VolumeTag =
SU4101L4
  Storage Element 1:Empty
  Storage Element 2:Full :VolumeTag=SU1002L1
  Storage Element 3:Full :VolumeTag=SU1003L1
  Storage Element 4:Full :VolumeTag=SU1004L1
  Storage Element 5:Full :VolumeTag=SU1005L1
  Storage Element 6:Full :VolumeTag=SU1006L1
  Storage Element 7:Full :VolumeTag=SU1007L1
  Storage Element 8:Full :VolumeTag=SU1008L1
  Storage Element 9:Full :VolumeTag=SU1009L1
  Storage Element 10:Full :VolumeTag=SU1010L1
  Storage Element 11:Full :VolumeTag=SU1101L1
  Storage Element 12:Full :VolumeTag=SU1102L1
  Storage Element 13:Full :VolumeTag=SU1103L1
  Storage Element 14:Full :VolumeTag=SU1104L1
  Storage Element 15:Full :VolumeTag=SU4001L4
  Storage Element 16:Full :VolumeTag=SU4002L4
  Storage Element 17:Full :VolumeTag=SU4003L4
  Storage Element 18:Full :VolumeTag=SU4004L4
  Storage Element 19:Full :VolumeTag=SU4005L4
  Storage Element 20:Empty
  Storage Element 21:Full :VolumeTag=SU4102L4
  Storage Element 22:Full :VolumeTag=SU4103L4
  Storage Element 23:Full :VolumeTag=SU4104L4
  Storage Element 24:Full :VolumeTag=SU4105L4
  Storage Element 25:Full :VolumeTag=SU4106L4
  Storage Element 26:Full :VolumeTag=SU4107L4
  Storage Element 27:Full :VolumeTag=SU4108L4
  Storage Element 28:Full :VolumeTag=SU4109L4
  Storage Element 29:Full :VolumeTag=SU4110L4
  Storage Element 30 IMPORT/EXPORT:Empty

bacula@tigersclaw:~$ /usr/sbin/mtx -f /dev/sg4 load 1 0
Loading media from Storage Element 1 into drive 0...done

bacula@tigersclaw:~$ mt -f /dev/nst1 status
SCSI 2 tape drive:
File number=0, block number=0, partition=0.
Tape block size 512 bytes. Density code 0x0 (default).
Soft error count since last status=0
General status bits on (4101):

Re: [Bacula-users] Autochanger not changing

2018-04-08 Thread Sebastian Suchanek
Am 01.04.2018 um 17:12 schrieb Sebastian Suchanek:

> while still setting up Bacula (v5.2.6), I've come accross a rather
> strange issue with my tape library (an Overland NEO2000) with a
> LTO4-FC-Drive. When I do "fill" test with btape over multiple tapes,
> everything works fine. Also, for example, when I do a "label barcodes"
> command in btape over multiple slots, the individual tapes are moved
> into the drive, get written and are put back into their original slot.
> 
> But when I run a "real" backup job which spans more than one tape, the
> job gets stuck as soon as the end of the first tape is reached. The last
> messages from the job are:
> 
> | [...]
> | 2018-04-01 14:16:42 tigersclaw-sd JobId 111: Volume "SU4103L4"
> previously written, moving to end of data.
> | 2018-04-01 15:55:32 tigersclaw-sd JobId 111: End of Volume 
> "SU4103L4"
> at 21:2548 on device "LTO4-Drive-1" (/dev/nst0). Write of 200 bytes
> got -1.
> 
> And after that, nothing happens anymore. Not even if I wait for half an
> hour.
> [...]

In the meantime, one of my LTO1 tapes (which of course is written in the
LTO1 drive of my library) managed to fill up during a backup job. And
now it get's really weird: this time, the tape was exchanged without any
noticable problems.

This makes me wonder if the problem is maybe caused by the LTO4 drive
itself. But what I didn't mention so far: during my various trial runs
around this problem, I also replaced the LTO4 drive with another one.
(AFAIR both of them were the same Seagate model, though...)


Best regards

Sebastian


--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Autochanger not changing

2018-04-02 Thread Sebastian Suchanek
Am 02.04.2018 um 09:54 schrieb Kern Sibbald:

Hello Kern,

thank you for your reply.

> First, I would recommend that you use at *most* 1MB block sizes for
> LT0-1 and LTO-4 tapes.

OK, I changed that for the LTO-4 drive. (I don't want go below 1MB
though, because it significantly reduces write rates.)

> [...]
> You haven't shown your full autochanger device configuration so it will 
> be hard/impossible to diagnose your problem.

No problem, here's my full bacula-sd.conf, only comments and passwords
are removed:

| Storage {
|   Name = tigersclaw-sd
|   SDPort = 9103
|   WorkingDirectory = "/var/lib/bacula"
|   Pid Directory = "/var/run/bacula"
|   Maximum Concurrent Jobs = 20
|   SDAddress = 10.1.0.1
| }
|
| Director {
|   Name = tigersclaw-dir
|   Password = 
| }
|
| Director {
|   Name = tigersclaw-mon
|   Password = 
|   Monitor = yes
| }
|
| Device {
|   Name = FileStorage
|   Media Type = File
|   Archive Device = /srv/bacula/file
|   LabelMedia = yes
|   Random Access = yes
|   AutomaticMount = yes
|   RemovableMedia = no
|   AlwaysOpen = no
| }
|
| Autochanger {
|   Name = Overland-NEO2000
|   Device = LTO1-Drive-1
|   Device = LTO4-Drive-1
|   Changer Command = "/etc/bacula/scripts/mtx-changer %c %o %S %a %d"
|   Changer Device = /dev/sg4
| }
|
| Device {
|   Name = LTO1-Drive-1
|   Drive Index = 0
|   Media Type = LTO-1
|   Archive Device = /dev/nst1
|   AutomaticMount = yes
|   AlwaysOpen = yes
|   RemovableMedia = yes
|   RandomAccess = no
|   AutoChanger = yes
|   Maximum File Size = 2GB
|   Alert Command = "sh -c 'tapeinfo -f %c |grep TapeAlert|cat'"
|   Spool Directory = "/srv/bacula/spool"
| }
|
| Device {
|   Name = LTO4-Drive-1
|   Drive Index = 1
|   Media Type = LTO-4
|   Archive Device = /dev/nst0
|   AutomaticMount = yes
|   AlwaysOpen = yes
|   RemovableMedia = yes
|   RandomAccess = no
|   Maximum block size = 1MB
|   Maximum File Size = 40GB
|   AutoChanger = yes
|   Alert Command = "sh -c 'tapeinfo -f %c |grep TapeAlert|cat'"
|   Spool Directory = "/srv/bacula/spool"
| }
|
| Messages {
|   Name = Standard
|   director = tigersclaw-dir = all
| }

JFTR: "tigersclaw" is the name of my server which runs (among other
things) the Bacula director, storage daemon und also the client where
the backup job in question comes from. (I have more jobs configured,
also from other clients, but they are way to small to even fill a LTO-1
tape.)

> Also the output from a:
> 
> lsscsi -g
> 
> would be necessary.

No problem either:

| # lsscsi -g
| [0:0:1:0]tapeHP   Ultrium 4-SCSI   H63H  /dev/st0   /dev/sg3
| [1:0:0:0]diskATA  Samsung SSD 850  2B6Q  /dev/sda   /dev/sg0
| [2:0:0:0]diskATA  WDC WD40EFRX-68W 0A82  /dev/sdb   /dev/sg1
| [3:0:0:0]diskATA  WDC WD40EFRX-68W 0A82  /dev/sdc   /dev/sg2
| [7:0:0:0]mediumx OVERLAND NEO Series   0616  /dev/sch0  /dev/sg4
| [7:0:0:1]tapeSEAGATE  ULTRIUM06242-XXX 1603  /dev/st1   /dev/sg5
| #


> Note in general, if btape works then Bacula will work because the SD 
> uses the same subroutines that btape uses for reading/writing tapes.

Well, that's what I expected and that's why I'm so puzzled about this
error...

> Consequently there may be some other problem.  When the SD seems to be 
> stuck, you can probably get more information by doing:
> 
> bconsole
> set debuglevel=200 storage= trace=1
> mount
> set debuglevel=0 storage= trace=0
> 
> then look at the trace file in your working directory to see what it 
> going on.

Here's the trace file from the beginning of the job until the point
where the first tape was full and Bacula got stuck:

   https://suchanek.de/temp/tigersclaw-sd.trace   (47kB)

And here ist what happend when I manually cancelled the stuck job (which
worked) and try to do a "release LTO4-Drive" command in bconsole. (Which
didn't work, i.e. Bacula got stuck here too.)

   https://suchanek.de/temp/tigersclaw-sd.trace.2   (3kB)

I hope you can find anything usefull in these debug files, because I'm
totally lost here...


Best regards

Sebastian

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Autochanger not changing

2018-04-01 Thread Sebastian Suchanek
Hi everyone,

while still setting up Bacula (v5.2.6), I've come accross a rather
strange issue with my tape library (an Overland NEO2000) with a
LTO4-FC-Drive. When I do "fill" test with btape over multiple tapes,
everything works fine. Also, for example, when I do a "label barcodes"
command in btape over multiple slots, the individual tapes are moved
into the drive, get written and are put back into their original slot.

But when I run a "real" backup job which spans more than one tape, the
job gets stuck as soon as the end of the first tape is reached. The last
messages from the job are:

| [...]
| 2018-04-01 14:16:42   tigersclaw-sd JobId 111: Volume "SU4103L4"
previously written, moving to end of data.
| 2018-04-01 15:55:32   tigersclaw-sd JobId 111: End of Volume "SU4103L4"
at 21:2548 on device "LTO4-Drive-1" (/dev/nst0). Write of 200 bytes
got -1.

And after that, nothing happens anymore. Not even if I wait for half an
hour.

Here's the (hopefully) relevant part of my bacula-sd.conf:

| [...]
| Autochanger {
|   Name = Overland-NEO2000
|   Device = LTO1-Drive-1
|   Device = LTO4-Drive-1
|   Changer Command = "/etc/bacula/scripts/mtx-changer %c %o %S %a %d"
|   Changer Device = /dev/sg4
| }
|
| Device {
|   Name = LTO4-Drive-1
|   Drive Index = 1
|   Media Type = LTO-4
|   Archive Device = /dev/nst0
|   AutomaticMount = yes
|   AlwaysOpen = yes
|   RemovableMedia = yes
|   RandomAccess = no
|   Maximum block size = 2MB
|   Maximum File Size = 40GB
|   AutoChanger = yes
|   Alert Command = "sh -c 'tapeinfo -f %c |grep TapeAlert|cat'"
|   Spool Directory = "/srv/bacula/spool"
| }
| [...]

Any idea what exactly is going wrong here? What can I do to track down
the reason for this error? What can I do to fix it?


Best regards

Sebastian

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Simultaneously spooling and writing to tape

2018-03-27 Thread Sebastian Suchanek
Hi everyone!

Currently, my Bacula seup (v5.2.6) is as follows:
The director, the storage daemon and a file daemon are running on my
server, two backup jobs are configured to run directly from the server.
Additionally, there's a client with another file daemon and one backup
job configured. The data of all three jobs is supposed to be written to
the same tape drive.
Since the client is connected to the server only via internet (not via
LAN), the backup data from there is spooled on the server.

All three jobs are scheduled for the same time and with the current
config, the jobs are queued by Bacula and are executed one after
another, including the spooling of the data from the external client.
But since this spooling can take quite some time, I would like Bacula to
start the spooling from the external client first and, while spooling,
to simultaneously start writing one (or both) local backup jobs to the tape.
Disk I/O shouldn't be an issue on the server, since the source of the
local backup jobs and the spooling disk are two physically separate drives.

I've already tried to set the priority number of the remote job to a
lower value and set "Maximum Concurrent Jobs = 2" for the director. (If
I've understood the Bacula documentation correctly, the default maximum
concurrent job value for the storage daemon should be 4 anyway.)

But also with these settings, the backup jobs are still executed
strictly consecutively.
What can I do to achieve the desired behaviour?


TIA,

Sebastian

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Schedule for every second month?

2018-03-26 Thread Sebastian Suchanek
Hi everyone!

In Bacula v5.2.6, I would like to define a job that runs on the first
Monday every second month. As an example:
- 1st Monday in January -> Full Backup
- 1st Monday in February -> Differential Backup
- 1st Monday in March -> Full Backup
- 1st Monday in April -> Differetial Backup
and so on...

Is there a more elegant way to define this kind of schedule other than
plainly writing the following?

Schedule {
  Name = "BiMonthly"
  Run = Full 1st mon jan at 01:00
  Run = Differential 1st mon feb at 01:00
  Run = Full 1st mon mar at 01:00
  Run = Differential 1st apr feb at 01:00
  ...
}

Maybe something similar like "0 1 1 */2 *" would do in crontab for the
first day of every second month?


Best regards

Sebastian

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Backup to file, filesize limit not working

2018-03-15 Thread Sebastian Suchanek
Am 15.03.2018 um 21:47 schrieb Dimitri Maziuk:
> On 03/15/2018 03:11 PM, Sebastian Suchanek wrote:
> 
>> I just did - unfortunately, with no effect. After restarting the
>> director and letting the backup job run manually, the backup file just
>> got even bigger.
> 
> I wonder if you have to run "update volume maxvolbytes=NNN" in bconsole
> in order for it to apply to existing volume.
> [...]

That did the trick. Thank you!


Regards

Sebastian

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Backup to file, filesize limit not working

2018-03-15 Thread Sebastian Suchanek
Am 15.03.2018 um 20:38 schrieb Pedro Oliveira:

Hi Pedro!

> Hi Sebastian, try to change the 
> 
> Maximum Volume Bytes = 500MB 
> 
> To 
> 
> Maximum Volume Bytes = 5 

I just did - unfortunately, with no effect. After restarting the
director and letting the backup job run manually, the backup file just
got even bigger.

> I also recommend to upgrade to version 9.x

I'm rather reluctant to use software "outside" of my distribution's
repository. I /could/ upgrade from Debian Jessie to Debian Stretch,
which would come with Bacula v7.4.4, but since this update will cause a
lot of work because of other interdependencies (independent of Bacula),
I'm postponing this for the moment.


Regards

Sebastian


--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Backup to file, filesize limit not working

2018-03-15 Thread Sebastian Suchanek
Hi all!

Currently, I'm trying to set up and getting familiar with Bacula.
(v5.2.6 - that's the version that comes with my Linux distribution
Debian Jessie.)

For making backups of the Bacula catalog, I've made the following
configurations:

- bacula-sd.conf --
[...]
Device {
  Name = FileStorage
  Media Type = File
  Archive Device = /srv/bacula/file
  LabelMedia = yes
  Random Access = yes
  AutomaticMount = yes
  RemovableMedia = no
  AlwaysOpen = no
}
[...]
---

- bacula-dir.conf -
[]
Job {
  Name = "BackupCatalog"
  JobDefs = "DefaultJob"
  Level = Full
  FileSet="Catalog"
  Schedule = "WeeklyCycleAfterBackup"
  RunBeforeJob = "/etc/bacula/scripts/make_catalog_backup.pl MyCatalog"
  RunAfterJob  = "/etc/bacula/scripts/delete_catalog_backup"
  Write Bootstrap = "/var/lib/bacula/%n.bsr"
  Priority = 11
}

Schedule {
  Name = "WeeklyCycleAfterBackup"
  Run = Full sun-sat at 20:10
}

FileSet {
  Name = "Catalog"
  Include {
Options {
  signature = MD5
}
File = "/var/lib/bacula/bacula.sql"
  }
}

Storage {
  Name = File
  Address = localhost
  SDPort = 9103
  Password = "xIOrJZDj98rAAfP3S_dN8ipaa6RbxCkV9"
  Device = FileStorage
  Media Type = File
}

Pool {
  Name = File
  Pool Type = Backup
  Recycle = yes
  AutoPrune = yes
  Volume Retention = 365 days
  Maximum Volume Bytes = 500MB
  Maximum Volumes = 10
  LabelFormat = "file"
}
---

With this configuration, I would expect that Bacula writes the jobs to a
file "file" in /srv/bacula/file and, as soon as this file's size
reaches 500MB, creates a new file and continues with that. (Up to ten
files.) But instead, Bacula keeps writing to a single file, which
currently has grown to around 690MB, IOW well above 500MB.
What's going wrong here? How can I make Bacula create a new file once
the current file's size has reached 500MB?


Regards

Sebastian

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Managing disk space for Bacula Backups

2012-11-06 Thread Gumprich, Sebastian
> -Ursprüngliche Nachricht-
> Von: Adrian Reyer [mailto:bacula-li...@lihas.de]
> Gesendet: Montag, 5. November 2012 22:46
> An: Gumprich, Sebastian
> Cc: bacula-users@lists.sourceforge.net
> Betreff: Re: [Bacula-users] Managing disk space for Bacula Backups
> 
> On Mon, Nov 05, 2012 at 01:45:25PM +0100, Gumprich, Sebastian wrote:
> > I see no downsides with this, except that I don't have backups that
> > are older than 14 days, but that's not needed.
> > The problem with recycling oldest volumes is, when Bacula uses the
> > oldest volumes, it would use 5 incremental, small volumes, when the
> > large full-backup-volumes are still there, taking up disk space.
> > Any workaround to this, except for manually searching for old volumes
> > and deleting them?
> 
> Erm, if you delete the Full the Incrementals are based on, you can throw away 
> the
> Incrementals just as well in almost all cases. So if you e.g.
> do 1 Full every week, rest incrementals and radically delete everything that 
> is older
> than 14 days, you can restore 1-2 wekks, depending on the date of failure. In 
> that
> case an official retention period of 1 week is much more honest together with
> recycle oldes volumes.
> 
> Regards,
>   Adrian
> --

Maybe I did not explain it clearly enough: I do fullbackups on Saturdays. I'd 
delete with my script on volumes that are older than 14 days on Fridays. This 
way the oldest backup would always be a fullbackup from Saturdays. So then 
incremental backups that happen the following days are based on the full backup 
on Saturday.
This way, I always have atleast a fullbackup that is younger than 14 days.
Atleast that's my plan to handle the disk-space automatically. :)
Any downsides?

Regards,
Sebastian
--
LogMeIn Central: Instant, anywhere, Remote PC access and management.
Stay in control, update software, and manage PCs from one command center
Diagnose problems and improve visibility into emerging IT issues
Automate, monitor and manage. Do more in less time with Central
http://p.sf.net/sfu/logmein12331_d2d
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Managing disk space for Bacula Backups

2012-11-05 Thread Gumprich, Sebastian
Hi,

>You should not delete files without telling Bacula. You should use the

>console the manually mark Volumes as "Recycle" or purge them. To  
>"automatically" prevent such situations you can use the recycle oldest

>volume policy but be aware of the donwsides listed in the manual.

Since I use a new volume for every backup and only need the backups for
the last 14 days, isn't it possible to delete the volumes older than 14
days from the database (with delete volume) and then delete these
volumes from the NFS?
I could do this easily with a batch-script.
I see no downsides with this, except that I don't have backups that are
older than 14 days, but that's not needed.

The problem with recycling oldest volumes is, when Bacula uses the
oldest volumes, it would use 5 incremental, small volumes, when the
large full-backup-volumes are still there, taking up disk space.
Any workaround to this, except for manually searching for old volumes
and deleting them?

Thanks!
Sebastian

--
LogMeIn Central: Instant, anywhere, Remote PC access and management.
Stay in control, update software, and manage PCs from one command center
Diagnose problems and improve visibility into emerging IT issues
Automate, monitor and manage. Do more in less time with Central
http://p.sf.net/sfu/logmein12331_d2d
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Managing disk space for Bacula Backups

2012-11-02 Thread Gumprich, Sebastian
Hi,

 

for my company I've set up a bacula-server which backups several clients
to an NFS.

The NFS is mounted on the Bacula-server and has 500GBs space.

 

I have to back up about 50 clients.

I do full backups on Saturdays and incremental backups every other day.

I set the file and job retention to 14 days for every client, AutoPrune
is on.

Every client writes into its own pool on the NFS. Every pool can contain
a maximum of 20 volumes and I use every volume only once.

The also get recycled and autopruned.

The volume retention period is set to 14 days.

 

So all retention periods are 14 days.

 

With this configuration, the 500GB space are usually sufficient to store
3 full backups and several incremental backups of all the hosts.

 

Now my problem is the following:

 

If I make full backups from all the clients, on my own outside of the
schedule, the 500GBs are full, but Bacula doesn't recycle the older
volumes, because the retention period and max. volumes limit is not
reached.

 

So what are my options?

 

-   Increase the storage (possible, but only a workaround?)

-   Manually delete the files that are older than 14 days on the NFS
(what I'm currently doing)

-   ???

 

 

Thanks for your help in advance!

 

 

Cheers

 

Sebastian

--
LogMeIn Central: Instant, anywhere, Remote PC access and management.
Stay in control, update software, and manage PCs from one command center
Diagnose problems and improve visibility into emerging IT issues
Automate, monitor and manage. Do more in less time with Central
http://p.sf.net/sfu/logmein12331_d2d___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Backup Fails since VM moved

2011-02-28 Thread Sebastian Bachmann
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Hi,
Today i moved our Backup VM (which contains Dir and SD) to another
Server because of performance problems.
everything should be the same, execpt for a new IPv6 IP (the v4 Adress
still the same)
but i get some errors while doing backups...
I'm only backuping to files, so here is my log output:

28-Feb 23:20 bacula.42.lefant.net-dir JobId 1952: Start Backup JobId
1952, Job=bacula.42.lefant.net.2011-02-28_23.20.55_29
28-Feb 23:20 bacula.42.lefant.net-dir JobId 1952: Using Device
"DiskChangerDrive_glusterfs_hetz2-changer_0"
28-Feb 23:20 bacula.42.lefant.net-dir JobId 1952: Sending Accurate
information.
28-Feb 23:20 bacula.42.lefant.net-sd JobId 1952: 3301 Issuing
autochanger "loaded? drive 0" command.
28-Feb 23:20 bacula.42.lefant.net-sd JobId 1952: 3302 Autochanger
"loaded? drive 0", result is Slot 186.
28-Feb 23:20 bacula.42.lefant.net-sd JobId 1952: 3307 Issuing
autochanger "unload slot 186, drive 0" command.
28-Feb 23:20 bacula.42.lefant.net-sd JobId 1952: 3304 Issuing
autochanger "load slot 187, drive 0" command.
28-Feb 23:20 bacula.42.lefant.net-sd JobId 1952: Fatal error: 3992 Bad
autochanger "load slot 187, drive 0": ERR=Child exited with code 1.
Results=Drive 0 Full (Storage element 186 loaded)

28-Feb 23:20 bacula.42.lefant.net-fd JobId 1952: Fatal error: job.c:2004
Bad response to Append Data command. Wanted 3000 OK data
, got 3903 Error append data

i allready deleted the volume file no 186 and recreated it, the first
backup was successfull then but the next failed again...
i have absolutly no idea where is error come from, so please help me out!
could it be, that every volume is used or full? when i make df -h i see
0% free, and list volumes shows me that every volume has state "used" or
"full"...

tia!

greetings sebastian
-BEGIN PGP SIGNATURE-
Version: GnuPG/MacGPG2 v2.0.14 (Darwin)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iQEcBAEBAgAGBQJNbCENAAoJEAhgHfpCPcybPpkH/irrpsEZNweM9PdKe08aCz8R
bf4UUZw3YvywKjtwGARCzx9LrIeyEKMjgBCu9tH3FMmYIMY9qQkRGADSf7uK6Bzc
0JqUzQ4IBXOATx6XzeWjLfb2+t5mfO+Jeu7sVLybo503rAw+R/fkMiYuDk0WoFqh
t+4BBJ9TDow9ecYM+KS8jgcZ5FnUBGxPWkXjOfTbF0iCKZSRv+60EtDtwBKzrdQw
aEbTD8p3TbJ2ZjOmL9H9N9RGG8noqLG4+Q6cJQFhzDycdswTfFf0czln97anwamA
DhQvVj3uTLBFR7/VqIQQLpEuBeQmd+OMQ745sVyBY+dVhM1UbPkIDQYeBLtg3JI=
=aE4f
-END PGP SIGNATURE-

--
Free Software Download: Index, Search & Analyze Logs and other IT data in 
Real-Time with Splunk. Collect, index and harness all the fast moving IT data 
generated by your applications, servers and devices whether physical, virtual
or in the cloud. Deliver compliance at lower cost and gain new business 
insights. http://p.sf.net/sfu/splunk-dev2dev 
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] only incremental Backup of a growing amount of data

2010-10-17 Thread Sebastian Gutweiler
Hi,

I have the following situation:

- A data storage server (4TB) with a growing amount of scientific data. Data 
which is already on the server will probably stay there and only occasionally 
some will be deleted. 
- A backup server with 4,5TB

My problem is (if I understand the documentation right):

- If I perform an incremental backup into one big volume file, the space 
occupied by files deleted on the storage server won't be freed, because the 
files will be deleted from the catalog but will stay in the volume file. Is 
this right?

- If I use small volume files, the old volume files won't be deleted/reused 
because they will contain files which are still on the storage server.

- I can't do 2 Full backups and then delete the elder one, because if more than 
2,25TB space are used on the storage server there is not enough space for this 
on the backup server. 

Am I missing something? Is there an option/setup method to avoid these problems?



Thank you very much,

Sebastian


--
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly 
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Problem with regex exclude

2010-08-26 Thread Sebastian Bachmann
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Hello,
i have now the following problem with our excludes on our backup...

this is basicly our fileset (i removed many lines to make it shorter...

http://pastebin.de/9428

the problem now is that all Wildcards are not working and the Exclude
Dir Containing clause also didnt work
So i have in my backup many files which are in folders containing a
.bacula-excludeme file

whats the problem? the includes works perfect... is there a problem with
an exlcude in an extra included directory?

thanks!

greeting sebastian

-BEGIN PGP SIGNATURE-
Version: GnuPG/MacGPG2 v2.0.14 (Darwin)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iQEcBAEBAgAGBQJMduPEAAoJEAhgHfpCPcybEwMH/iya4pI2C5Uk/vQDoFxkts98
nZZ+sHrLibM51zI8St0SXrPE1/qSyW9Ylr80R0ilbkp7l1QDDe1wQXA0XO+/xkiL
KOuxKnRWQhFqtbmqd7nKleNBJrNIHa3t3nD1F/L8TMmBEP1Wwu4cnsSexLZi6Oxf
VREDTIeU+GSnKiUCSBEIyARabTBUvTpeibzZqJiGpS0nuVFPusSRISHYncVJmxtR
jKt+MdvjNh0/ZZMG1P8g8pC7+tEC4WdcG43UnCi1IvcMJXRunxdUFPWW4691Zp+T
2HfmknEW6PNwFidR+mMxgT6zPwHvGSrUG/gPZv0IHL/bYEjhbIW9vvRFivuNkiY=
=WC1u
-END PGP SIGNATURE-

--
Sell apps to millions through the Intel(R) Atom(Tm) Developer Program
Be part of this innovative community and reach millions of netbook users 
worldwide. Take advantage of special opportunities to increase revenue and 
speed time-to-market. Join now, and jumpstart your future.
http://p.sf.net/sfu/intel-atom-d2d
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Spooling and backup concept

2010-08-26 Thread Sebastian Bachmann
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 26.08.10 16:27, Phil Stracchino wrote:
> By the sound of it, neither of these is applicable to you.
ok spooling is disabled for all pools on disks

> 17 hours to back up 80GB to disk?  Good grief!  You have a SERIOUS
> bottleneck somewhere in your system.  I use an LTO-2 drive for full
> backups, which is slower than almost any decent disk system should be,
> and my system backs up half a terabyte in five to six hours.  10GB
> should take only minutes.  The incremental backup last night of my main
> server, which backed up 98GB of data out of roughly 1.5TB, took only
> about an hour, most of which was spent scanning the disk farm for changes.
huh :o mh i think we have mostly little files...
im running a incremental backup right now, our system is running at load
2, we have 7% iowait, arround 10% nice and some percent on user and
system...
The bacula-fd process on client:
  PID USER  PR  NI  VIRT  RES  SHR S %CPU %MEMTIME+  COMMAND


10473 root  25   5 2080m 1.9g 2236 S   77 23.9 516:14.16
/usr/sbin/bacula-fd -c /etc/bacula/bacula-fd.conf

i also think we have a problem with our changing data... i started a new
incremental backup after 3h from the last one and it backuped 6GB...

i excluded now every cache directory and directories with many little
files but the backup is right now running since 2h and it has allready 7GB!
> 
> If your backup medium is THAT slow, it might actually be quicker to
> reinstall the base OS.  But remember that all your settings, patches,
> customizations, OS metadata will be lost that way too.  At the very
> least, you need to back up all your system settings under /etc.  The
> question is not just "Does a restore take longer than reinstalling?",
> it's "Does a restore take longer than reinstalling and then recreating
> all of the metadata, configuration settings and customizations by hand?"
> 
mh i think the backup medium isnt that slow... its more our server and
the harddisks...

we have EQ4 Server from Hetzner.de and they use normal desktop
hardware... we have just two Spinpoint F1 HDs... So random read access
is surely not made for reading thousands of little files...

sebastian
-BEGIN PGP SIGNATURE-
Version: GnuPG/MacGPG2 v2.0.14 (Darwin)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iQEcBAEBAgAGBQJMdpLRAAoJEAhgHfpCPcybzbQH/ispo5MOoCCx+HttfyDans4c
d/eSORvcuzA9Irryl1bpEa8x4Bi5Hqda4RxBLQz3kok9vPRzUfJZNcELIscu+x+R
bX03+AKjATd9LNQAxcPdgMCYlK//LUdDD0lBKvgywJdB3VUSBH19A/Ea2J3rS1BK
NsoGgHpQ2fH6RYxPc8ybeUJbqyMylR/24VioKlVZtFnSMOgyJm7nWnswyAkBZ/CS
6o36la3ciVnx1WWeJgLyrd7W2Ichs+OWanWNRRbfMTvvho3WSEUFgkU3toaDsKY/
NRix55vTdwBGWbYUE8J/DoXXgFZdH9rMVOcpSQNXQU+CdezbCPoDdali4Hi8gXA=
=tPkB
-END PGP SIGNATURE-

--
Sell apps to millions through the Intel(R) Atom(Tm) Developer Program
Be part of this innovative community and reach millions of netbook users 
worldwide. Take advantage of special opportunities to increase revenue and 
speed time-to-market. Join now, and jumpstart your future.
http://p.sf.net/sfu/intel-atom-d2d
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Fwd: Bacula

2010-06-29 Thread Sebastian Moreno
Hi Folks:


Good evening to all, I'm a guy from Uruguay..So.. sorry my bad English hehe


I'm having a problem with a Bacula fresh install, my version is 5.0.1 and
it's running on a Ubuntu Server 10.04 box (Also a tried to install on a
CentOS Box and I had the same problem)

I can make local backups but not with remote clients (My clients are on the
same lan network)

When I run a job the director status say :  "is waiting for Client laptop-fd
to connect to Storage HDD"

I don't have any IPtables or firewall or something like that..So the
connection outbound/inbound it's open..


What can be??

If you need more information I can give for you without any problems...


Thanks a lot!


PD: I tried with linux and windows clients and it's the same problem



-- 
Sebastián Moreno

Montevideo - Uruguay
+59895356960
--
This SF.net email is sponsored by Sprint
What will you do first with EVO, the first 4G phone?
Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Fatal Error SSL3_GET_RECORD:decryption failed or bad record mac

2009-07-30 Thread Sebastian Hofmann
Hi,

I am using bacula 1.38 (Debian Etch) and configured bacula to do backups
of a remote host using TLS. I have configured six jobs and five of them
run fine. But for some time a sixth job (same server, same
configuration) causes quite often (but not always) a fatal error:


Fatal error: Network error with FD during Backup: ERR=Keine Daten verfÃŒgbar
Fatal error: No Job status returned from FD.

ERROR in tls.c:83 TLS read/write failure.: ERR=error:1408F119:SSL
routines:SSL3_GET_RECORD:decryption failed or bad record mac


Does anyone know about the problem and can give me some advice?

Regards
Sebastian

--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Fatal Error SSL3_GET_RECORD:decryption failed or bad record mac

2009-07-09 Thread Sebastian Hofmann
Hi,

I am using Bacula 1.38 (Debian Etch) and configured Bacula to do backups
of a remote host using TLS. I have configured six jobs and five of them
run fine. But for some time a sixth job (same server, same
configuration) causes quite often (but not always) a fatal error:


Fatal error: Network error with FD during Backup: ERR=Keine Daten verfÃŒgbar
Fatal error: No Job status returned from FD.

ERROR in tls.c:83 TLS read/write failure.: ERR=error:1408F119:SSL
routines:SSL3_GET_RECORD:decryption failed or bad record mac


Does anyone know about the problem and can give me some advice?

Regards
Sebastian

--
Enter the BlackBerry Developer Challenge  
This is your chance to win up to $100,000 in prizes! For a limited time, 
vendors submitting new applications to BlackBerry App World(TM) will have
the opportunity to enter the BlackBerry Developer Challenge. See full prize  
details at: http://p.sf.net/sfu/Challenge
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Incremental backups of older data

2009-02-19 Thread Sebastian Stark

On 18.02.2009, at 22:08, Arno Lehmann wrote:
>> Is there any way to tell bacula it should backup all new files (new
>> meaning "not already backed up") within this directory, regardless of
>> the timestamp, without doing a full backup?
>>
> Solution one: Wait for 3.0, and / or start testing the current
> development version. You want the feature called "Accurate Backup".

Sounds good, thanks.

> Solution two: Create the file list to back up by script. Let that
> script have a minimal database of the files which are already backed
> up. Read the file list, subtract the files in the database, print the
> files to back up, save the list of files *in a temporary location*,
> preferably including the current job name.
>
> As a "Client Run after Job", have a script that *on success* of the
> job copies the temporary file list to the actual database. In any
> case, delete the temporary file list.


This does not sound less complex than what I do now (mv(1) old data  
and run full backup job), but it's a good tip anyway.


Sebastian

-- 
http://www.kyb.tuebingen.mpg.de/~stark
Max Planck Institute for Biological Cybernetics


--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Incremental backups of older data

2009-02-19 Thread Sebastian Stark

On 19.02.2009, at 14:50, Jari Fredriksson wrote:
>> Is there any way to tell bacula it should backup all new
>> files (new meaning "not already backed up") within this
>> directory, regardless of the timestamp, without doing a
>> full backup?
> Exclude the /archive from your normal backup job filelist.
>
> Create a new additional job, and schedule a daily full job for it.  
> Include  only /archive.

Thanks, but that is what I am doing already. I'd rather like to run  
incremental jobs on /archive so I do not have to care about removing  
already backed up data from it before running the next job.


Sebastian

-- 
http://www.kyb.tuebingen.mpg.de/~stark
Max Planck Institute for Biological Cybernetics


--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Incremental backups of older data

2009-02-18 Thread Sebastian Stark

For special data we have a backup scheme that does not really fit  
bacula's idea of incremental backups:

There is a directory, say /archive, that is empty by default. If  
something needs to be backed up by bacula, it is copied (or moved)  
into this directory. Then the backup job is started and eventually  
(see below) the data are deleted from the /archive directory.

Since the data are very likely to have an older timestamp than the  
last bacula backup run, incremental backups do not work for this. So  
far we handle this by doing a full backup every time and deleting the  
data from /archive. But what we would like is to keep the data within / 
archive as long as possible.

Is there any way to tell bacula it should backup all new files (new  
meaning "not already backed up") within this directory, regardless of  
the timestamp, without doing a full backup?

touch(1) is not an option because the timestamps are important  
information we must not loose.


Sebastian
-- 
http://www.kyb.tuebingen.mpg.de/~stark
Max Planck Institute for Biological Cybernetics


--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Questions about slow migration to tape (again)

2009-01-12 Thread Sebastian Lehmann
Hi,

Am Do 08.01.2009 22:22 schrieb Ulrich Leodolter
:

> Hello, 
> 
> On Thu, 2009-01-08 at 12:21 -0500, J-P wrote:
> > Hi everyone,
> > 
> > I wrote an e-mail regarding this issue before Christmas and had some
> > good
> > replies - Thanks to all. However, we were still unable to solve the
> > issue.
> > We decided to upgrade from 2.0.3 to 2.4.2 (using Ubuntu packages
> > from
> > Hardy-Backports) to see if we could get it solved.
> > 
> > Unfortunately, it didn't solve the slow migration to tape issue. We
> > had a
> > suggestion from Ulrich to move spooling to another RAID array, which
> > can't
> > be done at the moment. So I'm looking at other solutions (if
> > possible).
> > 
> > Here is a recap of our situation:
> > 
> > - Backups are taken from network clients to the Director/SD hard
> > disk
> > (RAID0, with MySQL on the same array) and then later migrated from
> > disk to
> > Tape (LTO3 with hardware compression)
> > - When migrating, it takes hours to write some MB to the tape (i.e.
> > 1h45mins
> > for 5MB, with a rate of 0.9KB/s)
> > - I tested the Tape drive with dd and have good throughput, around
> > 135MB/s.
> > 
> > 
> > Related to that, I have 2 questions:
> > 
> > 
> > Question 1:
> > 
> > When I do a migration to tape, while the first job is migrated, I'm
> > executing "status storage=Tape" and I see something like the
> > following
> > output:
> > 
> > --snip--
> > Device status:
> > Autochanger "Autochanger" with devices:
> >"IBM-ULTRIUM-TD3" (/dev/nst0)
> > Device "FileStorage" (/backup/bacula) is mounted with:
> > Volume:  WeeklyFileVolume-0002
> > Pool:*unknown*
> > Media type:  File
> > Total Bytes Read=159,528,829,516 Blocks Read=1,360,087
> > Bytes/block=64,512
> > Positioned at File=57 Block=2,323,636,495
> > Device "IBM-ULTRIUM-TD3" (/dev/nst0) is mounted with:
> > Volume:  14L3
> > Pool:Weekly Tape Pool
> > Media type:  LTO-3
> > Slot 4 is loaded in drive 0.
> > Total Bytes=87,741,932,544 Blocks=0 Bytes/block=64,512
> > Positioned at File=0 Block=1
> > --snip--
> > 
> > >From "FileStorage", the "Total Bytes Read" always go over the
> > >"Total Bytes"
> > in the "IBM-ULTRIUM-TD3" section. Why is that? Isn't supposed to be
> > the same
> > total in both section? It seems like the following is happening:
> > 
> > 1. Read and write to tape (I've done the math, and write speed is
> > around 3
> > GB/min there?!)
> > 2. When job writing is done, the FileStorage read continues (I think
> > this is
> > where we have a problem)
> 
> Bacula reads till the end of your FileStorage Volumes because BSR
> matching doesn't work.
> 
> Without spooling relative small jobs are split into many smaller
> blocks
> which are spread over your FileStorage volume (maybe uniformly
> distributed, depends on client speed, number of backup jobs and
> Maximum Concurrent Jobs). You can check this in the JobMedia sql
> table.
> 
> During migration Bacula seeks to the first block and then reads to the
> end of the volume (because BSR matching doesnt work).
> Bacula does NOT SEEK between consecutive blocks, it READS ALL BLOCKS
> TILL THE END of the volume.  This is done for each migration job.
> (This is not 100% true, but almost)
> 
Ahhh! That's the reason! I found this behaviour, too, but didn't know
the reason. We daily migraten several TB from Disk to Tape and it takes
a very long time to do this.

> > 3. When reading is done, "Migration OK" e-mail report is sent,
> > showing poor
> > stats about duration and speed rate.
> > 
> > Can someone explain that to me?
> > 
> > 
> > Question 2:
> > 
> > Would spooling help in our situation? Or it is just a waste of Disk
> > I/O
> > since it is a migration from local hard disk to Tape Drive and not
> > backup
> > from a network client directly to Tape?
> 
> Spooling would definitely help, this was my experience.
> But you have to limit the size of your FileStorage Volumes
> to relative small size (depends on your average incr/full job size,
> i used Maximum Volume Bytes = 4G).
We use 65GB files an it takes up to 10Minutes per Job - depending on the
position of the first block of the job.
 
> This problem is fixed in the latest beta 2.5.28-b1,
>

Re: [Bacula-users] FW: Disk to Disk to Tape

2008-12-01 Thread Sebastian Lehmann
Hi,

Am Mi 26.11.2008 15:46 schrieb Martin Hengst <[EMAIL PROTECTED]>:

>> I have realized disk2disk2tape by migrating jobs (see manual:
>> http://www.bacula.org/en/dev-manual/Migration.html). By doing so you
>> can configure something like this:
>>
>> client with file daemon (and the files you want to backup)
>> backserver with director daemon, storage daemon and file daemon.
>>
>> 1. you define a pool A in the filesystem of the backupserver and a
>> pool B in the tape library
>> 2. you define a standard backup job J1 which backups the files from
>> the client into pool B
>> 3. you define a "migrate" job J2 which migrates J1 to the tape
>
> Thanks for the suggestion. I'll take a look at migration.
>
that could be a nice solution for you problem, but keep in mind, that
you "lose" your original backup, because migration means, that you move
data from one pool to an other.

Greetings

Sebastian 


-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Newbee questions client/server + GUI

2008-11-18 Thread Sebastian Lehmann

Am Mo 17.11.2008 23:26 schrieb Johnny SSH <[EMAIL PROTECTED]>:

>
> Thanks alot for everyones advice
>
> bweb and brestore are found here:
>
>
> http://www.bacula.org/en/rel-manual/GUI_Programs.html#SECTION00231
>
> and here:
>
> http://wiki.bacula.org/doku.php?id=3rd_party_addons
>
> Maybe I'll try Webacula:
> http://sourceforge.net/search/?type_of_search=soft&words=bacula ??
>
> Webmin is not available for Etch either, a friend of mine is using
> Lenny
> because of that so I'm guessing it would be in backports but I am not
> a fan
> of Webmin as I prefer ssh. Webmin gets me lost lol
>
> Nevermind guess I'll have to keep searching for that 'perfect' web
> tool for
> Bacula :-P
>
> Before I ask about the advantage of mulitple pools for multiple
> clients is
> over my single pool multi client setup but didn't get a response. I
> hope
> that I am not doing something wrong by using one pool?? I know there
> will be
> limitations with my approach but still as long as I can back my
> machines up
> if necesary that's the important thing!
>
We use one pool for any of our backups (ca. 150 jobs per Day). I can't
see any advantage of using one pool per client, but it is possible.
We only have fife pools: Archive, Disk, Tape, VM-Images and Scratch.
Thats easy to handle and really enough.
One thing i can see is, that one pool per client will reserve one drive
per backup-job, but this could also be a disadvantage - it is not
possible to run many jobs at the same time.

Greetings
Sebastian

>
> Paul Cable wrote:
>>
>>
>>
>>> -Original Message-
>>> From: Johnny SSH [mailto:[EMAIL PROTECTED]
>>> Sent: Monday, November 17, 2008 10:18 AM
>>> To: bacula-users@lists.sourceforge.net
>>> Subject: Re: [Bacula-users] Newbee questions client/server + GUI
>>>
>>>
>>> Hmm well I guess then I will have to look at running Bacula
>>> on a different system , like CentOS for the future but as my
>>> server is the main server I don't want to distroy it by
>>> upgrading to an unstable system or version.
>>>
>>> Where can I find bweb and brestore? I already mentioned
>>> previously that I searched all over for them but couldn't
>>> find them at all!!
>>>
>>>
>>> John Drescher-2 wrote:
>>>>
>>>>> I am using standard Debian Etch version which I think is v1.38?
>>>>>
>>>>> I have bacula-web installed, so I can view the backups however I
>>>>> tried looking for bat and within my apt repos it says it
>>> needs v.2.4
>>>>> even though the common version is much older?? Maybe a
>>> Debian glitch.
>>>>>
>>>>
>>>> You can not run bat with that ancient 1.38 release.
>>>>
>>>> John
>>>>
>>>>
>>>
>>>
>>> --
>>>> --- This SF.Net email is sponsored by the Moblin Your Move
>>> Developer's
>>>> challenge Build the coolest Linux based applications with
>>> Moblin SDK &
>>>> win great prizes Grand prize is a trip for two to an Open
>>> Source event
>>>> anywhere in the world
>>>> http://moblin-contest.org/redirect.php?banner_id=100&url=/
>>>> ___
>>>> Bacula-users mailing list
>>>> Bacula-users@lists.sourceforge.net
>>>> https://lists.sourceforge.net/lists/listinfo/bacula-users
>>>>
>>>>
>>>
>>> -- 
>>> View this message in context:
>>> http://www.nabble.com/Newbee-questions-client-server-%2B-GUI-t
>>> p20529490p20541352.html
>>> Sent from the Bacula - Users mailing list archive at Nabble.com.
>>>
>>>
>>> --
>>> ---
>>> This SF.Net email is sponsored by the Moblin Your Move
>>> Developer's challenge
>>> Build the coolest Linux based applications with Moblin SDK &
>>> win great prizes
>>> Grand prize is a trip for two to an Open Source event
>>> anywhere in the world
>>> http://moblin-contest.org/redirect.php?banner_id=100&url=/
>>> ___
>>> Bacula-users mailing list
>>> Bacula-users@lists.sourceforge.net
>>> h

Re: [Bacula-users] slow performance copy/migrate disk to tape

2008-11-06 Thread Sebastian Lehmann
Hi,

Am Do 06.11.2008 15:54 schrieb Ulrich Leodolter
<[EMAIL PROTECTED]>:

> Hi,
> 
> On Thu, 2008-11-06 at 14:57 +0100, Sebastian Lehmann wrote:
> > Hi,
> > 
> > Am Di 04.11.2008 21:02 schrieb Ulrich Leodolter
> > <[EMAIL PROTECTED]>:
> > 
> > > Hi,
> > > 
> > > Problem:  Migrate/Copy jobs from disk pool (DiskBackup)
> > > to tape (DiskCopy) only get overall speed of 10-20MB/s.
> > > 
> > > full backup job size varies from 10-50GB.
> > > 
> > > Pool setup is simple, just one pool for full an incremental
> > > backups
> > > to disk (automatic recycle works good)
> > > 
> > > Pool {
> > >   Name = DiskBackup
> > >   Pool Type = Backup
> > >   Recycle = yes
> > >   RecyclePool = DiskBackup
> > >   AutoPrune = yes
> > >   Volume Retention = 15 days
> > >   Volume Use Duration = 6 days
> > >   Maximum Volume Bytes = 4G
> > >   Label Format = Backup-
> > >   Next Pool = DiskCopy
> > > }
> > > 
> > > DiskCopy pool goes to LTO4 tape device.
> > > DiskBackup goes to SATA external raid (6T ext3).
> > > 
> > > concurrency for DiskBackup jobs is 15,  jobs are spread
> > > over DiskBackup Valumes (maybe thats the main problem)
> > > 
> > > i can read write/continuous on both devices at about 70MB/s
> > > (SATA is not fast)
> > > 
> > > i tried spooling to local SAS raid, but overall speed is lower
> > > than direct writing to tape.
> > > despooling from SAS raid to Tape runs at Tape maximum spped.
> > > 
> > > I need some Performance tuning tips, maybe:
> > > 
> > 
> > we use bacula in the same way, but with version 2.4.3, so we only
> > use
> > migration instead of copy job.
> > 
> > Maybe you have the same problem as we have. Performance looks ok, if
> > i
> > use tools other then bacula to test it.
> > 
> > We assume, that the seek process on disk based volumes not really
> > works.
> > 
> > 2008-11-06 06:00:03 dss-bacula-dir JobId 39252: The following 1
> > JobIds
> > were chosen to be migrated: 38638
> > 2008-11-06 06:00:03 dss-bacula-dir JobId 39252: Migration using
> > JobId=38638 Job=TCB-PROJECT_DB-WEB.2008-11-03_22.00.14
> > 2008-11-06 06:00:03 dss-bacula-dir JobId 39252: Bootstrap records
> > written to /var/lib/bacula/dss-bacula-dir.restore.28.bsr
> > 2008-11-06 06:00:03 dss-bacula-dir JobId 39252: 
> > 2008-11-06 06:00:03 dss-bacula-dir JobId 39252: The job will require
> > the
> > following
> >Volume(s) Storage(s)SD Device(s)
> > 
> >
> > ===
> > 2008-11-06 06:00:03 dss-bacula-dir JobId 39252:
> > 2008-11-06 06:00:03 dss-bacula-dir JobId 39252: 00132 File
> > FileAutoChanger
> > 2008-11-06 06:00:03 dss-bacula-dir JobId 39252: 
> > 2008-11-06 13:25:54 dss-bacula-dir JobId 39252: Start Migration
> > JobId
> > 39252, Job=MigrateToTape.2008-11-06_06.00.48
> > 2008-11-06 13:25:54 dss-bacula-dir JobId 39252: Using Device
> > "SL500-1-Drive-1"
> > 2008-11-06 13:25:54 dss-bacula-sd JobId 39252: Ready to read from
> > volume
> > "00132" on device "FileStorage" (/stage0/drive0).
> > 2008-11-06 13:25:54 dss-bacula-sd JobId 39252: Forward spacing
> > Volume
> > "00132" to file:block 21:974164913.
> > 2008-11-06 13:37:49 dss-bacula-sd JobId 39252: End of Volume at file
> > 45
> > on device "FileStorage" (/stage0/drive0), Volume "00132"
> > 2008-11-06 13:37:49 dss-bacula-sd JobId 39252: End of all volumes.
> > 2008-11-06 13:37:52 dss-bacula-dir JobId 39252: Bacula
> > dss-bacula-dir
> > 2.4.2 (26Jul08): 06-Nov-2008 13:37:52
> >   Build OS:   x86_64-pc-linux-gnu debian 4.0
> >   Prev Backup JobId:  38638
> >   New Backup JobId:   39253
> >   Migration JobId:39252
> >   Migration Job:  MigrateToTape.2008-11-06_06.00.48
> >   Backup Level:   Full
> >   Client: BACULA-DIR
> >   FileSet:"LinuxFullSet" 2008-04-23 22:00:00
> >   Read Pool:  "Disk" (From Job resource)
> >   Read Storage:   "File" (From Pool resource)
> > Write Pool: "MONTH-TAPE" (From Job Pool's NextPool resource)
> > Write Storage: "SL500-1" (From Storage from Pool's NextPool
>

Re: [Bacula-users] slow performance copy/migrate disk to tape

2008-11-06 Thread Sebastian Lehmann
Hi,

Am Di 04.11.2008 21:02 schrieb Ulrich Leodolter
<[EMAIL PROTECTED]>:

> Hi,
> 
> Problem:  Migrate/Copy jobs from disk pool (DiskBackup)
> to tape (DiskCopy) only get overall speed of 10-20MB/s.
> 
> full backup job size varies from 10-50GB.
> 
> Pool setup is simple, just one pool for full an incremental backups
> to disk (automatic recycle works good)
> 
> Pool {
>   Name = DiskBackup
>   Pool Type = Backup
>   Recycle = yes
>   RecyclePool = DiskBackup
>   AutoPrune = yes
>   Volume Retention = 15 days
>   Volume Use Duration = 6 days
>   Maximum Volume Bytes = 4G
>   Label Format = Backup-
>   Next Pool = DiskCopy
> }
> 
> DiskCopy pool goes to LTO4 tape device.
> DiskBackup goes to SATA external raid (6T ext3).
> 
> concurrency for DiskBackup jobs is 15,  jobs are spread
> over DiskBackup Valumes (maybe thats the main problem)
> 
> i can read write/continuous on both devices at about 70MB/s
> (SATA is not fast)
> 
> i tried spooling to local SAS raid, but overall speed is lower
> than direct writing to tape.
> despooling from SAS raid to Tape runs at Tape maximum spped.
> 
> I need some Performance tuning tips, maybe:
> 

we use bacula in the same way, but with version 2.4.3, so we only use
migration instead of copy job.

Maybe you have the same problem as we have. Performance looks ok, if i
use tools other then bacula to test it.

We assume, that the seek process on disk based volumes not really works.

2008-11-06 06:00:03 dss-bacula-dir JobId 39252: The following 1 JobIds
were chosen to be migrated: 38638
2008-11-06 06:00:03 dss-bacula-dir JobId 39252: Migration using
JobId=38638 Job=TCB-PROJECT_DB-WEB.2008-11-03_22.00.14
2008-11-06 06:00:03 dss-bacula-dir JobId 39252: Bootstrap records
written to /var/lib/bacula/dss-bacula-dir.restore.28.bsr
2008-11-06 06:00:03 dss-bacula-dir JobId 39252: 
2008-11-06 06:00:03 dss-bacula-dir JobId 39252: The job will require the
following
   Volume(s) Storage(s)SD Device(s)

===
2008-11-06 06:00:03 dss-bacula-dir JobId 39252:
2008-11-06 06:00:03 dss-bacula-dir JobId 39252: 00132 File
FileAutoChanger
2008-11-06 06:00:03 dss-bacula-dir JobId 39252: 
2008-11-06 13:25:54 dss-bacula-dir JobId 39252: Start Migration JobId
39252, Job=MigrateToTape.2008-11-06_06.00.48
2008-11-06 13:25:54 dss-bacula-dir JobId 39252: Using Device
"SL500-1-Drive-1"
2008-11-06 13:25:54 dss-bacula-sd JobId 39252: Ready to read from volume
"00132" on device "FileStorage" (/stage0/drive0).
2008-11-06 13:25:54 dss-bacula-sd JobId 39252: Forward spacing Volume
"00132" to file:block 21:974164913.
2008-11-06 13:37:49 dss-bacula-sd JobId 39252: End of Volume at file 45
on device "FileStorage" (/stage0/drive0), Volume "00132"
2008-11-06 13:37:49 dss-bacula-sd JobId 39252: End of all volumes.
2008-11-06 13:37:52 dss-bacula-dir JobId 39252: Bacula dss-bacula-dir
2.4.2 (26Jul08): 06-Nov-2008 13:37:52
  Build OS:   x86_64-pc-linux-gnu debian 4.0
  Prev Backup JobId:  38638
  New Backup JobId:   39253
  Migration JobId:39252
  Migration Job:  MigrateToTape.2008-11-06_06.00.48
  Backup Level:   Full
  Client: BACULA-DIR
  FileSet:"LinuxFullSet" 2008-04-23 22:00:00
  Read Pool:  "Disk" (From Job resource)
  Read Storage:   "File" (From Pool resource)
Write Pool: "MONTH-TAPE" (From Job Pool's NextPool resource)
Write Storage: "SL500-1" (From Storage from Pool's NextPool resource)
  Start time: 06-Nov-2008 13:25:54
  End time:   06-Nov-2008 13:37:52
  Elapsed time:   11 mins 58 secs
  Priority:   10
  SD Files Written:   51
  SD Bytes Written:   37,420,967 (37.42 MB)
  Rate:   52.1 KB/s
  Volume name(s): 000211
  Volume Session Id:  3
  Volume Session Time:1225972440
  Last Volume Bytes:  31,316,447,232 (31.31 GB)
  SD Errors:  0
  SD termination status:  OK
  Termination:Migration OK

2008-11-06 13:37:52 dss-bacula-dir JobId 39252: Begin pruning Jobs.
2008-11-06 13:37:52 dss-bacula-dir JobId 39252: Pruned 2 Jobs for client
BACULA-DIR from catalog.
2008-11-06 13:37:52 dss-bacula-dir JobId 39252: Begin pruning Files.
2008-11-06 13:37:52 dss-bacula-dir JobId 39252: No Files found to prune.
2008-11-06 13:37:52 dss-bacula-dir JobId 39252: End auto prune.

As you can see, bacula needs 12 minutes to migrate 37MB. Thats becuase
is does not "jump" to the correct file position in the disk volume. It
reads the entire volume from the begining to the end if the job was the
last on it. You can see this with stat sd. Bacula reads the volume but
does not write to

Re: [Bacula-users] What new feature are you waiting for?

2008-11-04 Thread Sebastian Lehmann


Am Di 04.11.2008 11:07 schrieb Silver Salonen <[EMAIL PROTECTED]>:

> On Tuesday 04 November 2008 12:01:06 Sebastian Lehmann wrote:
> > 
> > Am Di 04.11.2008 10:42 schrieb Silver Salonen <[EMAIL PROTECTED]>:
> > 
> > > On Tuesday 04 November 2008 11:22:12 Sebastian Lehmann wrote:
> > > > Am Di 04.11.2008 05:10 schrieb Kevin Keane
> > > > <[EMAIL PROTECTED]>:
> > > > > - Native support for Windows system state backup without using
> > > > > NTBackup.
> > > > > Ideally including a full ASR.
> > > > > 
> > > > It's is implemented since Bacula supports VSS. You can run a
> > > > full
> > > > backup
> > > > and restore from scratch without NTBackup.
> > > 
> > > You mean with BartBE plugin? I wouldn't call it "implemented in
> > > Bacula".
> > > 
> > > There's no other way besides NTBackup and this listed in 
> > > http://wiki.bacula.org/doku.php?id=windows_bare_metal_recovery
> > 
> > No, that is not what i mean. We do full system backups with VSS
> > enabled
> > and restore the whole system from a linux rescue cd with a static
> > bacula
> > client. In the rescue-environment we prepare the target disks
> > (partions
> > and ntfs-format), then we restore the system (only partition c),
> > make
> > the system bootable trough a original windows install cd and start
> > the
> > restored maschine. Then we restore the rest of the system (any other
> > partition) with the original installed bacula-fd.
> > 
> > That has worked fine at our tests.
> > 
> > Ok, it is not truly implemented "in" bacula, but you will need a
> > rescue
> > cd - in any case.
> > 
> > Greetings
> > 
> > Sebastian
> 
> Hmm, sounds good. I didn't know it's possible like that.. Maybe you'd
> list and
> describe the method in wiki too? :)

maybe :-)

Sebastian


-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] What new feature are you waiting for?

2008-11-04 Thread Sebastian Lehmann

Am Di 04.11.2008 10:42 schrieb Silver Salonen <[EMAIL PROTECTED]>:

> On Tuesday 04 November 2008 11:22:12 Sebastian Lehmann wrote:
> > Am Di 04.11.2008 05:10 schrieb Kevin Keane
> > <[EMAIL PROTECTED]>:
> > > - Native support for Windows system state backup without using
> > > NTBackup.
> > > Ideally including a full ASR.
> > > 
> > It's is implemented since Bacula supports VSS. You can run a full
> > backup
> > and restore from scratch without NTBackup.
> 
> You mean with BartBE plugin? I wouldn't call it "implemented in
> Bacula".
> 
> There's no other way besides NTBackup and this listed in 
> http://wiki.bacula.org/doku.php?id=windows_bare_metal_recovery

No, that is not what i mean. We do full system backups with VSS enabled
and restore the whole system from a linux rescue cd with a static bacula
client. In the rescue-environment we prepare the target disks (partions
and ntfs-format), then we restore the system (only partition c), make
the system bootable trough a original windows install cd and start the
restored maschine. Then we restore the rest of the system (any other
partition) with the original installed bacula-fd.

That has worked fine at our tests.

Ok, it is not truly implemented "in" bacula, but you will need a rescue
cd - in any case.

Greetings

Sebastian


-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] What new feature are you waiting for?

2008-11-04 Thread Sebastian Lehmann
Hi,

Am Di 04.11.2008 05:10 schrieb Kevin Keane <[EMAIL PROTECTED]>:

> Here is my wish list. I hope I'm not including things that already
> exist...
> 
> What I would like to see is more support for backing up to removable 
> hard disks. Specifically:
> 
> - Have bacula delete the actual file on disk when it is 
> purged/pruned/deleted in the database. Unlike tapes, reusing files
> makes
> little sense. This will allow a true one-job, one-file scheme (yes, I 
> know the database takes care of that already, but I like redundancy in
> such things).
> 
> - Another level of  volume management between the current volume and 
> pool.  Currently, there is no way (that I could find) to have bacula 
> rotate hard disks with multiple volumes on each disk.
> 
> - Native support for Windows system state backup without using
> NTBackup.
> Ideally including a full ASR.
> 
It's is implemented since Bacula supports VSS. You can run a full backup
and restore from scratch without NTBackup.

> - Support for Windows 2008 and Vista (not sure if that may already 
> exist; it's not an issue for me - yet).
> 
> - Director and SD supported on Windows. I believe they currently work 
> but aren't officially supported?
> 
> - A good Windows client (or maybe I just didn't find it...)
>
> - Documentation updates. It's tricky to piece together the information
> about the correct information for anything past version 1.38.
> 
> Dan Langille schrieb:
> >> With the upcoming release of Bacula, what new feature are you
> >> waiting for?
> >> 
> 
 
Sebastian


-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Migrate RunBeforeJob RunAfterJob

2008-10-20 Thread Sebastian Lehmann
Hi,

Am So 19.10.2008 20:50 schrieb Ulrich Leodolter
<[EMAIL PROTECTED]>:

> Hello,
> 
> I've setup a migration job and like to run scripts
> before and after the controlling migration job.
> 
> RunBeforeJob and RunAfterJob are called for each migration job
> when using the job definition below.
> 
> Is it possible to limit RunScript directives only to the
> controlling migration Job ?
> 
No, it's not possible.


> I tried this on bacula 2.4.3.
> 
> 
> Job {
>   Name = "MigrateDiskToTape"
>   Type = Migrate
>   Level = Full
>   Client = server-fd
>   FileSet="Full Set"
>   Messages = Standard
>   Pool = DiskBackup
>   Storage = File
>   SpoolData = yes
>   Maximum Concurrent Jobs = 1
>   Selection Type = PoolTime
>   Priority = 12
>   RunBeforeJob = "/etc/bacula/run_before_migration"
>   RunAfterJob = "/etc/bacula/run_after_migration"
> }
> 
> Thanks
> Ulrich
> 
> 

> 
Sebastian Lehmann


-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] waiting on max storage jobs

2008-10-14 Thread Sebastian Lehmann
Hi Alan,

Am Di 14.10.2008 12:06 schrieb Alan Brown <[EMAIL PROTECTED]>:

> On Tue, 14 Oct 2008, Sebastian Lehmann wrote:
> 
> > Bacula will only use one drive per pool, so if you want to write to
> > more
> > then one drive you have to define several pools and direct the jobs
> > to
> > this pools.
> 
> Not quite correct.
> 
> That is the default setting, but Bacula can use several drives on one
> pool
> (in an autochanger) if the "prefer mounted volume" option is set to
> "no"
> 
> In general it's better to increase concurrent jobs and make sure
> there's
> adequate spool space than switch this option on.

oh, sorry, i didn't know that fact. Why is this not the recommended
setting?

Greetings

Sebastian


-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] waiting on max storage jobs

2008-10-14 Thread Sebastian Lehmann
Hello,

Am Di 14.10.2008 01:31 schrieb Dave Poirier <[EMAIL PROTECTED]>:

> Brand spankin new to Bacula... I like what I see so far.
> I googled and looked through the archives and couldn't find anything
> helpful. Anyway, I have a autochanger with 4 AIT-3 drives but it seems
> if I
> start multiple jobs it will only run one job on the first drive and
> any job
> after will sit with a status of "waiting on max storage jobs". I guess
> I
> expected the behavior to start any subsiquent jobs on the other three
> drives. Am I wrong in my thinking? I suspected that perhaps "Maximum
> Concurrent Jobs" would have something to do with it, but that is set
> to
> four... So I'm stumped and looking for some help... Any suggestions?

Bacula will only use one drive per pool, so if you want to write to more
then one drive you have to define several pools and direct the jobs to
this pools.

With the "Maximum Concurrent Jobs" option set to bigger then 1 bacula
will write the jobs simultaniously to the one drive.

> 
> Bacula version 2.0.3 on Centos 5.2, the RPM is from the EPEL
> Repository.
> 
> bacula-dir.conf
> 
> Director {# define myself
>   Name = bacula-dir
>   DIRport = 9101# where we listen for UA connections
>   QueryFile = "/etc/bacula/query.sql"
>   WorkingDirectory = "/var/spool/bacula"
>   PidDirectory = "/var/run"
>   Maximum Concurrent Jobs = 4
>   Password = "" # Console password
>   Messages = Daemon
> }
> 
> bacula-sd.conf
> 
> Storage { # definition of myself
>   Name = bacula-sd
>   SDPort = 9103  # Director's port
>   WorkingDirectory = "/var/spool/bacula"
>   Pid Directory = "/var/run"
>   Maximum Concurrent Jobs = 20
>   Heartbeat Interval = 30 sec;
> }
> 
> Thanks for any help,
> Dave

Look at the storage-section in the bacula-dir.conf. There you have also
to define "Maximum Concurrent Jobs", e.g:

Storage {
  Name = SL500-1
  Address = dss-bacula
  SD Port = 9103
  Password = ""
  Device = SL500-1
  Media Type = LTO-3
  Autochanger = yes
  Maximum Concurrent Jobs = 10
}


Greetings
Sebastian


-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula restore by email ?

2008-01-24 Thread Sebastian Perkins

Uwe Schuerkamp a écrit :
> On Thu, Jan 24, 2008 at 03:59:38PM +0100, Sebastian Perkins wrote:
>   
>> Hello,
>>
>> After a few bacula restores, we've found out that a very convenient way 
>> of restoring file(s) is to send them via email to the user.
>>
>> Most often the user just wants to compare the file to include whatever 
>> modification he did 3 days ago... so overwriting the file(s) isn't good...
>>
>> Is there any way to automatically send a restored file via email ?  
>> shell/perl/bacula trick anything is OK here :o)
>>
>> We are 2.2.6 on fedora core 6
>>
>> Many thanks,
>>
>> 
>
> Hello Sebastian, 
>
> it sounds to me like you require some kind of version control system
> more than just a plain backup solution like bacula ;-) 
>
> Cheers, uwe 
>
>   

Users can get quite complicated :-) But we do get "deleted files" / 
"moved files" etc...

Sebastian



-
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula restore by email ?

2008-01-24 Thread Sebastian Perkins
Dan Langille a écrit :
> Sebastian Perkins wrote:
>> Hello,
>>
>> After a few bacula restores, we've found out that a very convenient 
>> way of restoring file(s) is to send them via email to the user.
>>
>> Most often the user just wants to compare the file to include 
>> whatever modification he did 3 days ago... so overwriting the file(s) 
>> isn't good...
>
> Just so you know, you can restore without overwriting the file.  Look 
> at the WHERE options after issuing a mod command during the restore.
>

That's what we do : basically to /home/restore/... on the bacula server


>> Is there any way to automatically send a restored file via email ?  
>> shell/perl/bacula trick anything is OK here :o)
>
> I would look at a Run after job.  Should be pretty straight forward... 
> Except for knowing who to send the file to.
>

I'l have a look thanks. Sending the mail to the admins should do it 
(then they forward it...).


-
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Bacula restore by email ?

2008-01-24 Thread Sebastian Perkins

Hello,

After a few bacula restores, we've found out that a very convenient way 
of restoring file(s) is to send them via email to the user.

Most often the user just wants to compare the file to include whatever 
modification he did 3 days ago... so overwriting the file(s) isn't good...

Is there any way to automatically send a restored file via email ?  
shell/perl/bacula trick anything is OK here :o)

We are 2.2.6 on fedora core 6

Many thanks,


-- 
Sebastian Perkins
Responsable Informatique
[EMAIL PROTECTED]

ALPES CONTROLES
3 impasse des prairies
74940 Annecy le Vieux
Tél. 04.50.64.11.46 - Fax. 04.50.64.23.83
http://www.alpes-controles.fr 




-
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula-usersway too large incremental backup...

2008-01-16 Thread Sebastian Perkins
OK problem solved ! The command list files jobid=NNN helped out a lot to 
see what was going on, just a bit difficult to see all 40 files...


The interesting bit was that 99% of a backup jobid concerned exactly 4 
out of 23 shares. Checking the rsyncs with all 
flags/modifications/etc... the rsync modifications account to less than 
a 1gb per day.


Something MUST be going on on the backup server. After a lot of testing 
we found out that somebody had installed a shell script to chmod & 
chgroup files & directories on those 4 directories on the backup server !!!


Now bacula is backing up real good... under a Gb per day :o) 
Differential is also OK.


If you use bacula on rsync backups, it works great but don't 
touch/chmod/chANYTYHING the archives !


Mank thanks to all for your help and guidance.


--
Sebastian Perkins
Responsable Informatique
[EMAIL PROTECTED]


Wes Hardaker a écrit :

"SP" == Sebastian Perkins <[EMAIL PROTECTED]> writes:



SP> 2) Is there a way to show the list of files being saved from a job/client ? 


Within bconsole, you can use "list files jobid=NNN" where NNN is the
jobid that last ran.

I wouldn't think that rsynced files would be a problem, at least if you
weren't doing anything odd.
  
-
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] way too large incremental backup...

2007-12-27 Thread Sebastian Perkins



Uwe Schuerkamp a écrit :
> Do you use rsync's "archive" flag ("-a", I believe) when transferring
> the files to your backup server?
I use : rsync -arvz source dest ... (+ ssh etc...) so yes it's there

>  
>
> Cheers, uwe 
>
>   


-- 
Sebastian Perkins
Responsable Informatique
[EMAIL PROTECTED]

ALPES CONTROLES
3 impasse des prairies
74940 Annecy le Vieux
Tél. 04.50.64.11.46 - Fax. 04.50.64.23.83
http://www.alpes-controles.fr 




-
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2005.
http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] way too large incremental backup...

2007-12-27 Thread Sebastian Perkins


Uwe Schuerkamp a écrit :
> Do you use rsync's "archive" flag ("-a", I believe) when transferring
> the files to your backup server? 
>
> Cheers, uwe 
>
>   


-
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2005.
http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] way too large incremental backup...

2007-12-26 Thread Sebastian Perkins


Hello, 

I'm using Bacula 2.2.6 : I have the main client (linux) that is incrementing 
50Gb per day ! Out of a possible 270GB for a full backup... Every day, there 
are over 400.000 files being saved, even during weekends... 

We have modified the fileset to include only "office/pics/pdf" filetypes, we 
have gained 9Gb... but this is still not what we're expecting. 

The files are rsynced from distant sites to a central backup, and bacula is 
installed a as client on this central backup (so we can get the full/inc/diff 
backups on LAN). The combined daily upload (from rsync stats) is way below 
50Gb. 

So I've got two questions : 

1) How does Bacula check file mods ? Do I have to do something special with 
rsync (flag/option/...) ? 

2) Is there a way to show the list of files being saved from a job/client ? 

Thanks in advance and Merry Xmas to everybody ! 

Sebastian Perkins 
Responsable Informatique 
[EMAIL PROTECTED] 

ALPES CONTROLES 
3 impasse des prairies 
74940 Annecy le Vieux 
Tél. 04.50.64.11.46 - Fax. 04.50.64.23.83 
http://www.alpes-controles.fr 


-
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2005.
http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula and Windows XP client: dir/file names with spec. chars (unicode?)

2007-11-30 Thread Sebastian
Thanks for the hint, you are totally right: I am logging in via putty.
In the putty-options --> window --> translation --> UTF-8 and there are
no more problems with umlauts.

Sebastian


Arno Lehmann wrote:
> Hello,
>
> 30.11.2007 19:56,, Sebastian wrote::
>   
>> Hi,
>>
>> if I want to backup e.g. "C:\Dokumente und
>> Einstellungen\--user--\Startmenü", I have to write
>> File = "C:/Dokumente und Einstellungen/--user--/Startmenü" to my
>> FileSet-resource.
>>
>> works fine for me, it is probably an charset issue, and afaik it is not
>> documented in the manual.
>> 
>
> Well, that is nothing Bacula-specific, in fact.
>
> It's a character coding mismatch.
>
> The configuration file is interpreted as UTF-8 iirc (or rather, the 
> bytes in the file names are interpreted by windows to be UTF-8, and 
> you display with ISO-Latin1 most probably.
>
> I see this quite often, in most cases when I work on a linux system 
> using a UTF-8 character coding scheme (e.g. LC_CTYPE=en_US.UTF-8) and 
> the terminal (putty here, most often) is assuming latin1 character 
> encoding.
>
> When editing the configuration with vi in a putty terminal window, I 
> just need to activate the proper translation, and voilà, I see all the 
> Umlauts and accebted characters as they are interpreted by windows.
>
> You could try something similar...
>
> Arno
>
>   
>> greets,
>> Sebastian
>> 
>> Bacula-Dir: 2.2.5 on Debian sid
>> Bacula-Client: 2.2.6 on WindowsXP SP2
>>
>>
>> Arno Lehmann wrote:
>> 
>>> Hi,
>>>
>>> 29.11.2007 08:54,, Vladimirs Vecgailis wrote::
>>>   
>>>   
>>>> Hi,
>>>>
>>>> i'm experiencing the same problem except not with hungarian but
>>>> with german "Umlauts" - ö / ä / ü.
>>>>
>>>> I even found a similar question/problem like mine (and now - like
>>>> yours :-) ):
>>>>
>>>> http://www.mail-archive.com/bacula-users@lists.sourceforge.net/msg21470.html
>>>>
>>>>
>>>>
>>>> Backups works fine, but i get warnings in the LOG and the email. 
>>>> Although the files/dirs with special char's are backup'ed. So i
>>>> ignore these errors for now...
>>>>
>>>> If there would be any other solution i would be glad to hear about
>>>> it.
>>>> 
>>>> 
>>> I can not confirm this. See here:
>>> Microsoft Windows [Version 6.0.6000]
>>> Copyright (c) 2006 Microsoft Corporation. Alle Rechte vorbehalten.
>>>
>>> C:\Users\Arno>cd \tmp\bacula-restores\C\testbackups\Värßeichnµs
>>>
>>> C:\tmp\bacula-restores\C\testbackups\Värßeichnµs>dir
>>>   Volume in Laufwerk C: hat keine Bezeichnung.
>>>   Volumeseriennummer: 3AFC-56F4
>>>
>>>   Verzeichnis von C:\tmp\bacula-restores\C\testbackups\Värßeichnµs
>>>
>>> 29.11.2007  14:16  .
>>> 29.11.2007  14:16  ..
>>> 29.11.2007  11:25 0 Dätäì.txt
>>> 1 Datei(en),  0 Bytes
>>> 2 Verzeichnis(se), 14.232.092.672 Bytes frei
>>>
>>> C:\tmp\bacula-restores\C\testbackups\Värßeichnµs>
>>>
>>> This was backed up from and restored to the same client, MS Vista 
>>> business.
>>>
>>> This is the jobs file list:
>>>
>>> Choose a query (1-16): 12
>>> Enter JobId: 1168
>>> +-+-+
>>> | Path| Name 
>>>|
>>> +-+-+
>>> | C:/testbackups/ | 
>>>|
>>> | C:/testbackups/ | ADS.txt 
>>>|
>>> | C:/testbackups/ | Arno 
>>> Lehmann.contact|
>>> | C:/testbackups/ | Ein Name mit 
>>> Ümlätön.txt |
>>> | C:/testbackups/Documents/   | 
>>>|
>>> | C:/testbackups/Documents/   | sfscon-2.odp 
>>>|
>>> | C:/testbackups/Documents/   | sfscon.pdf 
>>>|
>>> | C:/testbacku

Re: [Bacula-users] Bacula and Windows XP client: dir/file names with spec. chars (unicode?)

2007-11-30 Thread Sebastian
Hi,

if I want to backup e.g. "C:\Dokumente und
Einstellungen\--user--\Startmenü", I have to write
File = "C:/Dokumente und Einstellungen/--user--/Startmenü" to my
FileSet-resource.

works fine for me, it is probably an charset issue, and afaik it is not
documented in the manual.
greets,
Sebastian

Bacula-Dir: 2.2.5 on Debian sid
Bacula-Client: 2.2.6 on WindowsXP SP2


Arno Lehmann wrote:
> Hi,
>
> 29.11.2007 08:54,, Vladimirs Vecgailis wrote::
>   
>> Hi,
>>
>> i'm experiencing the same problem except not with hungarian but
>> with german "Umlauts" - ö / ä / ü.
>>
>> I even found a similar question/problem like mine (and now - like
>> yours :-) ):
>>
>> http://www.mail-archive.com/bacula-users@lists.sourceforge.net/msg21470.html
>>
>>
>>
>> Backups works fine, but i get warnings in the LOG and the email. 
>> Although the files/dirs with special char's are backup'ed. So i
>> ignore these errors for now...
>>
>> If there would be any other solution i would be glad to hear about
>> it.
>> 
>
> I can not confirm this. See here:
> Microsoft Windows [Version 6.0.6000]
> Copyright (c) 2006 Microsoft Corporation. Alle Rechte vorbehalten.
>
> C:\Users\Arno>cd \tmp\bacula-restores\C\testbackups\Värßeichnµs
>
> C:\tmp\bacula-restores\C\testbackups\Värßeichnµs>dir
>   Volume in Laufwerk C: hat keine Bezeichnung.
>   Volumeseriennummer: 3AFC-56F4
>
>   Verzeichnis von C:\tmp\bacula-restores\C\testbackups\Värßeichnµs
>
> 29.11.2007  14:16  .
> 29.11.2007  14:16  ..
> 29.11.2007  11:25 0 Dätäì.txt
> 1 Datei(en),  0 Bytes
> 2 Verzeichnis(se), 14.232.092.672 Bytes frei
>
> C:\tmp\bacula-restores\C\testbackups\Värßeichnµs>
>
> This was backed up from and restored to the same client, MS Vista 
> business.
>
> This is the jobs file list:
>
> Choose a query (1-16): 12
> Enter JobId: 1168
> +-+-+
> | Path| Name 
>|
> +-+-+
> | C:/testbackups/ | 
>|
> | C:/testbackups/ | ADS.txt 
>|
> | C:/testbackups/ | Arno 
> Lehmann.contact|
> | C:/testbackups/ | Ein Name mit 
> Ümlätön.txt |
> | C:/testbackups/Documents/   | 
>|
> | C:/testbackups/Documents/   | sfscon-2.odp 
>|
> | C:/testbackups/Documents/   | sfscon.pdf 
>|
> | C:/testbackups/Värßeichnµs/  | 
> |
> | C:/testbackups/Värßeichnµs/  | Dätäì.txt 
>  |
> | C:/testbackups/Värßeichnµs/G€lôgenêß Gáld/ | 
>   |
> +-+-+
>
> And there are no warnings in the job output or the mail:
>
> 29-Nov 12:30 VM-dir JobId 1168: Start Backup JobId 1168, 
> Job=Host.2007-11-29_12.30.16
> 29-Nov 12:30 VM-dir JobId 1168: Using Device "FileStorage"
> 29-Nov 12:30 VM-sd JobId 1168: Volume "Full-0036" previously written, 
> moving to end of data.
> 29-Nov 12:30 VM-sd JobId 1168: Ready to append to end of Volume 
> "Full-0036" size=52083
> 29-Nov 12:30 Host-fd: Generate VSS snapshots. Driver="VSS Vista", 
> Drive(s)="C"
> 29-Nov 12:30 VM-sd JobId 1168: Job write elapsed time = 00:00:36, 
> Transfer rate = 7.099 K bytes/second
> 29-Nov 12:30 VM-dir JobId 1168: Bacula VM-dir 2.2.6 (10Nov07): 
> 29-Nov-2007 12:30:45
>Build OS:   i686-suse-linux-gnu suse 10.3
>JobId:  1168
>Job:Host.2007-11-29_12.30.16
>Backup Level:   Full
>Client: "Host-fd" 2.1.22 (26Jun07) 
> Linux,Cross-compile,Win32
>FileSet:"HostFS" 2007-11-13 22:15:00
>Pool:   "Full" (From Job FullPool override)
>Storage:"File" (From Pool resource)
>Scheduled time: 29-Nov-2007 12:30:00
>Start time: 29-Nov-2007 12:30:09
>End time:   29-Nov-2007 12:30:45
>Elapsed time:   36 secs
>Priority:   10
>FD Files Written:   10
>SD Files Written:  

[Bacula-users] WindowsXP EFS - encrypting file system - How can I backup efs-encrypted files?

2007-11-26 Thread Sebastian
Hi,
how can I backup efs-encrypted files?

Whether i 'm running bacula-fd as admin, SYSTEM, or my_user, it saves
only the path- and filenames, but not the content of the efs-encrypted
files. Running a restore-job results in zero-byte files.

When running fd as SYSTEM, there are access-denied entries in log (as
expected),
when running fd as my_user, there are *no* warnings in log.

Client: WinXP SP2 with bacula-fd 2.2.6
Server: Debian sid with bacula-dir + sd 2.2.5

greetings
Sebastian

#
# Default  Bacula File Daemon Configuration file
#
#  For Bacula release 2.2.5 (10/09/07) -- Windows MVS
#
# There is not much to change here except perhaps the
# File daemon Name
#

#
# "Global" File daemon configuration specifications
#
FileDaemon {# this is me
  Name = t40-fd
  FDport = 9102# where we listen for the director
  WorkingDirectory = ".\\Bacula\\Work"
  Pid Directory = ".\\Bacula\\Work"
  Maximum Concurrent Jobs = 1
}

#
# List Directors who are permitted to contact this File daemon
#
Director {
  Name = nna-dir
  Password = "..."
}

#
# Restricted Director, used by tray-monitor to get the
#   status of the file daemon
#
Director {
  Name = t40-mon
  Password = "..."
  Monitor = yes
}

# Send all messages except skipped files back to Director
Messages {
  Name = Standard
  director = nna-dir = all, !skipped, !restored
}

# Default Bacula Director Configuration file
#
#  The only thing that MUST be changed is to add one or more
#   file or directory names in the Include directive of the
#   FileSet resource.
#
#  For Bacula release 2.2.5 (09 October 2007) -- debian lenny/sid
#
#  You might also want to change the default email address
#   from root to your address.  See the "mail" and "operator"
#   directives in the Messages resource.
#

Director {# define myself
  Name = nna-dir
  DIRport = 9101# where we listen for UA connections
  QueryFile = "/etc/bacula/scripts/query.sql"
  WorkingDirectory = "/var/lib/bacula"
  PidDirectory = "/var/run/bacula"
  Maximum Concurrent Jobs = 1
  Password = "..." # Console password
  Messages = Daemon
  DirAddress = 127.0.0.1
}

JobDefs {
  Name = "DefaultJob"
  Type = Backup
  Level = Incremental
  Client = nna-fd 
  FileSet = "Full Set"
  Schedule = "WeeklyCycle"
  Storage = File
  Messages = Standard
  Pool = Default
  Priority = 10
}


#
# Define the main nightly save backup job
#   By default, this job will back up to disk in /tmp
Job {
  Name = "bastel"
  JobDefs = "DefaultJob"
  Write Bootstrap = "/var/lib/bacula/bastel.bsr"
}

Job {
  Name = "t40"
  Client = t40-fd
  JobDefs = "DefaultJob"
  FileSet = "t40-set"
  Write Bootstrap = "/var/lib/bacula/t40.bsr"
  Run Before Job = "/root/bacula/clientsup.sh %c"
  Reschedule On Error = yes
  Reschedule Interval = 1 minutes
  Reschedule Times = 60
  Rerun Failed Levels = yes
}

# Backup the catalog database (after the nightly save)
Job {
  Name = "BackupCatalog"
  JobDefs = "DefaultJob"
  Level = Full
  FileSet="Catalog"
  Schedule = "WeeklyCycleAfterBackup"
  # This creates an ASCII copy of the catalog
  RunBeforeJob = "/etc/bacula/scripts/make_catalog_backup bacula bacula"
  # This deletes the copy of the catalog
  RunAfterJob  = "/etc/bacula/scripts/delete_catalog_backup"
  Write Bootstrap = "/var/lib/bacula/BackupCatalog.bsr"
  Priority = 11   # run after main backup
}

#
# Standard Restore template, to be changed by Console program
#  Only one such job is needed for all Jobs/Clients/Storage ...
#
Job {
  Name = "RestoreFiles"
  Type = Restore
  Client=nna-fd 
  FileSet="Full Set"  
  Storage = File  
  Pool = Default
  Messages = Standard
  Where = /tmp/bacula-restores
}


# List of files to be backed up
FileSet {
  Name = "Full Set"
  Include {
Options {
  signature = MD5
}
#
#  Put your list of files here, preceded by 'File =', one per line
#or include an external list with:
#
#File = \" -s 
\"Bacula: %t %e of %c %l\" %r"
  operatorcommand = "/usr/lib/bacula/bsmtp -h localhost -f \"\(Bacula\) 
\<%r\>\" -s \"Bacula: Intervention needed for %j\" %r"
  mail = [EMAIL PROTECTED] = all, !skipped
  operator = [EMAIL PROTECTED] = mount
  console = all, !skipped, !saved
#
# WARNING! the following will create a file that you must cycle from
#  time to time as it will grow indefinitely. However, it will
#  also keep all your messages if they scroll off the console.
#
  append = "/var/lib/bacula/log" = all, !skip

Re: [Bacula-users] backup strategy

2007-11-21 Thread Sebastian Perkins

Thanks for the information : I'm using a disk based solution, but after 
a few days worth's of Incremental backup, it looks like I could do a 
diff backup every weekend (even with 2To backup space is still a concern 
!).

-- 
Sebastian Perkins
Responsable Informatique
[EMAIL PROTECTED]

ALPES CONTROLES
3 impasse des prairies
74940 Annecy le Vieux
Tél. 04.50.64.11.46 - Fax. 04.50.64.23.83
http://www.alpes-controles.fr 



Marek Simon a écrit :
> Differential and Incremental  levels differ in this thing: Incremental 
> backup takes the files which has changed since any previous backup of 
> any level. Differental backup takes all files, which has changed since 
> previous Full (and only Full) backup.
> So with your current strategy (one Full per month, Incr other days), 
> if you would have to restore files just a day before new full backup, 
> you must restore from full backup volume and then from 30 records in 
> volumes containing those Incremental ones, which takes longer time. 
> You see this strategy is not usable if you need to backup to tapes.
> If you have some Differential backup (lets say) every weekend, in 
> worst case you must to restore from 1 Full backup, one Differential 
> (which contains all files from last Full backup, which means in this 
> case 3 weeks) and from 6 Incremental backups. The restore would be 
> quicker, but the space needed for backups is bit bigger (in some cases 
> can be even smaller). However, if you have all your backups on some 
> kind of disk array and it is reliable, bacula is able to restore data 
> from 30 Incremental backups with no problem. You still need to keep 
> all your volumes with Incremental backups in non-interupted sequence, 
> or you risk the lose of some files. Of course the Full backup must be 
> all right too.
> MArek
>
>
> Sebastian Perkins napsal(a):
>> Thanks both for the info.
>>
>> I've been going through the "Maximum Volume Jobs" option with mutiple 
>> volumes for incr & full as in the "automated disk backup" example.  
>> Just that I trimmed everything down to one month (ie just 2 full 
>> volumes & 31 incr ones).
>>
>> With a test  situation with 10min retention times between full's ... 
>> volumes are recycling rel nice !
>>
>> One question remains : do I need differential in my stratrgy ?
>>
>> Regards
>>
>> Sebastian Perkins
>> Responsable Informatique
>> [EMAIL PROTECTED]
>>
>> ALPES CONTROLES
>> 3 impasse des prairies
>> 74940 Annecy le Vieux
>> Tél. 04.50.64.11.46 - Fax. 04.50.64.23.83
>> http://www.alpes-controles.fr
>>
>> - Message Original -
>> De: "Marek Simon" <[EMAIL PROTECTED]>
>> Cc: bacula-users@lists.sourceforge.net
>> Sent: lundi 19 novembre 2007 10 h 30 (GMT+0100) Europe/Berlin
>> Sujet: Re: [Bacula-users] backup strategy
>>
>> David is right. Bacula is not able to clear a part of a volume. She can
>> only append to a volume or clean it completely. I can recommend to have
>> one volume for one day (Use duration 23 hours). Bacula will create new
>> volumes everywhen she needs.
>> Marek
>>
>> David Legg napsal(a):
>> > Hi Sebastian,
>> >
>> > I'm only a newbie to this but looking at your director config settings
>> > it looks like you haven't expressed a maximum volume size.  Therefore
>> > Bacula will keep filling up a volume until your disk runs out.  To 
>> force
>> > Bacula to stop filling a volume and look around for another one you
>> > should use a 'Maximum Volume Bytes = nnn' or 'Maximum Volume Jobs = 
>> nnn'
>> > or 'Volume Use Duration = ttt' setting in your pools definition.
>> >
>> > Re-read the beginning of Chapter 22 'Automatic Volume Recycling' for
>> > more details.
>> >
>> > Hope that helps.
>> >
>> > Regards,
>> >
>> > David Legg
>> >
>> >
>> > Sebastian Perkins wrote:
>> >  >> Hi,
>> >>
>> >> We are using bacula 2.2.6 with a disk based backup solution. 3 Months
>> >> into testing, backups & restores are working.
>> >>
>> >> Here goes the problem : we need to backup 750Gb of data (22 server
>> >> samba shares) and guarantee one (maybe two) months of restore data
>> >> just in case somebody moves a directory, loses a file, wants lask
>> >> week's file etc... The samba shares are basically full of doc/xls/pdf
>> >> etc...
>> >>
>> >> The backup is a 

Re: [Bacula-users] backup strategy

2007-11-19 Thread Sebastian Perkins
Thanks both for the info. 

I've been going through the "Maximum Volume Jobs" option with mutiple volumes 
for incr & full as in the "automated disk backup" example. Just that I trimmed 
everything down to one month (ie just 2 full volumes & 31 incr ones). 

With a test situation with 10min retention times between full's ... volumes are 
recycling rel nice ! 

One question remains : do I need differential in my stratrgy ? 

Regards 

Sebastian Perkins 
Responsable Informatique 
[EMAIL PROTECTED] 

ALPES CONTROLES 
3 impasse des prairies 
74940 Annecy le Vieux 
Tél. 04.50.64.11.46 - Fax. 04.50.64.23.83 
http://www.alpes-controles.fr 


- Message Original - 
De: "Marek Simon" <[EMAIL PROTECTED]> 
Cc: bacula-users@lists.sourceforge.net 
Sent: lundi 19 novembre 2007 10 h 30 (GMT+0100) Europe/Berlin 
Sujet: Re: [Bacula-users] backup strategy 

David is right. Bacula is not able to clear a part of a volume. She can 
only append to a volume or clean it completely. I can recommend to have 
one volume for one day (Use duration 23 hours). Bacula will create new 
volumes everywhen she needs. 
Marek 

David Legg napsal(a): 
> Hi Sebastian, 
> 
> I'm only a newbie to this but looking at your director config settings 
> it looks like you haven't expressed a maximum volume size. Therefore 
> Bacula will keep filling up a volume until your disk runs out. To force 
> Bacula to stop filling a volume and look around for another one you 
> should use a 'Maximum Volume Bytes = nnn' or 'Maximum Volume Jobs = nnn' 
> or 'Volume Use Duration = ttt' setting in your pools definition. 
> 
> Re-read the beginning of Chapter 22 'Automatic Volume Recycling' for 
> more details. 
> 
> Hope that helps. 
> 
> Regards, 
> 
> David Legg 
> 
> 
> Sebastian Perkins wrote: 
> 
>> Hi, 
>> 
>> We are using bacula 2.2.6 with a disk based backup solution. 3 Months 
>> into testing, backups & restores are working. 
>> 
>> Here goes the problem : we need to backup 750Gb of data (22 server 
>> samba shares) and guarantee one (maybe two) months of restore data 
>> just in case somebody moves a directory, loses a file, wants lask 
>> week's file etc... The samba shares are basically full of doc/xls/pdf 
>> etc... 
>> 
>> The backup is a 2 To raid5 disk solution. I'm a bit worried about 
>> keeping control over volumes and disk space. I don't want the volumes 
>> to fill up any further than 1.8To while keeping one or 2 months of 
>> history. 
>> 
>> We've resolved one problem regarding size by using the compress option :o) 
>> 
>> So, our bacula.conf strategy is : 
>> 
>> * one full backup per month, plus incremental every other day (no 
>> differential). 
>> * one volume per share (so that we can keep a eye on a fast 
>> growing volume). 
>> * keeping job/file/volume retention to 1 month (maybe 2). 
>> 
>> But the volumes just grow... and grow. I've 'volume updated' for 
>> retention periods but the auto-pruning doesn't seem to reduce volume 
>> size. For example after the 2nd month's full backup I thought the 
>> volume would be reduced in size by the 1st month"s full backup size 
>> (it's outside the retention period). 
>> 
>> Schedule, Volume & Client syntax are : 
>> 
>> Schedule { 
>> Name = "WeeklyCycle" 
>> Run = Full 1st sun at 00:05 
>> Run = Incremental mon-sat at 23:05 
>> #Run = Differential 2nd-5th sun at 23:05 
>> #Run = Incremental mon-sun at 23:05 
>> } 
>> 
>> Client { 
>> Name = pool01-fd 
>> Address = 192.168.x.y 
>> FDPort = 9102 
>> Catalog = MyCatalog 
>> Password = "xxx" 
>> File Retention = 1 month # 30 days 
>> Job Retention = 1 months # 30 days 
>> AutoPrune = yes # Prune expired Jobs/Files 
>> } 
>> 
>> Pool { 
>> Name = Pool01 
>> Pool Type = Backup 
>> Recycle = yes # Bacula can automatically 
>> recycle Volumes 
>> AutoPrune = yes # Prune expired volumes 
>> Volume Retention = 1 month # one month 
>> LabelFormat = "Vol01" 
>> } 
>> 
>> 
>> So, just 2 questions : Is my strategy right ? Why are the volumes 
>> growing ? 
>> 
>> Thanks for any help ! 
>> 
>> Sebastian Perkins 
>> Responsable Informatique 
>> [EMAIL PROTECTED] 
>> 
>> ALPES CONTROLES 
>> 3 impasse des prairies 
>> 74940 Annecy le Vieux 
>> Tél. 04.50.64.11.46 - Fax. 04.50.64.23.83 
>> http://www.alpes-controles.fr 
>> 
&g

[Bacula-users] backup strategy

2007-11-18 Thread Sebastian Perkins

Hi, 

We are using bacula 2.2.6 with a disk based backup solution. 3 Months into 
testing, backups & restores are working. 

Here goes the problem : we need to backup 750Gb of data (22 server samba 
shares) and guarantee one (maybe two) months of restore data just in case 
somebody moves a directory, loses a file, wants lask week's file etc... The 
samba shares are basically full of doc/xls/pdf etc... 

The backup is a 2 To raid5 disk solution. I'm a bit worried about keeping 
control over volumes and disk space. I don't want the volumes to fill up any 
further than 1.8To while keeping one or 2 months of history. 

We've resolved one problem regarding size by using the compress option :o) 

So, our bacula.conf strategy is : 

• one full backup per month, plus incremental every other day (no 
differential). 
• one volume per share (so that we can keep a eye on a fast growing 
volume). 
• keeping job/file/volume retention to 1 month (maybe 2). 

But the volumes just grow... and grow. I've 'volume updated' for retention 
periods but the auto-pruning doesn't seem to reduce volume size. For example 
after the 2nd month's full backup I thought the volume would be reduced in size 
by the 1st month"s full backup size (it's outside the retention period). 

Schedule, Volume & Client syntax are : 

Schedule { 
Name = "WeeklyCycle" 
Run = Full 1st sun at 00:05 
Run = Incremental mon-sat at 23:05 
#Run = Differential 2nd-5th sun at 23:05 
#Run = Incremental mon-sun at 23:05 
} 

Client { 
Name = pool01-fd 
Address = 192.168.x.y 
FDPort = 9102 
Catalog = MyCatalog 
Password = "xxx" 
File Retention = 1 month # 30 days 
Job Retention = 1 months # 30 days 
AutoPrune = yes # Prune expired Jobs/Files 
} 

Pool { 
Name = Pool01 
Pool Type = Backup 
Recycle = yes # Bacula can automatically recycle Volumes 
AutoPrune = yes # Prune expired volumes 
Volume Retention = 1 month # one month 
LabelFormat = "Vol01" 
} 


So, just 2 questions : Is my strategy right ? Why are the volumes growing ? 

Thanks for any help ! 

Sebastian Perkins 
Responsable Informatique 
[EMAIL PROTECTED] 

ALPES CONTROLES 
3 impasse des prairies 
74940 Annecy le Vieux 
Tél. 04.50.64.11.46 - Fax. 04.50.64.23.83 
http://www.alpes-controles.fr 

-
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2005.
http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] restoration problem

2007-09-04 Thread Sebastian Perkins
Thanks for the info. 

Would this be due to the fact that the file retention period is 30 days + 
incremental saves only since the (only) full backup 2 months ago ? 

Did the full backup get purged ? 

If so, does this mean I have to get a full backup done on a regular basis ? 



Sebastian Perkins schrieb: 


>>Is it possible that you have put the directory to the destination in a way 
>>that the timestemps did not change? 
I don't quite understand... I'm still slightly newbie :o) 


Quote from the bacula site ( 
http://www.bacula.org/rel-manual/Current_State_Bacula.html#SECTION0054):
 
"Bacula's Differential and Incremental backups are based on time stamps. 
Consequently, if you move files into an existing directory or move a whole 
directory into the backup fileset after a Full backup, those files will 
probably not be backed up by an Incremental save because they will have old 
dates. You must explicitly update the date/time stamp on all moved files (we 
have a project to correct this)." 

This is the reason why we created a program for our windows-clients that is 
checking the files and directories of the backupfolders and if it found some 
file with an archiveflag it remove it and set a newer timestemp instead. Not 
everybody is happy here if the timestemp changed but it´s better than have no 
backup for a long time. 

However I don´t know if it is the same in Linux. I thought (after a few tests) 
Linux is save :). We don´t use such program or script there. So I´m interessted 
if this could be the reason for your problem. 


Greetings, 
user100 







Sebastian Perkins schrieb: 
> Hello 
> 
> We are using bacula for the first time in restoration mode : bacula 
> version 2.03 / platform fedora core 6. Bacula has been running w/o save 
> errors for 2 months. 
> 
> A test user has asked us to restore an entire directory = what it 
> contained last friday. 
> 
Is it possible that you have put the directory to the destination in a 
way that the timestemps did not change? Can you see all files when you 
try to select them for restore? I think there is a Problem when you move 
files or directories but I thought this problem mainly depends only to 
Win-Clients. 

> If I go through the restore process (using option 6 to select backup for 
> a client before a specific time) and mark his directory, restore is OK 
> BUT, only the modified files of last friday get restored... as if bacula 
> just restored that jobid. 
> 
> Our strategy is to use only the "incremental" option to save on a rather 
> large disk drive (no tapes) to keep the file system. A full backup takes 
> 250 Go of disk space... 
> 
> Bacula determined that the first incremental save was "full" so we do 
> have a full backup for reference. 
> 
> This is what the schedule entry looks like 
> 
> Schedule { 
> Name = "WeeklyCycle" 
> Run = Incremental mon-sun at 23:05 
> } 
> 
> Is this correct ? What is going wrong ? 
> 
> Thanks in advance, 
> 
> 


-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now >>  http://get.splunk.com/___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] restoration problem

2007-08-30 Thread Sebastian Perkins

I only see 800 files... a lot less than the full directory ! The client is also 
Linux based and no changes have been made in the directory structure. 

>>Is it possible that you have put the directory to the destination in a way 
>>that the timestemps did not change? 
I don't quite understand... I'm still slightly newbie :o) 



Sebastian Perkins schrieb: 
> Hello 
> 
> We are using bacula for the first time in restoration mode : bacula 
> version 2.03 / platform fedora core 6. Bacula has been running w/o save 
> errors for 2 months. 
> 
> A test user has asked us to restore an entire directory = what it 
> contained last friday. 
> 
Is it possible that you have put the directory to the destination in a 
way that the timestemps did not change? Can you see all files when you 
try to select them for restore? I think there is a Problem when you move 
files or directories but I thought this problem mainly depends only to 
Win-Clients. 

> If I go through the restore process (using option 6 to select backup for 
> a client before a specific time) and mark his directory, restore is OK 
> BUT, only the modified files of last friday get restored... as if bacula 
> just restored that jobid. 
> 
> Our strategy is to use only the "incremental" option to save on a rather 
> large disk drive (no tapes) to keep the file system. A full backup takes 
> 250 Go of disk space... 
> 
> Bacula determined that the first incremental save was "full" so we do 
> have a full backup for reference. 
> 
> This is what the schedule entry looks like 
> 
> Schedule { 
> Name = "WeeklyCycle" 
> Run = Incremental mon-sun at 23:05 
> } 
> 
> Is this correct ? What is going wrong ? 
> 
> Thanks in advance, 
> 
> 

-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now >>  http://get.splunk.com/___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] restoration problem

2007-08-30 Thread Sebastian Perkins
Hello

We are using bacula for the first time in restoration mode : bacula 
version 2.03 / platform fedora core 6. Bacula has been running w/o save 
errors for 2 months.

A test user has asked us to restore an entire directory = what it 
contained last friday.

If I go through the restore process (using option 6 to select backup for 
a client before a specific time) and mark his directory, restore is OK 
BUT, only the modified files of last friday get restored... as if bacula 
just restored that jobid.

Our strategy is to use only the "incremental" option to save on a rather 
large disk drive (no tapes) to keep the file system. A full backup takes 
250 Go of disk space...

Bacula determined that the first incremental save was "full" so we do 
have a full backup for reference.

This is what the schedule entry looks like

Schedule {
  Name = "WeeklyCycle"
  Run = Incremental mon-sun at 23:05
}

Is this correct ? What is going wrong ?

Thanks in advance,

-- 
Sebastian Perkins
Responsable Informatique
[EMAIL PROTECTED]

ALPES CONTROLES
3 impasse des prairies
74940 Annecy le Vieux
Tél. 04.50.64.11.46 - Fax. 04.50.64.23.83
http://www.alpes-controles.fr 



-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now >>  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Bacula with 2 tapes how??

2007-06-21 Thread ..::Sebastian Syrynski-Giro::..
Hi,

Maybe someone know how I should cofigure Bacula to work with two HP tapes??


-- 
Best regards
Seba

-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] high availability

2006-12-11 Thread Sebastian Hegewald

hello,

i should compare bacula and amanda concerning high availability.

now my question is. is there support for a failover-scenario?
just a little example:

i have a aktiv director and some clients and storagedaemons. now the
director fails. is it possible to switch to a passiv director so that he
will be the aktiv one.

thx hege
-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] scalability / multiple storage devices / infiniBand

2006-12-07 Thread Sebastian Hegewald

hey,

i have 3 questions.

1. delivers the FD the backupdata straight to the SD or uses he the detour
over the Director?

2. is it possible to write a backup of one client simultaneously to
different Storages Devices, so that the backup is distributed?

3. is it possible to run bacula over a infiniBand network?

thank you hege
-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Virtual Tapes and/or BlueRay

2006-12-02 Thread Sebastian Hegewald

hello,

is there support of virtual tapes and/or of blueray in bacula?

thx, hege
-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] BUG? - concurrent spooling.

2006-07-19 Thread Sebastian Stark
On 18.07.2006, at 18:47, Alan Brown wrote:

> On Tue, 18 Jul 2006, Sebastian Stark wrote:
>
>
>> I also noticed problems with this kind of setup but almost never  
>> got an
>> answer when asking questions about multiple drive autochanger  
>> issues...
>>
>
> For the most part, this is "esoteric high end use" :-)

Probably. One of baculas strengths however is great scalability  
(we're at 50TB of backup data at the moment), that's why we use it in  
favour of other solutions :)

>
>
>> ps I have three drives w/ thre concurrent jobs and spooling and  
>> very often
>> find two of the drives idleing while there are hundreds of jobs  
>> waiting for a
>> free drive.
>>
>
> I am seeing this too.
>
> Additionally I'm getting multiple-hour hangs when trying "status  
> director"
> in bconsole as it tries to check for jobs waiting to reserve a drive.
>
> The same hangs occur in the tray monitor.
>
>
> Having observed it for a while, it looks like anything using drive 1
> causes drive 0 to be locked out, but using drive 0 does not lockout  
> drive
> 1.
>

Sometimes it looks to me like bacula starts three jobs, then waits  
until *all* of them have finished and starts another round of three.  
I am not 100% sure yet, but I guess the other jobs wait "on max  
concurrent storage jobs", which I set to four. I have to find a way  
to monitor all this.

I did not choose different spool directories for each drive, in my  
opinion one would only benefit from this by having a dedicated hard  
drive for each tape drive. Am I wrong?

I have yet to find a way to reproduce this behaviour. It's a bit hard  
because you only notice this kind of stuff if you have relatively  
long running jobs. What I can do is send my configuration so far.

bacula-sd.conf:

Storage {
   Name = yangtse-sd
   SDPort = 9103
   WorkingDirectory = "/usr/local/bacula/working"
   Pid Directory = "/var/run"
   Maximum Concurrent Jobs = 4
}

Autochanger {
   Name = neo4000
   Device = Drive3,Drive4,Drive5
   Changer Command = "/usr/local/bacula/etc/mtx-changer %c %o %S %a %d"
   Changer Device = "/dev/scsi/changer/c4t211086119230d2"
}

Device {
# LTO-2 Laufwerk SCSI (NEO: Drive 1)
# Used only for permanent pool (LTO-2 tapes only!)
# thus autoselect=no
Name = Drive1
Media Type = LTO-2
Archive Device = /dev/rmt/2cbn
AutomaticMount = yes;
AlwaysOpen = yes;
RemovableMedia = yes;
Drive Index = 0
AutoChanger = yes
Autoselect = no
Spool Directory = /export/altai0/spool
Maximum Spool Size = 429496729600 # 400G
Maximum Job Spool Size = 214748364800 # 200G
Maximum Rewind Wait = 600
Maximum Open Wait = 30
Maximum Changer Wait = 120
}

Device {
# LTO-3 Laufwerk FC (NEO: Drive 3) (dmesg: st18)
Name = Drive3
Media Type = LTO-2
Archive Device = /dev/rmt/4cbn
AutomaticMount = yes;
AlwaysOpen = yes;
RemovableMedia = yes;
Drive Index = 1
AutoChanger = yes
Spool Directory = /export/altai0/spool
Maximum Spool Size = 429496729600  # 400G
Maximum Job Spool Size = 214748364800  # 200G
Maximum Rewind Wait = 600
Maximum Open Wait = 30
Maximum Changer Wait = 120
}

Device {
# LTO-3 Laufwerk FC (NEO: Drive 4) (dmesg: st17)
Name = Drive4
Media Type = LTO-2
Archive Device = /dev/rmt/3cbn
AutomaticMount = yes;
AlwaysOpen = yes;
RemovableMedia = yes;
#RandomAccess = no;
Drive Index = 2
AutoChanger = yes
Spool Directory = /export/altai0/spool
Maximum Spool Size = 429496729600  # 400G
Maximum Job Spool Size = 214748364800  # 200G
Maximum Rewind Wait = 600
Maximum Open Wait = 30
Maximum Changer Wait = 120
}

Device {
# LTO-3 Laufwerk SCSI (NEO: Drive 5) (dmesg: st14)
Name = Drive5
Media Type = LTO-2
Archive Device = /dev/rmt/0cbn
AutomaticMount = yes;
AlwaysOpen = yes;
RemovableMedia = yes;
Drive Index = 3
AutoChanger = yes
Spool Directory = /export/altai0/spool
Maximum Spool Size = 429496729600  # 400G
Maximum Job Spool Size = 214748364800  # 200G
Maximum Rewind Wait = 600
Maximum Open Wait = 30
Maximum Changer Wait = 120
}




Sebastian






-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys -- and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] status dir

2006-06-28 Thread Sebastian Stark

On 28.06.2006, at 15:55, Julien Cigar wrote:

> Yep it's turned on, but I have this messages every time I do a  
> *status dir, and nothing is pruned

Have you checked your retention periods? Maybe this volume is just  
not "old enough".

Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] status dir

2006-06-28 Thread Sebastian Stark

If you have automatic pruning turned on this is expected behaviour I  
would say.


Sebastian

On 28.06.2006, at 15:47, Julien Cigar wrote:

> Hi !
>
> I'm using 1.38.9 (Debian) with PostgreSQL (8.1.4)
>
> Am I the only one to have this kind of message : 28-Jun 12:39
> phoenix-dir: Pruning oldest volume "Canis-Incr-Disk-0001" when I do a
> *status dir ? (nothing is pruned of course)
>
> (Complete output is available on
> http://rafb.net/paste/results/xCvfPR87.html)
>
> Thanks
>
> Using Tomcat but need to do more? Need to support web services,  
> security?
> Get stuff done quickly with pre-integrated technology to make your  
> job easier
> Download IBM WebSphere Application Server v.1.0.1 based on Apache  
> Geronimo
> http://sel.as-us.falkag.net/sel? 
> cmd=lnk&kid=120709&bid=263057&dat=121642
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users


Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] list jobs for specific client

2006-06-26 Thread Sebastian Stark

Is there a way to restrict the "list jobs" to show the jobs of a  
specific client only?


-Sebastian

Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula 1.38.10 patch

2006-06-26 Thread Sebastian Stark

On 25.06.2006, at 15:55, Kern Sibbald wrote:

> Hello,
>
> I have released a patch (1.38.10-scheduler.patch) to the patches  
> area of the
> Bacula Source Forge releases.  I *strongly* recommend that everyone  
> using
> Bacula version 1.38.10 apply this patch.  It applies only to the  
> Director
> (the SD and FD are unchanged) and *only* to version 1.38.10.  The  
> patch will

After applying and recompiling, is it enough to copy src/dird/bacula- 
dir to the system or are there any other binaries affected?


-Sebastian

Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Director on 1.38.10 hangs when idle

2006-06-26 Thread Sebastian Stark

On 25.06.2006, at 17:55, Cristobal Sabroe Yde wrote:

> Hi, I've been using bacula 1.38.8 on a SuSE Linux 10.0 x86_64  
> without any
> problem, but I choose to switch to 1.38.10 and now every time the  
> director is
> idle for several hours (ie. waiting for backups the next day), it  
> stops to
> resopond. The process keps running, but it doesn't respond to the  
> schedule,
> nor bconsole . I have restart it to make it run ok.
> I've compiled the two versions the same way and installed 1.38.10  
> on top of
> the older (using the same configs), and I don't have a clue what it  
> could be
> causing this behaviour.
> In the mean time I'll switch back to 1.38.8.
> Any Idea will be appreciated. Thanks a lot.

Same for me (Solaris 10, sparc64). I will try the patch today.


-Sebastian

Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] priority problem with multiple drives

2006-06-20 Thread Sebastian Stark

I want to run a restore job, only one jobs is running at the moment  
but there are two other drives that could be used. The restore job  
you see in the list was run with priority 1, still it is waiting for  
higher priority jobs to finish. Why that?


Thanks,
Sebastian


Running Jobs:
JobId Level   Name   Status
==
   9732 Increme  Backup_agbs-steinlach_home.2006-06-20_10.40.22 is  
running
   9733 Increme  Backup_agbs-steinlach_share.2006-06-20_10.40.23 is  
waiting on max Client jobs
   9734 Increme  Backup_agbs-steinlach_share2.2006-06-20_10.40.24 is  
waiting on max Client jobs
   9737 FullBackup_mysql-catalog.2006-06-20_10.40.27 is waiting  
for higher priority jobs to finish
   9738 Restore_abt6-sirius.2006-06-20_11.00.28 is waiting  
for higher priority jobs to finish



Director resource in bacula-dir.conf:  Maximum Concurrent Jobs = 5
Storage resource in bacula-dir.conf:  Maximum Concurrent Jobs = 3
Storage resource in bacula-sd.conf:  Maximum Concurrent Jobs = 4


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] I love my bacula, but my boss says throughput is too slow.... :-( What can I do to optimize?

2006-06-18 Thread Sebastian Stark

Am 18.06.2006 um 13:04 schrieb Tracy R Reed:

> Tracy R Reed wrote:
>> Device:tps   Blk_read/s   Blk_wrtn/s   Blk_read
>> Blk_wrtn
>> hda   0.00 0.00 0.00   
>> 0  0
>> sda 969.39   146.94 13069.39144   
>> 12808
>>
>> How on earth could it be writing so much more than it is reading?  
>> That
>> is quite puzzling. If I strace the bacula-fd or bacula-sd  
>> processes they
>> are just sitting in a select. I never see them doing anything  
>> else. But
>> the spool file is growing so I know it is making progress.
>>
>
> A little more info: I noticed further down in the iostat output  
> that it
> says all of the write IO is going to dm-10 which means the 10th device
> manager device which in my lvm setup is  /var. This happens to be  
> where
> the bacula db is located. If I do an strace on bacula-dir when I first
> start up bacula I see:

As far as I understand the SQLite interface shouldn't be used in  
production environments. You should get better performance by  
switching to MySQL or PostgreSQL.



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] I love my bacula, but my boss says throughput is too slow.... :-( What can I do to optimize?

2006-06-17 Thread Sebastian Stark

Am 16.06.2006 um 21:02 schrieb Christoff Buch:

>
> Hi!
>
> So far I thought about turning off spooling, which speeded  
> throughput up from ca. 5MB/s to 7MB/s.
> But the old backup - software did ca. 15MB/s.
> So I'm still at only about 50%.

How did you measure? The througput value supplied by the fd is  
probably not measured the same way is it was with your old software.

Spooling is nice if you do not want your tape go into start-stop-mode  
when doing incrementals.

> What are the configuration items of bacula that influence its  
> throughput?
> I guess it can have something to do with:
> - signature = MD5 (In FileSet)
> - compression (In FileSet; switched off)

(Software) compression considerably slows things down.

> - messages (but this overhead can't be that big, right?)
> - MaximumNetworkBufferSize (set to 65536 in my sd and all fds, and  
> restarted of course)
>
> Unfortunately to no avail.
>
> Has anyone successfully managed to get over 10 MB/s?

Again, I don't know how your measured. I can spool up to MIN(speed-of- 
spooling-device, network-speed) and then write to tape with up to  
approximately 45 MB/s. I configured bacula such that it can run three  
jobs at the same time, on three devices.

What about your database speed? If you use MySQL turn on the slow  
query log to find problems with your db performance. Make sure you  
have all indexes set up properly


-Sebastian


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Can the storage daemon unload a tape?

2006-06-02 Thread Sebastian Stark

On 02.06.2006, at 10:14, Arno Lehmann wrote:
>
> I'd even like commands to move tapes...
>

Couldn't this be done with an infrastructure that is similar to sql  
queries? I can imagine a generic "changer" command that looks into a  
file just like query.sql and lists available commands like "move  
tape", "unload drive(s)", asking for parameters and then feeds the  
command to e. g. mtx-changer. What do you think?

One issue comes just right into my mind: You would still have to  
"update slots" afterwards...

(I Cc'ed the -devel list)


-Sebastian


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] using multiple autochanger resources with one autochanger / "soft-partitioning"

2006-06-02 Thread Sebastian Stark

At the moment all my tapes are LTO-2 and I want to switch to LTO-3  
tapes. There are three LTO-3 and one LTO-2 drive in my library. The  
idea is to have a pool "old" that has its own autochanger resource  
with only the LTO-2 drive and then some other pools (with only LTO-3  
tapes in them) that use another autochanger resource with only the  
LTO-3 drives.

I guess all I would have to do is put some queueing/locking code into  
mtx-changer, right? Do you think this is a good idea (I would call it  
"soft-partitioning the library" or is there a better way to do what I  
want?


Thanks,
Sebastian


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] contradicting volume requests

2006-05-18 Thread Sebastian Stark
I am sorry for the noise. The problem was that for a reason I still  
do not know the SCSI IDs (and therefore the device names) of the two  
drives were changed. This, of course, is very hard to handle for  
bacula...



-Sebastian

On 13.05.2006, at 10:11, Sebastian Stark wrote:

How can I resolve this situation? Volume 81 is currently loaded  
but it is not acceptable. Bacula somehow wants volume 84, which  
is also not acceptable for some reason...



*m
13-May 10:07 yangtse-sd: Backup_yangtse-system.2006-05-13_01.05.00  
Warning: Director wanted Volume "84" for device "Drive0" (/dev/ 
rmt/0cbn).

Current Volume "81" not acceptable because:
1998 Volume "81" status is Full, but should be Append,  
Purged or Recycle.
13-May 10:07 yangtse-sd: Please mount Volume "81" on Storage  
Device "Drive0" (/dev/rmt/0cbn) for Job Backup_yangtse-system. 
2006-05-13_01.05.00



This is bacula-1.38.6


-Sebastian


---
Using Tomcat but need to do more? Need to support web services,  
security?
Get stuff done quickly with pre-integrated technology to make your  
job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache  
Geronimo
http://sel.as-us.falkag.net/sel? 
cmd=lnk&kid=120709&bid=263057&dat=121642

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users




---
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] contradicting volume requests

2006-05-16 Thread Sebastian Stark
How can I resolve this situation? Volume 81 is currently loaded  
but it is not acceptable. Bacula somehow wants volume 84, which  
is also not acceptable for some reason...



*m
13-May 10:07 yangtse-sd: Backup_yangtse-system.2006-05-13_01.05.00  
Warning: Director wanted Volume "84" for device "Drive0" (/dev/ 
rmt/0cbn).

Current Volume "81" not acceptable because:
1998 Volume "81" status is Full, but should be Append,  
Purged or Recycle.
13-May 10:07 yangtse-sd: Please mount Volume "81" on Storage  
Device "Drive0" (/dev/rmt/0cbn) for Job Backup_yangtse-system. 
2006-05-13_01.05.00



This is bacula-1.38.6


-Sebastian


---
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


  1   2   >