Re: [Bacula-users] Base jobs and incremental backups
Le mardi 24 mai 2011 j'ai reçu le message suivant:
> Maybe laptop-lan and laptop-wlan need to be the same client (same name).
>
> Just change the ip address of the client configuration of laptop-lan to be
> the wlan ip and run a FULL backup on it.
>
> Let me know.
>
> Pablo
Hello,
That would be strange if the 2 needs to be the same name or IP address as in
the doc it is said that it can use backups from other clients as "template" of
backup:
-
extract of the doc:
A new Job directive Base=Jobx, Joby... permits to specify the list of files
that will be used during Full backup as base.
Job {
Name = BackupLinux
Level= Base
...
}
Job {
Name = BackupZog4
Base = BackupZog4, BackupLinux
Accurate = yes
...
}
In this example, the job BackupZog4 will use the most recent version of all
files contained in BackupZog4 and BackupLinux jobs. Base jobs should have run
with level=Base to be used.
-
Changing IP as you request would make me change the IP of the server too (WiFi
and LAN are not in the same network), so first I would like to do more
investigations without modifying IPs.
I will make some quick tests with small directories.
Could you post here the example of you base job and related job please ?
Thanks !
JC
--
http://www.tipmeabout.org
http://www.tipmeabout.com
--
vRanger cuts backup time in half-while increasing security.
With the market-leading solution for virtual backup and recovery,
you get blazing-fast, flexible, and affordable data protection.
Download your free trial now.
http://p.sf.net/sfu/quest-d2dcopy1___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Base jobs and incremental backups
Le mercredi 18 mai 2011 j'ai reçu le message suivant:
> > Are there any informations in the log file that prove the first full
> > after a base job is effectively using the base job ?
>> [...]
Hello,
I'm back with news, but not good.
I have done a base job backup of the laptop system through LAN connection (job
name: laptop-lan_system.basejob). Below the definition of this job:
Job {
Name= "laptop-lan_system.basejob"
Enabled= "yes"
Type= "Backup"
Level= "Base" # can be defined in the schedule resource
Client= "laptop-lan"
FileSet= "system"
Messages= "Standard"
Pool= "full"
Full Backup Pool= "full"
Differential Backup Pool= "diff"
Incremental Backup Pool= "incr"
Schedule= "full_1st_of_month"
Storage= "VTD_08"
Priority= 9
}
Then a full backup of this client through WIFI (job name:laptop-wlan_system)
and mentionning that this job should help itself with the previous base job.
Below the definition of this job:
Job {
Name= "laptop-wlan_system"
Enabled= "yes"
Type= "backup"
Base= "laptop-lan_system.basejob"
Level= "incremental" # can be defined in the schedule resource
Client= "laptop-wlan"
FileSet= "system"
Messages= "Standard"
Pool= "incr"
Full Backup Pool= "full"
Differential Backup Pool= "diff"
Incremental Backup Pool= "incr"
Schedule= "incr_everyday_but_1st"
Storage= "VTD_04"
}
As I have launched manually the full, I have change in command line the level
and pool of the job laptop-wlan_system to set them to full.
But unfortunately, it take more than 5 hours to do the backup and from the
report at the end of the backup, it did not take the base job into
consideration as no line appears to indicate the percentage of use from the
base job:
Build OS: x86_64-redhat-linux-gnu redhat
JobId: 1235
Job:laptop-wlan_system.2011-05-23_08.46.24_03
Backup Level: Full
Client: "laptop-wlan" 5.0.3 (04Aug10) x86_64-redhat-linux-
gnu,redhat,
FileSet:"system" 2011-03-18 08:47:54
Pool: "full" (From Job FullPool override)
Catalog:"bacula" (From Client resource)
Storage:"VTD_04" (From Job resource)
Scheduled time: 23-mai-2011 08:46:06
Start time: 23-mai-2011 08:46:26
End time: 23-mai-2011 14:05:18
Elapsed time: 5 hours 18 mins 52 secs
Priority: 10
FD Files Written: 131,130
SD Files Written: 131,130
FD Bytes Written: 7,233,904,662 (7.233 GB)
SD Bytes Written: 7,252,157,429 (7.252 GB)
Rate: 378.1 KB/s
Software Compression: None
VSS:no
Encryption: no
Accurate: no
Volume name(s): full_vol-027|full_vol-028|full_vol-029
Volume Session Id: 19
Volume Session Time:1306014285
Last Volume Bytes: 574,149,829 (574.1 MB)
Non-fatal FD errors:0
SD Errors: 0
FD termination status: OK
SD termination status: OK
Termination:Backup OK
So what's wrong with my configuration ?
Thanks for your help !
JC
--
http://www.tipmeabout.org
http://www.tipmeabout.com
--
What Every C/C++ and Fortran developer Should Know!
Read this article and learn how Intel has extended the reach of its
next-generation tools to help Windows* and Linux* C/C++ and Fortran
developers boost performance applications - including clusters.
http://p.sf.net/sfu/intel-dev2devmay
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Base jobs and incremental backups
Thank you Pablo for your help. I will do a test with the base job done through LAN, then the full through wifi. I will post the result here. JC Le mercredi 18 mai 2011 j'ai reçu le message suivant: > > Are there any informations in the log file that prove the first full > > after a base job is effectively using the base job ? > > The Bacula report after the FULL gives you very useful information, > including the BASE backup files used. > > This is a sample report after a FULL backup, notice the line Base > files/Used files: > > JobId: 371 > Job: server-fd-data.2011-05-09_16.58.33_17 > Backup Level: Full (upgraded from Incremental) > Client: "server-fd" 5.0.3 (04Aug10) Linux,Cross-compile,Win32 > FileSet: "server-set" 2011-05-09 14:29:09 > Pool: "Yearly" (From User input) > Catalog: "MyCatalog" (From Client resource) > Storage: "FileStorage" (From Job resource) > Scheduled time: 09-May-2011 16:58:24 > Start time: 09-May-2011 17:02:10 > End time: 09-May-2011 18:01:16 > Elapsed time: 59 mins 6 secs > Priority: 10 > FD Files Written: 39,344 > SD Files Written: 39,344 > FD Bytes Written: 8,600,464,982 (8.600 GB) > SD Bytes Written: 8,606,510,471 (8.606 GB) > Rate: 2425.4 KB/s > Software Compression: 39.7 % > Base files/Used files: 39336/39114 (99.44%) > VSS: yes > Encryption: no > Accurate: yes > Volume name(s): Tape-Year-0001 > Volume Session Id: 358 > Volume Session Time: 1302812565 > Last Volume Bytes: 252,270,109,076 (252.2 GB) > Non-fatal FD errors: 0 > SD Errors: 0 > FD termination status: OK > SD termination status: OK > Termination: Backup OK > > For your case, depending on how much data changes on the Laptop, it maybe > OK just to leave it on the WiFi for all backups (except for the BASE). > > Pablo > - Original Message - > From: "- -" > To: "Pablo Marques" > Cc: bacula-users@lists.sourceforge.net > Sent: Wednesday, May 18, 2011 9:10:55 AM > Subject: Re: [Bacula-users] Base jobs and incremental backups > > > 2011/5/18 Pablo Marques < pmarq...@miamilinux.net > > > > > When you do a Base backup, you need to do a FULL immediately after, > because the BASE backup is a "special" backup and you cannot restore only > from it. > > From then on you can do Incrementals, Fulls or Differentials. > > All the FULL backups that you will run after that fist FULL are going to be > very small, so you should only need to have the laptop on Gig on your > first BASE backup. > > Hope this helps. > > Pablo > > > > > > > > > Hello ! > > That's an interesting point ! I did not understand when read the > documentation that a full is necessary after a base job. I though a base > replaces a full. For me the interesting point of a base job was that you > can do a base job of a "template" server, and then backup n servers > directly without having n full backups to do. Writing that, I now > understand better the concept of base jobs, all the n full would contain > pointers on the base jobs. Are there any informations in the log file that > prove the first full after a base job is effectively using the base job ? > Something like "running 'client-bkp job' based on 'based-job' " ? > > So for my problem, I should try to do a floating IP between the 2 interface > - GiB and wifi - and do the backup on this interface: if the LAN cable is > connected, backup goes through the LAN, if there is only the wifi it would > use it. I think I can do that with a piece of script. eth0 would be > "client-lan", wlan0 "client-wlan" and the backup interface would be > "client-bkp" pointing on "eth0:0" if cable is connected or "wlan0:0". > > Thanks for your help ! > > JC > > > > > > > - Original Message - > From: "TipMeAbout" < tipmeab...@gmail.com > > To: bacula-users@lists.sourceforge.net > Sent: Tuesday, May 17, 2011 5:09:10 PM > Subject: Re: [Bacula-users] Base jobs and incremental backups > > > On Mon, May 16, 2011 at 11:07 PM, TipMeAbout < tipmeab...@gmail.com > wrote: > > > Hello all, > > > > > > I use Bacula for some times now and I experiment now the base job > > > backup. I have to solve a problem and I need help: I have to backup a > > > laptop. > > > > > > This laptop is most of the time connected by wifi. As it contains quite > > > large > > > data, I have decided to do a full the 1st of each month and an > > > incremental the > > > oth
Re: [Bacula-users] Base jobs and incremental backups
> On Mon, May 16, 2011 at 11:07 PM, TipMeAbout wrote: > > Hello all, > > > > I use Bacula for some times now and I experiment now the base job backup. > > I have to solve a problem and I need help: I have to backup a laptop. > > > > This laptop is most of the time connected by wifi. As it contains quite > > large > > data, I have decided to do a full the 1st of each month and an > > incremental the > > other days. > > To let the full run quickly, I decided that the laptop will be connected > > by its LAN 1Gb connection the 1st and by wifi the rest of the month. So > > I have 2 > > client instances configured: "client-lan" and "client-wlan", one for each > > type > > of backup, each with its own IP address. But when I start an incremental > > for > > "client-wlan", Bacula tells me it does not find a valid full, so it > > starts a > > full through the wifi connection. Too long !! > > I have decided to do a base job the 1st of the month by LAN for instance > > "client-lan" and then each incremental for "client-wlan" would be based > > on this base job. It does not work neither as it still starts a full > > backup in wifi mode instead of incremental. I have read that a base job > > is like a full > > and let full backup base on it: so I change my incremental backup by a > > full with hope it would saved only some datas, for instance > > "client-wlan". But after a while running, I have the impression Bacula > > does a new total full without taking into consideration the base job > > backup. > > > > So my questions are simple: does base job can be used with incremental > > backups > > to realise what I would like and how to do that ? > > > > Thanks in advance for your help ! > > > > > > JC > > > > > > -- > > http://www.tipmeabout.org > > Rather than try to backup the laptop with Bacula, I would use RSYNC to on > the laptop and then backup the rsync "mirror" of the laptop, that way you > don't rely on the laptop being connected and once you have done the initial > rsync the incrementals are much easier to manage over your WiFi bandwidth. > You could also trigger your rsync job to run when the interface comes up, > and if you did this over SSH via an Internet resolvable f.q.d.n then you > can backup from "anywhere" > > Although Bacula is fantastic for backing up, sometimes other "tools" can > make the overall process better Hello, Thanks for your answer ! Of course I could use other tools, but the challenge is to do that with bacula and to highlight how to use base job backup as a base for incremental backup. By using RSYNC, I have to provide space left on the bacula server which would act as mirror, and then space to backup this mirror with bacula (I use backup on disk file of 4GiB). Moreover, the rsync would mirror data I don't care (iso, mpeg, jpg) which are space and bandwidth consuming through wifi; with bacula, it excluded from the beginning. And maintaining 2 lists of exclusion - one for each tool - is not the most recommended I think. If someone else has a proposal, I'm still open for an answer. I will myself think if a solution based on virtual IPs can be set up. If I found something, I would of course complete this thread. See you all ! JC -- http://www.tipmeabout.org -- What Every C/C++ and Fortran developer Should Know! Read this article and learn how Intel has extended the reach of its next-generation tools to help Windows* and Linux* C/C++ and Fortran developers boost performance applications - including clusters. http://p.sf.net/sfu/intel-dev2devmay ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Base jobs and incremental backups
Hello all, I use Bacula for some times now and I experiment now the base job backup. I have to solve a problem and I need help: I have to backup a laptop. This laptop is most of the time connected by wifi. As it contains quite large data, I have decided to do a full the 1st of each month and an incremental the other days. To let the full run quickly, I decided that the laptop will be connected by its LAN 1Gb connection the 1st and by wifi the rest of the month. So I have 2 client instances configured: "client-lan" and "client-wlan", one for each type of backup, each with its own IP address. But when I start an incremental for "client-wlan", Bacula tells me it does not find a valid full, so it starts a full through the wifi connection. Too long !! I have decided to do a base job the 1st of the month by LAN for instance "client-lan" and then each incremental for "client-wlan" would be based on this base job. It does not work neither as it still starts a full backup in wifi mode instead of incremental. I have read that a base job is like a full and let full backup base on it: so I change my incremental backup by a full with hope it would saved only some datas, for instance "client-wlan". But after a while running, I have the impression Bacula does a new total full without taking into consideration the base job backup. So my questions are simple: does base job can be used with incremental backups to realise what I would like and how to do that ? Thanks in advance for your help ! JC -- http://www.tipmeabout.org -- Achieve unprecedented app performance and reliability What every C/C++ and Fortran developer should know. Learn how Intel has extended the reach of its next-generation tools to help boost performance applications - inlcuding clusters. http://p.sf.net/sfu/intel-dev2devmay ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
