[Bacula-users] Encoding
Hello, i want to know if anyone has experience with database encoding at Bacula 3.0.2-3. Its a lenny-backport package. system configuration: os: debian lenny bacula: 3.0.2-3 lenny-backport database: PostgreSQL 8.3 My question in detail. The database bacula on my postgreSQL-server has encoding level UTF-8. Bacula in this version requires SQL_ACSII. Is there any chance to say bacula it should use UTF-8 instead of SQL_ASCII? It is no option to change encoding of database to SQL_ASCII for us, we still want to use UTF-8. Maybe there exists any configuration file i've not found yet or any other surrounding to solve this problem? Many thanks and kind regards! -- Beste Grüße Gordon Neumann --- SOURCEPARK GmbH Helmholtzstr. 2-9, Gebäude M 10587 Berlin Tel:+49 (0) 30 / 39 80 68 30 Fax:+49 (0) 30 / 39 80 68 39 e-mail: gneum...@sourcepark.de www:www.sourcepark.de --- SOURCEPARK GmbH Sitz der Gesellschaft: Berlin / Amtsgericht Charlottenburg HRB 80254 Geschäftsführung: Matthias Barmeier, Harald Dürr --- Diese Email kann vertrauliche und/oder rechtlich geschützte Informationen enthalten. Wenn sie nicht der richtige Adressat sind oder diese E-Mail irr- tümlich erhalten haben, informieren Sie bitte sofort diesen Absender und ver- nichten Sie diese E-Mail. Das unerlaubte Kopieren sowie die unbefugte Weitergabe dieser E-Mail ist nicht gestattet. -- Return on Information: Google Enterprise Search pays you back Get the facts. http://p.sf.net/sfu/google-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backup error - Network send error to SD
uhog-v...@spamex.com wrote: > Hi everyone. I have a new problem with a particular backup in my environment. > I'm using bacula 3.0.2 across all components. This has been running fine for > some time however this particular laptop used to be running linux(recently it > was switched over to XP). > > Could be the NIC driver on the laptop. Bacula expects the SD-FD connection to stay up throughout the job. Try turning off any and all power saving functions implemented by the NIC driver. Some Windows NIC drivers will drop the connection and go into power saving mode for whatever reason. I have seen this with a Lenovo T61 . -- Return on Information: Google Enterprise Search pays you back Get the facts. http://p.sf.net/sfu/google-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Create new volume vs. recycle volume
I've re-read the section on volume retention and volume recycling but
I'm still confused.
My backup files are being reused even though my director is configured
to create new files. Backups are working on schedule but my secondary,
rsync-based backup is failing because the filenames and filesizes
haven't changed.
I did recently change the value of Recycle back to no.
Pool {
Name = Default
Label Format = "${JobName}-${Level}-${NumVols}"
Pool Type = Backup
Recycle = no
AutoPrune = yes # Prune expired volumes
Use Volume Once = yes
Volume Retention = 25 days # one year
MaximumVolumeBytes = 512m
Maximum Volume Jobs = 1
}
`show pools` within the console looks right:
Pool: name=Default PoolType=Backup
use_cat=1 use_once=1 cat_files=1
max_vols=0 auto_prune=1 VolRetention=25 days
VolUse=0 secs recycle=0 LabelFormat=${JobName}-${Level}-${NumVols}
CleaningPrefix=*None* LabelType=0
RecyleOldest=0 PurgeOldest=0
MaxVolJobs=1 MaxVolFiles=0 MaxVolBytes=0
MigTime=0 secs MigHiBytes=0 MigLoBytes=0
The output of `list volumes` in the console shows the volumes are full
or used, not purged.
Do I need to manually mark each volume purged so bacula will start
creating new files? How can I get bacula to create new files with each
backup job?
Thanks!
Brian Clarkson
Lone Star Internet
--
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Create new volume vs. recycle volume
On Thu, Dec 10, 2009 at 10:43 AM, Brian Clarkson wrote:
> I've re-read the section on volume retention and volume recycling but
> I'm still confused.
>
> My backup files are being reused even though my director is configured
> to create new files. Backups are working on schedule but my secondary,
> rsync-based backup is failing because the filenames and filesizes
> haven't changed.
>
> I did recently change the value of Recycle back to no.
>
> Pool {
> Name = Default
> Label Format = "${JobName}-${Level}-${NumVols}"
> Pool Type = Backup
> Recycle = no
> AutoPrune = yes # Prune expired volumes
> Use Volume Once = yes
> Volume Retention = 25 days # one year
> MaximumVolumeBytes = 512m
> Maximum Volume Jobs = 1
> }
>
> `show pools` within the console looks right:
>
> Pool: name=Default PoolType=Backup
> use_cat=1 use_once=1 cat_files=1
> max_vols=0 auto_prune=1 VolRetention=25 days
> VolUse=0 secs recycle=0 LabelFormat=${JobName}-${Level}-${NumVols}
> CleaningPrefix=*None* LabelType=0
> RecyleOldest=0 PurgeOldest=0
> MaxVolJobs=1 MaxVolFiles=0 MaxVolBytes=0
> MigTime=0 secs MigHiBytes=0 MigLoBytes=0
>
> The output of `list volumes` in the console shows the volumes are full
> or used, not purged.
>
> Do I need to manually mark each volume purged so bacula will start
> creating new files?
No that would make bacula use the old volumes. Purged is a state of recycling.
>How can I get bacula to create new files with each
> backup job?
>
Make the volume retention much longer. And then apply that to all of
your volumes.
However I suspect what you really want is after 25 days you want the
old volume to be deleted. For that you will need to have an external
script (that feeds commands to bconsole) fired by a cron job or admin
job.
John
--
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Network transfer Speed
Steve, Here is a quick snap of my top during a full backup. top - 09:32:35 up 1 day, 18:38, 1 user, load average: 11.41, 11.60, 10.75 Tasks: 161 total, 1 running, 160 sleeping, 0 stopped, 0 zombie Cpu0 : 0.3%us, 0.3%sy, 0.0%ni, 0.0%id, 99.4%wa, 0.0%hi, 0.0%si, 0.0%st Cpu1 : 13.0%us, 1.4%sy, 0.0%ni, 18.1%id, 66.9%wa, 0.0%hi, 0.6%si, 0.0%st Cpu2 : 1.9%us, 0.3%sy, 0.0%ni, 0.0%id, 97.8%wa, 0.0%hi, 0.0%si, 0.0%st Cpu3 : 0.6%us, 1.3%sy, 0.0%ni, 22.7%id, 74.8%wa, 0.0%hi, 0.6%si, 0.0%st Cpu4 : 0.6%us, 0.3%sy, 0.0%ni, 0.0%id, 99.1%wa, 0.0%hi, 0.0%si, 0.0%st Cpu5 : 0.6%us, 0.0%sy, 0.0%ni, 20.8%id, 78.3%wa, 0.0%hi, 0.3%si, 0.0%st Cpu6 : 0.4%us, 0.7%sy, 0.0%ni, 52.5%id, 46.5%wa, 0.0%hi, 0.0%si, 0.0%st Cpu7 : 0.6%us, 0.3%sy, 0.0%ni, 7.6%id, 91.5%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 4057152k total, 4035996k used,21156k free,14372k buffers Swap: 8000360k total, 1536k used, 7998824k free, 3852936k cached PID USER PR NI VIRT RES SHR S %CPU %MEMTIME+ COMMAND 6118 root 20 0 60388 2212 1296 S 24 0.1 102:35.41 bacula-fd 6240 root 20 0 130m 2092 1348 S3 0.1 227:19.75 bacula-sd 23214 hayden20 0 18992 1308 932 R1 0.0 0:00.24 top There are many occasions where the bacula-sd and bacula-fd have between 10-50% and all the wait percentages are through the roof as you see above. Also as you can see the load average is also through the roof. -H -Original Message- From: Steve Polyack [mailto:kor...@comcast.net] Sent: Wednesday, December 09, 2009 10:37 AM To: Hayden Katzenellenbogen Cc: mehma sarja; bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Network transfer Speed Hayden Katzenellenbogen wrote: > Everyone, > > Here is a little update. I finally after many months have been able to > run my first restore. > > I started an 800G restore. Which is half of my 1.7TB backup. > > I ran iostat while it was restoring and was getting between 50 and 140 > Meg/s. I would say the average is around 85Meg/s. > > This is performing a restore to the raid-6 array. Not sure if this > information helps or hinders the issue at hand. > > Thanks again for all the good suggestions. > > -H Do you have data encryption enabled? Also, I notice you've mentioned checking iostat during your backups, but have you watched top(1) to monitor CPU usage during the backup? -- Return on Information: Google Enterprise Search pays you back Get the facts. http://p.sf.net/sfu/google-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Incremental backup logic
Hi, I've ntoiced problem in the way Bacula is doing incremental backup. I have one folder to backup and in this folder database is writing log files, I have new file in every few minutes. Previous incremental backup ended at 11:07 am. The next incremental backup started 13:05 so in folder it had log files and Bacula should backup all files from 11:07 am to around 13:05. Backup Job started at 13:05 and endet at 16:05, it had backuped 115 files . When I checked what files where in this backup I've noticied that in this incremental I have files from 11:07 am to 13:11 and from 14:27 to 15:14. So why files from hour 14:27 to 15:14 where backuped and why it didn't included files from 13:11 to 14:27 ??? It's strange. Regards, Tomasz -- Return on Information: Google Enterprise Search pays you back Get the facts. http://p.sf.net/sfu/google-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Network transfer Speed
On 12/10/2009 9:33 AM, Hayden Katzenellenbogen wrote: > Steve, > > Here is a quick snap of my top during a full backup. > > top - 09:32:35 up 1 day, 18:38, 1 user, load average: 11.41, 11.60, > 10.75 > Tasks: 161 total, 1 running, 160 sleeping, 0 stopped, 0 zombie > Cpu0 : 0.3%us, 0.3%sy, 0.0%ni, 0.0%id, 99.4%wa, 0.0%hi, 0.0%si, > 0.0%st > Cpu1 : 13.0%us, 1.4%sy, 0.0%ni, 18.1%id, 66.9%wa, 0.0%hi, 0.6%si, > 0.0%st > Cpu2 : 1.9%us, 0.3%sy, 0.0%ni, 0.0%id, 97.8%wa, 0.0%hi, 0.0%si, > 0.0%st > Cpu3 : 0.6%us, 1.3%sy, 0.0%ni, 22.7%id, 74.8%wa, 0.0%hi, 0.6%si, > 0.0%st > Cpu4 : 0.6%us, 0.3%sy, 0.0%ni, 0.0%id, 99.1%wa, 0.0%hi, 0.0%si, > 0.0%st > Cpu5 : 0.6%us, 0.0%sy, 0.0%ni, 20.8%id, 78.3%wa, 0.0%hi, 0.3%si, > 0.0%st > Cpu6 : 0.4%us, 0.7%sy, 0.0%ni, 52.5%id, 46.5%wa, 0.0%hi, 0.0%si, > 0.0%st > Cpu7 : 0.6%us, 0.3%sy, 0.0%ni, 7.6%id, 91.5%wa, 0.0%hi, 0.0%si, > 0.0%st > Mem: 4057152k total, 4035996k used,21156k free,14372k buffers > Swap: 8000360k total, 1536k used, 7998824k free, 3852936k cached > >PID USER PR NI VIRT RES SHR S %CPU %MEMTIME+ COMMAND > > 6118 root 20 0 60388 2212 1296 S 24 0.1 102:35.41 bacula-fd > > 6240 root 20 0 130m 2092 1348 S3 0.1 227:19.75 bacula-sd > > 23214 hayden20 0 18992 1308 932 R1 0.0 0:00.24 top > > > There are many occasions where the bacula-sd and bacula-fd have between > 10-50% and all the wait percentages are through the roof as you see > above. Also as you can see the load average is also through the roof. > > -H Hayden- I'm not sure what else you might be running on this box, but I've noticed on mine that my memory usage recently went up significantly, and I started seeing high load average peaks when only bacula (or the db behind it) should have been generating high load. It didn't seem that the bacula daemons themselves were using significantly more memory than previously, and I hadn't changed my bacula version anyway. Further, I had not changed any configuration from what had been running smoothly before. In my case, after detuning my MySQL config to use less memory, my load averages improved, and so did bacula performance. I have not dug into this very far yet, but my guess is that either the kernel behavior has changed recently with some update I applied (perhaps significantly increased kernel buffering??), or some library used by lots of programs now uses more memory than previously. Certainly, my box, with only 2 processors shouldn't need as much physical RAM as yours, but both your 8-core box and my 2-core box have 4Gigs of RAM. I have no silver bullets here, but if see load average spike dramatically during a backup, and see very high wait percentages on your CPUs during backups, then you might look to see what programs are using the most VM, and seeing if they can either be temporarily turned off or detuned to use less memory. An even better answer might be to try adding RAM to your machine (assuming its running a 64-bit OS), but the first approach could be done without taking the box down and without any expense at least just to test the theory. Hope that helps, -se -- Return on Information: Google Enterprise Search pays you back Get the facts. http://p.sf.net/sfu/google-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bug or Feature Request - Config token too long?
Thank you. Great tip. I won't implement because I'd need to update though.
But it did lead me to the right place.
-Shon
On Tue, Nov 24, 2009 at 10:16 AM, Arno Lehmann wrote:
> Hi,
>
> 24.11.2009 15:47, Mingus Dew wrote:
> > All,
> > Running Bacula 3. on Solaris 10 x86. I'm setting up some Copy jobs
> > using the Selection Type = SQLQuery. When I try to test the config file
> > I get the error:
> >
> > bac...@backup_svr: bacula-dir -t -c /opt/csw/etc/bacula/bacula-dir.conf
> > 24-Nov 01:51 bacula-dir: ERROR TERMINATION at lex.c:270
> > Config token too long, file: /opt/csw/etc/bacula/bacula-dir_jobs.conf,
> > line 757, begins at line 756
>
> Looks like a config token must not span lines.
>
> > My SQLQuery is actually 2 queries on the same line. It works fine in
> > MySQL and I need 2 queries to select jobs from 2 pools in the same Copy
> > Job. Here is the SQL statement
> >
> > select distinct Job.JobId,Job.Name from Job,Pool where Pool.Name =
> > 'FS-Incremental_Pool' and Pool.PoolId = Job.PoolId and Job.Type = 'B'
> > and Job.JobStatus in ('T','W') and Job.jobBytes > 0 and Job.StartTime >
> > date_sub(current_timestamp(),interval 7 day) and Job.StartTime <
> > current_timestamp() order by Job.StartTime; select distinct
> > Job.JobId,Job.Name from Job,Pool where Pool.Name = 'FS-Full_Pool' and
> > Pool.PoolId = Job.PoolId and Job.Type = 'B' and Job.JobStatus in
> > ('T','W') and Job.jobBytes > 0 and Job.StartTime >
> > date_sub(current_timestamp(),interval 7 day) and Job.StartTime <
> > current_timestamp() order by Job.StartTime;
> >
> > This is the only method I can use as the other methods for selecting Job
> > ID's for Copying don't fit my environment. I'd prefer not to split the
> > copying of Incrementals and Fulls into different Jobs.
>
> It should be possible to create on query, but I don't know how right
> now :-)
>
> I haven't checked the actual length of your queries, but if they
> really exceed Baculas built-in limit, you might want a function
> defined in the catalog database. Should be possible with PostgreSQL
> and MySQL, as far as I know.
>
> Cheers,
>
> Arno
>
> > Thanks,
> > Shon
> >
> >
> >
> >
> >
> --
> > Let Crystal Reports handle the reporting - Free Crystal Reports 2008
> 30-Day
> > trial. Simplify your report design, integration and deployment - and
> focus on
> > what you do best, core application coding. Discover what's new with
> > Crystal Reports now. http://p.sf.net/sfu/bobj-july
> >
> >
> >
> >
> > ___
> > Bacula-users mailing list
> > Bacula-users@lists.sourceforge.net
> > https://lists.sourceforge.net/lists/listinfo/bacula-users
>
> --
> Arno Lehmann
> IT-Service Lehmann
> Sandstr. 6, 49080 Osnabrück
> www.its-lehmann.de
>
>
> --
> Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
> trial. Simplify your report design, integration and deployment - and focus
> on
> what you do best, core application coding. Discover what's new with
> Crystal Reports now. http://p.sf.net/sfu/bobj-july
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
--
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Question on RunAfterJob directive
I'd like to run a Bacula Job after the successful run of another Bacula job. Does RunAfterJob only work for external commands, or do I have to fully define using a RunScript directive? Thanks, Shon -- Return on Information: Google Enterprise Search pays you back Get the facts. http://p.sf.net/sfu/google-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Questions on Copy Jobs
Thanks for the help. This got me going in just the right direction.
-Shon
On Tue, Oct 27, 2009 at 11:49 AM, Brian Debelius <
bdebel...@intelesyscorp.com> wrote:
> The copy job copies all uncopied jobs one job at a time, one job at a time.
> If you need to limit this, you need to use your own sql command. I pulled
> the SQL statement from the source that does the selection for the uncopied
> jobs, and modified it with a date range, and run this to do uncopied jobs in
> batches when the need arises.
>
> Watch for typos
>
> SELECT DISTINCTJob.JobId FROM Job,Pool WHERE Pool.Name = 'MyPoolName'
> AND Pool.PoolId = Job.PoolId AND Job.Type = 'B' AND Job.JobStatus IN
> ('T','W') AND Job.jobBytes > 0 AND (Job.StartTime > '2009-09-01 00:00:00'
> AND Job.StartTime < '2009-10-27 00:00:00') AND Job.JobId NOT IN (SELECT
> PriorJobId FROM Job WHERE Type IN ('B','C') AND Job.JobStatus IN ('T','W')
> AND PrioJobId != 0) ORDER by Job.StartTime;
>
> Mingus Dew wrote:
>
>> In the documentation, there is an example for a Copy Job using the
>> Selection Type "PoolUncopiedJobs". I'd like to implement Copy Jobs using
>> this selection type. I currently have about 30 clients backed up into the
>> same Disk Pool. There are 28 days of backups on Disk for each client.
>>
>> If I setup a Copy Job like the one below, will it Copy all the previous
>> Jobs in that Pool in one run? Is there a way to limit this?
>> If I use a SQLquery selection to Copy the previous 14 days, will the next
>> Copy using PoolUncopiedJobs only copy the Jobs since then, or will it go
>> back beyond as well?
>> For Pools like mine that contains many Jobs, will there only be 1 Copy Job
>> Id or does it create and ID for each Job being copied?
>>
>> #
>> # Default template for a CopyDiskToTape Job
>> #
>> JobDefs {
>> Name = CopyDiskToTape
>>
>> Type = Copy
>> Messages = StandardCopy
>> Client = None
>> FileSet = None
>> Selection Type = PoolUncopiedJobs
>> Maximum Concurrent Jobs = 10
>> SpoolData = No
>> Allow Duplicate Jobs = Yes
>> Allow Higher Duplicates = No
>>
>> Cancel Queued Duplicates = No
>> Cancel Running Duplicates = No
>> Priority = 13
>> }
>>
>> Schedule {
>> Name = DaySchedule7:00
>> Run = Level=Full daily at 7:00
>> }
>>
>> Job {
>> Name = CopyDiskToTapeFullBackups
>>
>> Enabled = Yes
>> Schedule = DaySchedule7:00
>> Pool = FullBackupsVirtualPool
>> JobDefs = CopyDiskToTape
>> }
>>
>> Thanks,
>> Shon
>>
>>
>>
>> --
>> Come build with us! The BlackBerry(R) Developer Conference in SF, CA
>> is the only developer event you need to attend this year. Jumpstart your
>> developing skills, take BlackBerry mobile applications to market and stay
>> ahead of the curve. Join us from November 9 - 12, 2009. Register now!
>> http://p.sf.net/sfu/devconference
>>
>>
>>
>> ___
>> Bacula-users mailing list
>> Bacula-users@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/bacula-users
>>
>>
>
>
--
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Encoding
Gordon Neumann wrote: > Hello, > > i want to know if anyone has experience with database encoding at Bacula > 3.0.2-3. > Its a lenny-backport package. > system configuration: > os: debian lenny > bacula: 3.0.2-3 lenny-backport > database: PostgreSQL 8.3 > > My question in detail. > The database bacula on my postgreSQL-server has encoding level UTF-8. > Bacula in this version requires SQL_ACSII. > Is there any chance to say bacula it should use UTF-8 instead of SQL_ASCII? > It is no option to change encoding of database to SQL_ASCII for us, we > still want to > use UTF-8. Maybe there exists any configuration file i've not found yet > or any other > surrounding to solve this problem? > > Many thanks and kind regards! > If you want to use utf-8 database you can create your database based on a utf-8 enabled template. check the create-database script. Quiet easy to hack. BUT If you save inside anything else than proper utf-8 filename & path : you loose. Check the mailing archives in users & dev about the subject "Catastrophic changes to PostgreSQL 8.4" -- Bruno Friedmann -- Return on Information: Google Enterprise Search pays you back Get the facts. http://p.sf.net/sfu/google-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Create new volume vs. recycle volume
On Thu, 2009-12-10 at 11:34 -0500, John Drescher wrote:
> On Thu, Dec 10, 2009 at 10:43 AM, Brian Clarkson wrote:
> > I've re-read the section on volume retention and volume recycling but
> > I'm still confused.
> >
> > My backup files are being reused even though my director is configured
> > to create new files. Backups are working on schedule but my secondary,
> > rsync-based backup is failing because the filenames and filesizes
> > haven't changed.
> >
> > I did recently change the value of Recycle back to no.
> >
> > Pool {
> > Name = Default
> > Label Format = "${JobName}-${Level}-${NumVols}"
> > Pool Type = Backup
> > Recycle = no
> > AutoPrune = yes # Prune expired volumes
> > Use Volume Once = yes
> > Volume Retention = 25 days # one year
> > MaximumVolumeBytes = 512m
> > Maximum Volume Jobs = 1
> > }
> >
> > `show pools` within the console looks right:
> >
> > Pool: name=Default PoolType=Backup
> > use_cat=1 use_once=1 cat_files=1
> > max_vols=0 auto_prune=1 VolRetention=25 days
> > VolUse=0 secs recycle=0 LabelFormat=${JobName}-${Level}-${NumVols}
> > CleaningPrefix=*None* LabelType=0
> > RecyleOldest=0 PurgeOldest=0
> > MaxVolJobs=1 MaxVolFiles=0 MaxVolBytes=0
> > MigTime=0 secs MigHiBytes=0 MigLoBytes=0
> >
> > The output of `list volumes` in the console shows the volumes are full
> > or used, not purged.
> >
> > Do I need to manually mark each volume purged so bacula will start
> > creating new files?
>
> No that would make bacula use the old volumes. Purged is a state of recycling.
>
> >How can I get bacula to create new files with each
> > backup job?
> >
>
> Make the volume retention much longer. And then apply that to all of
> your volumes.
Wouldn't the volume retention period need to be shorter?
The catalog is exhibiting the correct file naming behavior:
BackupCatalog.2009-12-10_03.10.22-2917
BackupCatalog.2009-12-09_03.10.15-2913
BackupCatalog.2009-12-08_03.10.08-2909
Etc.
My server backup files are reusing old files.
Last night's run includes files like:
Backup_Server2.2009-08-09_01.05.27-Differential-17715
Backup_Server3.2009-08-09_01.05.24-Differential-17711
Backup_Server3.2009-08-09_01.05.24-Differential-17712
All with filesystem dates of early today. (2009-12-10)
>
> However I suspect what you really want is after 25 days you want the
> old volume to be deleted. For that you will need to have an external
> script (that feeds commands to bconsole) fired by a cron job or admin
> job.
I do have a cronjob that deletes old file. My volume list (in the
console) is huge, though. I guess I need to prune my catalog.
Thanks
Brian Clarkson
Lone Star Internet
--
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Create new volume vs. recycle volume
>> Make the volume retention much longer. And then apply that to all of >> your volumes. > > Wouldn't the volume retention period need to be shorter? > Retention period is how long to keep the volume before it can be reused. John -- Return on Information: Google Enterprise Search pays you back Get the facts. http://p.sf.net/sfu/google-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Create new volume vs. recycle volume
On Thu, Dec 10, 2009 at 3:06 PM, John Drescher wrote: >>> Make the volume retention much longer. And then apply that to all of >>> your volumes. >> >> Wouldn't the volume retention period need to be shorter? >> > > Retention period is how long to keep the volume before it can be reused. > Bacula does not automatically delete volumes. It reuses them. If you want to delete you have to do that outside of bacula using scripts. John -- Return on Information: Google Enterprise Search pays you back Get the facts. http://p.sf.net/sfu/google-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Continue to spool to disk when tape is full?
Hello, I'm running Bacula version 2.4.3 on a machine with a single tape drive, and on occasion the tape will become full overnight. 'status dir' shows the following: server1.-MM-DD_HH.MM.SS is waiting on max Storage jobs Since the machine has plenty of space to spool the data, I'd like to continue to spool to disk when the tape is full so despooling to tape can take place when the tape is changed. I have the following Maximum Concurrent Jobs set: bacula-dir.conf: Maximum Concurrent Jobs = 1 bacula-sd.conf: Maximum Concurrent Jobs = 30 If I understand the documentation correctly, raising dir.conf Maximum Concurrent Jobs will interleave multiple backups to tape, which I want to avoid. Is there something obvious I've missed in the documentation, or is Bacula expected to stop spooling to disk when the tape is full? Regards, -- Glen Barber -- Return on Information: Google Enterprise Search pays you back Get the facts. http://p.sf.net/sfu/google-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Create new volume vs. recycle volume
On Thu, Dec 10, 2009 at 3:53 PM, Brian Clarkson wrote: > On Thu, 2009-12-10 at 15:06 -0500, John Drescher wrote: >> >> Make the volume retention much longer. And then apply that to all of >> >> your volumes. >> > >> > Wouldn't the volume retention period need to be shorter? >> > >> >> Retention period is how long to keep the volume before it can be reused. > > So if I don't want to reuse volumes I should set the retention period to > zero? > Definitely not. I know telling bacula to keep your backup data for 0 seconds is not what you want. Set this to the amount of time you want to keep your data after the backup is finished. > Reusing the files (a volume is just a collection of 512m files per my > configuration) is what I want to stop. > I got you there. As you mentioned you need to turn off automatic volume recycling. Please post your configs. Have you had bacula reload the config file after you have changed it? John -- Return on Information: Google Enterprise Search pays you back Get the facts. http://p.sf.net/sfu/google-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] prune not working as expected
I have a couple older volumes that I expected to get pruned by now, but they don't. I am using bacula 3.0.2 on OpenSuSE. Here is one example: | 244 | randamai_20091101223426_Full.bacula| Archive | 1 | 93,005,712,230 | 21 |2,851,200 | 0 |0 | 0 | File | 2009-11-02 02:11:00 | When I used the prune volume command, I saw the following (all as expected): Enter *MediaId or Volume name: *244 The current Volume retention period is: 1 month 3 days Continue? (yes/mod/no): yes But this volume remains unpruned even though it is older than 1 month and 3 days. One thing that might possibly be related: these volumes were created with bacula 2.4.2. When I migrated to 3.0, I created a new database from scratch and used bscan to import the volumes. That was about a week ago. Bacula falsely assigned a retention time of 1 year; I corrected that with an update pool command. Thanks! -- Return on Information: Google Enterprise Search pays you back Get the facts. http://p.sf.net/sfu/google-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Create new volume vs. recycle volume (with config)
On Thu, 2009-12-10 at 16:11 -0500, John Drescher wrote:
> On Thu, Dec 10, 2009 at 3:53 PM, Brian Clarkson wrote:
> > On Thu, 2009-12-10 at 15:06 -0500, John Drescher wrote:
> >> >> Make the volume retention much longer. And then apply that to all of
> >> >> your volumes.
> >> >
> >> > Wouldn't the volume retention period need to be shorter?
> >> >
> >>
> >> Retention period is how long to keep the volume before it can be reused.
> >
> > So if I don't want to reuse volumes I should set the retention period to
> > zero?
> >
>
> Definitely not. I know telling bacula to keep your backup data for 0
> seconds is not what you want. Set this to the amount of time you want
> to keep your data after the backup is finished.
>
> > Reusing the files (a volume is just a collection of 512m files per my
> > configuration) is what I want to stop.
> >
>
> I got you there. As you mentioned you need to turn off automatic
> volume recycling. Please post your configs. Have you had bacula reload
> the config file after you have changed it?
I restarted the bacula director after making the changes. Subsequent
backup jobs still re-used files.
>From bacula-dir.conf
Pool {
Name = Default
Label Format = "${JobName}-${Level}-${NumVols}"
Pool Type = Backup
Recycle = no
AutoPrune = yes # Prune expired volumes
Use Volume Once = yes
Volume Retention = 25 days
MaximumVolumeBytes = 512m
Maximum Volume Jobs = 1
}
Client {
Name = client-fd
Address = server.com
FDPort = 9102
Catalog = MyCatalog
Password = "***"
File Retention = 21 days
Job Retention = 21 days
AutoPrune = yes
}
Job {
Name = "Backup Server"
Type = Backup
Client = server-fd
FileSet = "Full Set"
Schedule = "WeeklyCycle"
Storage = Storage
Messages = Standard
Pool = Default
Write Bootstrap = "/usr/local/bacula/var/bacula/working/server.bsr"
}
Storage {
Name = Storage
Address = storage.server.com
SDPort = 9103
Password = "***"
Device = StorageServer
Media Type = File
}
>From bacula-sd.conf
Device {
Name = StorageServer
Media Type = File
Archive Device = /home/bacula-data/
LabelMedia = yes; # lets Bacula label unlabeled
media
Random Access = Yes;
AutomaticMount = yes; # when device opened, read it
RemovableMedia = no;
AlwaysOpen = no;
}
--
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Create new volume vs. recycle volume (with config)
On Thu, Dec 10, 2009 at 5:09 PM, Brian Clarkson wrote:
> On Thu, 2009-12-10 at 16:11 -0500, John Drescher wrote:
>> On Thu, Dec 10, 2009 at 3:53 PM, Brian Clarkson wrote:
>> > On Thu, 2009-12-10 at 15:06 -0500, John Drescher wrote:
>> >> >> Make the volume retention much longer. And then apply that to all of
>> >> >> your volumes.
>> >> >
>> >> > Wouldn't the volume retention period need to be shorter?
>> >> >
>> >>
>> >> Retention period is how long to keep the volume before it can be reused.
>> >
>> > So if I don't want to reuse volumes I should set the retention period to
>> > zero?
>> >
>>
>> Definitely not. I know telling bacula to keep your backup data for 0
>> seconds is not what you want. Set this to the amount of time you want
>> to keep your data after the backup is finished.
>>
>> > Reusing the files (a volume is just a collection of 512m files per my
>> > configuration) is what I want to stop.
>> >
>>
>> I got you there. As you mentioned you need to turn off automatic
>> volume recycling. Please post your configs. Have you had bacula reload
>> the config file after you have changed it?
>
> I restarted the bacula director after making the changes. Subsequent
> backup jobs still re-used files.
>
> >From bacula-dir.conf
>
> Pool {
> Name = Default
> Label Format = "${JobName}-${Level}-${NumVols}"
> Pool Type = Backup
> Recycle = no
> AutoPrune = yes # Prune expired volumes
> Use Volume Once = yes
> Volume Retention = 25 days
> MaximumVolumeBytes = 512m
> Maximum Volume Jobs = 1
> }
>
> Client {
> Name = client-fd
> Address = server.com
> FDPort = 9102
> Catalog = MyCatalog
> Password = "***"
> File Retention = 21 days
> Job Retention = 21 days
> AutoPrune = yes
> }
>
> Job {
> Name = "Backup Server"
> Type = Backup
> Client = server-fd
> FileSet = "Full Set"
> Schedule = "WeeklyCycle"
> Storage = Storage
> Messages = Standard
> Pool = Default
> Write Bootstrap = "/usr/local/bacula/var/bacula/working/server.bsr"
> }
>
> Storage {
> Name = Storage
> Address = storage.server.com
> SDPort = 9103
> Password = "***"
> Device = StorageServer
> Media Type = File
> }
>
> >From bacula-sd.conf
>
> Device {
> Name = StorageServer
> Media Type = File
> Archive Device = /home/bacula-data/
> LabelMedia = yes; # lets Bacula label unlabeled
> media
> Random Access = Yes;
> AutomaticMount = yes; # when device opened, read it
> RemovableMedia = no;
> AlwaysOpen = no;
> }
>
I think I see why this is happening.
Do the following
list media pool=Default
and see if Recycle=1 is set in any of the volumes.
if so
update
and then select "Pool from resource"
and follow the prompts.
John
--
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Create new volume vs. recycle volume (with config)
Is there a way to paginate the response from these list commands? I
have 37k entries in this pool ...
On Thu, 2009-12-10 at 17:38 -0500, John Drescher wrote:
> On Thu, Dec 10, 2009 at 5:09 PM, Brian Clarkson wrote:
> > On Thu, 2009-12-10 at 16:11 -0500, John Drescher wrote:
> >> On Thu, Dec 10, 2009 at 3:53 PM, Brian Clarkson wrote:
> >> > On Thu, 2009-12-10 at 15:06 -0500, John Drescher wrote:
> >> >> >> Make the volume retention much longer. And then apply that to all of
> >> >> >> your volumes.
> >> >> >
> >> >> > Wouldn't the volume retention period need to be shorter?
> >> >> >
> >> >>
> >> >> Retention period is how long to keep the volume before it can be reused.
> >> >
> >> > So if I don't want to reuse volumes I should set the retention period to
> >> > zero?
> >> >
> >>
> >> Definitely not. I know telling bacula to keep your backup data for 0
> >> seconds is not what you want. Set this to the amount of time you want
> >> to keep your data after the backup is finished.
> >>
> >> > Reusing the files (a volume is just a collection of 512m files per my
> >> > configuration) is what I want to stop.
> >> >
> >>
> >> I got you there. As you mentioned you need to turn off automatic
> >> volume recycling. Please post your configs. Have you had bacula reload
> >> the config file after you have changed it?
> >
> > I restarted the bacula director after making the changes. Subsequent
> > backup jobs still re-used files.
> >
> > >From bacula-dir.conf
> >
> > Pool {
> > Name = Default
> > Label Format = "${JobName}-${Level}-${NumVols}"
> > Pool Type = Backup
> > Recycle = no
> > AutoPrune = yes # Prune expired volumes
> > Use Volume Once = yes
> > Volume Retention = 25 days
> > MaximumVolumeBytes = 512m
> > Maximum Volume Jobs = 1
> > }
> >
> > Client {
> > Name = client-fd
> > Address = server.com
> > FDPort = 9102
> > Catalog = MyCatalog
> > Password = "***"
> > File Retention = 21 days
> > Job Retention = 21 days
> > AutoPrune = yes
> > }
> >
> > Job {
> > Name = "Backup Server"
> > Type = Backup
> > Client = server-fd
> > FileSet = "Full Set"
> > Schedule = "WeeklyCycle"
> > Storage = Storage
> > Messages = Standard
> > Pool = Default
> > Write Bootstrap = "/usr/local/bacula/var/bacula/working/server.bsr"
> > }
> >
> > Storage {
> > Name = Storage
> > Address = storage.server.com
> > SDPort = 9103
> > Password = "***"
> > Device = StorageServer
> > Media Type = File
> > }
> >
> > >From bacula-sd.conf
> >
> > Device {
> > Name = StorageServer
> > Media Type = File
> > Archive Device = /home/bacula-data/
> > LabelMedia = yes; # lets Bacula label unlabeled
> > media
> > Random Access = Yes;
> > AutomaticMount = yes; # when device opened, read it
> > RemovableMedia = no;
> > AlwaysOpen = no;
> > }
> >
>
> I think I see why this is happening.
>
> Do the following
> list media pool=Default
>
> and see if Recycle=1 is set in any of the volumes.
>
> if so
>
> update
>
> and then select "Pool from resource"
>
> and follow the prompts.
>
> John
--
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
