Re: [Bacula-users] Why isn't bacula recycling these volumes?

[Uwe Schuerkamp]

Hello Larry,

did you remember to "update pools" after you made the changes to the
pool definition (maximum volumes) or did you include those from the
get-go? Taking a look at the pool definition in the DB itself might
shed some light on the issue as well.

What happens if you manually prune / purge a volume in one of those
pools, does bacula use one of those for the next backup job then?

All the best,

Uwe


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Verify jobs and "Warning: sql_get.c:186 More than one Filename!"

[Mark Dixon]

Hi all,

I find the verify job feature of bacula really useful to see what has 
changed since the last verifyinit job, but the job output is becoming 
difficult to read as it's clustered with lots and lots of messages of the 
form:


17-Dec 18:28 foo-dir JobId 67663: Warning: sql_get.c:186 More than one 
Filename!: 2 for file: AnySimpleTypeDatatypeValidator.hpp

And:

17-Dec 18:28 foo-dir JobId 67663: Warning: sql_get.c:236 More than one Path!: 2 
for path: /usr/include/xercesc/validators/common/


Looking at the database, the messages are absolutely right:


select * from Filename where Name = "AnySimpleTypeDatatypeValidator.hpp";

+++
| FilenameId | Name   |
+++
|6421754 | AnySimpleTypeDatatypeValidator.hpp |
|6421755 | AnySimpleTypeDatatypeValidator.hpp |
+++
2 rows in set (0.00 sec)



select * from Path where Path = "/usr/include/xercesc/validators/common/";

+-+-+
| PathId  | Path|
+-+-+
| 2518839 | /usr/include/xercesc/validators/common/ |
| 2518840 | /usr/include/xercesc/validators/common/ |
+-+-+
2 rows in set (0.00 sec)


I've been using the verify job feature for years (thanks!), but have only 
come across this relatively recently - presumably it's a race condition 
since switching to running jobs in parallel.


Firstly:

1) Should I be worried about these messages?

2) If not, is there a good way to get rid of them?!

I'm using bacula 9.6.5 + mariadb on centos7.

Thanks!

Mark


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] New Bacula Server with multiple disks

[Josh Fisher]

On 12/16/21 19:39, mac-eduki2.co.uk wrote:

Hi Josh

Thank you for your reply, advice and link.

This is a remote server and as I do not need long term storage of 
backups it is really for disaster recovery - it is also not located 
anywhere near the clients. My hope is that if it does crash I will be 
able to rebuild it and take full backups before anything else fails.


I do take on your comment about if one disk fails the whole server 
will be lost - would this not be the case with vchanger?



No. Vchanger allows using multiple filesystems as one large emulated 
tape autoloader library, so each disk is an independent store of volume 
files, much like a magazine full of tapes in a real tape autoloader. It 
emulates a mult-magazine tape autoloader using one symlink for each 
virtual drive that links to the volume file currently loaded into that 
drive. It is an automated way of dynamically creating the symlinks 
needed to use N filesystems as one large store, rather than N disks as 
one filesystem.


Cheers,
Josh Fisher




___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Why isn't bacula recycling these volumes?

[Larry Rosenman]

On 12/17/2021 2:45 am, Uwe Schuerkamp wrote:

Hello Larry,

did you remember to "update pools" after you made the changes to the
pool definition (maximum volumes) or did you include those from the
get-go? Taking a look at the pool definition in the DB itself might
shed some light on the issue as well.

What happens if you manually prune / purge a volume in one of those
pools, does bacula use one of those for the next backup job then?

All the best,

Uwe


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

been there from the get go.

I have this at the end of the backup catalog job, and since the upgrade 
to 11 NO volumes

have been matching:

17-Dec 02:08 borg-dir JobId 4604: shell command: run AfterJob 
"/usr/local/share/bacula/delete_catalog_backup"
17-Dec 02:08 borg-dir JobId 4604: console command: run AfterJob "prune 
expired volume yes"
17-Dec 02:08 borg-dir JobId 4604: console command: run AfterJob 
"truncate allpools Storage=File"


17-Dec 02:08 borg-dir JobId 0: Automatically selected Catalog: MyCatalog
17-Dec 02:08 borg-dir JobId 0: Using Catalog "MyCatalog"
17-Dec 02:08 borg-dir JobId 0: 0 expired volume found

7-Dec 02:08 borg-dir JobId 0: Automatically selected Catalog: MyCatalog
17-Dec 02:08 borg-dir JobId 0: Using Catalog "MyCatalog"
17-Dec 02:08 borg-dir JobId 0: No Volumes found to perform the command.



I can re-send all my configs if needed, as well as give access to the 
server.



--
Larry Rosenman http://www.lerctr.org/~ler
Phone: +1 214-642-9640 E-Mail: l...@lerctr.org
US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Documentation MaximumVolumes Inaccuracy Bacula Manual 11

[Heitor Faria]

Hello All, 

According to the Thread "[Bacula-users] Why isn't bacula recycling these 
volumes?" and to the documentation: 
:
 

"A few points to keep in mind: 
If a pool doesn't have maximum volumes defined then Bacula will prefer to 
demand new volumes over forcibly purging older volumes." 

This is not accurate at all in consonance to my simple test: 

*show pool=Test 
Pool: name=Test PoolType=Backup 
use_cat=1 use_once=0 cat_files=1 
max_vols=0 auto_prune=1 VolRetention=1 sec 
VolUse=0 secs recycle=1 LabelFormat=${Pool}-${NumVols} 
CleaningPrefix=*None* LabelType=0 
RecyleOldest=0 PurgeOldest=0 ActionOnPurge=1 
MaxVolJobs=0 MaxVolFiles=0 MaxVolBytes=5368709120 
MaxPoolBytes=0 
MigTime=0 secs MigHiBytes=0 MigLoBytes=0 
CacheRetention=0 secs 
JobRetention=0 secs FileRetention=0 secs 
--> Autochanger: name=DedupDisk address=192.168.0.205 SDport=9103 MaxJobs=10 
NumJobs=0 
DeviceName=FileChgr1 MediaType=Dedup StorageId=3 Autochanger=1 
AC group=3 ShareStore=*none* 
*list media pool=Test 
+-++---+-+---+--+--+-+--+---+---+-+--+-+---+
 
| mediaid | volumename | volstatus | enabled | volbytes | volfiles | 
volretention | recycle | slot | inchanger | mediatype | voltype | volparts | 
lastwritten | expiresin | 
+-++---+-+---+--+--+-+--+---+---+-+--+-+---+
 
| 1,039 | Test-0 | Append | 1 | 1,426,546 | 0 | 1 | 1 | 0 | 0 | Dedup | 15 | 0 
| 2021-12-17 09:57:36 | 0 | 
+-++---+-+---+--+--+-+--+---+---+-+--+-+---+
 
*update volstatus=Used volume=Test-0 
New Volume status is: Used 
*run job=BaculaConfs pool=Test yes 
*list joblog jobid=9558 
++
 
| logtext | 
++
 
| enterprisebacula-dir JobId 9558: Start Backup JobId 9558, 
Job=BaculaConfs.2021-12-17_09.59.14_42 | 
| enterprisebacula-dir JobId 9558: Connected to Storage "DedupDisk" at 
192.168.0.205:9103 with TLS | 
| enterprisebacula-dir JobId 9558: There are no more Jobs associated with 
Volume "Test-0". Marking it purged. | 
| enterprisebacula-dir JobId 9558: All records pruned from Volume "Test-0"; 
marking it "Purged" | 
| enterprisebacula-dir JobId 9558: Recycled volume "Test-0" | 
| enterprisebacula-dir JobId 9558: Connected to Client "enterprisebacula-fd" at 
enterprisebacula:9102 with TLS | 
| enterprisebacula-fd JobId 9558: Connected to Storage at 192.168.0.205:9103 
with TLS | 
| enterprisebacula-dir JobId 9558: Sending Accurate information to the FD. | 
| enterprisebacula-sd JobId 9558: Recycled volume "Test-0" on Dedup device 
"FileChgr1-Dev2" (/mnt/dedup), all previous data lost. | 
| enterprisebacula-sd JobId 9558: Elapsed time=00:00:24, Transfer rate=31.48 K 
Bytes/second | 
| enterprisebacula-sd JobId 9558: Sending spooled attrs to the Director. 
Despooling 5,049 bytes ... | 
| enterprisebacula-dir JobId 9558: Bacula Enterprise enterprisebacula-dir 
12.8.1 (30Jun21): 
Build OS: x86_64-redhat-linux-gnu-bacula-enterprise redhat (Core) 
JobId: 9558 
Job: BaculaConfs.2021-12-17_09.59.14_42 
Backup Level: Incremental, since=2021-12-17 09:57:14 
Client: "enterprisebacula-fd" 12.8.3 (28Sep21) 
x86_64-redhat-linux-gnu-bacula-enterprise,redhat,(Core) 
FileSet: "BaculaConfigurations" 2021-06-22 08:13:03 
Pool: "Test" (From Command input) 
Catalog: "MyCatalog" (From Client resource) 
Storage: "DedupDisk" (From Pool resource) 
Scheduled time: 17-Dec-2021 09:59:14 
Start time: 17-Dec-2021 09:59:18 
End time: 17-Dec-2021 09:59:42 
Elapsed time: 24 secs 
Priority: 10 
FD Files Written: 20 
SD Files Written: 20 
FD Bytes Written: 752,748 (752.7 KB) 
SD Bytes Written: 755,631 (755.6 KB) 
Rate: 31.4 KB/s 
Software Compression: 99.9% 1331.7:1 
Comm Line Compression: 79.0% 4.8:1 
Snapshot/VSS: no 
Encryption: no 
Accurate: yes 
Volume name(s): Test-0 
Volume Session Id: 1762 
Volume Session Time: 1628965590 
Last Volume Bytes: 757,480 (757.4 KB) 
Non-fatal FD errors: 0 
SD Errors: 0 
FD termination status: OK 
SD termination status: OK 
Termination: Backup OK | 
++
 
+---+-+-+--+---+--+--+---+
 
| jobid | name | starttime | type | level | jobfiles | jobbytes | jobstatus | 
+---+-+-+--+---+--+--+---+
 
| 9,558 | BaculaConfs | 2021-12-17 09:59:18 | B | I | 20 | 752,748

Re: [Bacula-users] Why isn't bacula recycling these volumes?

[Heitor Faria]

Hello Larry,

> I can re-send all my configs if needed, as well as give access to the
> server.

Please show your configurations, and also a full job log where a new volume is 
created.

Regards,
-- 
MSc Heitor Faria (Miami/USA) 
Bacula LATAM CEO 

mobile1: + 1 909 655-8971 
mobile2: + 55 61 98268-4220 
[ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] 
[ http://www.bacula.com.br/ ] 

América Latina 
[ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | 
bacula.com.br ]


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Why isn't bacula recycling these volumes?

[Heitor Faria]

Hello Larry,

Your jobs do not show the need for a new volume. However, your configuration 
does not look good:

"Pool {
  Name = Default
  Pool Type = Backup
  Recycle = yes   # Bacula can automatically recycle Volumes
  AutoPrune = yes # Prune expired volumes
  *Volume Retention = 0*
  LabelFormat="LERCTR-"
  #Use Volume Once = yes 
  #Maximum Volume Jobs = 4
  Maximum Volume Bytes=100GB
  Volume Use Duration = 12h
  Action On Purge = Truncate
  Recycle Oldest Volume = no
}"

Its unusual to have a VolumeRetention=0, in fact I believe Bacula could even 
understand it as infinite. It should mess the Bacula recycling algortithm.

Regards,
-- 
MSc Heitor Faria (Miami/USA) 
Bacula LATAM CEO 

mobile1: + 1 909 655-8971 
mobile2: + 55 61 98268-4220 
[ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] 
[ http://www.bacula.com.br/ ] 

América Latina 
[ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | 
bacula.com.br ]


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Why isn't bacula recycling these volumes?

[Larry Rosenman]

On 12/17/2021 9:56 am, Heitor Faria wrote:

Hello Larry,

Your jobs do not show the need for a new volume. However, your
configuration does not look good:

"Pool {
  Name = Default
  Pool Type = Backup
  Recycle = yes   # Bacula can automatically 
recycle Volumes

  AutoPrune = yes # Prune expired volumes
  *Volume Retention = 0*
  LabelFormat="LERCTR-"
  #Use Volume Once = yes
  #Maximum Volume Jobs = 4
  Maximum Volume Bytes=100GB
  Volume Use Duration = 12h
  Action On Purge = Truncate
  Recycle Oldest Volume = no
}"

Its unusual to have a VolumeRetention=0, in fact I believe Bacula
could even understand it as infinite. It should mess the Bacula
recycling algortithm.

Regards,


That was called out in the 11 release notes as letting the JOB 
retentions

determine volume retentions.

Did I misread something?  That was new with 11.
--
Larry Rosenman http://www.lerctr.org/~ler
Phone: +1 214-642-9640 E-Mail: l...@lerctr.org
US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Why isn't bacula recycling these volumes?

[Heitor Faria]

Hello Larry,

> That was called out in the 11 release notes as letting the JOB
> retentions
> determine volume retentions.
> 
> Did I misread something?  That was new with 11.

I wasn't aware of this new feature. Thanks for pointing out.
Most likely, your problem now is that these volumes were created and purged 
with old Bacula Bacula versions that didn't have this feature.
An easy workaround is just to disable or delete these volumes, or just start a 
new Pool that aims to use this new feature.

Regards,
-- 
MSc Heitor Faria (Miami/USA) 
Bacula LATAM CEO 

mobile1: + 1 909 655-8971 
mobile2: + 55 61 98268-4220 
[ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] 
[ http://www.bacula.com.br/ ] 

América Latina 
[ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | 
bacula.com.br ]


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Why isn't bacula recycling these volumes?

[Larry Rosenman]

On 12/17/2021 10:28 am, Heitor Faria wrote:

Hello Larry,


That was called out in the 11 release notes as letting the JOB
retentions
determine volume retentions.

Did I misread something?  That was new with 11.


I wasn't aware of this new feature. Thanks for pointing out.
Most likely, your problem now is that these volumes were created and
purged with old Bacula Bacula versions that didn't have this feature.
An easy workaround is just to disable or delete these volumes, or just
start a new Pool that aims to use this new feature.

Regards,


I set all the volretentions to zero in the Database.

I'd love some direction from dev or someone else.

I'd also be willing to give access.

--
Larry Rosenman http://www.lerctr.org/~ler
Phone: +1 214-642-9640 E-Mail: l...@lerctr.org
US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Why isn't bacula recycling these volumes?

[Heitor Faria]

Hello Larry,

> I set all the volretentions to zero in the Database.
> 
> I'd love some direction from dev or someone else.
> 
> I'd also be willing to give access.

I'm not sure if you understand how GPL licensing works, but it is a software 
that comes with no support or warranties. What I mean, is all people here 
provided answers to your problem voluntarely using their free time. BTW: I'm 
pretty sure my diagnostic is right.
Also, I strongly recommend you to have a test environment to deploy features 
before putting them into production, and to not perform manual Catalog SQL 
updates.
That said, this is an user group. If you want the developers feedback you 
should address your message to: "bacula-devel" 
.

Regards,
-- 
MSc Heitor Faria (Miami/USA) 
Bacula LATAM CEO 

mobile1: + 1 909 655-8971 
mobile2: + 55 61 98268-4220 
[ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] 
[ http://www.bacula.com.br/ ] 

América Latina 
[ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | 
bacula.com.br ]


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Why isn't bacula recycling these volumes?

[Larry Rosenman]

On 12/17/2021 11:03 am, Heitor Faria wrote:

Hello Larry,


I set all the volretentions to zero in the Database.

I'd love some direction from dev or someone else.

I'd also be willing to give access.


I'm not sure if you understand how GPL licensing works, but it is a
software that comes with no support or warranties. What I mean, is all
people here provided answers to your problem voluntarely using their
free time. BTW: I'm pretty sure my diagnostic is right.
Also, I strongly recommend you to have a test environment to deploy
features before putting them into production, and to not perform
manual Catalog SQL updates.
That said, this is an user group. If you want the developers feedback
you should address your message to: "bacula-devel"
.

Regards,
I'm WELL aware how FOSS works (Been involved in PostgreSQL for >15 
years, FreeBSD >5 years).


I'll send to bacula-devel.
(FTR: I'm a Site Reliability Engineer for a LARGE travel company by day, 
and have been in

IT for >40 years in support/ops).

--
Larry Rosenman http://www.lerctr.org/~ler
Phone: +1 214-642-9640 E-Mail: l...@lerctr.org
US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Documentation MaximumVolumes Inaccuracy Bacula Manual 11

[Martin Simmons]

I think the doc is correct because "forcibly purging" only happens if you set
the Purge Oldest Volume or Recycle Oldest Volume directives to yes.  The
purging you are seeing below happens because the volume has no current jobs
(e.g. they were pruned) so that is normal recycling.

__Martin


> On Fri, 17 Dec 2021 12:04:49 -0300 (BRT), Heitor Faria said:
> 
> Hello All, 
> 
> According to the Thread "[Bacula-users] Why isn't bacula recycling these 
> volumes?" and to the documentation: 
> :
>  
> 
> "A few points to keep in mind: 
> If a pool doesn't have maximum volumes defined then Bacula will prefer to 
> demand new volumes over forcibly purging older volumes." 
> 
> This is not accurate at all in consonance to my simple test: 
> 
> *show pool=Test 
> Pool: name=Test PoolType=Backup 
> use_cat=1 use_once=0 cat_files=1 
> max_vols=0 auto_prune=1 VolRetention=1 sec 
> VolUse=0 secs recycle=1 LabelFormat=${Pool}-${NumVols} 
> CleaningPrefix=*None* LabelType=0 
> RecyleOldest=0 PurgeOldest=0 ActionOnPurge=1 
> MaxVolJobs=0 MaxVolFiles=0 MaxVolBytes=5368709120 
> MaxPoolBytes=0 
> MigTime=0 secs MigHiBytes=0 MigLoBytes=0 
> CacheRetention=0 secs 
> JobRetention=0 secs FileRetention=0 secs 
> --> Autochanger: name=DedupDisk address=192.168.0.205 SDport=9103 MaxJobs=10 
> NumJobs=0 
> DeviceName=FileChgr1 MediaType=Dedup StorageId=3 Autochanger=1 
> AC group=3 ShareStore=*none* 
> *list media pool=Test 
> +-++---+-+---+--+--+-+--+---+---+-+--+-+---+
>  
> | mediaid | volumename | volstatus | enabled | volbytes  | volfiles | 
> volretention | recycle | slot | inchanger | mediatype | voltype | volparts | 
> lastwritten | expiresin | 
> +-++---+-+---+--+--+-+--+---+---+-+--+-+---+
>  
> | 1,039   | Test-0 | Append| 1   | 1,426,546 | 0| 1   
>  | 1   | 0| 0 | Dedup | 15  | 0| 
> 2021-12-17 09:57:36 | 0 | 
> +-++---+-+---+--+--+-+--+---+---+-+--+-+---+
>  
> *update volstatus=Used volume=Test-0 
> New Volume status is: Used 
> *run job=BaculaConfs pool=Test yes 
> *list joblog jobid=9558 
> ++
>  
> | logtext | 
> ++
>  
> | enterprisebacula-dir JobId 9558: Start Backup JobId 9558, 
> Job=BaculaConfs.2021-12-17_09.59.14_42 | 
> | enterprisebacula-dir JobId 9558: Connected to Storage "DedupDisk" at 
> 192.168.0.205:9103 with TLS | 
> | enterprisebacula-dir JobId 9558: There are no more Jobs associated with 
> Volume "Test-0". Marking it purged. | 
> | enterprisebacula-dir JobId 9558: All records pruned from Volume "Test-0"; 
> marking it "Purged" | 
> | enterprisebacula-dir JobId 9558: Recycled volume "Test-0" | 
> | enterprisebacula-dir JobId 9558: Connected to Client "enterprisebacula-fd" 
> at enterprisebacula:9102 with TLS | 
> | enterprisebacula-fd JobId 9558: Connected to Storage at 192.168.0.205:9103 
> with TLS | 
> | enterprisebacula-dir JobId 9558: Sending Accurate information to the FD. | 
> | enterprisebacula-sd JobId 9558: Recycled volume "Test-0" on Dedup device 
> "FileChgr1-Dev2" (/mnt/dedup), all previous data lost. | 
> | enterprisebacula-sd JobId 9558: Elapsed time=00:00:24, Transfer rate=31.48 
> K Bytes/second | 
> | enterprisebacula-sd JobId 9558: Sending spooled attrs to the Director. 
> Despooling 5,049 bytes ... | 
> | enterprisebacula-dir JobId 9558: Bacula Enterprise enterprisebacula-dir 
> 12.8.1 (30Jun21): 
> Build OS: x86_64-redhat-linux-gnu-bacula-enterprise redhat (Core) 
> JobId: 9558 
> Job: BaculaConfs.2021-12-17_09.59.14_42 
> Backup Level: Incremental, since=2021-12-17 09:57:14 
> Client: "enterprisebacula-fd" 12.8.3 (28Sep21) 
> x86_64-redhat-linux-gnu-bacula-enterprise,redhat,(Core) 
> FileSet: "BaculaConfigurations" 2021-06-22 08:13:03 
> Pool: "Test" (From Command input) 
> Catalog: "MyCatalog" (From Client resource) 
> Storage: "DedupDisk" (From Pool resource) 
> Scheduled time: 17-Dec-2021 09:59:14 
> Start time: 17-Dec-2021 09:59:18 
> End time: 17-Dec-2021 09:59:42 
> Elapsed time: 24 secs 
> Priority: 10 
> FD Files Written: 20 
> SD Files Written: 20 
> FD Bytes Written: 752,748 (752.7 KB) 
> SD Bytes Written: 755,631 (755.6 KB) 
> Rate: 31.4 KB/s 
> Software Compression: 99.9% 1331.7:1 
> Comm Line Compression: 79.0% 4.8:1 
> Snapshot/VSS: no 
> Encryption: no 
> Accurate: yes 
> Volume name(s): Test-0 
> Volume Sessio

Re: [Bacula-users] Why isn't bacula recycling these volumes?

[Heitor Faria]

Hello Large,

> I'll send to bacula-devel.
> (FTR: I'm a Site Reliability Engineer for a LARGE travel company by day,
> and have been in
> IT for >40 years in support/ops).

Such a large company chooses to not pay for a backup supported software and to 
reply on the community?
IMHO it tells me how serious this company is. =)

Regards,
-- 
MSc Heitor Faria (Miami/USA) 
Bacula LATAM CIO 

mobile1: + 1 909 655-8971 
mobile2: + 55 61 98268-4220 
[ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] 
[ http://www.bacula.com.br/ ] 

América Latina 
[ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | 
bacula.com.br ]


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Why isn't bacula recycling these volumes?

[Larry Rosenman]

On 12/17/2021 11:30 am, Heitor Faria wrote:

Hello Large,


I'll send to bacula-devel.
(FTR: I'm a Site Reliability Engineer for a LARGE travel company by 
day,

and have been in
IT for >40 years in support/ops).


Such a large company chooses to not pay for a backup supported
software and to reply on the community?
IMHO it tells me how serious this company is. =)

Regards,

this is MY PERSONAL STUFF that bacula is backing up.
Just explaining my background.
--
Larry Rosenman http://www.lerctr.org/~ler
Phone: +1 214-642-9640 E-Mail: l...@lerctr.org
US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Documentation MaximumVolumes Inaccuracy Bacula Manual 11

[Heitor Faria]

Hello Martin,

> I think the doc is correct because "forcibly purging" only happens if you set
> the Purge Oldest Volume or Recycle Oldest Volume directives to yes.  The
> purging you are seeing below happens because the volume has no current jobs
> (e.g. they were pruned) so that is normal recycling.

Well observed. I believe you are right:

*show pool=Test
Pool: name=Test PoolType=Backup
  use_cat=1 use_once=0 cat_files=1
  max_vols=0 auto_prune=1 VolRetention=0 secs
  VolUse=0 secs recycle=1 LabelFormat=${Pool}-${NumVols}
  CleaningPrefix=*None* LabelType=0
  RecyleOldest=0 PurgeOldest=1 ActionOnPurge=1
  MaxVolJobs=0 MaxVolFiles=0 MaxVolBytes=5368709120
  MaxPoolBytes=0
  MigTime=0 secs MigHiBytes=0 MigLoBytes=0
  CacheRetention=0 secs
  JobRetention=0 secs FileRetention=0 secs
  --> Autochanger: name=DedupDisk address=192.168.0.205 SDport=9103 MaxJobs=10 
NumJobs=0
  DeviceName=FileChgr1 MediaType=Dedup StorageId=3 Autochanger=1
  AC group=3 ShareStore=*none*
*list media pool=Test
+-++---+-+---+--+--+-+--+---+---+-+--+-+---+
| mediaid | volumename | volstatus | enabled | volbytes  | volfiles | 
volretention | recycle | slot | inchanger | mediatype | voltype | volparts | 
lastwritten | expiresin |
+-++---+-+---+--+--+-+--+---+---+-+--+-+---+
|   1,039 | Test-0 | Used  |   1 | 1,442,156 |0 |   
 0 |   1 |0 | 0 | Dedup |  15 |0 | 2021-12-17 
10:54:57 | 0 |
|   1,040 | Test-1 | Used  |   1 |   682,207 |0 |   
 0 |   1 |0 | 0 | Dedup |  15 |0 | 2021-12-17 
10:56:08 | 0 |
*list joblog jobid=9561
Automatically selected Catalog: MyCatalog
Using Catalog "MyCatalog"
++
| logtext   
   |
++
| enterprisebacula-dir JobId 9561: Start Backup JobId 9561, 
Job=BaculaConfs.2021-12-17_13.03.27_51 |
| enterprisebacula-dir JobId 9561: Connected to Storage "DedupDisk" at 
192.168.0.205:9103 with TLS |
| enterprisebacula-dir JobId 9561: Created new Volume="Test-2", Pool="Test", 
MediaType="Dedup" in catalog. |
| enterprisebacula-dir JobId 9561: Connected to Client "enterprisebacula-fd" at 
enterprisebacula:9102 with TLS |
| enterprisebacula-fd JobId 9561: Connected to Storage at 192.168.0.205:9103 
with TLS  |
| enterprisebacula-dir JobId 9561: Sending Accurate information to the FD.  
   |
| enterprisebacula-sd JobId 9561: Labeled new Volume "Test-2" on Dedup device 
"FileChgr1-Dev2" (/mnt/dedup). |
| enterprisebacula-sd JobId 9561: Wrote label to prelabeled Volume "Test-2" on 
Dedup device "FileChgr1-Dev2" (/mnt/dedup) |
| enterprisebacula-sd JobId 9561: Elapsed time=00:00:25, Transfer rate=27.36 K 
Bytes/second|
| enterprisebacula-sd JobId 9561: Sending spooled attrs to the Director. 
Despooling 675 bytes ...  |
| enterprisebacula-dir JobId 9561: Bacula Enterprise enterprisebacula-dir 
12.8.1 (30Jun21):
  Build OS:   x86_64-redhat-linux-gnu-bacula-enterprise redhat 
(Core)
  JobId:  9561
  Job:BaculaConfs.2021-12-17_13.03.27_51
  Backup Level:   Incremental, since=2021-12-17 10:55:43
  Client: "enterprisebacula-fd" 12.8.3 (28Sep21) 
x86_64-redhat-linux-gnu-bacula-enterprise,redhat,(Core)
  FileSet:"BaculaConfigurations" 2021-06-22 08:13:03
  Pool:   "Test" (From Command input)
  Catalog:"MyCatalog" (From Client resource)
  Storage:"DedupDisk" (From Pool resource)
  Scheduled time: 17-Dec-2021 13:03:27
  Start time: 17-Dec-2021 13:03:30
  End time:   17-Dec-2021 13:03:55
  Elapsed time:   25 secs
  Priority:   10
  FD Files Written:   3
  SD Files Written:   3
  FD Bytes Written:   683,842 (683.8 KB)
  SD Bytes Written:   684,232 (684.2 KB)
  Rate:   27.4 KB/s
  Software Compression:   99.9% 1470.6:1
  Comm Line Compression:  82.1% 5.6:1
  Snapshot/VSS:   no
  Encryption: no
  Accurate:   yes
  Volume name(s): Test-2
  Volume Session Id:  1765
  Volume Session Time:1628965590
  Last Volume Bytes:  685,469 (685.4 KB)
  Non-fatal FD errors:0
  SD Errors:  0
  FD termination status:  OK
  SD termination status:  OK
  Termination:B

Re: [Bacula-users] Verify jobs and "Warning: sql_get.c:186 More than one Filename!"

[Phil Stracchino]

On 12/17/21 05:16, Mark Dixon wrote:

Hi all,

I find the verify job feature of bacula really useful to see what has
changed since the last verifyinit job, but the job output is becoming
difficult to read as it's clustered with lots and lots of messages of the
form:

17-Dec 18:28 foo-dir JobId 67663: Warning: sql_get.c:186 More than one 
Filename!: 2 for file: AnySimpleTypeDatatypeValidator.hpp

And:

17-Dec 18:28 foo-dir JobId 67663: Warning: sql_get.c:236 More than one Path!: 2 
for path: /usr/include/xercesc/validators/common/


Looking at the database, the messages are absolutely right:


select * from Filename where Name = "AnySimpleTypeDatatypeValidator.hpp";

+++
| FilenameId | Name   |
+++
|6421754 | AnySimpleTypeDatatypeValidator.hpp |
|6421755 | AnySimpleTypeDatatypeValidator.hpp |
+++
2 rows in set (0.00 sec)



select * from Path where Path = "/usr/include/xercesc/validators/common/";

+-+-+
| PathId  | Path|
+-+-+
| 2518839 | /usr/include/xercesc/validators/common/ |
| 2518840 | /usr/include/xercesc/validators/common/ |
+-+-+
2 rows in set (0.00 sec)


I've been using the verify job feature for years (thanks!), but have only
come across this relatively recently - presumably it's a race condition
since switching to running jobs in parallel.

Firstly:

1) Should I be worried about these messages?

2) If not, is there a good way to get rid of them?!

I'm using bacula 9.6.5 + mariadb on centos7.



In current Bacula versions:
* The Filename table is gone; filenames are now in the File table
* Duplicate Filenames are fine, you can have multiple Files with the 
same name and different paths

* The Path table now has a unique index over Path


I've been running my Bacula jobs in parallel for literally decades now 
and have never seen it result in a duplicate Path or Filename warning. 
And they ARE only warnings.


I would not worry about it as long as it is only a warning.  You could 
manually clean up the duplicates, but it is probably not worth your while.


When did you last run a dbcheck?  The dbcheck tool should clean up most 
orphaned and duplicate records.




--
  Phil Stracchino
  Babylon Communications
  ph...@caerllewys.net
  p...@co.ordinate.org
  Landline: +1.603.293.8485
  Mobile:   +1.603.998.6958


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users