Re: [bareos-users] Re: Job creating multiples new volumes
Hi,
The media was not created on disk, only in the catalog.
And new jobs do not reuse recycled volumes because there are volumes with
append status.
Regards,
Rodrigo
Em seg., 12 de jul. de 2021 às 11:28, Spadajspadaj
escreveu:
> I'd start by checking whether the media files are really created on disk.
>
> Then I'd run the daemon with higher debug level and capture the output.
> On 12.07.2021 16:24, Rodrigo Jorge wrote:
>
> Hello Folks,
>
> This is a BUG or a CONFIG error ?
>
> Regards,
>
> Rodrigo L L Jorge
>
> Em sáb., 10 de jul. de 2021 às 11:54, Rodrigo Jorge
> escreveu:
>
>> Hello guys!
>>
>> I have a problem when execute parallel jobs are created many new volumes
>> in catalog.
>>
>> For Example, I ran the jobid 112109 and this job created 19 new volumes.
>>
>> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
>> "diario-DISCO-6043" in catalog.
>> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
>> "diario-DISCO-6044" in catalog.
>> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
>> "diario-DISCO-6045" in catalog.
>> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
>> "diario-DISCO-6046" in catalog.
>> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
>> "diario-DISCO-6047" in catalog.
>> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
>> "diario-DISCO-6048" in catalog.
>> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
>> "diario-DISCO-6049" in catalog.
>> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
>> "diario-DISCO-6050" in catalog.
>> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
>> "diario-DISCO-6051" in catalog.
>> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
>> "diario-DISCO-6052" in catalog.
>> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
>> "diario-DISCO-6053" in catalog.
>> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
>> "diario-DISCO-6054" in catalog.
>> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
>> "diario-DISCO-6055" in catalog.
>> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
>> "diario-DISCO-6056" in catalog.
>> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
>> "diario-DISCO-6057" in catalog.
>> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
>> "diario-DISCO-6058" in catalog.
>> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
>> "diario-DISCO-6059" in catalog.
>> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
>> "diario-DISCO-6060" in catalog.
>> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
>> "diario-DISCO-6061" in catalog.
>>
>> But using only one volume.
>>
>> *list jobid=112109
>>
>> +-+-++-+--+---+--+-+---+
>> | JobId | Name| Client | StartTime | Type |
>> Level | JobFiles | JobBytes| JobStatus |
>>
>> +-+-++-+--+---+--+-+---+
>> | 112,109 | pmbp-sql-01 | pmbp-sql-01-fd | 2021-07-06 20:00:43 | B| I
>> |6 | 199,093,012 | T |
>>
>> +-+-++-+--+---+--+-+---+
>>
>> *list jobmedia jobid=112109
>> +-+---++---+
>> | JobId | VolumeName| FirstIndex | LastIndex |
>> +-+---++---+
>> | 112,109 | diario-DISCO-6043 | 1 | 6 |
>> +-+---++---+
>>
>> If I execute one job per time I don't have this problem.
>> I attach the full job execution
>>
>> My Configs:
>>
>> Client {
>> Name = pmbp-sql-01-fd
>> Address = 172.16.123.13
>> Password = "PWD"
>> @/etc/bareos/bareos-client-common.conf
>> }
>>
>> Job {
>> Name = "pmbp-sql-01"
>> JobDefs = "DefJobsDISCO"
>> Schedule = "DISCO_20h_TANDBERG"
>> Client = pmbp-sql-01-fd
>> Storage = backup-disco
>> FileSet = file_pmbp-sql-01
>> Client Run Before Job = "E:\bkp_full_pmbp-sql-01.bat"
>> }
>>
>> FileSet {
>> Name = "file_pmbp-sql-01"
>> Enable VSS = yes
>> Include {
>> Options {
>> Signature = MD5
>> Drive Type = fixed
>> IgnoreCase = yes
>> WildFile = "[A-Z]:/pagefile.sys"
>> WildDir = "[A-Z]:/RECYCLER"
>> WildDir = "[A-Z]:/$RECYCLE.BIN"
>> WildDir = "[A-Z]:/System Volume Information"
>> Exclude = yes
>> }
>> File = E:/SQLBackup
>> }
>> }
>>
>> JobDefs {
>> Name = "DefJobsDISCO"
>> Type = Backup
>> Level = Incremental
>> Storage = backup-disco
>> Schedule = "DISCO_19h_TANDBERG"
>> Messages = Standard
>> Accurate = no
>> Pool = diario-DISCO
>> Priority = 10
>> Write Bootstrap = "/var/lib/bareos/%c.bsr"
>> Full Backup Pool = semanal-DISCO
>> Incremental Backup Pool = diario-DISCO
>> Maximum Concurrent Jobs = 10
>> }
>>
>> Schedule {
>> Name = "DISCO_20h_TANDBERG"
>> Run =
Re: [bareos-users] Re: Job creating multiples new volumes
I'd start by checking whether the media files are really created on disk.
Then I'd run the daemon with higher debug level and capture the output.
On 12.07.2021 16:24, Rodrigo Jorge wrote:
Hello Folks,
This is a BUG or a CONFIG error ?
Regards,
Rodrigo L L Jorge
Em sáb., 10 de jul. de 2021 às 11:54, Rodrigo Jorge
mailto:rlljo...@gmail.com>> escreveu:
Hello guys!
I have a problem when execute parallel jobs are created many new
volumes in catalog.
For Example, I ran the jobid 112109 and this job created 19 new
volumes.
06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
"diario-DISCO-6043" in catalog.
06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
"diario-DISCO-6044" in catalog.
06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
"diario-DISCO-6045" in catalog.
06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
"diario-DISCO-6046" in catalog.
06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
"diario-DISCO-6047" in catalog.
06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
"diario-DISCO-6048" in catalog.
06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
"diario-DISCO-6049" in catalog.
06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
"diario-DISCO-6050" in catalog.
06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
"diario-DISCO-6051" in catalog.
06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
"diario-DISCO-6052" in catalog.
06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
"diario-DISCO-6053" in catalog.
06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
"diario-DISCO-6054" in catalog.
06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
"diario-DISCO-6055" in catalog.
06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
"diario-DISCO-6056" in catalog.
06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
"diario-DISCO-6057" in catalog.
06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
"diario-DISCO-6058" in catalog.
06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
"diario-DISCO-6059" in catalog.
06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
"diario-DISCO-6060" in catalog.
06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
"diario-DISCO-6061" in catalog.
But using only one volume.
*list jobid=112109
+-+-++-+--+---+--+-+---+
| JobId | Name | Client | StartTime | Type |
Level | JobFiles | JobBytes | JobStatus |
+-+-++-+--+---+--+-+---+
| 112,109 | pmbp-sql-01 | pmbp-sql-01-fd | 2021-07-06 20:00:43 | B
| I | 6 | 199,093,012 | T |
+-+-++-+--+---+--+-+---+
*list jobmedia jobid=112109
+-+---++---+
| JobId | VolumeName | FirstIndex | LastIndex |
+-+---++---+
| 112,109 | diario-DISCO-6043 | 1 | 6 |
+-+---++---+
If I execute one job per time I don't have this problem.
I attach the full job execution
My Configs:
Client {
Name = pmbp-sql-01-fd
Address = 172.16.123.13
Password = "PWD"
@/etc/bareos/bareos-client-common.conf
}
Job {
Name = "pmbp-sql-01"
JobDefs = "DefJobsDISCO"
Schedule = "DISCO_20h_TANDBERG"
Client = pmbp-sql-01-fd
Storage = backup-disco
FileSet = file_pmbp-sql-01
Client Run Before Job = "E:\bkp_full_pmbp-sql-01.bat"
}
FileSet {
Name = "file_pmbp-sql-01"
Enable VSS = yes
Include {
Options {
Signature = MD5
Drive Type = fixed
IgnoreCase = yes
WildFile = "[A-Z]:/pagefile.sys"
WildDir = "[A-Z]:/RECYCLER"
WildDir = "[A-Z]:/$RECYCLE.BIN"
WildDir = "[A-Z]:/System Volume Information"
Exclude = yes
}
File = E:/SQLBackup
}
}
JobDefs {
Name = "DefJobsDISCO"
Type = Backup
Level = Incremental
Storage = backup-disco
Schedule = "DISCO_19h_TANDBERG"
Messages = Standard
Accurate = no
Pool = diario-DISCO
Priority = 10
Write Bootstrap = "/var/lib/bareos/%c.bsr"
Full Backup Pool = semanal-DISCO
Incremental Backup Pool = diario-DISCO
Maximum Concurrent Jobs = 10
}
Schedule {
Name = "DISCO_20h_TANDBERG"
Run = Incremental 1st mon-fri at 20:00
Run = Incremental 2nd-5th mon-sat at 20:00
Run = Full sun at 20:00
Run = Full Pool=Mensal Storage=TANDBERG 1st sat at
[bareos-users] Re: Job creating multiples new volumes
Hello Folks,
This is a BUG or a CONFIG error ?
Regards,
Rodrigo L L Jorge
Em sáb., 10 de jul. de 2021 às 11:54, Rodrigo Jorge
escreveu:
> Hello guys!
>
> I have a problem when execute parallel jobs are created many new volumes
> in catalog.
>
> For Example, I ran the jobid 112109 and this job created 19 new volumes.
>
> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
> "diario-DISCO-6043" in catalog.
> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
> "diario-DISCO-6044" in catalog.
> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
> "diario-DISCO-6045" in catalog.
> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
> "diario-DISCO-6046" in catalog.
> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
> "diario-DISCO-6047" in catalog.
> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
> "diario-DISCO-6048" in catalog.
> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
> "diario-DISCO-6049" in catalog.
> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
> "diario-DISCO-6050" in catalog.
> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
> "diario-DISCO-6051" in catalog.
> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
> "diario-DISCO-6052" in catalog.
> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
> "diario-DISCO-6053" in catalog.
> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
> "diario-DISCO-6054" in catalog.
> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
> "diario-DISCO-6055" in catalog.
> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
> "diario-DISCO-6056" in catalog.
> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
> "diario-DISCO-6057" in catalog.
> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
> "diario-DISCO-6058" in catalog.
> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
> "diario-DISCO-6059" in catalog.
> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
> "diario-DISCO-6060" in catalog.
> 06-Jul 20:00 backup01-dir JobId 112109: Created new Volume
> "diario-DISCO-6061" in catalog.
>
> But using only one volume.
>
> *list jobid=112109
>
> +-+-++-+--+---+--+-+---+
> | JobId | Name| Client | StartTime | Type |
> Level | JobFiles | JobBytes| JobStatus |
>
> +-+-++-+--+---+--+-+---+
> | 112,109 | pmbp-sql-01 | pmbp-sql-01-fd | 2021-07-06 20:00:43 | B| I
> |6 | 199,093,012 | T |
>
> +-+-++-+--+---+--+-+---+
>
> *list jobmedia jobid=112109
> +-+---++---+
> | JobId | VolumeName| FirstIndex | LastIndex |
> +-+---++---+
> | 112,109 | diario-DISCO-6043 | 1 | 6 |
> +-+---++---+
>
> If I execute one job per time I don't have this problem.
> I attach the full job execution
>
> My Configs:
>
> Client {
> Name = pmbp-sql-01-fd
> Address = 172.16.123.13
> Password = "PWD"
> @/etc/bareos/bareos-client-common.conf
> }
>
> Job {
> Name = "pmbp-sql-01"
> JobDefs = "DefJobsDISCO"
> Schedule = "DISCO_20h_TANDBERG"
> Client = pmbp-sql-01-fd
> Storage = backup-disco
> FileSet = file_pmbp-sql-01
> Client Run Before Job = "E:\bkp_full_pmbp-sql-01.bat"
> }
>
> FileSet {
> Name = "file_pmbp-sql-01"
> Enable VSS = yes
> Include {
> Options {
> Signature = MD5
> Drive Type = fixed
> IgnoreCase = yes
> WildFile = "[A-Z]:/pagefile.sys"
> WildDir = "[A-Z]:/RECYCLER"
> WildDir = "[A-Z]:/$RECYCLE.BIN"
> WildDir = "[A-Z]:/System Volume Information"
> Exclude = yes
> }
> File = E:/SQLBackup
> }
> }
>
> JobDefs {
> Name = "DefJobsDISCO"
> Type = Backup
> Level = Incremental
> Storage = backup-disco
> Schedule = "DISCO_19h_TANDBERG"
> Messages = Standard
> Accurate = no
> Pool = diario-DISCO
> Priority = 10
> Write Bootstrap = "/var/lib/bareos/%c.bsr"
> Full Backup Pool = semanal-DISCO
> Incremental Backup Pool = diario-DISCO
> Maximum Concurrent Jobs = 10
> }
>
> Schedule {
> Name = "DISCO_20h_TANDBERG"
> Run = Incremental 1st mon-fri at 20:00
> Run = Incremental 2nd-5th mon-sat at 20:00
> Run = Full sun at 20:00
> Run = Full Pool=Mensal Storage=TANDBERG 1st sat at 20:00
> }
>
> Pool {
> Name = semanal-DISCO
> Pool Type = Backup
> Storage = backup-disco
> AutoPrune = yes
> Action On Purge = Truncate
> Maximum Volume Bytes = 100g
> Maximum Volume Jobs = 10
> Maximum Volumes = 100
> Recycle = yes
> Volume Retention = 31 days
> Volume Use Duration = 12 hours
> File Retention = 31 days
> Job Retention = 31 days
> Label Format = "semanal-DISCO-"
> }
>
> Pool {
>
