[Bacula-users] Q: Bacula fails to update catalog reference

2020-01-22 Thread John H Nyhuis 
The Bacula "update slots" command fails to update the catalog for a 
specific volume.  The volume is labeled correctly, and bacula can read 
the label using "update slots scan"

To resolve, I had to manually add the volume to the catalog using the 
"add" command.  I am still at a lose to understand why "label" failed 
silently for a random number of volumes.

Can anyone give me some pointers on figuring out why label keeps 
silently failing?

*update slots
Automatically selected Catalog: GACCatalog
Using Catalog "GACCatalog"
Automatically selected Storage: Scalar-i40
Connecting to Storage daemon Scalar-i40 at 127.0.0.1:9103 ...
Enter autochanger drive[0]:
Connecting to Storage daemon Scalar-i40 at 127.0.0.1:9103 ...
3306 Issuing autochanger "slots" command.
Device "AutoChanger-Scalar-i40" has 38 slots.
Connecting to Storage daemon Scalar-i40 at 127.0.0.1:9103 ...
3306 Issuing autochanger "list" command.
Catalog record for Volume "01" is up to date.
Catalog record for Volume "02" is up to date.
Catalog record for Volume "03" is up to date.
Catalog record for Volume "07" is up to date.
Volume "05" not found in catalog. Slot=5 InChanger set to zero.
Catalog record for Volume "06" is up to date.
Catalog record for Volume "08" is up to date.
Catalog record for Volume "09" is up to date.
Catalog record for Volume "10" updated to reference slot 10.
Catalog record for Volume "11" is up to date.
Catalog record for Volume "12" is up to date.
Catalog record for Volume "13" is up to date.
Catalog record for Volume "14" is up to date.
Catalog record for Volume "15" is up to date.
Catalog record for Volume "16" is up to date.
Catalog record for Volume "17" is up to date.
Catalog record for Volume "18" is up to date.
Volume "19" not found in catalog. Slot=19 InChanger set to zero.
Volume "20" not found in catalog. Slot=20 InChanger set to zero.
*update slot=5 scan
Automatically selected Storage: Scalar-i40
Enter autochanger drive[0]:
Connecting to Storage daemon Scalar-i40 at 127.0.0.1:9103 ...
3306 Issuing autochanger "slots" command.
Device "AutoChanger-Scalar-i40" has 38 slots.
Connecting to Storage daemon Scalar-i40 at 127.0.0.1:9103 ...
3306 Issuing autochanger "list" command.
Connecting to Storage daemon Scalar-i40 at 127.0.0.1:9103 ...
3304 Issuing autochanger "load slot 5, drive 0" command.
3305 Autochanger "load slot 5, drive 0", status is OK.
3001 Volume=05 Slot=5
Volume "05" not found in catalog. Slot=5 InChanger set to zero.
*

So the volume is present in the changer, Bacula can read the volume, 
it's labeled correctly, but Bacula does not add it to the catalog.
Finally, I had to force the issue using the add command:

*add pool=lto6-pool
You probably don't want to be using this command since it
creates database records without labeling the Volumes.
You probably want to use the "label" command.
Automatically selected Storage: Scalar-i40
Enter number of Volumes to create. 0=>fixed name. Max=1000: 0
Enter Volume name: 05
Enter slot (0 for none): 5
InChanger? yes/no: yes
1 Volumes created in pool lto6-pool
*update slot=05
Automatically selected Storage: Scalar-i40
Enter autochanger drive[0]:
Connecting to Storage daemon Scalar-i40 at 127.0.0.1:9103 ...
3306 Issuing autochanger "slots" command.
Device "AutoChanger-Scalar-i40" has 38 slots.
Connecting to Storage daemon Scalar-i40 at 127.0.0.1:9103 ...
3306 Issuing autochanger "list" command.
Catalog record for Volume "05" is up to date.

Any ideas as to why bacula looses references to inchanger volumes, and 
then refuses to update them with update slots?  As you can see, I will 
need to repeat the process for scratch volumes 19 and 20 as well.


Could it be a misalignment of the barcode reader in the changer?

-- 
Thanks,

John H. Nyhuis
Desk: (206)-685-8334
jnyh...@uw.edu
Box 359461, 15th floor, 106

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Disk setup for best performance on backups

2020-01-22 Thread Josh Fisher 


On 1/22/2020 10:52 AM, dmaziuk via Bacula-users wrote:

On 1/22/2020 2:19 AM, Radosław Korzeniewski wrote:


Unless you are using BEE GED or other similar functionality you should
never use the SSD in your backup solution as it will be a pure waste of
money.


I'm running a bunch of jobs in parallel and spooling them on an ssd. 
Works pretty well for the money, but you need to work out how to size it.



It makes sense to put Bacula's work directory and any spooling to a 
separate disk of some kind. It prevents writes for spooling, logging, 
etc. from interfering with the sequential nature of the volume data writes.


Another thing that makes SSD worth the money is the very fast random 
read/write speeds and IOPS allows running a local DB server for the 
catalog. This is particularly helpful for those of us contending with 1G 
networks, and adding a SSD is far cheaper than upgrading the network to 
10 G.





Dima


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Disk setup for best performance on backups

2020-01-22 Thread dmaziuk via Bacula-users 

On 1/22/2020 2:19 AM, Radosław Korzeniewski wrote:


Unless you are using BEE GED or other similar functionality you should
never use the SSD in your backup solution as it will be a pure waste of
money.


I'm running a bunch of jobs in parallel and spooling them on an ssd. 
Works pretty well for the money, but you need to work out how to size it.


Dima


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Disk setup for best performance on backups

2020-01-22 Thread Radosław Korzeniewski 
Hello,

pon., 20 sty 2020 o 16:57 Jason Voorhees  napisał(a):

> - Does it matter a lot choosing XFS instead of ext4 as filesystem?
>

IMVHO, yes. :)


> - How can I know the amount of IOPS needed for my local disk?
>

You can calculate the value based on required throughput and expected block
size.
But it is very tricky as Bacula generates a sequential stream of 64k blocks
during backup which underlying VFS/FS/OS can consolidate for best
performance for a particular disk device.


> - What does Bacula need most: high IOPS or throughput (MB/s)?
>

For standard Bacula backup it is throughput as described above but for
Bacula Enterprise with GED plugin it would be IOPS in some components.


> - Based on the previous question, should I choose SSD over HDD disks?
>

Unless you are using BEE GED or other similar functionality you should
never use the SSD in your backup solution as it will be a pure waste of
money.


> - Is it worth using RAID1 or RAID10 for improving performance?
>

A simple RAID1 will never improve performance during writes, never ever.
RAID10 could or even should improve performance but its "redundancy factor"
will always be 2x.


> By the way, I pretend to use an external DB (Amazon RDS) for my
> Catalog, so my Storage daemon wouldn't share the same underlying
> storage.
>

Bacula support SQL_ASCII database encoding only.


> I hope someone can share some ideas about disk performance.

I didn't find enough info about this topic on Internet. Thanks in advance
>

There is a bunch of whitepapers about designing a disk based backups for
Bacula at website: https://www.bacula.org/white-papers/
Did you check it?

best regards
-- 
Radosław Korzeniewski
rados...@korzeniewski.net
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users