On Mon, 20 Sep 2021 18:32:28 -0400
Jon LaBadie wrote:
> Interesting discussion in other threads got me wondering
> whether I should have made some other choices when setting
> up my vtape environment. Particularly whether I should
> have used LVM (Logical Volume Management) to create one
>
Deb, Kees,
Yes, I'd done something similar, we have zfs mounts for each user, and then
globbed them together by first letter of the username.
Brian
Extract from disklist
ZFS mounts for samba shares was by specific share, I'd written a script to find
the shares that currently existed and
I meant to send this to the list.
Forwarded Message
Subject:Re: LVM for vtapes
Date: Tue, 21 Sep 2021 16:10:09 -0400
From: Chris Hoogendyk
To: Olivier
Just an off hand comment on disk drives. We've been getting 10TB Western Digital Ultrastar Data
Center
On Tue, Sep 21, 2021 at 10:01:04AM +0200, Diego Zuccato wrote:
A different approach here.
I configured a single MD-RAID6 of 16 4TB disks and the vtapes are
simple folders.
I did it mostly because I didn't know the exact space requirements our
backups would have. Today I'd go with a smaller
Jens, Kees,
I think Shilly Tar, STAR is multi-threaded and that we use it with Amanda on at
least one of our Amanda clients.
Honestly don't recall (without checking the docs) if spindle is to group DLE's
for concurrent backup, or to avoid running them concurrently, I think that
latter.
Be
Have you experimented with dividing those target disks into smaller pieces,
using
tar? So that amanda isn’t doing level 0 on all parts on the same day?
I’ve divided some disks as far as a*, b*, c*, …. z*, Other (to catch caps or
numbers
or future additions). I’ve found that each piece
Hi,
Thanks as well!
The source is spinning rust with SSD cache. The target is RAID-Z2 ZFS on
spinning rust.
And yes: way too much tiny files.
To be continued...
K.
On 21-09-2021 17:53, C. Chan wrote:
Is the file storage media hard disk, and are the files mostly
small and IOPS/latency
Thanks, I'll take that into consideration.
K.
On 21-09-2021 16:30, Jens Berg wrote:
maybe you can try to split up the files into several DLEs and put them
into different spindles. That should fire off multiple instances of
tar in parallel, if I understood Amanda's concept of spindles
Ah, I'll take a look at that as well. Thanks!
K.
On 21-09-2021 16:44, Cuttler, Brian R (HEALTH) wrote:
I think Shilly Tar, STAR is multi-threaded and that we use it with Amanda on at
least one of our Amanda clients.
Honestly don't recall (without checking the docs) if spindle is to group
Is the file storage media hard disk, and are the files mostly
small and IOPS/latency bound? If so, you may have to live with slw
backups. We eventually added NVMe SSDs to our ZFS array as special devices
and sent files smaller than 128KB to NVMe, which along with the metadata,
helped speed
Hi Kees,
maybe you can try to split up the files into several DLEs and put them
into different spindles. That should fire off multiple instances of tar
in parallel, if I understood Amanda's concept of spindles correctly.
Hope it helps,
Jens
On 21.09.2021 15:55, Kees Meijs | Nefos wrote:
Hi list,
We've got some backup targets with lots (and lots, and then some) of
files. There's so much of them that making back-ups is becoming a problem.
During the backup process, tar(1) is eating up a CPU core. There's no or
hardly no I/O wait to be seen. Very likely tar is single threaded
On Tuesday 21 September 2021 03:44:14 Diego Zuccato wrote:
> I'm not an expert but I'd set a tapechanger script that wakes the
> vtape by reading or writing something to the disk.
>
> Il 20/09/2021 05:07, Jon LaBadie ha scritto:
> > is there a way to run a user supplied program just
> > before
A different approach here.
I configured a single MD-RAID6 of 16 4TB disks and the vtapes are simple
folders.
I did it mostly because I didn't know the exact space requirements our
backups would have. Today I'd go with a smaller RAID (probably just 10
disks, so to have 32TB and a sane stripe
I'm not an expert but I'd set a tapechanger script that wakes the vtape
by reading or writing something to the disk.
Il 20/09/2021 05:07, Jon LaBadie ha scritto:
is there a way to run a user supplied program just
before amanda's taper opens each tape file? I.e.,
before it actually opens and
15 matches
Mail list logo
