Re: [CentOS] Understanding VDO vs ZFS

2020-05-04 Thread John Pierce
Rather than dedupe at the file system level, I found the application level dedupe in BackupPC works really well... I've run BackupPC on both a big ZFS volume, and on a giant XFS over LVM over MDRAID volume (24 x 3TB disks organized as 2 x 11 raid6 plus 2 hot spares). The backuppc server I built

Re: [CentOS] Understanding VDO vs ZFS

2020-05-04 Thread Jeffrey Walton
On Sat, May 2, 2020 at 10:54 PM david wrote: > > I'm looking for a solution for backups because ZFS has failed on me > too many times. In my environment, I have a large amount of data > (around 2tb) that I periodically back up. I keep the last 5 > "snapshots". I use rsync so that when I overwri

Re: [CentOS] Understanding VDO vs ZFS

2020-05-04 Thread Andrew Walsh
you can backup at will you can probably forego the btrfs volume for > intermediate storage - that is just a band-aid to work around a specific > issue here. > > > Stefan > > > -- > > ________ > From: CentOS on behalf of david > Sent: Su

Re: [CentOS] Understanding VDO vs ZFS

2020-05-04 Thread Andrew Walsh
On Sat, May 2, 2020 at 10:54 PM david wrote: > > Folks > > I'm looking for a solution for backups because ZFS has failed on me > too many times. In my environment, I have a large amount of data > (around 2tb) that I periodically back up. I keep the last 5 > "snapshots". I use rsync so that when

Re: [CentOS] Understanding VDO vs ZFS

2020-05-04 Thread Stefan S
s just a band-aid to work around a specific issue here. Stefan -- From: CentOS on behalf of david Sent: Sunday, May 3, 2020 2:50 AM To: centos@centos.org Subject: [CentOS] Understanding VDO vs ZFS Folks I'm looking for a solution for backups because

Re: [CentOS] Understanding VDO vs ZFS

2020-05-03 Thread Erick Perez - Quadrian Enterprises
Strahil, I am using about 1012MB for the first ISO. I believe it's because of compression. From there vdostats --hu reports 5.0G usage and 12% in percentage. With savings of 89% for original + 9 copies of the same ISO. On Sun, May 3, 2020 at 1:17 AM Strahil Nikolov wrote: > On May 3, 2020 8:33:

Re: [CentOS] Understanding VDO vs ZFS

2020-05-03 Thread david
0At 08:07 PM 5/2/2020, you wrote: My two cents: 1- Do you have an encrypted filesystem on top of VDO? If yes, you will see no benefit from dedupe. 2- can you post the stats of vdostats ­verbose /dev/mapper/x (replace with your device) you can do something like: "vdostats -verbose /dev/mapp

Re: [CentOS] Understanding VDO vs ZFS

2020-05-03 Thread Alessandro Baggi
Il 03/05/20 04:50, david ha scritto: Folks I'm looking for a solution for backups because ZFS has failed on me too many times.  In my environment, I have a large amount of data (around 2tb) that I periodically back up.  I keep the last 5 "snapshots".  I use rsync so that when I overwrite th

Re: [CentOS] Understanding VDO vs ZFS

2020-05-02 Thread Strahil Nikolov via CentOS
On May 3, 2020 8:33:33 AM GMT+03:00, Erick Perez - Quadrian Enterprises wrote: >sorry corrections: >For this test I created a 40GB lvm volume group with /dev/sdb and >/dev/sdc >then a 40GB LV >then a 60GB VDO vol (for testing purposes) > >vdostats --verbose /dev/mapper/vdoas | grep -B6 'saving pe

Re: [CentOS] Understanding VDO vs ZFS

2020-05-02 Thread Erick Perez - Quadrian Enterprises
sorry corrections: For this test I created a 40GB lvm volume group with /dev/sdb and /dev/sdc then a 40GB LV then a 60GB VDO vol (for testing purposes) vdostats --verbose /dev/mapper/vdoas | grep -B6 'saving percent' output from just created vdoas [root@localhost ~]# vdostats --verbose /dev/mappe

Re: [CentOS] Understanding VDO vs ZFS

2020-05-02 Thread Erick Perez - Quadrian Enterprises
My two cents: 1- Do you have an encrypted filesystem on top of VDO? If yes, you will see no benefit from dedupe. 2- can you post the stats of vdostats –verbose /dev/mapper/x (replace with your device) you can do something like: "vdostats -verbose /dev/mapper/ | grep -B6 'save percent

[CentOS] Understanding VDO vs ZFS

2020-05-02 Thread david
Folks I'm looking for a solution for backups because ZFS has failed on me too many times. In my environment, I have a large amount of data (around 2tb) that I periodically back up. I keep the last 5 "snapshots". I use rsync so that when I overwrite the oldest backup, most of the data is al