Re: ZFS performance (was: Re: deduplicating file systems: VDO withDebian?)

2022-11-09 Thread gene heskett
On 11/10/22 00:37, David Christensen wrote: On 11/9/22 00:24, hw wrote: > On Tue, 2022-11-08 at 17:30 -0800, David Christensen wrote: > Hmm, when you can backup like 3.5TB with that, maybe I should put FreeBSD on my > server and give ZFS a try.  Worst thing that can happen is that it crashe

Re: Increased read IO wait times after Bullseye upgrade

2022-11-09 Thread Vukovics Mihaly
Hi Gareth, - Smartmon/smarctl does not report any hw issues on the HDDs. - Fragmentation score is 1 (not fragmented at all) - 18% used only - RAID status is green (force-resynced) - rebooted several times - the IO utilization is almost zero(!) - chart attached - tried to change the io scheduler o

Re: ZFS performance (was: Re: deduplicating file systems: VDO with Debian?)

2022-11-09 Thread David Christensen
On 11/9/22 01:35, DdB wrote: > But i am satisfied with zfs performance from spinning rust, if i dont fill up the pool too much, and defrag after a while ... What is your technique for defragmenting ZFS? David

Re: definiing deduplication (was: Re: deduplicating file systems: VDO with Debian?)

2022-11-09 Thread David Christensen
On 11/9/22 03:08, Thomas Schmitt wrote: So i would use at least four independent storage facilities interchangeably. I would make snapshots, if the filesystem supports them, and backup those instead of the changeable filesystem. I would try to reduce the activity of applications on the filesyste

Re: ZFS performance (was: Re: deduplicating file systems: VDO with Debian?)

2022-11-09 Thread David Christensen
On 11/9/22 05:29, didier gaumet wrote: - *BSDs nowadays have departed from old ZFS code and use the same source code stack as Linux (OpenZFS) AIUI FreeBSD 12 and prior use ZFS-on-Linux code, while FreeBSD 13 and later use OpenZFS code. On 11/9/22 05:44, didier gaumet wrote: > I was usin

Re: ZFS performance (was: Re: deduplicating file systems: VDO with Debian?)

2022-11-09 Thread David Christensen
On 11/9/22 00:24, hw wrote: > On Tue, 2022-11-08 at 17:30 -0800, David Christensen wrote: > Hmm, when you can backup like 3.5TB with that, maybe I should put FreeBSD on my > server and give ZFS a try. Worst thing that can happen is that it crashes and > I'd have made an experiment that wasn't

Re: else or Debian (Re: ZFS performance (was: Re: deduplicating file systems: VDO with Debian?))

2022-11-09 Thread hw
On Wed, 2022-11-09 at 19:17 +0100, Linux-Fan wrote: > hw writes: > > > On Wed, 2022-11-09 at 14:29 +0100, didier gaumet wrote: > > > Le 09/11/2022 à 12:41, hw a écrit : > > [...] > > > > I am really not so well aware of ZFS state but my impression was that: > > > - FUSE implementation of ZoL (ZF

Re: else or Debian (Re: ZFS performance (was: Re: deduplicating file systems: VDO with Debian?))

2022-11-09 Thread hw
On Wed, 2022-11-09 at 18:26 +0100, Christoph Brinkhaus wrote: > Am Wed, Nov 09, 2022 at 06:11:34PM +0100 schrieb hw: > [...] > > FreeBSD has ZFS but can't even configure the disk controllers, so that won't > > work.  > > If I understand you right you mean RAID controllers? yes > According to my

Re: Debian 11 - How to install Gtkmm

2022-11-09 Thread David Abbott
On Wed, Nov 9, 2022 at 7:27 PM Amn wrote: > > Trying to install Gtkmm 4 in a Debian 11 box I do this : > sudo apt install libgtkmm-4.0-dev > > But then I get this error : > > Unable to locate package libgtkmm-4.0-dev > > What am I doing wrong? > # apt-cache search libgtkmm libgtkmm-2.4-1v5 - C++

Re: Debian 11 - How to install Gtkmm

2022-11-09 Thread Keith Bainbridge
On 10/11/22 11:09, Amn wrote: Trying to install Gtkmm 4 in a Debian 11 box I do this : sudo apt install libgtkmm-4.0-dev But then I get this error : Unable to locate package libgtkmm-4.0-dev What am I doing wrong? Amn I run testing, and latest version here is 3.0-1v5. Alternative versio

Re: Debian 11 - How to install Gtkmm

2022-11-09 Thread Bob McGowan
On 11/9/22 04:09 PM, Amn wrote: Trying to install Gtkmm 4 in a Debian 11 box I do this : sudo apt install libgtkmm-4.0-dev But then I get this error : Unable to locate package libgtkmm-4.0-dev What am

Debian 11 - How to install Gtkmm

2022-11-09 Thread Amn
Trying to install Gtkmm 4 in a Debian 11 box I do this : sudo apt install libgtkmm-4.0-dev But then I get this error : Unable to locate package libgtkmm-4.0-dev What am I doing wrong?

Re: else or Debian (Re: ZFS performance (was: Re: deduplicating file systems: VDO with Debian?))

2022-11-09 Thread Linux-Fan
hw writes: On Wed, 2022-11-09 at 14:29 +0100, didier gaumet wrote: > Le 09/11/2022 à 12:41, hw a écrit : [...] > I am really not so well aware of ZFS state but my impression was that: > - FUSE implementation of ZoL (ZFS on Linux) is deprecated and that, > Ubuntu excepted (classic module?), Z

Re: Bluetooth sound problems

2022-11-09 Thread Peter von Kaehne
> On 9 Nov 2022, at 15:12, Charles Curley > wrote: > > On Wed, 9 Nov 2022 09:52:15 + > Peter von Kaehne wrote: > >> My laptop (Thinkpad Yoga11e first gen) on Debian Sid is showing for >> last few months diverse and variable sound problems.l, particularly >> with using Bluetooth speaker

Re: else or Debian (Re: ZFS performance (was: Re: deduplicating file systems: VDO with Debian?))

2022-11-09 Thread Christoph Brinkhaus
Am Wed, Nov 09, 2022 at 06:11:34PM +0100 schrieb hw: Hi hw, > On Wed, 2022-11-09 at 14:29 +0100, didier gaumet wrote: > > Le 09/11/2022 à 12:41, hw a écrit : > > [...] > > > In any case, I'm currently tending to think that putting FreeBSD with ZFS > > > on > > > my > > > server might be the best

Re: ZFS performance (was: Re: deduplicating file systems: VDO with Debian?)

2022-11-09 Thread hw
On Wed, 2022-11-09 at 17:29 +0100, DdB wrote: > Am 09.11.2022 um 12:41 schrieb hw: > > In any case, I'm currently tending to think that putting FreeBSD with ZFS on > > my > > server might be the best option.  But then, apparently I won't be able to > > configure the controller cards, so that won't

else or Debian (Re: ZFS performance (was: Re: deduplicating file systems: VDO with Debian?))

2022-11-09 Thread hw
On Wed, 2022-11-09 at 14:29 +0100, didier gaumet wrote: > Le 09/11/2022 à 12:41, hw a écrit : > [...] > > In any case, I'm currently tending to think that putting FreeBSD with ZFS on > > my > > server might be the best option.  But then, apparently I won't be able to > > configure the controller ca

Re: definiing deduplication (was: Re: deduplicating file systems: VDO with Debian?)

2022-11-09 Thread hw
On Wed, 2022-11-09 at 14:44 +0100, didier gaumet wrote: > Le 09/11/2022 à 14:25, hw a écrit : > > > I don't think it was, see https://docs.freebsd.org/en/books/handbook/zfs/ > > > > I does mention performance, but I remember other statements saying that was > > designed for arrays with 40+ disks

Re: ZFS performance (was: Re: deduplicating file systems: VDO with Debian?)

2022-11-09 Thread DdB
Am 09.11.2022 um 12:41 schrieb hw: > In any case, I'm currently tending to think that putting FreeBSD with ZFS on > my > server might be the best option. But then, apparently I won't be able to > configure the controller cards, so that won't really work. And ZFS with Linux > isn't so great becau

Re: Bluetooth sound problems

2022-11-09 Thread Charles Curley
On Wed, 9 Nov 2022 09:52:15 + Peter von Kaehne wrote: > My laptop (Thinkpad Yoga11e first gen) on Debian Sid is showing for > last few months diverse and variable sound problems.l, particularly > with using Bluetooth speakers, but also with Airplay. You might see what tips or tricks you can

Re: ZFS performance (was: Re: deduplicating file systems: VDO with Debian?)

2022-11-09 Thread D. R. Evans
hw wrote on 11/9/22 04:41: configure the controller cards, so that won't really work. And ZFS with Linux isn't so great because it keeps fuse in between. That isn't true. I've been using ZFS with Debian for years without FUSE, through the ZFSonLinux project. The only slightly discomfortin

Re: definiing deduplication (was: Re: deduplicating file systems: VDO with Debian?)

2022-11-09 Thread didier gaumet
Le 09/11/2022 à 14:25, hw a écrit : I don't think it was, see https://docs.freebsd.org/en/books/handbook/zfs/ I does mention performance, but I remember other statements saying that was designed for arrays with 40+ disks and, besides data integrity, with ease of use in mind. Performance doesn'

Re: ZFS performance (was: Re: deduplicating file systems: VDO with Debian?)

2022-11-09 Thread didier gaumet
Le 09/11/2022 à 12:41, hw a écrit : [...] In any case, I'm currently tending to think that putting FreeBSD with ZFS on my server might be the best option. But then, apparently I won't be able to configure the controller cards, so that won't really work. And ZFS with Linux isn't so great because

Re: definiing deduplication (was: Re: deduplicating file systems: VDO with Debian?)

2022-11-09 Thread hw
On Wed, 2022-11-09 at 11:05 +0100, didier gaumet wrote: > Le 09/11/2022 à 10:27, hw a écrit : > [...] > > Yes, I've seen those.  I can only wonder how much performance impact VDO > > would > > have for backups.  And I wonder why it doesn't require as much memory as ZFS > > seems to need for dedupli

Re: deduplicating file systems: VDO with Debian?

2022-11-09 Thread Nicolas George
hw (12022-11-08): > When I want to have 2 (or more) generations of backups, do I actually want > deduplication? It leaves me with only one actual copy of the data which seems > to defeat the idea of having multiple generations of backups at least to some > extent. The idea of having multiple gene

Re: deduplicating file systems: VDO with Debian?

2022-11-09 Thread didier gaumet
Le 09/11/2022 à 13:12, hw a écrit : On Wed, 2022-11-09 at 11:37 +0100, didier gaumet wrote: [...] in my opinion you are confusing deduplicating during backup and incremental/differential backups. [...] I don't know why you think that.[...] Because earlier in a previous message you stated: "

Re: deduplicating file systems: VDO with Debian?

2022-11-09 Thread Dan Ritter
hw wrote: > > The question is rather if it makes sense to have two full backups on the same > machine for redundancy and to be able to go back in time, or if it's better to > give up on redundancy and to have only one copy and use snapshots or whatever > to > be able to go back in time. And fo

Re: deduplicating file systems: VDO with Debian?

2022-11-09 Thread hw
On Tue, 2022-11-08 at 15:07 +0100, hede wrote: > On 08.11.2022 05:31, hw wrote: > > That still requires you to have enough disk space for at least two full > > backups. > > Correct, if you do always full backups then the second run will consume > full backup space in the first place. (not fully

Re: deduplicating file systems: VDO with Debian?

2022-11-09 Thread hw
On Tue, 2022-11-08 at 10:04 -0500, The Wanderer wrote: > On 2022-11-08 at 09:36, Nicolas George wrote: > > > Curt (12022-11-08): > > > > > Redundancy sounds a lot like a back up. > > > > RAID also sounds a lot like a backup, and the R means redundant. > > > > Yet raid is not a backup. > > That

Re: deduplicating file systems: VDO with Debian?

2022-11-09 Thread hw
On Tue, 2022-11-08 at 09:52 +0100, DdB wrote: > Am 08.11.2022 um 05:31 schrieb hw: > > > That's only one point. > > What are the others? > > > > >  And it's not really some valid one, I think, as > > > you do typically not run into space problems with one single action > > > (YMMV). Running mult

Re: deduplicating file systems: VDO with Debian?

2022-11-09 Thread hw
On Wed, 2022-11-09 at 11:37 +0100, didier gaumet wrote: > > I am no expert (in Linux, backporting or anything else) and cannot emit > a viable advice about what your backup plan should be. You are in better > position to evaluate your needs, your means and design a satisfying > backup plan acco

Re: deduplicating file systems: VDO with Debian?

2022-11-09 Thread hw
On Wed, 2022-11-09 at 12:13 +0100, to...@tuxteam.de wrote: > On Wed, Nov 09, 2022 at 11:15:15AM +0100, hw wrote: > > On Wed, 2022-11-09 at 09:46 +0100, to...@tuxteam.de wrote: > > [...] > > > But, as others have said, deduplication at the file system level (or > > > below, > > > as VDO does) is ma

Re: ZFS performance (was: Re: deduplicating file systems: VDO with Debian?)

2022-11-09 Thread hw
On Wed, 2022-11-09 at 10:35 +0100, DdB wrote: > Am 09.11.2022 um 09:24 schrieb hw: > > > Learn more about ZFS and invest in hardware to get performance. > > Hardware like?  In theory, using SSDs for cache with ZFS should improve > > performance.  In practise, it only wore out the SSDs after a while

Re: deduplicating file systems: VDO with Debian?

2022-11-09 Thread hw
On Tue, 2022-11-08 at 07:19 -0500, Dan Ritter wrote: > hw wrote: > > > As you say, deduplication in backup systems is quite common, and works > > > pretty well. There's also an on-disk non-filesystem utility, rdfind, > > > which is packaged in Debian. It can discover identical files and make > > >

Re: deduplicating file systems: VDO with Debian?

2022-11-09 Thread tomas
On Wed, Nov 09, 2022 at 11:15:15AM +0100, hw wrote: > On Wed, 2022-11-09 at 09:46 +0100, to...@tuxteam.de wrote: [...] > > Pehaps you don't know about rsync's --link-dest option: you can, with rsync, > > keep generations without duplicating between them. > > No, I didn't know that. My intention

Re: definiing deduplication (was: Re: deduplicating file systems: VDO with Debian?)

2022-11-09 Thread Thomas Schmitt
Hi, i wrote: > >   https://github.com/dm-vdo/kvdo/issues/18 hw wrote: > So the VDO ppl say 4kB is a good block size They actually say that it's the only size which they support. > Deduplication doesn't work when files aren't sufficiently identical, The definition of sufficiently identical pro

Re: support for ancient peripherals

2022-11-09 Thread Virgo Pärna
On Sun, 6 Nov 2022 06:31:04 -0500, Dan Ritter wrote: > Kleene, Steven (kleenesj) wrote: >> 1. A Northgate Omnikey 101 keyboard (from 2006) with a 5-pin DIN cable, >> currently going via an adapter to a PS/2 port in the desktop; > > 2. There are two kinds of PS/2 to USB adapters; one kind will > w

Re: deduplicating file systems: VDO with Debian?

2022-11-09 Thread didier gaumet
I am no expert (in Linux, backporting or anything else) and cannot emit a viable advice about what your backup plan should be. You are in better position to evaluate your needs, your means and design a satisfying backup plan accordingly. What I was underlyning is that in my opinion you are

Re: deduplicating file systems: VDO with Debian?

2022-11-09 Thread hw
On Wed, 2022-11-09 at 09:46 +0100, to...@tuxteam.de wrote: > On Wed, Nov 09, 2022 at 09:39:45AM +0100, hw wrote: > > [...] > > > When you keep N full generations of backups it's different.  Using rsync, > > you'll > > only write the changes anyway, switching between the generations.  Most of > >

Re: definiing deduplication (was: Re: deduplicating file systems: VDO with Debian?)

2022-11-09 Thread hw
On Tue, 2022-11-08 at 11:11 +0100, Thomas Schmitt wrote: > Hi, > > hw wrote: > > I still wonder how VDO actually works. > > There is a comparer/decider named UDS which holds an index of the valid > storage blocks, and a device driver named VDO which performes the > deduplication and hides its int

Re: definiing deduplication (was: Re: deduplicating file systems: VDO with Debian?)

2022-11-09 Thread didier gaumet
Le 09/11/2022 à 10:27, hw a écrit : [...] Yes, I've seen those. I can only wonder how much performance impact VDO would have for backups. And I wonder why it doesn't require as much memory as ZFS seems to need for deduplication. It's *only* an hypothesis, but I would suppose that ZFS was desi

Bluetooth sound problems

2022-11-09 Thread Peter von Kaehne
My laptop (Thinkpad Yoga11e first gen) on Debian Sid is showing for last few months diverse and variable sound problems.l, particularly with using Bluetooth speakers, but also with Airplay. Current system uses pulse audio and pipe wire. I do not fully understand the connection between the two.

ZFS performance (was: Re: deduplicating file systems: VDO with Debian?)

2022-11-09 Thread DdB
Am 09.11.2022 um 09:24 schrieb hw: >> Learn more about ZFS and invest in hardware to get performance. > Hardware like? In theory, using SSDs for cache with ZFS should improve > performance. In practise, it only wore out the SSDs after a while, and now > it's > not any faster without SSD cache. >

Re: definiing deduplication (was: Re: deduplicating file systems: VDO with Debian?)

2022-11-09 Thread hw
On Tue, 2022-11-08 at 10:04 +0100, didier gaumet wrote: > Le 08/11/2022 à 05:13, hw a écrit : > > On Mon, 2022-11-07 at 13:57 -0500, rhkra...@gmail.com wrote: > > > > > > > > > I didn't (and don't) know much about deduplication (beyond what you might > > > deduce from the name), so I google and f

Re: firmware-atheros - slow internet

2022-11-09 Thread Alexander V. Makartsev
On 09.11.2022 05:37, Amn wrote: I have found impossible to use Bluetooth with my Debian 11 on my : System Manufacturer    Acer System Model    Aspire E5-771G System Type    x64-based PC System SKU    Aspire E5-771G_0880_1_09 Processor    Intel(R) Core(TM) i5-4210U CPU @ 1.70GHz, 2401 Mhz, 2 Core

Re: deduplicating file systems: VDO with Debian?

2022-11-09 Thread tomas
On Wed, Nov 09, 2022 at 09:39:45AM +0100, hw wrote: [...] > When you keep N full generations of backups it's different. Using rsync, > you'll > only write the changes anyway, switching between the generations. Most of the > data is being stored N times. Pehaps you don't know about rsync's --l

Re: deduplicating file systems: VDO with Debian?

2022-11-09 Thread hw
On Tue, 2022-11-08 at 10:26 +0100, didier gaumet wrote: > Le 08/11/2022 à 04:49, hw a écrit : > [...] > > When I want to have 2 (or more) generations of backups, do I actually want > > deduplication?  It leaves me with only one actual copy of the data which > > seems > > to defeat the idea of havin

Re: Just a test

2022-11-09 Thread Pierre-Elliott Bécue
Amn wrote on 09/11/2022 at 01:12:12+0100: > Please disregard this email. Alright, I'll disregard it. -- PEB signature.asc Description: PGP signature

Re: deduplicating file systems: VDO with Debian?

2022-11-09 Thread hw
On Tue, 2022-11-08 at 17:30 -0800, David Christensen wrote: > On 11/7/22 23:13, hw wrote: > > On Mon, 2022-11-07 at 21:46 -0800, David Christensen wrote: > > > Are you deduplicating?  > > > Yes. > > > > Apparently some people say bad things happen when ZFS > > runs out of memory from deduplic