Re: [developer] ZFS user quotas with compression

Just for ref, @Flefebvre started a work on this, but is currently stalled / closed : https://github.com/openzfs/openzfs/pull/250 Ben On 07 Nov 2016 19:00, Matthew Ahrens wrote: I see the use case for these "logical" quotas (variants on userquota@, quota, refquota). FYI, I added the "logica

Re: [developer] ZFS user quotas with compression

> Respectfully, you’re changing the subject. We’re talking about quota, not > billing. > Logicalreferenced is already available for billing. > — richard > Ah that could be. I thought we were talking about quotas set before compression, but I did join the thread in the middle. Billing doesn't i

Re: [developer] ZFS user quotas with compression

On Mon, Nov 07, 2016 at 02:51:14PM -0800, Richard Elling wrote: > Respectfully, you’re changing the subject. We’re talking about quota, > not billing. Logicalreferenced is already available for billing. It's not really changing the subject. If you're a storage provider using zfs and you want to

Re: [developer] ZFS user quotas with compression

> On Nov 7, 2016, at 2:45 PM, Jorgen Lundman wrote: > > Richard Elling wrote: > >> >> No, this is a lie. If I upload 50GB of data that compresses or dedups to >> 25GB, then I want to pay for 25GB. >> — richard > > Huh neat. So how far does it stretch though? If I have compression off, you

Re: [developer] ZFS user quotas with compression

Richard Elling wrote: No, this is a lie. If I upload 50GB of data that compresses or dedups to 25GB, then I want to pay for 25GB. — richard Huh neat. So how far does it stretch though? If I have compression off, you are happy. What if I use lz4, but gzip-9 would save more, should you get

RE: [developer] ZFS user quotas with compression

> From: Richard Elling > Sent: Monday, November 07, 2016 1:33 PM > > No, this is a lie. If I upload 50GB of data that compresses or dedups to 25GB, > then I want to pay for 25GB. That is an interesting perspective. So let's say you upload 1TB of data. It dedups to 100GB, and for a year you pay f

Re: [developer] ZFS user quotas with compression

> On Nov 7, 2016, at 1:21 PM, Paul B. Henson wrote: > >> From: Richard Elling >> Sent: Monday, November 07, 2016 9:44 AM >> >> As a customer, I don’t like getting ripped off. I think you need to find a >> better >> justification. > > That seems a bit harsh :). If you pay for "50GB of data sto

RE: [developer] ZFS user quotas with compression

> From: Richard Elling > Sent: Monday, November 07, 2016 9:44 AM > > As a customer, I don’t like getting ripped off. I think you need to find a > better > justification. That seems a bit harsh :). If you pay for "50GB of data storage" and you upload 50GB of data, how are you getting ripped off?

Re: [developer] ZFS user quotas with compression

I see the use case for these "logical" quotas (variants on userquota@, quota, refquota). FYI, I added the "logicalused" and "logicalreferenced" properties a few years back, and these can be used to implement application-level checks/quotas. If we implement a "logicalquota" and "logicalrefquota",

Re: [developer] ZFS user quotas with compression

> On Nov 5, 2016, at 5:19 AM, Ben RUBSON wrote: > > >> On 05 Nov 2016, at 01:11, Jorgen Lundman wrote: >> >> The space saved from compression should be to our advantage, not that of the >> customers > > Totally agree :) As a customer, I don’t like getting ripped off. I think you need to fi

Re: [developer] ZFS user quotas with compression

> On 05 Nov 2016, at 01:11, Jorgen Lundman wrote: > > The space saved from compression should be to our advantage, not that of the > customers Totally agree :) > We too want (alternate?) quotas based on pre-compressed sized :) As buffers contain both size before compression (b_lsize) and aft

Re: [developer] ZFS user quotas with compression

I believe this was one of my questions at my first ZFS Summit day :) The space saved from compression should be to our advantage, not that of the customers (who should really compress their data anyway, right?) which is how Google does its drive space etc. But since OpenZFS can not currently

Re: [developer] ZFS user quotas with compression

> On Nov 4, 2016, at 3:19 PM, Ben RUBSON wrote: > >> >> On 04 Nov 2016, at 19:24, Richard Elling > > wrote: >> >> >>> On Nov 4, 2016, at 11:19 AM, Ben RUBSON >> > wrote: >>> >>> On 04 Nov 2016, at 19:13, Richard Elli

[developer] ZFS user quotas with compression

how to handle the quotas better when compression is on? I enabled a user quota for 10GB, but when I could copy the files up to 15 or 16GB, probably due to compression. How to make sure or force to use the absolute number even with the compression? # zfs userspace liberate |grep -i user1 TYPE