Re: [pve-devel] ZFS alternatives

2018-02-22 Thread Dietmar Maurer
> I have here a bounce of friends complain about ZFS, which is a memory eater
> - and killer!
> So, I wonder if Proxmox consider others alternatives, like BRTFS or
> whatever.

Yes, but there are still concerns about btrfs stability ...
And btrfs is really slow in some scenarios (dpkg).

___
pve-devel mailing list
pve-devel@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


Re: [pve-devel] ZFS alternatives

2018-02-22 Thread Alexander Schmid

ext4 on mdraid would be really nice alternative

proven to work for decades now and small footprint


Am 22.02.2018 um 17:55 schrieb Dietmar Maurer:

I have here a bounce of friends complain about ZFS, which is a memory eater
- and killer!
So, I wonder if Proxmox consider others alternatives, like BRTFS or
whatever.

Yes, but there are still concerns about btrfs stability ...
And btrfs is really slow in some scenarios (dpkg).

___
pve-devel mailing list
pve-devel@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


___
pve-devel mailing list
pve-devel@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


Re: [pve-devel] ZFS alternatives

2018-02-22 Thread Gilberto Nunes
>> Yes, but there are still concerns about btrfs stability

There's a lot of world-wide company, such as Facebook, Synology and
Rockstor, that are using BTRFS as default FS.
I don't why is no stable right now.

>> ext4 on mdraid would be really nice alternative

>> proven to work for decades now and small footprint

Yes! EXT4 for are very stable, but leak something advanced tools such as
compression, dedup and RAID... Well AFAIK, the ext4 doesn't has this
features... Perhaps am I wrong?


---
Gilberto Nunes Ferreira

(47) 3025-5907
(47) 99676-7530 - Whatsapp / Telegram

Skype: gilberto.nunes36




2018-02-22 13:55 GMT-03:00 Dietmar Maurer :

> > I have here a bounce of friends complain about ZFS, which is a memory
> eater
> > - and killer!
> > So, I wonder if Proxmox consider others alternatives, like BRTFS or
> > whatever.
>
> Yes, but there are still concerns about btrfs stability ...
> And btrfs is really slow in some scenarios (dpkg).
>
>
___
pve-devel mailing list
pve-devel@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


Re: [pve-devel] ZFS alternatives

2018-02-22 Thread Alexander Schmid



ext4 on mdraid would be really nice alternative
proven to work for decades now and small footprint

Yes! EXT4 for are very stable, but leak something advanced tools such as
compression, dedup and RAID... Well AFAIK, the ext4 doesn't has this
features... Perhaps am I wrong?

mdadm will do mirroring, and is easy and well know to maintain.

Not sure if one needs any of the other features on the boot volume.
Only thing EXT4 would not do is checksum / integrity check - what i 
guess is the reason it is not supported.


afaik, it is possible to install debian minimal on mdadm raid and then 
add the proxmox repositories afterwards.




---
Gilberto Nunes Ferreira

(47) 3025-5907
(47) 99676-7530 - Whatsapp / Telegram

Skype: gilberto.nunes36




2018-02-22 13:55 GMT-03:00 Dietmar Maurer :


I have here a bounce of friends complain about ZFS, which is a memory

eater

- and killer!
So, I wonder if Proxmox consider others alternatives, like BRTFS or
whatever.

Yes, but there are still concerns about btrfs stability ...
And btrfs is really slow in some scenarios (dpkg).



___
pve-devel mailing list
pve-devel@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


___
pve-devel mailing list
pve-devel@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


Re: [pve-devel] ZFS alternatives

2018-02-23 Thread Andreas Steinel
On Thu, Feb 22, 2018 at 6:04 PM, Gilberto Nunes
 wrote:
>>> proven to work for decades now and small footprint
>
> Yes! EXT4 for are very stable, but leak something advanced tools such as
> compression, dedup and RAID... Well AFAIK, the ext4 doesn't has this
> features... Perhaps am I wrong?

Yeah AND snapshots, replication, bitrot detection, resilvering only
used stuff, auto healing with multiple copies ... yet let's say ext4
and ZFS have in common that they both are filesystems, yet that's all.

ext4 and md is inferior in every aspect except memory usage, but ZFS
was and is an enterprise file system.
___
pve-devel mailing list
pve-devel@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


Re: [pve-devel] ZFS alternatives

2018-02-23 Thread Diaolin

Il 2018-02-23 14:50 Andreas Steinel ha scritto:

On Thu, Feb 22, 2018 at 6:04 PM, Gilberto Nunes
 wrote:

proven to work for decades now and small footprint


Yes! EXT4 for are very stable, but leak something advanced tools such 
as

compression, dedup and RAID... Well AFAIK, the ext4 doesn't has this
features... Perhaps am I wrong?


Yeah AND snapshots, replication, bitrot detection, resilvering only
used stuff, auto healing with multiple copies ... yet let's say ext4
and ZFS have in common that they both are filesystems, yet that's all.

ext4 and md is inferior in every aspect except memory usage, but ZFS
was and is an enterprise file system.

^^
This is the fact!
Diaolin


---
par sèmpro

Vöime bèn sol qoanche às tèmp
anca ‘l fuss sol en menùt
par mi e par ti
e po’ pù niènt

Giuliano

Tel: 349 66 84 215
Skype: diaolin



___
pve-devel mailing list
pve-devel@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


Re: [pve-devel] ZFS alternatives

2018-02-23 Thread Gilberto Nunes
s/leak/lack/g =)

---
Gilberto Nunes Ferreira

(47) 3025-5907
(47) 99676-7530 - Whatsapp / Telegram

Skype: gilberto.nunes36




2018-02-23 14:51 GMT-03:00 Diaolin :

> Il 2018-02-23 14:50 Andreas Steinel ha scritto:
>
>> On Thu, Feb 22, 2018 at 6:04 PM, Gilberto Nunes
>>  wrote:
>>
>>> proven to work for decades now and small footprint
>

>>> Yes! EXT4 for are very stable, but leak something advanced tools such as
>>> compression, dedup and RAID... Well AFAIK, the ext4 doesn't has this
>>> features... Perhaps am I wrong?
>>>
>>
>> Yeah AND snapshots, replication, bitrot detection, resilvering only
>> used stuff, auto healing with multiple copies ... yet let's say ext4
>> and ZFS have in common that they both are filesystems, yet that's all.
>>
>> ext4 and md is inferior in every aspect except memory usage, but ZFS
>> was and is an enterprise file system.
>>
> ^^
> This is the fact!
> Diaolin
>
>
> ---
> par sèmpro
>
> Vöime bèn sol qoanche às tèmp
> anca ‘l fuss sol en menùt
> par mi e par ti
> e po’ pù niènt
>
> Giuliano
>
> Tel: 349 66 84 215
> Skype: diaolin
>
>
>
>
> ___
> pve-devel mailing list
> pve-devel@pve.proxmox.com
> https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
>
___
pve-devel mailing list
pve-devel@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


Re: [pve-devel] ZFS alternatives

2018-02-23 Thread Gandalf Corvotempesta
Il 23 feb 2018 2:50 PM, "Andreas Steinel"  ha scritto:

ext4 and md is inferior in every aspect except memory usage, but ZFS
was and is an enterprise file system.


MD is way more flexible than zfs
___
pve-devel mailing list
pve-devel@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


Re: [pve-devel] ZFS alternatives

2018-02-23 Thread Andreas Steinel
On Fri, Feb 23, 2018 at 7:11 PM, Gandalf Corvotempesta
 wrote:
> MD is way more flexible than zfs

Please elaborate.
___
pve-devel mailing list
pve-devel@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


Re: [pve-devel] ZFS alternatives

2018-02-24 Thread Gandalf Corvotempesta
In example, you can add/remove single disks
You can change from any raid level to any raid level on the fly with no
downtime or loss of redundancy
You can grow /shrink a volume

And so on...

Il 24 feb 2018 12:36 AM, "Andreas Steinel"  ha scritto:

> On Fri, Feb 23, 2018 at 7:11 PM, Gandalf Corvotempesta
>  wrote:
> > MD is way more flexible than zfs
>
> Please elaborate.
> ___
> pve-devel mailing list
> pve-devel@pve.proxmox.com
> https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
>
___
pve-devel mailing list
pve-devel@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


Re: [pve-devel] ZFS alternatives

2018-02-24 Thread Søren Laursen
What about CEPH.

Pro and cons?

Søren



Fra: pve-devel [pve-devel-boun...@pve.proxmox.com] på vegne af Gandalf 
Corvotempesta [gandalf.corvotempe...@gmail.com]
Sendt: 23. februar 2018 19:11
Til: PVE development discussion
Emne: Re: [pve-devel] ZFS alternatives

Il 23 feb 2018 2:50 PM, "Andreas Steinel"  ha scritto:

ext4 and md is inferior in every aspect except memory usage, but ZFS
was and is an enterprise file system.


MD is way more flexible than zfs
___
pve-devel mailing list
pve-devel@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
___
pve-devel mailing list
pve-devel@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


Re: [pve-devel] ZFS alternatives

2018-02-24 Thread Gilberto Nunes
Ceph is wonderful, but isn't in discussion in this thread.

---
Gilberto Nunes Ferreira

(47) 3025-5907
(47) 99676-7530 - Whatsapp / Telegram

Skype: gilberto.nunes36




2018-02-24 9:35 GMT-03:00 Søren Laursen :

> What about CEPH.
>
> Pro and cons?
>
> Søren
>
>
> 
> Fra: pve-devel [pve-devel-boun...@pve.proxmox.com] på vegne af
> Gandalf Corvotempesta [gandalf.corvotempe...@gmail.com]
> Sendt: 23. februar 2018 19:11
> Til: PVE development discussion
> Emne: Re: [pve-devel] ZFS alternatives
>
> Il 23 feb 2018 2:50 PM, "Andreas Steinel"  ha
> scritto:
>
> ext4 and md is inferior in every aspect except memory usage, but ZFS
> was and is an enterprise file system.
>
>
> MD is way more flexible than zfs
> ___
> pve-devel mailing list
> pve-devel@pve.proxmox.com
> https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
> ___
> pve-devel mailing list
> pve-devel@pve.proxmox.com
> https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
>
___
pve-devel mailing list
pve-devel@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


Re: [pve-devel] ZFS alternatives

2018-02-24 Thread Gandalf Corvotempesta
It's a totally different kind of storage.
You can't compare ceph with MD or zfs

Il 24 feb 2018 1:35 PM, "Søren Laursen"  ha scritto:

What about CEPH.

Pro and cons?

Søren



Fra: pve-devel [pve-devel-boun...@pve.proxmox.com] på vegne af Gandalf
Corvotempesta [gandalf.corvotempe...@gmail.com]
Sendt: 23. februar 2018 19:11
Til: PVE development discussion
Emne: Re: [pve-devel] ZFS alternatives

Il 23 feb 2018 2:50 PM, "Andreas Steinel"  ha scritto:

ext4 and md is inferior in every aspect except memory usage, but ZFS
was and is an enterprise file system.


MD is way more flexible than zfs
___
pve-devel mailing list
pve-devel@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
___
pve-devel mailing list
pve-devel@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
___
pve-devel mailing list
pve-devel@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


Re: [pve-devel] ZFS alternatives

2018-02-25 Thread Andreas Steinel
On Sat, Feb 24, 2018 at 11:16 AM, Gandalf Corvotempesta
 wrote:
> In example, you can add/remove single disks
> You can change from any raid level to any raid level on the fly with no
> downtime or loss of redundancy
> You can grow /shrink a volume

Good points, especially the shrink that, that does indeed currently
not work in ZFS. Yet I have to say, I'd never added a single disk in
an enterprise setup nor changed a RAID level on the fly. How often did
you do the latter? I just add at least one shelf to existing storage
boxes.
___
pve-devel mailing list
pve-devel@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


Re: [pve-devel] ZFS alternatives

2018-02-25 Thread Gandalf Corvotempesta
I do that quite often.
Starting with a small number of expansive disks (like SSDs or NVMEs) and
being able to expand on the fly when needed, allows me to keep running cost
as low as possible

With zfs this is not possible (in a simple way) thus you have to start with
the proper number of disks that you plan to use for some following  years

Il 25 feb 2018 1:42 PM, "Andreas Steinel"  ha scritto:

> On Sat, Feb 24, 2018 at 11:16 AM, Gandalf Corvotempesta
>  wrote:
> > In example, you can add/remove single disks
> > You can change from any raid level to any raid level on the fly with no
> > downtime or loss of redundancy
> > You can grow /shrink a volume
>
> Good points, especially the shrink that, that does indeed currently
> not work in ZFS. Yet I have to say, I'd never added a single disk in
> an enterprise setup nor changed a RAID level on the fly. How often did
> you do the latter? I just add at least one shelf to existing storage
> boxes.
> ___
> pve-devel mailing list
> pve-devel@pve.proxmox.com
> https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
>
___
pve-devel mailing list
pve-devel@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


Re: [pve-devel] ZFS alternatives

2018-02-25 Thread Michael Bellerue
Online expansion was recently added to OpenZFS for RAID-Z.

https://www.freebsdfoundation.org/blog/openzfs-raid-z-online-expansion-project-announcement/


On Sun, Feb 25, 2018 at 6:47 AM, Gandalf Corvotempesta <
gandalf.corvotempe...@gmail.com> wrote:

> I do that quite often.
> Starting with a small number of expansive disks (like SSDs or NVMEs) and
> being able to expand on the fly when needed, allows me to keep running cost
> as low as possible
>
> With zfs this is not possible (in a simple way) thus you have to start with
> the proper number of disks that you plan to use for some following  years
>
> Il 25 feb 2018 1:42 PM, "Andreas Steinel"  ha
> scritto:
>
> > On Sat, Feb 24, 2018 at 11:16 AM, Gandalf Corvotempesta
> >  wrote:
> > > In example, you can add/remove single disks
> > > You can change from any raid level to any raid level on the fly with no
> > > downtime or loss of redundancy
> > > You can grow /shrink a volume
> >
> > Good points, especially the shrink that, that does indeed currently
> > not work in ZFS. Yet I have to say, I'd never added a single disk in
> > an enterprise setup nor changed a RAID level on the fly. How often did
> > you do the latter? I just add at least one shelf to existing storage
> > boxes.
> > ___
> > pve-devel mailing list
> > pve-devel@pve.proxmox.com
> > https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
> >
> ___
> pve-devel mailing list
> pve-devel@pve.proxmox.com
> https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
>



-- 
Michael Bellerue
michael.belle...@gmail.com
651.900.3068
___
pve-devel mailing list
pve-devel@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


Re: [pve-devel] ZFS alternatives

2018-02-25 Thread Gilberto Nunes
Wow
That will be nice!

Em dom, 25 de fev de 2018 13:24, Michael Bellerue <
michael.belle...@gmail.com> escreveu:

> Online expansion was recently added to OpenZFS for RAID-Z.
>
>
> https://www.freebsdfoundation.org/blog/openzfs-raid-z-online-expansion-project-announcement/
>
>
> On Sun, Feb 25, 2018 at 6:47 AM, Gandalf Corvotempesta <
> gandalf.corvotempe...@gmail.com> wrote:
>
> > I do that quite often.
> > Starting with a small number of expansive disks (like SSDs or NVMEs) and
> > being able to expand on the fly when needed, allows me to keep running
> cost
> > as low as possible
> >
> > With zfs this is not possible (in a simple way) thus you have to start
> with
> > the proper number of disks that you plan to use for some following  years
> >
> > Il 25 feb 2018 1:42 PM, "Andreas Steinel"  ha
> > scritto:
> >
> > > On Sat, Feb 24, 2018 at 11:16 AM, Gandalf Corvotempesta
> > >  wrote:
> > > > In example, you can add/remove single disks
> > > > You can change from any raid level to any raid level on the fly with
> no
> > > > downtime or loss of redundancy
> > > > You can grow /shrink a volume
> > >
> > > Good points, especially the shrink that, that does indeed currently
> > > not work in ZFS. Yet I have to say, I'd never added a single disk in
> > > an enterprise setup nor changed a RAID level on the fly. How often did
> > > you do the latter? I just add at least one shelf to existing storage
> > > boxes.
> > > ___
> > > pve-devel mailing list
> > > pve-devel@pve.proxmox.com
> > > https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
> > >
> > ___
> > pve-devel mailing list
> > pve-devel@pve.proxmox.com
> > https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
> >
>
>
>
> --
> Michael Bellerue
> michael.belle...@gmail.com
> 651.900.3068
> ___
> pve-devel mailing list
> pve-devel@pve.proxmox.com
> https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
>
___
pve-devel mailing list
pve-devel@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


Re: [pve-devel] ZFS alternatives

2018-02-25 Thread Gandalf Corvotempesta
Planning to add doesn't mean that it was added
If I remember properly, no a single line of code was written up to
today

Il 25 feb 2018 5:24 PM, "Michael Bellerue"  ha
scritto:

> Online expansion was recently added to OpenZFS for RAID-Z.
>
> https://www.freebsdfoundation.org/blog/openzfs-raid-z-
> online-expansion-project-announcement/
>
>
> On Sun, Feb 25, 2018 at 6:47 AM, Gandalf Corvotempesta <
> gandalf.corvotempe...@gmail.com> wrote:
>
> > I do that quite often.
> > Starting with a small number of expansive disks (like SSDs or NVMEs) and
> > being able to expand on the fly when needed, allows me to keep running
> cost
> > as low as possible
> >
> > With zfs this is not possible (in a simple way) thus you have to start
> with
> > the proper number of disks that you plan to use for some following  years
> >
> > Il 25 feb 2018 1:42 PM, "Andreas Steinel"  ha
> > scritto:
> >
> > > On Sat, Feb 24, 2018 at 11:16 AM, Gandalf Corvotempesta
> > >  wrote:
> > > > In example, you can add/remove single disks
> > > > You can change from any raid level to any raid level on the fly with
> no
> > > > downtime or loss of redundancy
> > > > You can grow /shrink a volume
> > >
> > > Good points, especially the shrink that, that does indeed currently
> > > not work in ZFS. Yet I have to say, I'd never added a single disk in
> > > an enterprise setup nor changed a RAID level on the fly. How often did
> > > you do the latter? I just add at least one shelf to existing storage
> > > boxes.
> > > ___
> > > pve-devel mailing list
> > > pve-devel@pve.proxmox.com
> > > https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
> > >
> > ___
> > pve-devel mailing list
> > pve-devel@pve.proxmox.com
> > https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
> >
>
>
>
> --
> Michael Bellerue
> michael.belle...@gmail.com
> 651.900.3068
> ___
> pve-devel mailing list
> pve-devel@pve.proxmox.com
> https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
>
___
pve-devel mailing list
pve-devel@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


Re: [pve-devel] ZFS alternatives

2018-02-25 Thread Gilberto Nunes
Take a look at

https://twitter.com/OpenZFS/status/92104244627598



Em dom, 25 de fev de 2018 13:36, Gandalf Corvotempesta <
gandalf.corvotempe...@gmail.com> escreveu:

> Planning to add doesn't mean that it was added
> If I remember properly, no a single line of code was written up to
> today
>
> Il 25 feb 2018 5:24 PM, "Michael Bellerue"  ha
> scritto:
>
> > Online expansion was recently added to OpenZFS for RAID-Z.
> >
> > https://www.freebsdfoundation.org/blog/openzfs-raid-z-
> > online-expansion-project-announcement/
> >
> >
> > On Sun, Feb 25, 2018 at 6:47 AM, Gandalf Corvotempesta <
> > gandalf.corvotempe...@gmail.com> wrote:
> >
> > > I do that quite often.
> > > Starting with a small number of expansive disks (like SSDs or NVMEs)
> and
> > > being able to expand on the fly when needed, allows me to keep running
> > cost
> > > as low as possible
> > >
> > > With zfs this is not possible (in a simple way) thus you have to start
> > with
> > > the proper number of disks that you plan to use for some following
> years
> > >
> > > Il 25 feb 2018 1:42 PM, "Andreas Steinel"  ha
> > > scritto:
> > >
> > > > On Sat, Feb 24, 2018 at 11:16 AM, Gandalf Corvotempesta
> > > >  wrote:
> > > > > In example, you can add/remove single disks
> > > > > You can change from any raid level to any raid level on the fly
> with
> > no
> > > > > downtime or loss of redundancy
> > > > > You can grow /shrink a volume
> > > >
> > > > Good points, especially the shrink that, that does indeed currently
> > > > not work in ZFS. Yet I have to say, I'd never added a single disk in
> > > > an enterprise setup nor changed a RAID level on the fly. How often
> did
> > > > you do the latter? I just add at least one shelf to existing storage
> > > > boxes.
> > > > ___
> > > > pve-devel mailing list
> > > > pve-devel@pve.proxmox.com
> > > > https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
> > > >
> > > ___
> > > pve-devel mailing list
> > > pve-devel@pve.proxmox.com
> > > https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
> > >
> >
> >
> >
> > --
> > Michael Bellerue
> > michael.belle...@gmail.com
> > 651.900.3068
> > ___
> > pve-devel mailing list
> > pve-devel@pve.proxmox.com
> > https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
> >
> ___
> pve-devel mailing list
> pve-devel@pve.proxmox.com
> https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
>
___
pve-devel mailing list
pve-devel@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


Re: [pve-devel] ZFS alternatives

2018-02-25 Thread Gandalf Corvotempesta
Still unfinished and is not the same as MD
As I can see, old data still keep the old parity, with MD all data are
rewritten thus making use of all disks for performance reason

If you add 2 disks to a 4 disks raid6, you'll get 6 disks IOPS when
reading, with zfs you are still limited to 4 disks IOPS for old data

AFAIK the only real reason to use ZFS is for bitrot and incremental backups
using shapshots.

Everything else can also be made by using MD plus some additional software
(in pure Unix style: one software to do one thing. ZFS it's the opposite
:one software for all: raid, filesystem, snapshots, volume manager,
backups,)

Il 25 feb 2018 5:37 PM, "Gilberto Nunes"  ha
scritto:

> Take a look at
>
> https://twitter.com/OpenZFS/status/92104244627598
>
>
>
> Em dom, 25 de fev de 2018 13:36, Gandalf Corvotempesta <
> gandalf.corvotempe...@gmail.com> escreveu:
>
> > Planning to add doesn't mean that it was added
> > If I remember properly, no a single line of code was written up to
> > today
> >
> > Il 25 feb 2018 5:24 PM, "Michael Bellerue" 
> ha
> > scritto:
> >
> > > Online expansion was recently added to OpenZFS for RAID-Z.
> > >
> > > https://www.freebsdfoundation.org/blog/openzfs-raid-z-
> > > online-expansion-project-announcement/
> > >
> > >
> > > On Sun, Feb 25, 2018 at 6:47 AM, Gandalf Corvotempesta <
> > > gandalf.corvotempe...@gmail.com> wrote:
> > >
> > > > I do that quite often.
> > > > Starting with a small number of expansive disks (like SSDs or NVMEs)
> > and
> > > > being able to expand on the fly when needed, allows me to keep
> running
> > > cost
> > > > as low as possible
> > > >
> > > > With zfs this is not possible (in a simple way) thus you have to
> start
> > > with
> > > > the proper number of disks that you plan to use for some following
> > years
> > > >
> > > > Il 25 feb 2018 1:42 PM, "Andreas Steinel"  ha
> > > > scritto:
> > > >
> > > > > On Sat, Feb 24, 2018 at 11:16 AM, Gandalf Corvotempesta
> > > > >  wrote:
> > > > > > In example, you can add/remove single disks
> > > > > > You can change from any raid level to any raid level on the fly
> > with
> > > no
> > > > > > downtime or loss of redundancy
> > > > > > You can grow /shrink a volume
> > > > >
> > > > > Good points, especially the shrink that, that does indeed currently
> > > > > not work in ZFS. Yet I have to say, I'd never added a single disk
> in
> > > > > an enterprise setup nor changed a RAID level on the fly. How often
> > did
> > > > > you do the latter? I just add at least one shelf to existing
> storage
> > > > > boxes.
> > > > > ___
> > > > > pve-devel mailing list
> > > > > pve-devel@pve.proxmox.com
> > > > > https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
> > > > >
> > > > ___
> > > > pve-devel mailing list
> > > > pve-devel@pve.proxmox.com
> > > > https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
> > > >
> > >
> > >
> > >
> > > --
> > > Michael Bellerue
> > > michael.belle...@gmail.com
> > > 651.900.3068
> > > ___
> > > pve-devel mailing list
> > > pve-devel@pve.proxmox.com
> > > https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
> > >
> > ___
> > pve-devel mailing list
> > pve-devel@pve.proxmox.com
> > https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
> >
> ___
> pve-devel mailing list
> pve-devel@pve.proxmox.com
> https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
>
___
pve-devel mailing list
pve-devel@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


Re: [pve-devel] ZFS alternatives

2018-02-25 Thread Andreas Steinel
On Sun, Feb 25, 2018 at 9:08 PM, Gandalf Corvotempesta
 wrote:
> As I can see, old data still keep the old parity, with MD all data are
> rewritten thus making use of all disks for performance reason

Yes, data has to be "resynched" manually via send/receive - same
way as with an expansion of disks.



> AFAIK the only real reason to use ZFS is for bitrot and incremental backups
> using shapshots.

CoW clones, variable block size, transparent compression, deduplication,
resync only used records on disk failure


> Everything else can also be made by using MD plus some additional software
> (in pure Unix style: one software to do one thing. ZFS it's the opposite
> :one software for all: raid, filesystem, snapshots, volume manager,
> backups,)

Yes, ZFS kinda breakes this concept, yet I see the charme in it. It happend
 - more than once - with e.g. LVM that you have enough space, yet not all in
one volume, but in multiple. This cannot happen in ZFS because of the unified
approach that all data is stored in the pool and you can use the free space
everywhere. I really think combining this is the way to go.
___
pve-devel mailing list
pve-devel@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel