Re: [qubes-users] Re: Is it possible to create a fast clone/copy-on-write Qube?

2018-05-27 Thread awokd
On Sun, May 27, 2018 1:43 am, fsharpn...@gmail.com wrote:

> Btrfs looks interesting, but given I don't fully understand how Qubes 4
> handles storage even in its vanilla configuration, I'd better get some
> more experience with it under my belt before I experiment with a
> non-default file system.

I find the diagram towards the beginning of
https://www.qubes-os.org/news/2017/10/03/core3/ helpful to see how the
pieces fit together.

-- 
You received this message because you are subscribed to the Google Groups 
"qubes-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to qubes-users+unsubscr...@googlegroups.com.
To post to this group, send email to qubes-users@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/qubes-users/4b449b56886b78e7f6fbdd77f409e032%40elude.in.
For more options, visit https://groups.google.com/d/optout.


Re: [qubes-users] Re: Is it possible to create a fast clone/copy-on-write Qube?

2018-05-26 Thread fsharpn00b
> When you clone a VM (lets say an appVM), you'll notice another private
> volume is created and shows the same figures as the volume it
> originates from. But looking at pool00 (the overall container for our
> VM volumes), the Data% barely changes if at all.

I did see in Qubes Manager that some template-based VMs, sys-net, sys-firewall, 
and untrusted, have small sizes (< 100 MB) after I played around with them. I'm 
guessing that represents stuff that has accumulated in their private volumes.

> The Linux storage options won't show a volume that grows from nothing
> and has a size equal to the delta from the parent volume.

That's just what I was (mistakenly) looking for, based on my experience with 
Hyper-V.

> And that brings me to another point: On Btrfs if you have two related
> files (.img volumes) but suspect they have diverged too much over
> time, you can tell Btrfs to perform deduplication to find new
> commonalities and reduce the overall space used.

Btrfs looks interesting, but given I don't fully understand how Qubes 4 handles 
storage even in its vanilla configuration, I'd better get some more experience 
with it under my belt before I experiment with a non-default file system.

Thank you again for your help! This has cleared things up and taught me some 
things.

-- 
You received this message because you are subscribed to the Google Groups 
"qubes-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to qubes-users+unsubscr...@googlegroups.com.
To post to this group, send email to qubes-users@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/qubes-users/39f1776f-6b2a-4b36-9556-3619080ed42e%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [qubes-users] Re: Is it possible to create a fast clone/copy-on-write Qube?

2018-05-25 Thread tasket

On 26.05.2018 07:19, tas...@posteo.net wrote:

On 26.05.2018 05:56, fsharpn...@gmail.com wrote:

Ok, I discovered pvs to tell me the disk usage, ran it before and
after cloning a ~10 GB Windows VM, and verified usage was the same
before and after:

$ sudo pvs
  PV VG Fmt  Attr PSize  PFree
  /dev/sdb2  qubes_dom0 lvm2 a--  58.76g 8.71g



Actually, the answer is also there in the lvs output. The LSize shows
the upper limit for the volume's size, and the Data% shows how much of
that is used.

When you clone a VM (lets say an appVM), you'll notice another private
volume is created and shows the same figures as the volume it
originates from. But looking at pool00 (the overall container for our
VM volumes), the Data% barely changes if at all.




$ qvm-clone windows windows2
windows2: Cloning private volume
windows2: Cloning root volume

$ sudo pvs
  PV VG Fmt  Attr PSize  PFree
  /dev/sdb2  qubes_dom0 lvm2 a--  58.76g 8.71g

Qubes manager gives the disk of the clone VM as 0 before I run it:

https://imgur.com/NGAjTxg

Though afterward it gets the same disk size as the original:

https://imgur.com/hCGUVqs

So again I assume that's the virtual space allocated to the clone
rather than the actual space.


Yes.

The Linux storage options won't show a volume that grows from nothing
and has a size equal to the delta from the parent volume. This is
because the Thin LVM and Btrfs objects are not really hierarchical,
and this can be a good thing because it usually means fewer demands on
you attention... there is less 'care and feeding' necessary with the
Linux options. But you do have to keep an eye on your overall free
space, of course.

If you really need to know the delta size between two related volumes,
there may be a utility out there that scans the volume metadata and
shows you. My guess is you would most likely find it for Btrfs, and it
would be described as a tool related to deduplication (or 'dedup').

And that brings me to another point: On Btrfs if you have two related
files (.img volumes) but suspect they have diverged too much over
time, you can tell Btrfs to perform deduplication to find new
commonalities and reduce the overall space used.

Chris


--
You received this message because you are subscribed to the Google Groups 
"qubes-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to qubes-users+unsubscr...@googlegroups.com.
To post to this group, send email to qubes-users@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/qubes-users/7cb83760b4f19224a260986216b19808%40posteo.net.
For more options, visit https://groups.google.com/d/optout.


[qubes-users] Re: Is it possible to create a fast clone/copy-on-write Qube?

2018-05-25 Thread fsharpn00b
Ok, I discovered pvs to tell me the disk usage, ran it before and after cloning 
a ~10 GB Windows VM, and verified usage was the same before and after:

$ sudo pvs
  PV VG Fmt  Attr PSize  PFree
  /dev/sdb2  qubes_dom0 lvm2 a--  58.76g 8.71g

$ qvm-clone windows windows2
windows2: Cloning private volume
windows2: Cloning root volume

$ sudo pvs
  PV VG Fmt  Attr PSize  PFree
  /dev/sdb2  qubes_dom0 lvm2 a--  58.76g 8.71g

Qubes manager gives the disk of the clone VM as 0 before I run it:

https://imgur.com/NGAjTxg

Though afterward it gets the same disk size as the original:

https://imgur.com/hCGUVqs

So again I assume that's the virtual space allocated to the clone rather than 
the actual space.

-- 
You received this message because you are subscribed to the Google Groups 
"qubes-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to qubes-users+unsubscr...@googlegroups.com.
To post to this group, send email to qubes-users@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/qubes-users/426fb451-b320-4ea8-8ed9-211f2530912c%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.