[Qemu-devel] CoW image commit+shrink(= make_empty) support

2012-06-07 Thread Taisuke Yamada
I attended Paolo Bonzini's qemu session ("Live Disk Operations: Juggling Data and Trying to go Unnoticed") in LinuxCon Japan, and he adviced me to post the bits I have regarding my question on qemu's support on shrinking CoW image. Here's my problem description. I recently designed a experimenta

Re: [Qemu-devel] CoW image commit+shrink(= make_empty) support

2012-06-07 Thread Jeff Cody
On 06/07/2012 02:19 AM, Taisuke Yamada wrote: > I attended Paolo Bonzini's qemu session ("Live Disk Operations: Juggling > Data and Trying to go Unnoticed") in LinuxCon Japan, and he adviced me > to post the bits I have regarding my question on qemu's support on shrinking > CoW image. > > Here's

Re: [Qemu-devel] CoW image commit+shrink(= make_empty) support

2012-06-08 Thread Kevin Wolf
Am 07.06.2012 08:19, schrieb Taisuke Yamada: > I attended Paolo Bonzini's qemu session ("Live Disk Operations: Juggling > Data and Trying to go Unnoticed") in LinuxCon Japan, and he adviced me > to post the bits I have regarding my question on qemu's support on shrinking > CoW image. > > Here's m

Re: [Qemu-devel] CoW image commit+shrink(= make_empty) support

2012-06-08 Thread Stefan Hajnoczi
On Thu, Jun 7, 2012 at 3:14 PM, Jeff Cody wrote: > On 06/07/2012 02:19 AM, Taisuke Yamada wrote: >> I attended Paolo Bonzini's qemu session ("Live Disk Operations: Juggling >> Data and Trying to go Unnoticed") in LinuxCon Japan, and he adviced me >> to post the bits I have regarding my question on

Re: [Qemu-devel] CoW image commit+shrink(= make_empty) support

2012-06-08 Thread Jeff Cody
On 06/08/2012 08:42 AM, Stefan Hajnoczi wrote: > On Thu, Jun 7, 2012 at 3:14 PM, Jeff Cody wrote: >> On 06/07/2012 02:19 AM, Taisuke Yamada wrote: >>> I attended Paolo Bonzini's qemu session ("Live Disk Operations: Juggling >>> Data and Trying to go Unnoticed") in LinuxCon Japan, and he adviced me

Re: [Qemu-devel] CoW image commit+shrink(= make_empty) support

2012-06-08 Thread Stefan Hajnoczi
On Fri, Jun 8, 2012 at 2:19 PM, Jeff Cody wrote: > On 06/08/2012 08:42 AM, Stefan Hajnoczi wrote: >> On Thu, Jun 7, 2012 at 3:14 PM, Jeff Cody wrote: >>> On 06/07/2012 02:19 AM, Taisuke Yamada wrote: >> We want to commit snap1.qcow2 down into vm001.img while the guest is running: >> >> vm001.img

Re: [Qemu-devel] CoW image commit+shrink(= make_empty) support

2012-06-08 Thread Jeff Cody
On 06/08/2012 09:53 AM, Stefan Hajnoczi wrote: > On Fri, Jun 8, 2012 at 2:19 PM, Jeff Cody wrote: >> On 06/08/2012 08:42 AM, Stefan Hajnoczi wrote: >>> On Thu, Jun 7, 2012 at 3:14 PM, Jeff Cody wrote: On 06/07/2012 02:19 AM, Taisuke Yamada wrote: >>> We want to commit snap1.qcow2 down into v

Re: [Qemu-devel] CoW image commit+shrink(= make_empty) support

2012-06-08 Thread Kevin Wolf
Am 08.06.2012 16:32, schrieb Jeff Cody: > On 06/08/2012 09:53 AM, Stefan Hajnoczi wrote: >> On Fri, Jun 8, 2012 at 2:19 PM, Jeff Cody wrote: >>> On 06/08/2012 08:42 AM, Stefan Hajnoczi wrote: Note that block-commit cannot work on the top-most image since the guest is still writing to tha

Re: [Qemu-devel] CoW image commit+shrink(= make_empty) support

2012-06-08 Thread Jeff Cody
On 06/08/2012 12:11 PM, Kevin Wolf wrote: > Am 08.06.2012 16:32, schrieb Jeff Cody: >> On 06/08/2012 09:53 AM, Stefan Hajnoczi wrote: >>> On Fri, Jun 8, 2012 at 2:19 PM, Jeff Cody wrote: On 06/08/2012 08:42 AM, Stefan Hajnoczi wrote: > Note that block-commit cannot work on the top-most im

Re: [Qemu-devel] CoW image commit+shrink(= make_empty) support

2012-06-08 Thread Kevin Wolf
Am 08.06.2012 19:46, schrieb Jeff Cody: > On 06/08/2012 12:11 PM, Kevin Wolf wrote: >> Am 08.06.2012 16:32, schrieb Jeff Cody: >>> On 06/08/2012 09:53 AM, Stefan Hajnoczi wrote: On Fri, Jun 8, 2012 at 2:19 PM, Jeff Cody wrote: > On 06/08/2012 08:42 AM, Stefan Hajnoczi wrote: >> Note t

Re: [Qemu-devel] CoW image commit+shrink(= make_empty) support

2012-06-08 Thread Jeff Cody
On 06/08/2012 01:57 PM, Kevin Wolf wrote: > Am 08.06.2012 19:46, schrieb Jeff Cody: >> On 06/08/2012 12:11 PM, Kevin Wolf wrote: >>> Am 08.06.2012 16:32, schrieb Jeff Cody: On 06/08/2012 09:53 AM, Stefan Hajnoczi wrote: > On Fri, Jun 8, 2012 at 2:19 PM, Jeff Cody wrote: >> On 06/08/20

Re: [Qemu-devel] CoW image commit+shrink(= make_empty) support

2012-06-08 Thread Kevin Wolf
Am 08.06.2012 20:33, schrieb Jeff Cody: > On 06/08/2012 01:57 PM, Kevin Wolf wrote: >> Am 08.06.2012 19:46, schrieb Jeff Cody: >>> On 06/08/2012 12:11 PM, Kevin Wolf wrote: Am 08.06.2012 16:32, schrieb Jeff Cody: > On 06/08/2012 09:53 AM, Stefan Hajnoczi wrote: >> On Fri, Jun 8, 2012 a

Re: [Qemu-devel] CoW image commit+shrink(= make_empty) support

2012-06-09 Thread Taisuke Yamada
>> This split-image configration is done to keep VM I/Os on a SSD > > This is an interesting use case that I wasn't aware of yet. So you're > not really interested in a snapshot here, but what you're trying to do > is using the SSD as some sort of a cache, right? Right. By splitting, not only I ca

Re: [Qemu-devel] CoW image commit+shrink(= make_empty) support

2012-06-09 Thread Jeff Cody
On 06/08/2012 05:08 PM, Kevin Wolf wrote: > Am 08.06.2012 20:33, schrieb Jeff Cody: >> On 06/08/2012 01:57 PM, Kevin Wolf wrote: >>> Am 08.06.2012 19:46, schrieb Jeff Cody: On 06/08/2012 12:11 PM, Kevin Wolf wrote: > Am 08.06.2012 16:32, schrieb Jeff Cody: >> On 06/08/2012 09:53 AM, St

Re: [Qemu-devel] CoW image commit+shrink(= make_empty) support

2012-06-10 Thread Paolo Bonzini
Il 08/06/2012 15:19, Jeff Cody ha scritto: >> > >> > This means copying allocated blocks from snap1.qcow2 and writing them >> > into vm001.img. Once this process is complete it is safe to delete >> > snap1.qcow2 since all data is now in vm001.img. > Yes, this is the same as what we are wanting to

Re: [Qemu-devel] CoW image commit+shrink(= make_empty) support

2012-06-10 Thread Paolo Bonzini
Il 08/06/2012 19:57, Kevin Wolf ha scritto: >> > >> > I agree, doing it like mirroring for new writes on the top layer makes >> > sense, as long as you are willing to violate the (optional) speed >> > parameter. I wouldn't think violating the speed parameter in that case >> > would be an issue, a

Re: [Qemu-devel] CoW image commit+shrink(= make_empty) support

2012-06-11 Thread Kevin Wolf
Am 09.06.2012 18:52, schrieb Jeff Cody: > On 06/08/2012 05:08 PM, Kevin Wolf wrote: >> Am 08.06.2012 20:33, schrieb Jeff Cody: >>> On 06/08/2012 01:57 PM, Kevin Wolf wrote: The question is what the speed parameter really means for a live commit block job (or for an active mirror). I think

Re: [Qemu-devel] CoW image commit+shrink(= make_empty) support

2012-06-11 Thread Kevin Wolf
Am 10.06.2012 18:10, schrieb Paolo Bonzini: > Il 08/06/2012 19:57, Kevin Wolf ha scritto: I agree, doing it like mirroring for new writes on the top layer makes sense, as long as you are willing to violate the (optional) speed parameter. I wouldn't think violating the speed par

Re: [Qemu-devel] CoW image commit+shrink(= make_empty) support

2012-06-11 Thread Paolo Bonzini
Il 11/06/2012 09:59, Kevin Wolf ha scritto: > I agree, doing it like mirroring for new writes on the top layer > makes > sense, as long as you are willing to violate the (optional) speed > parameter. I wouldn't think violating the speed parameter in that >

Re: [Qemu-devel] CoW image commit+shrink(= make_empty) support

2012-06-11 Thread Stefan Hajnoczi
On Fri, Jun 8, 2012 at 6:46 PM, Jeff Cody wrote: > On 06/08/2012 12:11 PM, Kevin Wolf wrote: >> Am 08.06.2012 16:32, schrieb Jeff Cody: >>> On 06/08/2012 09:53 AM, Stefan Hajnoczi wrote: On Fri, Jun 8, 2012 at 2:19 PM, Jeff Cody wrote: > On 06/08/2012 08:42 AM, Stefan Hajnoczi wrote: >>>

Re: [Qemu-devel] CoW image commit+shrink(= make_empty) support

2012-06-11 Thread Kevin Wolf
Am 11.06.2012 14:09, schrieb Stefan Hajnoczi: > On Fri, Jun 8, 2012 at 6:46 PM, Jeff Cody wrote: >> On 06/08/2012 12:11 PM, Kevin Wolf wrote: >>> Am 08.06.2012 16:32, schrieb Jeff Cody: On 06/08/2012 09:53 AM, Stefan Hajnoczi wrote: > On Fri, Jun 8, 2012 at 2:19 PM, Jeff Cody wrote:

Re: [Qemu-devel] CoW image commit+shrink(= make_empty) support

2012-06-11 Thread Stefan Hajnoczi
On Mon, Jun 11, 2012 at 1:50 PM, Kevin Wolf wrote: > Am 11.06.2012 14:09, schrieb Stefan Hajnoczi: >> On Fri, Jun 8, 2012 at 6:46 PM, Jeff Cody wrote: >>> On 06/08/2012 12:11 PM, Kevin Wolf wrote: Am 08.06.2012 16:32, schrieb Jeff Cody: > On 06/08/2012 09:53 AM, Stefan Hajnoczi wrote: >>

Re: [Qemu-devel] CoW image commit+shrink(= make_empty) support

2012-06-11 Thread Jeff Cody
On 06/11/2012 10:24 AM, Stefan Hajnoczi wrote: > On Mon, Jun 11, 2012 at 1:50 PM, Kevin Wolf wrote: >> Am 11.06.2012 14:09, schrieb Stefan Hajnoczi: >>> On Fri, Jun 8, 2012 at 6:46 PM, Jeff Cody wrote: On 06/08/2012 12:11 PM, Kevin Wolf wrote: > Am 08.06.2012 16:32, schrieb Jeff Cody: >>

Re: [Qemu-devel] CoW image commit+shrink(= make_empty) support

2012-06-11 Thread Paolo Bonzini
Il 11/06/2012 17:37, Jeff Cody ha scritto: > It sounds like Zhi Hui is working on live block commit patches, and > Supriya is working on the bdrv_reopen() portion - I don't want to > duplicate any effort, but if there is anything I can do to help with > either of those areas, just let me know. Is

Re: [Qemu-devel] CoW image commit+shrink(= make_empty) support

2012-06-12 Thread Zhi Hui Li
On 2012年06月12日 03:12, Paolo Bonzini wrote: Il 11/06/2012 17:37, Jeff Cody ha scritto: It sounds like Zhi Hui is working on live block commit patches, and Supriya is working on the bdrv_reopen() portion - I don't want to duplicate any effort, but if there is anything I can do to help with either

Re: [Qemu-devel] CoW image commit+shrink(= make_empty) support

2012-06-12 Thread Stefan Hajnoczi
On Mon, Jun 11, 2012 at 4:37 PM, Jeff Cody wrote: > On 06/11/2012 10:24 AM, Stefan Hajnoczi wrote: >> On Mon, Jun 11, 2012 at 1:50 PM, Kevin Wolf wrote: >>> Am 11.06.2012 14:09, schrieb Stefan Hajnoczi: On Fri, Jun 8, 2012 at 6:46 PM, Jeff Cody wrote: > On 06/08/2012 12:11 PM, Kevin Wol

Re: [Qemu-devel] CoW image commit+shrink(= make_empty) support

2012-06-13 Thread Supriya Kannery
On 06/12/2012 04:26 PM, Stefan Hajnoczi wrote: On Mon, Jun 11, 2012 at 4:37 PM, Jeff Cody wrote: On 06/11/2012 10:24 AM, Stefan Hajnoczi wrote: On Mon, Jun 11, 2012 at 1:50 PM, Kevin Wolf wrote: Am 11.06.2012 14:09, schrieb Stefan Hajnoczi: On Fri, Jun 8, 2012 at 6:46 PM, Jeff Cody wrote:

Re: [Qemu-devel] CoW image commit+shrink(= make_empty) support

2012-06-14 Thread Zhi Hui Li
On 2012年06月11日 23:37, Jeff Cody wrote: On 06/11/2012 10:24 AM, Stefan Hajnoczi wrote: On Mon, Jun 11, 2012 at 1:50 PM, Kevin Wolf wrote: Am 11.06.2012 14:09, schrieb Stefan Hajnoczi: On Fri, Jun 8, 2012 at 6:46 PM, Jeff Cody wrote: On 06/08/2012 12:11 PM, Kevin Wolf wrote: Am 08.06.2012 16

Re: [Qemu-devel] CoW image commit+shrink(= make_empty) support

2012-06-14 Thread Jeff Cody
On 06/14/2012 10:23 AM, Zhi Hui Li wrote: > On 2012年06月11日 23:37, Jeff Cody wrote: >> On 06/11/2012 10:24 AM, Stefan Hajnoczi wrote: >>> On Mon, Jun 11, 2012 at 1:50 PM, Kevin Wolf wrote: Am 11.06.2012 14:09, schrieb Stefan Hajnoczi: > On Fri, Jun 8, 2012 at 6:46 PM, Jeff Cody wrote: >>>

Re: [Qemu-devel] CoW image commit+shrink(= make_empty) support

2012-06-14 Thread Supriya Kannery
On 06/14/2012 07:59 PM, Jeff Cody wrote: On 06/14/2012 10:23 AM, Zhi Hui Li wrote: On 2012年06月11日 23:37, Jeff Cody wrote: On 06/11/2012 10:24 AM, Stefan Hajnoczi wrote: On Mon, Jun 11, 2012 at 1:50 PM, Kevin Wolf wrote: Am 11.06.2012 14:09, schrieb Stefan Hajnoczi: On Fri, Jun 8, 2012 at 6

Re: [Qemu-devel] CoW image commit+shrink(= make_empty) support

2012-06-15 Thread Supriya Kannery
On 06/14/2012 11:58 PM, Supriya Kannery wrote: On 06/14/2012 07:59 PM, Jeff Cody wrote: On 06/14/2012 10:23 AM, Zhi Hui Li wrote: On 2012年06月11日 23:37, Jeff Cody wrote: On 06/11/2012 10:24 AM, Stefan Hajnoczi wrote: On Mon, Jun 11, 2012 at 1:50 PM, Kevin Wolf wrote: Am 11.06.2012 14:09, schr