[Qemu-devel] Memory mapping on MIPS

2016-02-21 Thread Igor R
I have some issues when accessing guest Linux kernel memory above 0xC000 by means of cpu_memory_rw_debug (x86_64 host, MIPS guest), and I'm trying to debug it. Here is an excerpt from r4k_map_address(), related to addresses >= 0x8000. Actually, it maps 0x8010 and 0xA010 to the

Re: [Qemu-devel] An RDMA race?

2016-01-09 Thread Michael R. Hines
are doing). Maybe we can coalesce around something? - Michael On 01/04/2016 12:15 PM, Dr. David Alan Gilbert wrote: * Michael R. Hines (mhi...@digitalocean.com) wrote: Adding such a control message would defeat the benefits of RDMA, as there shouldn't be any signalling in the actual DMA pat

Re: [Qemu-devel] An RDMA race?

2015-12-19 Thread Michael R. Hines
wrote: > * Michael R. Hines (mhi...@digitalocean.com) wrote: > > David, > > > > Thanks for including my email directly. It helps a lot. > > > > Below, I'm going to assume that only "dest" is calling > > qemu_rdma_exchange_recv() > > and on

Re: [Qemu-devel] An RDMA race?

2015-12-19 Thread Michael R. Hines
And, yes, out-of-order messages are totally fine - we just have to be careful with the design. - Michael On Sun, Dec 20, 2015 at 3:08 PM, Michael R. Hines <mhi...@digitalocean.com> wrote: > Adding such a control message would defeat the benefits of RDMA, as there > shou

[Qemu-devel] Monitoring memory writes

2015-12-12 Thread Igor R
In my QEMU-based project I would like to perform "extensive" tracing of basic blocks (translation blocks). I.e. in addition to what the existing tracing mechanism does, I'd like to log registers modified by TB and memory (RAM) written by TB. As for registers, it seems to be trivial. My main

Re: [Qemu-devel] An RDMA race?

2015-12-11 Thread Michael R. Hines
David, Thanks for including my email directly. It helps a lot. Below, I'm going to assume that only "dest" is calling qemu_rdma_exchange_recv() and only src is calling qemu_rdma_exchange_send(), since you didn't specify who is sending and who is receiving. If that assumption is wrong, please

Re: [Qemu-devel] [PATCH v18 00/21] Deterministic replay core

2015-11-04 Thread Igor R
Hello, I would like to try this new functionality. What's the correct way to do this? I'm trying the following (after applying the patches to qemu upstream): qemu-system-i386 mylinux.qcow2 -icount shift=7,rr=record,rrfile=record.bin -net none Linux gets booted, record.bin file is created. Then

[Qemu-devel] MIPS: reading kernel memory when guest Linux is in user mode

2015-08-13 Thread Igor R
Hello, I try to use cpu_memory_rw_debug() to read from 0x8xxx kernel virtual address, when the guest is in user mode. Obviously, it fails. Is it possible to modify some control registers to allow such an access? I tried to set/clear the kernel mode bits in CP0_Status, but it doesn't help.

Re: [Qemu-devel] MIPS: reading kernel memory when guest Linux is in user mode

2015-08-13 Thread Igor R
I try to use cpu_memory_rw_debug() to read from 0x8xxx kernel virtual address, when the guest is in user mode. Obviously, it fails. Is it possible to modify some control registers to allow such an access? I tried to set/clear the kernel mode bits in CP0_Status, but it doesn't help.

Re: [Qemu-devel] Getting current PGD on Linux@ARM

2015-08-11 Thread Igor R
When debugging (via gdbstub), I would like to get the current process id by a virtual address. When the virtual address is in the user-space, the only way to find the current task_struct I can think of is to iterate over all the task_struct's (assuming we know task_init and the offsets

Re: [Qemu-devel] Accessing guest kernel thread_info struct

2015-07-20 Thread Igor R
Thanks for the useful info! (Actually, my approach works as well - it was just endianness issue...)

[Qemu-devel] Accessing guest kernel thread_info struct

2015-07-20 Thread Igor R
Hello, I need to access thread_info (linux kernel struct) of the guest from within qemu, when the guest is in kernel mode. To do this, I read the stack pointer and mask it with ~(stack_size - 1). This works with x86 and ARM, but doesn't seem to work with MIPS - the pointer points to something

[Qemu-devel] Getting current PGD on Linux@ARM

2015-07-18 Thread Igor R
Hello, On x86 one can get the current PGD from CR3. What's the right way to do this on ARM? In a code based on an old QEMU version, I see the following: pgd = env-cp15.c2_base0 env-cp15.c2_base_mask; But in the recent QEMU version c2_base0 field is absent. Instead, there's ttbr0[] array. So

Re: [Qemu-devel] Getting current PGD on Linux@ARM

2015-07-18 Thread Igor R
On x86 one can get the current PGD from CR3. What's the right way to do this on ARM? What's a PGD ? Page global directory However just looking at base mask is not necessarily correct -- depending on the configuration of the CPU we might be using translation table base control registers

Re: [Qemu-devel] [PATCH COLO-BLOCK v7 00/17] Block replication for continuous checkpoints

2015-07-08 Thread Michael R. Hines
On 07/07/2015 08:38 PM, Wen Congyang wrote: On 07/08/2015 12:56 AM, Michael R. Hines wrote: On 07/07/2015 04:23 AM, Paolo Bonzini wrote: On 07/07/2015 11:13, Dr. David Alan Gilbert wrote: This log is very stange. The NBD client connects to NBD server, and NBD server wants to read data from

Re: [Qemu-devel] [PATCH COLO-BLOCK v7 00/17] Block replication for continuous checkpoints

2015-07-07 Thread Michael R. Hines
On 07/07/2015 04:23 AM, Paolo Bonzini wrote: On 07/07/2015 11:13, Dr. David Alan Gilbert wrote: This log is very stange. The NBD client connects to NBD server, and NBD server wants to read data from NBD client, but reading fails. It seems that the connection is closed unexpectedly. Can you

Re: [Qemu-devel] [PATCH COLO-BLOCK v7 00/17] Block replication for continuous checkpoints

2015-07-06 Thread Michael R. Hines
On 07/04/2015 07:46 AM, Wen Congyang wrote: At 2015/7/3 23:30, Dr. David Alan Gilbert Wrote: * Wen Congyang (we...@cn.fujitsu.com) wrote: Block replication is a very important feature which is used for continuous checkpoints(for example: COLO). Usage: Please refer to

Re: [Qemu-devel] [PATCH COLO-BLOCK v7 00/17] Block replication for continuous checkpoints

2015-07-02 Thread Michael R. Hines
Is this up to date: On 06/29/2015 10:34 PM, Wen Congyang wrote: Block replication is a very important feature which is used for continuous checkpoints(for example: COLO). Usage: Please refer to docs/block-replication.txt You can get the patch here:

Re: [Qemu-devel] [PATCH COLO-BLOCK v7 13/17] docs: block replication's description

2015-07-02 Thread Michael R. Hines
On 06/29/2015 10:34 PM, Wen Congyang wrote: Signed-off-by: Wen Congyang we...@cn.fujitsu.com Signed-off-by: Yang Hongyang yan...@cn.fujitsu.com Signed-off-by: zhanghailiang zhang.zhanghaili...@huawei.com Signed-off-by: Gonglei arei.gong...@huawei.com --- docs/block-replication.txt | 179

Re: [Qemu-devel] [PATCH COLO-BLOCK v7 00/17] Block replication for continuous checkpoints

2015-07-02 Thread Michael R. Hines
On 06/29/2015 10:34 PM, Wen Congyang wrote: Block replication is a very important feature which is used for continuous checkpoints(for example: COLO). Usage: Please refer to docs/block-replication.txt You can get the patch here:

Re: [Qemu-devel] [Qemu-discuss] GRO not happening in VM with VxLAN

2015-07-01 Thread Santosh R
features # ethtool -k tap0 | grep -i tnl tx-udp_tnl-segmentation: off [fixed] On Tue, Jun 30, 2015 at 12:24 PM, Santosh R skrasta...@gmail.com wrote: On Mon, Jun 29, 2015 at 9:24 PM, Santosh R skrasta...@gmail.com wrote: On Mon, Jun 29, 2015 at 9:04 PM, Vlad Yasevich vyase...@redhat.com

Re: [Qemu-devel] [Qemu-discuss] GRO not happening in VM with VxLAN

2015-07-01 Thread Santosh R
I am using 3.18 kernel. #uname -a Linux Indra.asicdesigners.com 3.18.0 #11 SMP Wed Jul 1 21:49:44 IST 2015 x86_64 x86_64 x86_64 GNU/Linux #cat /etc/issue Red Hat Enterprise Linux Server release 6.5 (Santiago) Kernel \r on an \m As mentioned in my initial post, this is how I am starting the VM

Re: [Qemu-devel] [RFC PATCH COLO v2 00/13] Block replication for continuous checkpoints

2015-07-01 Thread Michael R. Hines
On 06/30/2015 11:11 PM, Wen Congyang wrote: On 07/01/2015 11:09 AM, Michael R. Hines wrote: On 03/25/2015 04:36 AM, Wen Congyang wrote: Block replication is a very important feature which is used for continuous checkpoints(for example: COLO). Usage: Please refer to docs/block-replication.txt

Re: [Qemu-devel] [RFC PATCH COLO v2 00/13] Block replication for continuous checkpoints

2015-07-01 Thread Michael R. Hines
On 06/30/2015 11:11 PM, Wen Congyang wrote: On 07/01/2015 11:09 AM, Michael R. Hines wrote: On 03/25/2015 04:36 AM, Wen Congyang wrote: Block replication is a very important feature which is used for continuous checkpoints(for example: COLO). Usage: Please refer to docs/block-replication.txt

Re: [Qemu-devel] [RFC PATCH COLO v2 00/13] Block replication for continuous checkpoints

2015-06-30 Thread Michael R. Hines
On 03/25/2015 04:36 AM, Wen Congyang wrote: Block replication is a very important feature which is used for continuous checkpoints(for example: COLO). Usage: Please refer to docs/block-replication.txt You can get the patch here:

Re: [Qemu-devel] [Qemu-discuss] GRO not happening in VM with VxLAN

2015-06-30 Thread Santosh R
On Mon, Jun 29, 2015 at 9:24 PM, Santosh R skrasta...@gmail.com wrote: On Mon, Jun 29, 2015 at 9:04 PM, Vlad Yasevich vyase...@redhat.com wrote: On 06/29/2015 01:46 AM, Santosh R wrote: All, I am testing VxLAN performance in VM. For this I am using below command to bring up

Re: [Qemu-devel] [Qemu-discuss] GRO not happening in VM with VxLAN

2015-06-29 Thread Santosh R
On Mon, Jun 29, 2015 at 9:04 PM, Vlad Yasevich vyase...@redhat.com wrote: On 06/29/2015 01:46 AM, Santosh R wrote: All, I am testing VxLAN performance in VM. For this I am using below command to bring up the VM. # qemu-system-x86_64 -m 4096 -smp 4 -boot c -device virtio-net-pci

[Qemu-devel] GRO not happening in VM with VxLAN

2015-06-29 Thread Santosh R
All, I am testing VxLAN performance in VM. For this I am using below command to bring up the VM. # qemu-system-x86_64 -m 4096 -smp 4 -boot c -device virtio-net-pci,netdev=tap0,mac=00:11:22:33:44:55 -netdev tap,id=tap0,script=no,vhost=on -drive file=/root/vdisk_rhel65.img This is resulting

Re: [Qemu-devel] [PATCH v2 06/12] Translate offsets to destination address space

2015-06-12 Thread Michael R. Hines
On 06/12/2015 01:50 PM, Dr. David Alan Gilbert wrote: * Michael R. Hines (mrhi...@linux.vnet.ibm.com) wrote: On 06/11/2015 01:58 PM, Dr. David Alan Gilbert wrote: * Michael R. Hines (mrhi...@linux.vnet.ibm.com) wrote: On 06/11/2015 12:17 PM, Dr. David Alan Gilbert (git) wrote: From: Dr

Re: [Qemu-devel] [PATCH v2 04/12] rdma typos

2015-06-11 Thread Michael R. Hines
On 06/11/2015 12:17 PM, Dr. David Alan Gilbert (git) wrote: From: Dr. David Alan Gilbert dgilb...@redhat.com A couple of typo fixes. Signed-off-by: Dr. David Alan Gilbert dgilb...@redhat.com --- migration/rdma.c | 6 +++--- trace-events | 4 ++-- 2 files changed, 5 insertions(+), 5

Re: [Qemu-devel] [PATCH v2 06/12] Translate offsets to destination address space

2015-06-11 Thread Michael R. Hines
On 06/11/2015 12:17 PM, Dr. David Alan Gilbert (git) wrote: From: Dr. David Alan Gilbert dgilb...@redhat.com The 'offset' field in RDMACompress and 'current_addr' field in RDMARegister are commented as being offsets within a particular RAMBlock, however they appear to actually be offsets within

Re: [Qemu-devel] [PATCH v2 07/12] Rework ram_control_load_hook to hook during block load

2015-06-11 Thread Michael R. Hines
On 06/11/2015 12:17 PM, Dr. David Alan Gilbert (git) wrote: From: Dr. David Alan Gilbert dgilb...@redhat.com We need the names of RAMBlocks as they're loaded for RDMA, reuse a slightly modified ram_control_load_hook: a) Pass a 'data' parameter to use for the name in the block-reg case

Re: [Qemu-devel] [PATCH v2 08/12] Allow rdma_delete_block to work without the hash

2015-06-11 Thread Michael R. Hines
) { -rdma_delete_block(rdma, rdma-local_ram_blocks.block-offset); +rdma_delete_block(rdma, rdma-local_ram_blocks.block[0]); } } Looks good overall. Maybe this is a silly question, but have you done a few migrations over actual RDMA hardware yet? Reviewed-by: Michael R. Hines mrhi

Re: [Qemu-devel] [PATCH v2 09/12] Rework ram block hash

2015-06-11 Thread Michael R. Hines
Reviewed-by: Michael R. Hines mrhi...@us.ibm.com

Re: [Qemu-devel] [PATCH v2 10/12] Sort destination RAMBlocks to be the same as the source

2015-06-11 Thread Michael R. Hines
-dest_blocks[i].remote_rkey; } } Seems pretty good overall, without actually testing it. Deleting code is good =). Reviewed-by: Michael R. Hines mrhi...@us.ibm.com diff --git a/trace-events b/trace-events index 7dff362..b2bf8ea 100644 --- a/trace-events +++ b/trace-events @@ -1426,6

Re: [Qemu-devel] [PATCH v2 06/12] Translate offsets to destination address space

2015-06-11 Thread Michael R. Hines
On 06/11/2015 01:58 PM, Dr. David Alan Gilbert wrote: * Michael R. Hines (mrhi...@linux.vnet.ibm.com) wrote: On 06/11/2015 12:17 PM, Dr. David Alan Gilbert (git) wrote: From: Dr. David Alan Gilbert dgilb...@redhat.com The 'offset' field in RDMACompress and 'current_addr' field in RDMARegister

Re: [Qemu-devel] ABNT2 keys again

2015-05-26 Thread R. Lemos
I've tested an unpatched QEMU 2.3.0 (x86_64) with -k pt_br option and the /?° key works perfectly. I have not tested the numpad ., but I can inform that ABNT2 keyboard does have . (dot) and , (comma) as separate keys: comma (numlock on) combined with delete (numlock off). But I found another key

Re: [Qemu-devel] [PATCH 04/10] Translate offsets to destination address space

2015-05-19 Thread Michael R. Hines
On 04/20/2015 10:57 AM, Dr. David Alan Gilbert (git) wrote: From: Dr. David Alan Gilbert dgilb...@redhat.com The 'offset' field in RDMACompress and 'current_addr' field in RDMARegister are commented as being offsets within a particular RAMBlock, however they appear to actually be offsets within

Re: [Qemu-devel] [PATCH 06/10] Remove unneeded memset

2015-05-19 Thread Michael R. Hines
= -1; rdma-current_chunk = -1; Reviewed-by: Michael R. Hines mrhi...@us.ibm.com

Re: [Qemu-devel] [PATCH 05/10] Rework ram_control_load_hook to hook during block load

2015-05-19 Thread Michael R. Hines
On 04/20/2015 10:57 AM, Dr. David Alan Gilbert (git) wrote: From: Dr. David Alan Gilbert dgilb...@redhat.com We need the names of RAMBlocks as they're loaded for RDMA, reuse an existing QEMUFile hook with some small mods. Signed-off-by: Dr. David Alan Gilbert dgilb...@redhat.com ---

Re: [Qemu-devel] [PATCH 07/10] Simplify rdma_delete_block and remove it's dependence on the hash

2015-05-19 Thread Michael R. Hines
On 04/20/2015 10:57 AM, Dr. David Alan Gilbert (git) wrote: From: Dr. David Alan Gilbert dgilb...@redhat.com rdma_delete_block is currently very general, but it's only used in cleanup at the end. Simplify it and remove it's dependence on the hash table and remove all of the hash-table

Re: [Qemu-devel] [PATCH 08/10] Rework ram block hash

2015-05-19 Thread Michael R. Hines
On 04/20/2015 10:57 AM, Dr. David Alan Gilbert (git) wrote: From: Dr. David Alan Gilbert dgilb...@redhat.com RDMA uses a hash from block offset-RAM Block; this isn't needed on the destination, and now that the destination sorts the ramblock list, is harder to maintain. Destination sorts the

Re: [Qemu-devel] [PATCH 09/10] Sort destination RAMBlocks to be the same as the source

2015-05-19 Thread Michael R. Hines
On 04/20/2015 10:57 AM, Dr. David Alan Gilbert (git) wrote: From: Dr. David Alan Gilbert dgilb...@redhat.com Use the order of incoming RAMBlocks from the source to record an index number; that then allows us to sort the destination local RAMBlock list to match the source. Now that the

Re: [Qemu-devel] [PATCH 10/10] Sanity check RDMA remote data

2015-05-19 Thread Michael R. Hines
; +} } chunk_start = ram_chunk_start(block, chunk); chunk_end = ram_chunk_end(block, chunk + reg-chunks); Reviewed-by: Michael R. Hines mrhi...@us.ibm.com

Re: [Qemu-devel] [PATCH 04/10] Translate offsets to destination address space

2015-05-19 Thread Michael R. Hines
On 05/19/2015 01:44 PM, Dr. David Alan Gilbert wrote: * Michael R. Hines (mrhi...@linux.vnet.ibm.com) wrote: On 04/20/2015 10:57 AM, Dr. David Alan Gilbert (git) wrote: From: Dr. David Alan Gilbert dgilb...@redhat.com The 'offset' field in RDMACompress and 'current_addr' field in RDMARegister

Re: [Qemu-devel] [PATCH 01/10] Rename RDMA structures to make destination clear

2015-05-19 Thread Michael R. Hines
-block[i].remote_rkey; +rdma-dest_blocks[i].remote_host_addr; +local-block[j].remote_rkey = rdma-dest_blocks[i].remote_rkey; break; } Good to get these renamed, thanks. Reviewed-by: Michael R. Hines mrhi...@us.ibm.com

Re: [Qemu-devel] [PATCH 02/10] qemu_ram_foreach_block: pass up error value, and down the ramblock name

2015-05-19 Thread Michael R. Hines
rdma_add_block(opaque, host_addr, block_offset, length); } /* Shame on me for not checking the return value =) Reviewed-by: Michael R. Hines mrhi...@us.ibm.com

Re: [Qemu-devel] [PATCH 03/10] Store block name in local blocks structure

2015-05-19 Thread Michael R. Hines
rdma_start_incoming_migration(void) rdma_start_incoming_migration_after_dest_init(void) Reviewed-by: Michael R. Hines mrhi...@us.ibm.com

Re: [Qemu-devel] [PATCH 08/10] Rework ram block hash

2015-05-19 Thread Michael R. Hines
On 05/19/2015 01:55 PM, Dr. David Alan Gilbert wrote: I would like to keep the ramblock list directly addressable by hash on both sides, because, as I mentioned earlier, we want as much flexibility in registering RAMBlock memory as possible by being able to add or delete arbitrary blocks int the

Re: [Qemu-devel] [PATCH 00/10] Remove RDMA migration dependence on RAMBlock offset

2015-05-18 Thread Michael R. Hines
On 04/20/2015 10:57 AM, Dr. David Alan Gilbert (git) wrote: From: Dr. David Alan Gilbert dgilb...@redhat.com RDMA migration currently relies on the source and destination RAMBlocks having the same offsets within ram_addr_t space; unfortunately that's just not true when: a) You hotplug on

Re: [Qemu-devel] [Qemu-discuss] Add 3D video card acceleration

2015-04-25 Thread Dale R. Worley
Kris zhang zhang.k...@gmail.com writes: On Wednesday, April 8, 2015, Programmingkid programmingk...@gmail.com wrote: It would be great if QEMU could emulate a 3D video card. We would all be able to play our games in it. VirtualBox does have a GPL v2 implementation of a 2D and 3D video card.

Re: [Qemu-devel] Network Migration in QEMU during Live Migration

2015-02-04 Thread Gary R Hook
is quite easy. What he said. The guest doesn't know, doesn't care, and doesn't change its network configuration; external connections are maintained. Only the host upon which the guest runs changes, and that is kind of irrelevant from a guest perspective. -- Gary R Hook Senior Kernel Engineer

Re: [Qemu-devel] [libvirt-users] Using virsh blockcopy -- what's it supposed to accomplish?

2015-01-08 Thread Gary R Hook
to the above command. Or, rather, what I really need, which is virsh blockcopy --domain my_domain --raw which I can then control with subsequent commands. I'm kinda surprised no one else has tried to do this and lived to write about it. -- Gary R Hook Senior Kernel Engineer NIMBOXX, Inc

Re: [Qemu-devel] [libvirt-users] Using virsh blockcopy -- what's it supposed to accomplish?

2015-01-08 Thread Gary R Hook
working. Thank you for confirming the conclusions I arrived at independently. I should turn this experience into a guest blog post, I suppose. -- Gary R Hook Senior Kernel Engineer NIMBOXX, Inc

Re: [Qemu-devel] [libvirt-users] Using virsh blockcopy -- what's it supposed to accomplish?

2015-01-08 Thread Gary R Hook
On 12/24/14 4:42 AM, Kashyap Chamarthy wrote: On Tue, Dec 23, 2014 at 12:38:57PM -0600, Gary R Hook wrote: [. . .] In my case, the block device is a QCOW2 disk image file. If I boot without using the disk image file which has the operating system, the domain will fail to boot, no? I see

Re: [Qemu-devel] [PATCH 1/1] block migration: fix return value mismatch

2014-11-21 Thread Gary R Hook
in the current source (which makes sense due to the 2.2 RC2 work) but folks are asking. And it appears that there's a bug report over at RedHat that may be the same problem. I think I'll add to my .sig: Look, ma, only 72 columns! -- Gary R Hook Senior Kernel Engineer NIMBOXX, Inc

Re: [Qemu-devel] Fwd: Re: Tunneled Migration with Non-Shared Storage

2014-11-20 Thread Gary R Hook
On 11/20/14 3:54 AM, Dr. David Alan Gilbert wrote: * Gary R Hook (grhookatw...@gmail.com) wrote: Ugh, I wish I could teach Thunderbird to understand how to reply to a newsgroup. Apologies to Paolo for the direct note. On 11/19/14 4:19 AM, Paolo Bonzini wrote: On 19/11/2014 10:35, Dr. David

Re: [Qemu-devel] Tunneled Migration with Non-Shared Storage

2014-11-19 Thread Gary R Hook
:59.258+ Send command '{execute:block-job-cancel,arguments:{device:drive-virtio-disk0},id:libvirt-2176}' for write with FD -1 -- Gary R Hook Senior Kernel Engineer NIMBOXX, Inc

[Qemu-devel] Fwd: Re: Tunneled Migration with Non-Shared Storage

2014-11-19 Thread Gary R Hook
. Thank you for your attention. -- Gary R Hook Senior Kernel Engineer NIMBOXX, Inc

[Qemu-devel] Tunneled Migration with Non-Shared Storage

2014-11-18 Thread Gary R Hook
to understand why the code is written this way. I've yet to run across any comments that explain the need for this extra copy, and am looking for background and advice. Any insights are welcome. -- Gary R Hook Senior Kernel Engineer NIMBOXX, Inc

Re: [Qemu-devel] [PATCH 1/1] block migration: fix return value mismatch

2014-11-13 Thread Gary R Hook
Stefan Hajnoczi mailto:stefa...@gmail.com November 13, 2014 at 12:55 PM One more thing about email configuration: the character set encoding of your emails seems to be incorrect. GMail is rendering a superscript 1 (like to the power of one) when you wanted a single quote:

Re: [Qemu-devel] [Bug 1363641] Re: Build of v2.1.0 fails on armv7l due to undeclared __NR_select

2014-09-23 Thread Michael R. Hines
On 09/09/2014 02:09 AM, Dr. David Alan Gilbert wrote: (cc'ing Michael Hines who owns and knows the RDMA code) * Karl-Philipp Richter (krichter...@aol.de) wrote: ** Description changed: After `make clean` and `git clean -x -f -d` `git checkout v2.1.0 configure

Re: [Qemu-devel] [Bug 1363641] Re: Build of v2.1.0 fails on armv7l due to undeclared __NR_select

2014-09-23 Thread Michael R. Hines
On 09/09/2014 02:09 AM, Dr. David Alan Gilbert wrote: (cc'ing Michael Hines who owns and knows the RDMA code) * Karl-Philipp Richter (krichter...@aol.de) wrote: ** Description changed: After `make clean` and `git clean -x -f -d` `git checkout v2.1.0 configure

Re: [Qemu-devel] ballooning not working on hotplugged pc-dimm

2014-09-11 Thread Michael R. Hines
On 09/11/2014 02:22 PM, Paolo Bonzini wrote: Il 11/09/2014 03:57, Michael R. Hines ha scritto: Why does hotplugging use a different name? This also affects RDMA live migration - we are explicitly looking up pc.ram ram blocks and pinning them for memory registration with Linux. Are we? I

Re: [Qemu-devel] Microcheckpointing: Memory-VCPU / Disk State consistency

2014-09-10 Thread Michael R. Hines
for any ideas Walid Am 17.08.2014 11:52, schrieb Paolo Bonzini: Il 11/08/2014 22:15, Michael R. Hines ha scritto: Excellent question: QEMU does have a feature called drive-mirror in block/mirror.c that was introduced a couple of years ago. I'm not sure what the adoption rate of the feature

Re: [Qemu-devel] ballooning not working on hotplugged pc-dimm

2014-09-10 Thread Michael R. Hines
On 09/10/2014 05:00 PM, zhanghailiang wrote: On 2014/9/9 11:05, Alexandre DERUMIER wrote: Hello, I was playing with pc-dimm hotplug, and I notice that balloning is not working on memory space of pc-dimm devices. example: qemu -m size=1024,slots=255,maxmem=15000M #free -m : 1024M - qmp

Re: [Qemu-devel] Microcheckpointing: Memory-VCPU / Disk State consistency

2014-08-14 Thread Michael R. Hines
On 08/14/2014 06:58 PM, Dr. David Alan Gilbert wrote: cc'ing in a couple of the COLOers. Thanks, David. Glad to see their patches in last month - I need to take a look at them. The 2013 paper says: 'COLO modifies the guest OS’s TCP/IP stack in order to make the behavior more deterministic.

Re: [Qemu-devel] Microcheckpointing: Memory-VCPU / Disk State consistency

2014-08-13 Thread Michael R. Hines
On 08/13/2014 10:03 PM, Walid Nouri wrote: While looking to find some ideas for approaches to replicating block devices I have read the paper about the Remus implementation. I think MC can take a similar approach for local disk. I agree. Here are the main facts that I have understood:

Re: [Qemu-devel] Microcheckpointing: Memory-VCPU / Disk State consistency

2014-08-11 Thread Michael R. Hines
:25, schrieb Michael R. Hines: On Sat, 2014-08-09 at 14:08 +0200, Walid Nouri wrote: Hi Michael, how is the weather in Bejing? :-) It's terrible. Lots of pollution =( May I ask you some questions to your MC implementation? Currently i'm trying to understand the general working of the MC

Re: [Qemu-devel] Microcheckpointing: Memory-VCPU / Disk State consistency

2014-08-11 Thread Michael R. Hines
:25, schrieb Michael R. Hines: On Sat, 2014-08-09 at 14:08 +0200, Walid Nouri wrote: Hi Michael, how is the weather in Bejing? :-) It's terrible. Lots of pollution =( May I ask you some questions to your MC implementation? Currently i'm trying to understand the general working of the MC

Re: [Qemu-devel] [RFC] COLO HA Project proposal

2014-07-09 Thread Michael R. Hines
On 07/03/2014 11:42 AM, Hongyang Yang wrote: I wonder if there is anyway to coordinate this between COLO, Michael Hines microcheckpointing and the two separate reverse-execution projects that also need to do some similar things. Are there any standard APIs for the heartbeet thing we can

Re: [Qemu-devel] [PATCH] rdma: bug fixes

2014-06-12 Thread Michael R. Hines
On 02/18/2014 10:34 AM, mrhi...@linux.vnet.ibm.com wrote: From: Michael R. Hines mrhi...@us.ibm.com 1. Fix small memory leak in parsing inet address from command line in data_init() 2. Fix ibv_post_send() return value check and pass error code back up correctly. 3. Fix rdma_destroy_qp

Re: [Qemu-devel] [PATCH] rdma: Fix block during rdma migration

2014-05-14 Thread Michael R. Hines
On 05/09/2014 12:25 PM, Gonglei (Arei) wrote: Hi, -Original Message- From: Michael R. Hines [mailto:mrhi...@linux.vnet.ibm.com] Sent: Tuesday, April 01, 2014 8:42 AM To: Gonglei (Arei); qemu-devel@nongnu.org Cc: Huangweidong (C); quint...@redhat.com; dgilb...@redhat.com; owass

Re: [Qemu-devel] [Qemu-trivial] [PATCH] arch_init.c: remove duplicate function

2014-04-14 Thread Michael R. Hines
migration does? Just for RDMA: Reviewed-by: Michael R. Hines mrhi...@us.ibm.com - Michael

Re: [Qemu-devel] [RFC PATCH v2 10/12] mc: expose tunable parameter for checkpointing frequency

2014-04-11 Thread Michael R. Hines
On 04/04/2014 10:56 PM, Eric Blake wrote: On 04/03/2014 11:29 PM, Michael R. Hines wrote: I'm trying to thing of a back-compat method, which exploits the fact that we now have flat unions (something we didn't have when migrate-set-capabilities was first added). Maybe something like: { 'type

Re: [Qemu-devel] [RFC PATCH v2 02/12] mc: timestamp migration_bitmap and KVM logdirty usage

2014-04-03 Thread Michael R. Hines
On 03/12/2014 05:31 AM, Juan Quintela wrote: mrhi...@linux.vnet.ibm.com wrote: From: Michael R. Hines mrhi...@us.ibm.com We also later export these statistics over QMP for better monitoring of micro-checkpointing as the workload changes. Signed-off-by: Michael R. Hines mrhi...@us.ibm.com

Re: [Qemu-devel] [RFC PATCH v2 03/12] mc: introduce a 'checkpointing' status check into the VCPU states

2014-04-03 Thread Michael R. Hines
On 03/12/2014 05:36 AM, Juan Quintela wrote: mrhi...@linux.vnet.ibm.com wrote: From: Michael R. Hines mrhi...@us.ibm.com During micro-checkpointing, the VCPUs get repeatedly paused and resumed. We need to not freak out when the VM begins micro-checkpointing. Signed-off-by: Michael R. Hines

Re: [Qemu-devel] [RFC PATCH v2 03/12] mc: introduce a 'checkpointing' status check into the VCPU states

2014-04-03 Thread Michael R. Hines
On 03/12/2014 05:40 AM, Eric Blake wrote: +++ b/qapi-schema.json @@ -169,6 +169,8 @@ # # @save-vm: guest is paused to save the VM state # +# @checkpoint-vm: guest is paused to checkpoint the VM state +# It would be nice to mention '(since 2.1)'. Acknowledged. # @shutdown: guest is

Re: [Qemu-devel] [RFC PATCH v2 07/12] mc: introduce additional QMP statistics for micro-checkpointing

2014-04-03 Thread Michael R. Hines
On 03/12/2014 05:45 AM, Eric Blake wrote: +++ b/qapi-schema.json @@ -603,6 +603,36 @@ 'cache-miss': 'int', 'overflow': 'int' } } ## +# @MCStats +# +# Detailed Micro Checkpointing (MC) statistics +# +# @mbps: throughput of transmitting last MC +# +# @xmit-time: milliseconds to

Re: [Qemu-devel] [RFC PATCH v2 10/12] mc: expose tunable parameter for checkpointing frequency

2014-04-03 Thread Michael R. Hines
On 03/12/2014 05:49 AM, Eric Blake wrote: diff --git a/hmp-commands.hx b/hmp-commands.hx index f3fc514..2066c76 100644 --- a/hmp-commands.hx +++ b/hmp-commands.hx @@ -888,7 +888,7 @@ ETEXI \n\t\t\t -b for migration without shared storage with full

Re: [Qemu-devel] [RFC PATCH v2 11/12] mc: introduce new capabilities to control micro-checkpointing

2014-04-03 Thread Michael R. Hines
On 03/12/2014 05:57 AM, Eric Blake wrote: --- qapi-schema.json | 36 +++- 1 file changed, 35 insertions(+), 1 deletion(-) +# Only for performance testing. (Since 2.x) +# +# @mc-rdma-copy: MC requires creating a local-memory checkpoint before +#

Re: [Qemu-devel] [RFC PATCH v2 06/12] mc: introduce state machine changes for MC

2014-04-03 Thread Michael R. Hines
On 03/12/2014 05:57 AM, Juan Quintela wrote: mrhi...@linux.vnet.ibm.com wrote: From: Michael R. Hines mrhi...@us.ibm.com This patch sets up the initial changes to the migration state machine and prototypes to be used by the checkpointing code to interact with the state machine so that we can

Re: [Qemu-devel] [RFC PATCH v2 07/12] mc: introduce additional QMP statistics for micro-checkpointing

2014-04-03 Thread Michael R. Hines
On 03/12/2014 05:59 AM, Juan Quintela wrote: mrhi...@linux.vnet.ibm.com wrote: From: Michael R. Hines mrhi...@us.ibm.com MC provides a lot of new information, including the same RAM statistics that ordinary migration does, so we centralize a lot of that printing code into a common function so

Re: [Qemu-devel] [RFC PATCH v2 11/12] mc: introduce new capabilities to control micro-checkpointing

2014-04-03 Thread Michael R. Hines
On 03/12/2014 06:02 AM, Juan Quintela wrote: mrhi...@linux.vnet.ibm.com wrote: From: Michael R. Hines mrhi...@us.ibm.com New capabilities include the use of RDMA acceleration, use of network buffering, and keepalive support, as documented in patch #1. Signed-off-by: Michael R. Hines mrhi

Re: [Qemu-devel] [RFC PATCH v2 11/12] mc: introduce new capabilities to control micro-checkpointing

2014-04-03 Thread Michael R. Hines
On 03/12/2014 06:07 AM, Eric Blake wrote: On 03/11/2014 04:02 PM, Juan Quintela wrote: mrhi...@linux.vnet.ibm.com wrote: From: Michael R. Hines mrhi...@us.ibm.com +# @mc-net-disable: Deactivate network buffering against outbound network +# traffic while Micro-Checkpointing (@mc

Re: [Qemu-devel] [RFC PATCH v2 10/12] mc: expose tunable parameter for checkpointing frequency

2014-04-03 Thread Michael R. Hines
On 03/12/2014 06:49 AM, Eric Blake wrote: On 03/11/2014 04:15 PM, Juan Quintela wrote: Eric Blake ebl...@redhat.com wrote: On 02/18/2014 01:50 AM, mrhi...@linux.vnet.ibm.com wrote: From: Michael R. Hines mrhi...@us.ibm.com We're building up a LOT of migrate- tunable commands. Maybe it's

Re: [Qemu-devel] [PATCH] rdma: Fix block during rdma migration

2014-03-31 Thread Michael R. Hines
+949,7 @@ route: ERROR(errp, result not equal to event_addr_resolved %s, rdma_event_str(cm_event-event)); perror(rdma_resolve_addr); +rdma_ack_cm_event(cm_event); ret = -EINVAL; goto err_resolve_get_addr; } Reviewed-by: Michael R

Re: [Qemu-devel] [PATCH] rdma: bug fixes

2014-03-26 Thread Michael R. Hines
On 02/27/2014 11:49 PM, Michael Roth wrote: Quoting mrhi...@linux.vnet.ibm.com (2014-02-17 20:34:06) From: Michael R. Hines mrhi...@us.ibm.com 1. Fix small memory leak in parsing inet address from command line in data_init() 2. Fix ibv_post_send() return value check and pass error code back

[Qemu-devel] RDMA upstream moved to stable status - will proceed formally with libvirt patchset and more FT review

2014-03-26 Thread Michael R. Hines
Dr. David Alan Gilbert (2): Fix vmstate_info_int32_le comparison/assign Fix two XBZRLE corruption issues Juan Quintela (1): qemu_file: use fwrite() correctly Michael R. Hines (1): rdma: rename 'x-rdma' = 'rdma' arch_init.c

Re: [Qemu-devel] [RFC PATCH v2 01/12] mc: add documentation for micro-checkpointing

2014-03-02 Thread Michael R. Hines
On 02/21/2014 05:44 PM, Dr. David Alan Gilbert wrote: It's not clear to me how much of this (or any) of this control loop should be in QEMU or in the management software, but I would definitely agree that a minimum of at least the ability to detect the situation and remedy the situation should

Re: [Qemu-devel] [RFC PATCH v2 06/12] mc: introduce state machine changes for MC

2014-02-21 Thread Michael R. Hines
On 02/19/2014 09:00 AM, Li Guang wrote: Hi, mrhi...@linux.vnet.ibm.com wrote: From: Michael R. Hinesmrhi...@us.ibm.com This patch sets up the initial changes to the migration state machine and prototypes to be used by the checkpointing code to interact with the state machine so that we can

Re: [Qemu-devel] [RFC PATCH v2 01/12] mc: add documentation for micro-checkpointing

2014-02-20 Thread Michael R. Hines
On 02/20/2014 06:09 PM, Dr. David Alan Gilbert wrote: * Michael R. Hines (mrhi...@linux.vnet.ibm.com) wrote: On 02/19/2014 07:27 PM, Dr. David Alan Gilbert wrote: I was just wondering if a separate 'max buffer size' knob would allow you to more reasonably bound memory without setting policy; I

Re: [Qemu-devel] [RFC PATCH v2 01/12] mc: add documentation for micro-checkpointing

2014-02-20 Thread Michael R. Hines
On 02/20/2014 07:14 PM, Li Guang wrote: Dr. David Alan Gilbert wrote: * Michael R. Hines (mrhi...@linux.vnet.ibm.com) wrote: On 02/19/2014 07:27 PM, Dr. David Alan Gilbert wrote: I was just wondering if a separate 'max buffer size' knob would allow you to more reasonably bound memory without

Re: [Qemu-devel] [RFC PATCH v2 01/12] mc: add documentation for micro-checkpointing

2014-02-20 Thread Michael R. Hines
On 02/21/2014 12:32 AM, Dr. David Alan Gilbert wrote: I'm happy to use more memory to get FT, all I'm trying to do is see if it's possible to put a lower bound than 2x on it while still maintaining full FT, at the expense of performance in the case where it uses a lot of memory. The bottom

Re: [Qemu-devel] [RFC PATCH v2 01/12] mc: add documentation for micro-checkpointing

2014-02-19 Thread Michael R. Hines
On 02/19/2014 07:27 PM, Dr. David Alan Gilbert wrote: I was just wondering if a separate 'max buffer size' knob would allow you to more reasonably bound memory without setting policy; I don't think people like having potentially x2 memory. Note: Checkpoint memory is not monotonic in this

Re: [Qemu-devel] [RFC PATCH v2 06/12] mc: introduce state machine changes for MC

2014-02-19 Thread Michael R. Hines
On 02/19/2014 09:00 AM, Li Guang wrote: Hi, mrhi...@linux.vnet.ibm.com wrote: From: Michael R. Hinesmrhi...@us.ibm.com This patch sets up the initial changes to the migration state machine and prototypes to be used by the checkpointing code to interact with the state machine so that we can

Re: [Qemu-devel] [RFC PATCH v2 00/12] mc: fault tolerante through micro-checkpointing

2014-02-18 Thread Michael R. Hines
wrote: From: Michael R. Hinesmrhi...@us.ibm.com Changes since v1: 1. Re-based against Juan's improved migration_bitmap performance changes 2. Overhauled RDMA support to prepare for better usage of RDMA in other parts of the QEMU code base (such as storage). 3. Fix for netlink issues that failed

Re: [Qemu-devel] [RFC PATCH v2 01/12] mc: add documentation for micro-checkpointing

2014-02-18 Thread Michael R. Hines
On 02/18/2014 08:45 PM, Dr. David Alan Gilbert wrote: +The Micro-Checkpointing Process +Basic Algorithm +Micro-Checkpoints (MC) work against the existing live migration path in QEMU, and can effectively be understood as a live migration that never ends. As such, iteration rounds happen at the

Re: [Qemu-devel] [RFC PATCH v2 02/12] mc: timestamp migration_bitmap and KVM logdirty usage

2014-02-18 Thread Michael R. Hines
On 02/18/2014 06:32 PM, Dr. David Alan Gilbert wrote: * mrhi...@linux.vnet.ibm.com (mrhi...@linux.vnet.ibm.com) wrote: From: Michael R. Hines mrhi...@us.ibm.com We also later export these statistics over QMP for better monitoring of micro-checkpointing as the workload changes. snip

Re: [Qemu-devel] [RFC PATCH v2 06/12] mc: introduce state machine changes for MC

2014-02-18 Thread Michael R. Hines
On 02/19/2014 09:00 AM, Li Guang wrote: Hi, mrhi...@linux.vnet.ibm.com wrote: From: Michael R. Hinesmrhi...@us.ibm.com This patch sets up the initial changes to the migration state machine and prototypes to be used by the checkpointing code to interact with the state machine so that we can

<    1   2   3   4   5   6   7   8   >