[Qemu-devel] [PATCH COLO-Frame v8 29/34] COLO: Do checkpoint according to the result of packets comparation

2015-07-29 Thread zhanghailiang
Only do checkpoint, when the PVM's and SVM's output net packets are inconsistent, We also limit the min time between two continuous checkpoint action, to give VM a change to run. Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian --- include/net/colo-nic.h | 2 ++ migrat

[Qemu-devel] [PATCH COLO-Frame v8 21/34] COLO: Add new command parameter 'forward_nic' 'colo_script' for net

2015-07-29 Thread zhanghailiang
ke Cc: Markus Armbruster Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian --- include/net/colo-nic.h | 23 +++ include/net/net.h | 2 ++ net/tap.c | 26 +++--- qapi-schema.json | 8 +++- qemu-options.hx| 7 +

[Qemu-devel] [PATCH COLO-Frame v8 24/34] COLO NIC: Implement colo nic device interface configure()

2015-07-29 Thread zhanghailiang
Implement colo nic device interface configure() add a script to configure nic devices: ${QEMU_SCRIPT_DIR}/colo-proxy-script.sh Cc: Stefan Hajnoczi Cc: Jason Wang Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian --- include/net/tap.h| 17 net/colo-nic.c

[Qemu-devel] [PATCH COLO-Frame v8 25/34] colo-nic: Handle secondary VM's original net device configure

2015-07-29 Thread zhanghailiang
. Signed-off-by: zhanghailiang --- include/net/colo-nic.h | 2 ++ net/colo-nic.c | 52 ++- net/tap.c| 4 +++ scripts/colo-proxy-script.sh | 65 4 files changed, 116 insertions(+), 7

[Qemu-devel] [PATCH COLO-Frame v8 33/34] COLO: Implement shutdown checkpoint

2015-07-29 Thread zhanghailiang
For Secondary VM, we forbid it shutdown directly when in COLO mode, FOR Primary VM's shutdown, we should do some work to ensure the consistent action between PVM and SVM. Cc: Paolo Bonzini Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian --- include/sysemu/sysemu.h | 3 +++ migr

[Qemu-devel] [PATCH COLO-Frame v8 04/34] colo-comm/migration: skip colo info section for special cases

2015-07-29 Thread zhanghailiang
however the --enable-colo/disable-colo on the source/destination; Signed-off-by: zhanghailiang --- migration/colo-comm.c | 5 + 1 file changed, 5 insertions(+) diff --git a/migration/colo-comm.c b/migration/colo-comm.c index 2b1d70c..4330bd8 100644 --- a/migration/colo-comm.c +++ b/migration

[Qemu-devel] [PATCH COLO-Frame v8 26/34] COLO NIC: Implement colo nic init/destroy function

2015-07-29 Thread zhanghailiang
When in colo mode, call colo nic init/destroy function. Cc: Stefan Hajnoczi Cc: Jason Wang Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian --- include/net/colo-nic.h | 3 +++ migration/colo.c | 14 ++ net/colo-nic.c | 69

[Qemu-devel] [PATCH COLO-Frame v8 18/34] COLO failover: Implement COLO primary/secondary vm failover work

2015-07-29 Thread zhanghailiang
xit. So if users choose secondary VM to take over work, please make sure that Primary VM is dead, or there will be 'split-brain' problem. Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian --- include/migration/colo.h | 4 ++ include/migration/failover.h | 1 + migration/colo

[Qemu-devel] [PATCH COLO-Frame v8 20/34] COLO failover: Don't do failover during loading VM's state

2015-07-29 Thread zhanghailiang
We should not do failover work while the main thread is loading VM's state, otherwise it will destroy the consistent of VM's memory and device state. Here we add a new failover status 'RELAUNCH' which means we should relaunch the process of failover. Signed-off-by: zhanghai

[Qemu-devel] [PATCH COLO-Frame v8 23/34] tap: Make launch_script() public

2015-07-29 Thread zhanghailiang
We also change the parameters of launch_script(). Cc: Stefan Hajnoczi Cc: Jason Wang Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian --- include/net/tap.h | 2 ++ net/tap.c | 31 ++- 2 files changed, 20 insertions(+), 13 deletions(-) diff --git a

[Qemu-devel] [PATCH COLO-Frame v8 22/34] COLO NIC: Init/remove colo nic devices when add/cleanup tap devices

2015-07-29 Thread zhanghailiang
When go into COLO mode, we need to some init work for all VM's nics. Here we use a list to record these nic, and for now we only support the 'tap' nic backend. Cc: Stefan Hajnoczi Cc: Jason Wang Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian --- include/net/colo-nic.h

[Qemu-devel] [PATCH COLO-Frame v8 03/34] COLO: migrate colo related info to slave

2015-07-29 Thread zhanghailiang
We can know if VM in destination should go into COLO mode by refer to the info that been migrated from PVM. Signed-off-by: zhanghailiang Signed-off-by: Yang Hongyang Signed-off-by: Gonglei --- include/migration/colo.h | 2 ++ migration/Makefile.objs | 1 + migration/colo-comm.c| 49

[Qemu-devel] [PATCH COLO-Frame v8 14/34] arch_init: Start to trace dirty pages of SVM

2015-07-29 Thread zhanghailiang
we will use this dirty bitmap together with VM's cache RAM dirty bitmap to decide which page in cache should be flushed into VM's RAM. Signed-off-by: zhanghailiang --- migration/ram.c | 16 1 file changed, 16 insertions(+) diff --git a/migration/ram.c b/migration/r

[Qemu-devel] [PATCH COLO-Frame v8 19/34] qmp event: Add event notification for COLO error

2015-07-29 Thread zhanghailiang
l necessary to notify users that we exit COLO mode. Cc: Markus Armbruster Cc: Michael Roth Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian --- docs/qmp/qmp-events.txt | 16 migration/colo.c| 11 ++- qapi/event.json | 15 +++ 3 files ch

[Qemu-devel] [PATCH COLO-Frame v8 13/34] COLO VMstate: Load VM state into qsb before restore it

2015-07-29 Thread zhanghailiang
d of PVM in the startup process. Signed-off-by: zhanghailiang Signed-off-by: Yang Hongyang Signed-off-by: Gonglei Reviewed-by: Dr. David Alan Gilbert --- include/migration/migration.h | 1 + migration/colo.c | 50 --- 2 files changed, 48 ins

[Qemu-devel] [PATCH COLO-Frame v8 06/34] migration: Integrate COLO checkpoint process into migration

2015-07-29 Thread zhanghailiang
Add a migrate state: MIGRATION_STATUS_COLO, enter this migration state after the first live migration successfully finished. Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian Signed-off-by: Gonglei --- include/migration/colo.h | 3 +++ migration/colo.c | 58

[Qemu-devel] [PATCH COLO-Frame v8 16/34] COLO failover: Introduce a new command to trigger a failover

2015-07-29 Thread zhanghailiang
COLO mode, and takeover, if to Secondary, Secondary will do failover work and at last takeover server. Cc: Luiz Capitulino Cc: Eric Blake Cc: Markus Armbruster Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian Signed-off-by: Yang Hongyang --- hmp-commands.hx | 15

[Qemu-devel] [PATCH COLO-Frame v8 17/34] COLO failover: Introduce state to record failover process

2015-07-29 Thread zhanghailiang
set the value. Signed-off-by: zhanghailiang --- include/migration/failover.h | 10 ++ migration/colo-failover.c| 29 + migration/colo.c | 3 +++ trace-events | 1 + 4 files changed, 43 insertions(+) diff --git a/include

[Qemu-devel] [PATCH COLO-Frame v8 28/34] COLO: Handle nfnetlink message from proxy module

2015-07-29 Thread zhanghailiang
#x27;atomic_set' 'atomic_xchg'. Cc: Stefan Hajnoczi Cc: Jason Wang Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian --- net/colo-nic.c | 42 ++ 1 file changed, 42 insertions(+) diff --git a/net/colo-nic.c b/net/colo-nic.c index c8e7734..49380

[Qemu-devel] [PATCH COLO-Frame v8 10/34] QEMUSizedBuffer: Introduce two help functions for qsb

2015-07-29 Thread zhanghailiang
m the file into qsb, this is used to get VM state from socket into a buffer. Signed-off-by: Yang Hongyang Signed-off-by: zhanghailiang Reviewed-by: Dr. David Alan Gilbert --- include/migration/qemu-file.h | 3 ++- migration/qemu-file-buf.c | 58 ++

[Qemu-devel] [PATCH COLO-Frame v8 07/34] migration: Integrate COLO checkpoint process into loadvm

2015-07-29 Thread zhanghailiang
_incoming_co' records the original migration incoming coroutine. Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian Signed-off-by: Yang Hongyang --- include/migration/colo.h | 8 include/migration/migration.h | 7 +++ migration/colo-comm.c | 1

[Qemu-devel] [PATCH COLO-Frame v8 12/34] COLO RAM: Load PVM's dirty page into SVM's RAM cache temporarily

2015-07-29 Thread zhanghailiang
e). Signed-off-by: zhanghailiang Signed-off-by: Yang Hongyang Signed-off-by: Li Zhijian Signed-off-by: Gonglei --- include/exec/cpu-all.h | 1 + include/migration/colo.h | 3 ++ migration/colo.c | 32 ++--- migration/ram.

[Qemu-devel] [PATCH COLO-Frame v8 00/34] COarse-grain LOck-stepping(COLO) Virtual Machines for Non-stop Service (FT)

2015-07-29 Thread zhanghailiang
imize colo_flush_ram_cache() - Add migration state for incoming side, we use the state to verify if migration incoming side is in COLO state or not (Patch 5). - Drop the patch 'COLO: Disable qdev hotplug when VM is in COLO mode', since it is not correct. zhanghailiang (34): confi

[Qemu-devel] [PATCH COLO-Frame v8 09/34] COLO: Add a new RunState RUN_STATE_COLO

2015-07-29 Thread zhanghailiang
Guest will enter this state when paused to save/restore VM state under colo checkpoint. Cc: Eric Blake Cc: Markus Armbruster Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian Signed-off-by: Gonglei Reviewed-by: Dr. David Alan Gilbert --- qapi-schema.json | 5 - vl.c

[Qemu-devel] [PATCH COLO-Frame v8 15/34] COLO RAM: Flush cached RAM into SVM's memory

2015-07-29 Thread zhanghailiang
hing all content of SVM's RAM cache into SVM's MEMORY, we do this in a more efficient way: Only flush any page that dirtied by PVM or SVM since last checkpoint. In this way, we ensure SVM's memory same with PVM's. Besides, we must ensure flush RAM cache before load device state.

[Qemu-devel] [PATCH COLO-Frame v8 05/34] migration: Add state records for migration incoming

2015-07-29 Thread zhanghailiang
ned-off-by: zhanghailiang --- include/migration/migration.h | 3 +++ migration/migration.c | 38 +++--- 2 files changed, 26 insertions(+), 15 deletions(-) diff --git a/include/migration/migration.h b/include/migration/migration.h index 5fd61a3..6fde8df 100644 ---

[Qemu-devel] [PATCH COLO-Frame v8 08/34] COLO: Implement colo checkpoint protocol

2015-07-29 Thread zhanghailiang
ynchronization is required, a opposite direction sync-point should be added. 3) Since sync-points are single direction, the remote side may go forward a lot when this side just receives the sync-point. Signed-off-by: Yang Hongyang Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian

[Qemu-devel] [PATCH COLO-Frame v8 11/34] COLO: Save VM state to slave when do checkpoint

2015-07-29 Thread zhanghailiang
ff-by: zhanghailiang Signed-off-by: Yang Hongyang Signed-off-by: Gonglei Signed-off-by: Li Zhijian --- include/migration/migration.h | 7 + migration/colo.c | 60 --- migration/ram.c | 46 + migr

[Qemu-devel] [PATCH COLO-Frame v8 01/34] configure: Add parameter for configure to enable/disable COLO support

2015-07-29 Thread zhanghailiang
configure --enable-colo/--disable-colo to switch COLO support on/off. COLO support is off by default. Signed-off-by: zhanghailiang Signed-off-by: Yang Hongyang Signed-off-by: Gonglei --- configure | 11 +++ 1 file changed, 11 insertions(+) diff --git a/configure b/configure index

Re: [Qemu-devel] [POC] colo-proxy in qemu

2015-07-27 Thread zhanghailiang
:00 zhanghailiang : Agreed, besides, it is seemed that slirp is not supporting ipv6, we also have to supplement it. patch for ipv6 slirp support some times ago sended to qemu list, but i don't know why in not accepted. I think no one reviewed it but there was no objection against IPv6 su

Re: [Qemu-devel] [PATCH 0/9] For QEMU 2.5: Add a net filter and a netbuffer plugin based on the filter

2015-07-24 Thread zhanghailiang
=f0 Which is a little verbose for 'netdev' option. We'd better come to an agreement on the command line style for net filter :) Cc: Daniel P. Berrange Thanks, zhanghailiang NOTE: You can attach multiple plugins to the filter, dynamically add/remove filter and filter-. The netb

Re: [Qemu-devel] [POC] colo-proxy in qemu

2015-07-20 Thread zhanghailiang
On 2015/7/20 23:01, Stefan Hajnoczi wrote: On Mon, Jul 20, 2015 at 2:12 PM, Vasiliy Tolstov wrote: 2015-07-20 14:55 GMT+03:00 zhanghailiang : Agreed, besides, it is seemed that slirp is not supporting ipv6, we also have to supplement it. patch for ipv6 slirp support some times ago sended

Re: [Qemu-devel] [POC] colo-proxy in qemu

2015-07-20 Thread zhanghailiang
at slirp is not supporting ipv6, we also have to supplement it. Thanks, zhanghailiang

Re: [Qemu-devel] [PATCH COLO-Frame v7 04/34] colo-comm/migration: skip colo info section for special cases

2015-07-20 Thread zhanghailiang
On 2015/7/18 1:07, Dr. David Alan Gilbert wrote: * zhanghailiang (zhang.zhanghaili...@huawei.com) wrote: For older machine types, we skip the colo info section when do migration, in this way, we can migrate successfully between older mainchine and the new one. We also skip this section if colo

[Qemu-devel] [PATCH COLO-Frame v7 00/34] COarse-grain LOck-stepping(COLO) Virtual Machines for Non-stop Service (FT)

2015-07-08 Thread zhanghailiang
secondary VM. - Rename migration-colo.h to colo.h, migration-failover.h to failover.h zhanghailiang (34): configure: Add parameter for configure to enable/disable COLO support migration: Introduce capability 'colo' to migration COLO: migrate colo related info to slave colo-comm/migr

[Qemu-devel] [PATCH COLO-Frame v7 21/34] COLO NIC: Init/remove colo nic devices when add/cleanup tap devices

2015-07-08 Thread zhanghailiang
When go into COLO mode, we need to some init work for all VM's nics. Here we use a list to record these nic, and for now we only support the 'tap' nic backend. Cc: Stefan Hajnoczi Cc: Jason Wang Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian --- include/net/colo-nic.h

[Qemu-devel] [PATCH COLO-Frame v7 26/34] COLO NIC: Some init work related with proxy module

2015-07-08 Thread zhanghailiang
tefan Hajnoczi Cc: Jason Wang Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian --- configure | 22 +++- net/colo-nic.c | 160 + 2 files changed, 180 insertions(+), 2 deletions(-) diff --git a/configure b/configure index a2

[Qemu-devel] [PATCH COLO-Frame v7 19/34] COLO failover: Don't do failover during loading VM's state

2015-07-08 Thread zhanghailiang
We should not do failover work while the main thread is loading VM's state, otherwise it will destroy the consistent of VM's memory and device state. Here we add a new failover status 'RELAUNCH' which means we should relaunch the process of failover. Signed-off-by: zhanghai

[Qemu-devel] [PATCH COLO-Frame v7 27/34] COLO: Handle nfnetlink message from proxy module

2015-07-08 Thread zhanghailiang
#x27;atomic_set' 'atomic_xchg'. Cc: Stefan Hajnoczi Cc: Jason Wang Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian --- net/colo-nic.c | 42 ++ 1 file changed, 42 insertions(+) diff --git a/net/colo-nic.c b/net/colo-nic.c index c8e7734..49380

[Qemu-devel] [PATCH COLO-Frame v7 04/34] colo-comm/migration: skip colo info section for special cases

2015-07-08 Thread zhanghailiang
however the --enable-colo/disable-colo on the source/destination; Signed-off-by: zhanghailiang --- hw/i386/pc_piix.c | 1 + hw/i386/pc_q35.c | 1 + hw/ppc/spapr.c| 1 + include/migration/migration.h | 1 + migration/colo-comm.c | 13

[Qemu-devel] [PATCH COLO-Frame v7 28/34] COLO: Do checkpoint according to the result of packets comparation

2015-07-08 Thread zhanghailiang
Only do checkpoint, when the PVM's and SVM's output net packets are inconsistent, We also limit the min time between two continuous checkpoint action, to give VM a change to run. Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian --- include/net/colo-nic.h | 2 ++ migrat

[Qemu-devel] [PATCH COLO-Frame v7 20/34] COLO: Add new command parameter 'forward_nic' 'colo_script' for net

2015-07-08 Thread zhanghailiang
ke Cc: Markus Armbruster Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian --- include/net/colo-nic.h | 23 +++ include/net/net.h | 2 ++ net/tap.c | 26 +++--- qapi-schema.json | 8 +++- qemu-options.hx| 7 +

[Qemu-devel] [PATCH COLO-Frame v7 34/34] COLO: Add block replication into colo process

2015-07-08 Thread zhanghailiang
Make sure master start block replication after slave's block replication started. Signed-off-by: zhanghailiang Signed-off-by: Wen Congyang Signed-off-by: Yang Hongyang Signed-off-by: Li Zhijian --- migration/colo.c | 71 +--- trace-e

[Qemu-devel] [PATCH COLO-Frame v7 31/34] COLO NIC: Implement NIC checkpoint and failover

2015-07-08 Thread zhanghailiang
Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian --- include/net/colo-nic.h | 2 ++ migration/colo.c | 21 ++--- net/colo-nic.c | 23 +++ 3 files changed, 43 insertions(+), 3 deletions(-) diff --git a/include/net/colo-nic.h b/include/net

[Qemu-devel] [PATCH COLO-Frame v7 18/34] qmp event: Add event notification for COLO error

2015-07-08 Thread zhanghailiang
l necessary to notify users that we exit COLO mode. Cc: Markus Armbruster Cc: Michael Roth Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian --- docs/qmp/qmp-events.txt | 16 migration/colo.c| 10 +- qapi/event.json | 15 +++ 3 files ch

[Qemu-devel] [PATCH COLO-Frame v7 24/34] colo-nic: Handle secondary VM's original net device configure

2015-07-08 Thread zhanghailiang
. Signed-off-by: zhanghailiang --- include/net/colo-nic.h | 2 ++ net/colo-nic.c | 52 ++- net/tap.c| 4 +++ scripts/colo-proxy-script.sh | 65 4 files changed, 116 insertions(+), 7

[Qemu-devel] [PATCH COLO-Frame v7 16/34] COLO failover: Introduce state to record failover process

2015-07-08 Thread zhanghailiang
set the value. Signed-off-by: zhanghailiang --- include/migration/failover.h | 9 + migration/colo-failover.c| 24 trace-events | 1 + 3 files changed, 34 insertions(+) diff --git a/include/migration/failover.h b/include/migration/failover.h

[Qemu-devel] [PATCH COLO-Frame v7 23/34] COLO NIC: Implement colo nic device interface configure()

2015-07-08 Thread zhanghailiang
Implement colo nic device interface configure() add a script to configure nic devices: ${QEMU_SCRIPT_DIR}/colo-proxy-script.sh Cc: Stefan Hajnoczi Cc: Jason Wang Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian --- include/net/tap.h| 17 net/colo-nic.c

[Qemu-devel] [PATCH COLO-Frame v7 17/34] COLO failover: Implement COLO primary/secondary vm failover work

2015-07-08 Thread zhanghailiang
xit. So if users choose secondary VM to take over work, please make sure that Primary VM is dead, or there will be 'split-brain' problem. Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian Signed-off-by: Lai Jiangshan --- include/migration/colo.h | 4 ++ include/migrat

[Qemu-devel] [PATCH COLO-Frame v7 30/34] COLO: Add colo-set-checkpoint-period command

2015-07-08 Thread zhanghailiang
With this command, we can control the period of checkpoint, if there is no comparison of net packets. Cc: Luiz Capitulino Cc: Eric Blake Cc: Markus Armbruster Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian --- hmp-commands.hx| 15 +++ hmp.c | 7

[Qemu-devel] [PATCH COLO-Frame v7 03/34] COLO: migrate colo related info to slave

2015-07-08 Thread zhanghailiang
We can know if VM in destination should go into COLO mode by refer to the info that been migrated from PVM. Signed-off-by: zhanghailiang Signed-off-by: Yang Hongyang Signed-off-by: Lai Jiangshan Signed-off-by: Gonglei --- include/migration/colo.h | 2 ++ migration/Makefile.objs | 1

[Qemu-devel] [PATCH COLO-Frame v7 01/34] configure: Add parameter for configure to enable/disable COLO support

2015-07-08 Thread zhanghailiang
configure --enable-colo/--disable-colo to switch COLO support on/off. COLO support is off by default. Signed-off-by: zhanghailiang Signed-off-by: Yang Hongyang Signed-off-by: Gonglei Signed-off-by: Lai Jiangshan --- configure | 11 +++ 1 file changed, 11 insertions(+) diff --git a

[Qemu-devel] [PATCH COLO-Frame v7 25/34] COLO NIC: Implement colo nic init/destroy function

2015-07-08 Thread zhanghailiang
When in colo mode, call colo nic init/destroy function. Cc: Stefan Hajnoczi Cc: Jason Wang Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian --- include/net/colo-nic.h | 3 +++ migration/colo.c | 15 +++ net/colo-nic.c | 69

[Qemu-devel] [PATCH COLO-Frame v7 13/34] arch_init: Start to trace dirty pages of SVM

2015-07-08 Thread zhanghailiang
we will use this dirty bitmap together with VM's cache RAM dirty bitmap to decide which page in cache should be flushed into VM's RAM. Signed-off-by: zhanghailiang --- migration/ram.c | 16 1 file changed, 16 insertions(+) diff --git a/migration/ram.c b/migration/r

[Qemu-devel] [PATCH COLO-Frame v7 33/34] COLO: Implement shutdown checkpoint

2015-07-08 Thread zhanghailiang
For Secondary VM, we forbid it shutdown directly when in COLO mode, FOR Primary VM's shutdown, we should do some work to ensure the consistent action between PVM and SVM. Cc: Paolo Bonzini Signed-off-by: zhanghailiang Signed-off-by: Lai Jiangshan Signed-off-by: Li Zhijian --- include/s

[Qemu-devel] [PATCH COLO-Frame v7 12/34] COLO VMstate: Load VM state into qsb before restore it

2015-07-08 Thread zhanghailiang
d of PVM in the startup process. Signed-off-by: zhanghailiang Signed-off-by: Yang Hongyang Signed-off-by: Gonglei Reviewed-by: Dr. David Alan Gilbert --- migration/colo.c | 53 ++--- 1 file changed, 50 insertions(+), 3 deletions(-) diff --g

[Qemu-devel] [PATCH COLO-Frame v7 14/34] COLO RAM: Flush cached RAM into SVM's memory

2015-07-08 Thread zhanghailiang
hing all content of SVM's RAM cache into SVM's MEMORY, we do this in a more efficient way: Only flush any page that dirtied by PVM or SVM since last checkpoint. In this way, we ensure SVM's memory same with PVM's. Besides, we must ensure flush RAM cache before load device state.

[Qemu-devel] [PATCH COLO-Frame v7 11/34] COLO RAM: Load PVM's dirty page into SVM's RAM cache temporarily

2015-07-08 Thread zhanghailiang
e). Signed-off-by: zhanghailiang Signed-off-by: Gonglei Signed-off-by: Yang Hongyang Signed-off-by: Lai Jiangshan Signed-off-by: Li Zhijian --- include/exec/cpu-all.h | 1 + include/migration/colo.h | 3 ++ migration/colo.c | 31 +--- migration/ram.

[Qemu-devel] [PATCH COLO-Frame v7 09/34] QEMUSizedBuffer: Introduce two help functions for qsb

2015-07-08 Thread zhanghailiang
m the file into qsb, this is used to get VM state from socket into a buffer. Signed-off-by: Yang Hongyang Signed-off-by: zhanghailiang Reviewed-by: Dr. David Alan Gilbert --- include/migration/qemu-file.h | 3 ++- migration/qemu-file-buf.c | 58 ++

[Qemu-devel] [PATCH COLO-Frame v7 29/34] COLO: Improve checkpoint efficiency by do additional periodic checkpoint

2015-07-08 Thread zhanghailiang
stent). Signed-off-by: zhanghailiang Signed-off-by: Yang Hongyang --- migration/colo.c | 29 + 1 file changed, 21 insertions(+), 8 deletions(-) diff --git a/migration/colo.c b/migration/colo.c index 815f2ab..64862dc 100644 --- a/migration/colo.c +++ b/migration/c

[Qemu-devel] [PATCH COLO-Frame v7 08/34] COLO: Add a new RunState RUN_STATE_COLO

2015-07-08 Thread zhanghailiang
Guest will enter this state when paused to save/restore VM state under colo checkpoint. Cc: Eric Blake Cc: Markus Armbruster Signed-off-by: zhanghailiang Signed-off-by: Gonglei Signed-off-by: Lai Jiangshan Reviewed-by: Dr. David Alan Gilbert --- qapi-schema.json | 5 - vl.c

[Qemu-devel] [PATCH COLO-Frame v7 32/34] COLO: Disable qdev hotplug when VM is in COLO mode

2015-07-08 Thread zhanghailiang
COLO do not support qdev hotplug migration, disable it. Signed-off-by: zhanghailiang Signed-off-by: Yang Hongyang --- migration/colo.c | 11 +++ 1 file changed, 11 insertions(+) diff --git a/migration/colo.c b/migration/colo.c index 3dc7eee..f5bad95 100644 --- a/migration/colo.c +++ b

[Qemu-devel] [PATCH COLO-Frame v7 07/34] COLO: Implement colo checkpoint protocol

2015-07-08 Thread zhanghailiang
ynchronization is required, a opposite direction sync-point should be added. 3) Since sync-points are single direction, the remote side may go forward a lot when this side just receives the sync-point. Signed-off-by: Yang Hongyang Signed-off-by: Lai Jiangshan Signed-off-by: zhanghailia

[Qemu-devel] [PATCH COLO-Frame v7 05/34] migration: Integrate COLO checkpoint process into migration

2015-07-08 Thread zhanghailiang
Add a migrate state: MIGRATION_STATUS_COLO, enter this migration state after the first live migration successfully finished. Signed-off-by: zhanghailiang Signed-off-by: Gonglei Signed-off-by: Lai Jiangshan --- include/migration/colo.h | 3 +++ include/migration/migration.h | 2

[Qemu-devel] [PATCH COLO-Frame v7 06/34] migration: Integrate COLO checkpoint process into loadvm

2015-07-08 Thread zhanghailiang
Switch from normal migration loadvm process into COLO checkpoint process if COLO mode is enabled. Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian Signed-off-by: Lai Jiangshan Signed-off-by: Yang Hongyang --- include/migration/colo.h | 13 + migration/colo-comm.c| 10

[Qemu-devel] [PATCH COLO-Frame v7 02/34] migration: Introduce capability 'colo' to migration

2015-07-08 Thread zhanghailiang
earn if colo is supported. Cc: Juan Quintela Cc: Amit Shah Cc: Eric Blake Cc: Markus Armbruster Signed-off-by: zhanghailiang Signed-off-by: Yang Hongyang Signed-off-by: Gonglei Signed-off-by: Lai Jiangshan --- include/migration/colo.h | 20 include/migration

[Qemu-devel] [PATCH COLO-Frame v7 22/34] tap: Make launch_script() public

2015-07-08 Thread zhanghailiang
We also change the parameters of launch_script(). Cc: Stefan Hajnoczi Cc: Jason Wang Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian --- include/net/tap.h | 2 ++ net/tap.c | 31 ++- 2 files changed, 20 insertions(+), 13 deletions(-) diff --git a

[Qemu-devel] [PATCH COLO-Frame v7 15/34] COLO failover: Introduce a new command to trigger a failover

2015-07-08 Thread zhanghailiang
COLO mode, and takeover, if to Secondary, Secondary will do failover work and at last takeover server. Cc: Luiz Capitulino Cc: Eric Blake Cc: Markus Armbruster Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian Signed-off-by: Lai Jiangshan Signed-off-by: Yang Hongyang --- hmp-c

[Qemu-devel] [PATCH COLO-Frame v7 10/34] COLO: Save VM state to slave when do checkpoint

2015-07-08 Thread zhanghailiang
ff-by: zhanghailiang Signed-off-by: Yang Hongyang Signed-off-by: Gonglei Signed-off-by: Lai Jiangshan Signed-off-by: Li Zhijian --- migration/colo.c | 61 +++--- migration/ram.c| 47 - migration/savevm.c | 2

Re: [Qemu-devel] [PULL 14/28] runstate: migration allows more transitions now

2015-07-08 Thread zhanghailiang
On 2015/7/8 19:06, Juan Quintela wrote: zhanghailiang wrote: Hi, If testing migration with '-S' for qemu command line, (migrate directly without executing 'cont' command), qemu process in the destination will abort with the follow message: ERROR: invalid runstate tr

Re: [Qemu-devel] [PULL 14/28] runstate: migration allows more transitions now

2015-07-08 Thread zhanghailiang
{ RUN_STATE_INMIGRATE, RUN_STATE_PRELAUNCH }, { RUN_STATE_INTERNAL_ERROR, RUN_STATE_PAUSED }, { RUN_STATE_INTERNAL_ERROR, RUN_STATE_FINISH_MIGRATE }, Thanks, zhanghailiang On 2015/7/7 21:08, Juan Quintela wrote: Next commit would allow to move from incoming migration to error happening on

Re: [Qemu-devel] [BUG/RFC] Two cpus are not brought up normally in SLES11 sp3 VM after reboot

2015-07-07 Thread zhanghailiang
On 2015/7/7 20:21, Igor Mammedov wrote: On Tue, 7 Jul 2015 19:43:35 +0800 zhanghailiang wrote: On 2015/7/7 19:23, Igor Mammedov wrote: On Mon, 6 Jul 2015 17:59:10 +0800 zhanghailiang wrote: On 2015/7/6 16:45, Paolo Bonzini wrote: On 06/07/2015 09:54, zhanghailiang wrote: From host

Re: [Qemu-devel] [BUG/RFC] Two cpus are not brought up normally in SLES11 sp3 VM after reboot

2015-07-07 Thread zhanghailiang
On 2015/7/7 19:23, Igor Mammedov wrote: On Mon, 6 Jul 2015 17:59:10 +0800 zhanghailiang wrote: On 2015/7/6 16:45, Paolo Bonzini wrote: On 06/07/2015 09:54, zhanghailiang wrote: From host, we found that QEMU vcpu1 thread and vcpu7 thread were not consuming any cpu (Should be in idle

Re: [Qemu-devel] [BUG/RFC] Two cpus are not brought up normally in SLES11 sp3 VM after reboot

2015-07-06 Thread zhanghailiang
On 2015/7/6 16:45, Paolo Bonzini wrote: On 06/07/2015 09:54, zhanghailiang wrote: From host, we found that QEMU vcpu1 thread and vcpu7 thread were not consuming any cpu (Should be in idle state), All of VCPUs' stacks in host is like bellow: [] kvm_vcpu_block+0x65/0xa0 [kvm] [] __vcp

Re: [Qemu-devel] [PATCH COLO-Frame v6 03/31] COLO: migrate colo related info to slave

2015-07-06 Thread zhanghailiang
On 2015/7/6 16:29, Dr. David Alan Gilbert wrote: * zhanghailiang (zhang.zhanghaili...@huawei.com) wrote: On 2015/7/4 2:03, Dr. David Alan Gilbert wrote: * zhanghailiang (zhang.zhanghaili...@huawei.com) wrote: We can know if VM in destination should go into COLO mode by refer to the info that

[Qemu-devel] [BUG/RFC] Two cpus are not brought up normally in SLES11 sp3 VM after reboot

2015-07-06 Thread zhanghailiang
roduce this problem, we are not quite sure. Is there any possible that the cupid emulation in kvm/qemu has some bug ? Has anyone come across these problem before? Or any idea? Thanks, zhanghailiang

Re: [Qemu-devel] [PATCH COLO-Frame v6 03/31] COLO: migrate colo related info to slave

2015-07-06 Thread zhanghailiang
On 2015/7/4 2:03, Dr. David Alan Gilbert wrote: * zhanghailiang (zhang.zhanghaili...@huawei.com) wrote: We can know if VM in destination should go into COLO mode by refer to the info that has been migrated from PVM. Signed-off-by: zhanghailiang Signed-off-by: Yang Hongyang Signed-off-by: Lai

Re: [Qemu-devel] [PATCH COLO-Frame v6 01/31] configure: Add parameter for configure to enable/disable COLO support

2015-07-05 Thread zhanghailiang
On 2015/7/4 1:51, Dr. David Alan Gilbert wrote: * zhanghailiang (zhang.zhanghaili...@huawei.com) wrote: configure --enable-colo/--disable-colo to switch COLO support on/off. COLO support is off by default. Signed-off-by: zhanghailiang Signed-off-by: Yang Hongyang Signed-off-by: Gonglei

Re: [Qemu-devel] [PATCH COLO-Frame v6 00/31] COarse-grain LOck-stepping(COLO) Virtual Machines for Non-stop Service

2015-06-30 Thread zhanghailiang
s, we will look into them ... Thanks, zhanghailiang It would be good to find a way to detect this failure reliably. * zhanghailiang (zhang.zhanghaili...@huawei.com) wrote: This is the 6th version of COLO, here is only COLO frame part, include: VM checkpoint, failover, proxy API, block repli

Re: [Qemu-devel] [PATCH v7 01/42] Start documenting how postcopy works.

2015-06-26 Thread zhanghailiang
On 2015/6/26 14:46, Yang Hongyang wrote: Hi Dave, On 06/16/2015 06:26 PM, Dr. David Alan Gilbert (git) wrote: From: "Dr. David Alan Gilbert" [...] += Postcopy = +'Postcopy' migration is a way to deal with migrations that refuse to converge; +its plus side is that there is an upper bound on

Re: [Qemu-devel] Adding new migration-parameters - any easier way?

2015-06-23 Thread zhanghailiang
On 2015/6/23 15:50, Markus Armbruster wrote: zhanghailiang writes: On 2015/6/19 16:11, Markus Armbruster wrote: [...] To avoid the ugliness, we could change the QAPI generator. Currently, { 'command': 'migrate-set-parameters', 'data': 'Mi

Re: [Qemu-devel] Adding new migration-parameters - any easier way?

2015-06-22 Thread zhanghailiang
On 2015/6/19 16:11, Markus Armbruster wrote: zhanghailiang writes: Hi, Is there any news about this discussion? Is anyone working on it? ;) Since the 'hard feature freeze' time is closer, we'd better to fix it in 2.4 before libvirt uses it. I have sent a RFC patch "

[Qemu-devel] [PATCH COLO-Frame v6 27/31] COLO: Add colo-set-checkpoint-period command

2015-06-18 Thread zhanghailiang
With this command, we can control the period of checkpoint, if there is no comparison of net packets. Cc: Luiz Capitulino Cc: Eric Blake Cc: Markus Armbruster Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian --- hmp-commands.hx| 15 +++ hmp.c | 7

[Qemu-devel] [PATCH COLO-Frame v6 30/31] COLO: Implement shutdown checkpoint

2015-06-18 Thread zhanghailiang
For Secondary VM, we forbid it shutdown directly when in COLO mode, FOR Primary VM's shutdown, we should do some work to ensure the consistent action between PVM and SVM. Cc: Paolo Bonzini Signed-off-by: zhanghailiang Signed-off-by: Lai Jiangshan Signed-off-by: Li Zhijian --- include/s

[Qemu-devel] [PATCH COLO-Frame v6 22/31] COLO NIC : Implement colo nic init/destroy function

2015-06-18 Thread zhanghailiang
When in colo mode, call colo nic init/destroy function. Cc: Stefan Hajnoczi Cc: Jason Wang Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian --- include/net/colo-nic.h | 4 +++ migration/colo.c | 15 +++ net/colo-nic.c | 71

[Qemu-devel] [PATCH COLO-Frame v6 28/31] COLO NIC: Implement NIC checkpoint and failover

2015-06-18 Thread zhanghailiang
Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian --- include/net/colo-nic.h | 2 ++ migration/colo.c | 21 ++--- net/colo-nic.c | 23 +++ 3 files changed, 43 insertions(+), 3 deletions(-) diff --git a/include/net/colo-nic.h b/include/net

[Qemu-devel] [PATCH COLO-Frame v6 18/31] COLO: Add new command parameter 'colo_nicname' 'colo_script' for net

2015-06-18 Thread zhanghailiang
ke Cc: Markus Armbruster Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian --- include/net/colo-nic.h | 23 +++ include/net/net.h | 2 ++ net/tap.c | 27 --- qapi-schema.json | 8 +++- qemu-options.hx| 7 +

[Qemu-devel] [PATCH COLO-Frame v6 16/31] qmp event: Add event notification for COLO error

2015-06-18 Thread zhanghailiang
l necessary to notify users that we exit COLO mode. Cc: Markus Armbruster Cc: Michael Roth Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian --- docs/qmp/qmp-events.txt | 16 migration/colo.c| 12 ++-- qapi/event.json | 15 +++ 3

[Qemu-devel] [PATCH COLO-Frame v6 20/31] tap: Make launch_script() public

2015-06-18 Thread zhanghailiang
We also change the parameters of launch_script(). Cc: Stefan Hajnoczi Cc: Jason Wang Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian --- include/net/tap.h | 2 ++ net/tap.c | 31 ++- 2 files changed, 20 insertions(+), 13 deletions(-) diff --git a

[Qemu-devel] [PATCH COLO-Frame v6 25/31] COLO: Do checkpoint according to the result of packets comparation

2015-06-18 Thread zhanghailiang
Only do checkpoint, when the PVM's and SVM's output net packets are inconsistent, We also limit the min time between two continuous checkpoint action, to give VM a change to run. Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian --- include/net/colo-nic.h | 2 ++ migrat

[Qemu-devel] [PATCH COLO-Frame v6 29/31] COLO: Disable qdev hotplug when VM is in COLO mode

2015-06-18 Thread zhanghailiang
COLO do not support qdev hotplug migration, disable it. Signed-off-by: zhanghailiang Signed-off-by: Yang Hongyang --- migration/colo.c | 11 +++ 1 file changed, 11 insertions(+) diff --git a/migration/colo.c b/migration/colo.c index 0fcadcd..8d6d166 100644 --- a/migration/colo.c +++ b

[Qemu-devel] [PATCH COLO-Frame v6 26/31] COLO: Improve checkpoint efficiency by do additional periodic checkpoint

2015-06-18 Thread zhanghailiang
stent). Signed-off-by: zhanghailiang Signed-off-by: Yang Hongyang --- migration/colo.c | 29 + 1 file changed, 21 insertions(+), 8 deletions(-) diff --git a/migration/colo.c b/migration/colo.c index cf7a6e1..b11ed7b 100644 --- a/migration/colo.c +++ b/migration/c

[Qemu-devel] [PATCH COLO-Frame v6 23/31] COLO NIC: Some init work related with proxy module

2015-06-18 Thread zhanghailiang
tefan Hajnoczi Cc: Jason Wang Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian --- configure | 22 +++- net/colo-nic.c | 160 + 2 files changed, 180 insertions(+), 2 deletions(-) diff --git a/configure b/configure index 8b

[Qemu-devel] [PATCH COLO-Frame v6 21/31] COLO NIC: Implement colo nic device interface configure()

2015-06-18 Thread zhanghailiang
Implement colo nic device interface configure() add a script to configure nic devices: ${QEMU_SCRIPT_DIR}/colo-proxy-script.sh Cc: Stefan Hajnoczi Cc: Jason Wang Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian --- include/net/tap.h| 17 + net/colo-nic.c

[Qemu-devel] [PATCH COLO-Frame v6 19/31] COLO NIC: Init/remove colo nic devices when add/cleanup tap devices

2015-06-18 Thread zhanghailiang
When COLO mode, we do some init work for nic that will be used for COLO. Cc: Stefan Hajnoczi Cc: Jason Wang Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian --- include/net/colo-nic.h | 3 +++ net/Makefile.objs | 1 + net/colo-nic.c | 70

[Qemu-devel] [PATCH COLO-Frame v6 31/31] COLO: Add block replication into colo process

2015-06-18 Thread zhanghailiang
Make sure master start block replication after slave's block replication started. Signed-off-by: zhanghailiang Signed-off-by: Wen Congyang Signed-off-by: Yang Hongyang Signed-off-by: Li Zhijian --- migration/colo.c | 139 ++- trace-e

[Qemu-devel] [PATCH COLO-Frame v6 08/31] QEMUSizedBuffer: Introduce two help functions for qsb

2015-06-18 Thread zhanghailiang
m the file into qsb, this is used to get VM state from socket into a buffer. Signed-off-by: Yang Hongyang Signed-off-by: zhanghailiang Reviewed-by: Dr. David Alan Gilbert --- include/migration/qemu-file.h | 3 ++- migration/qemu-file-buf.c | 58 ++

[Qemu-devel] [PATCH COLO-Frame v6 17/31] COLO failover: Don't do failover during loading VM's state

2015-06-18 Thread zhanghailiang
Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian Signed-off-by: Lai Jiangshan --- migration/colo.c | 10 ++ 1 file changed, 10 insertions(+) diff --git a/migration/colo.c b/migration/colo.c index a65f9ea..76bdd44 100644 --- a/migration/colo.c +++ b/migration/colo.c @@ -53,6

[Qemu-devel] [PATCH COLO-Frame v6 24/31] COLO: Handle nfnetlink message from proxy module

2015-06-18 Thread zhanghailiang
#x27;atomic_set' 'atomic_xchg'. Cc: Stefan Hajnoczi Cc: Jason Wang Signed-off-by: zhanghailiang Signed-off-by: Li Zhijian --- net/colo-nic.c | 42 ++ trace-events | 1 + 2 files changed, 43 insertions(+) diff --git a/net/colo-nic.c b/net/col

[Qemu-devel] [PATCH COLO-Frame v6 02/31] migration: Introduce capability 'colo' to migration

2015-06-18 Thread zhanghailiang
earn if colo is supported. Cc: Juan Quintela Cc: Amit Shah Cc: Eric Blake Cc: Markus Armbruster Signed-off-by: zhanghailiang Signed-off-by: Yang Hongyang Signed-off-by: Gonglei Signed-off-by: Lai Jiangshan --- include/migration/migration-colo.h | 20 include/migration/migr

<    4   5   6   7   8   9   10   11   12   13   >