On Tue, 25 Jun 2019, Roger Pau Monné wrote:
> On Mon, Jun 24, 2019 at 11:47:09AM -0700, Stefano Stabellini wrote:
> > + xen-devel
> > 
> > On Mon, 24 Jun 2019, Stefano Stabellini wrote:
> > > Hi all,
> > > 
> > > I might have found a bug with PCI passthrough to a Linux HVM guest on
> > > x86 with Xen 4.12. It is not easy for me to get access, and especially
> > > change components, on this particular system, and I don't have access to
> > > other x86 boxes at the moment, so apologies for the partial information
> > > report. The setup is as follow:
> > > 
> > > - two PCI devices have been assigned to a HVM guest, everything is fine
> > > - reboot the guest from inside, i.e. `reboot' in Linux
> > > - after the reboot completes, only one device is assigned
> 
> Can you provide the xl debug log of the whole process?

See attached.


> > > Before the reboot, I see all the appropriate xenstore entries for both
> > > devices. Everything is fine. After the reboot, I can only see the
> > > xenstore entries of one device. It is as if the other device
> > > "disappeared" without throwing any errors.
> 
> So there are no errors on the hypervisor dmesg or the xl logs at all?

Nope. Only:

[445257.718590] xen_pciback: vpci: 0000:00:0e.0: assign to virtual slot 0
[445257.733048] pciback 0000:00:0e.0: registering for 4
[445257.741257] xen_pciback: vpci: 0000:03:00.0: assign to virtual slot 1
[445257.758836] pciback 0000:03:00.0: registering for 4
[445340.380219] xen_pciback: vpci: 0000:00:0e.0: assign to virtual slot 0
[445340.391755] pciback 0000:00:0e.0: registering for 5



> > > Have you seen this before? Do you know if it has been fixed in staging?
> > > I noticed this fix which seems to be very relevant:
> > > 
> > > https://lists.xenproject.org/archives/html/xen-devel/2018-11/msg01616.html
> > > 
> > > but it is already included in 4.12.
> 
> AFAICT your issue seems related to xl/libxl not properly re-adding the
> devices on reboot. The fix above had to do with leaving devices in a
> broken state under some circumstances (ie: they where always attached
> to the guest, just not working properly).

Yes, it looks like it is as you describe.
Waiting for domain test-multi-adapters.1 (domid 4) to die [pid 1536]
libxl: debug: libxl_event.c:639:libxl__ev_xswatch_register: watch 
w=0x7f67c0e09880 wpath=@releaseDomain token=3/0: register slotnum=3
libxl: debug: libxl_event.c:576:watchfd_callback: watch w=0x7f67c0e09880 
wpath=@releaseDomain token=3/0: event epath=@releaseDomain
libxl: debug: libxl_domain.c:767:domain_death_xswatch_callback: Domain 
4:[evg=0x7f67c0e09a20] nentries=1 rc=1 4..4
libxl: debug: libxl_domain.c:778:domain_death_xswatch_callback: Domain 
4:[evg=0x7f67c0e09a20]   got=domaininfos[0] got->domain=4
libxl: debug: libxl_domain.c:804:domain_death_xswatch_callback: Domain 4:Exists 
shutdown_reported=0 dominf.flags=ffff0102
libxl: debug: libxl_domain.c:771:domain_death_xswatch_callback: [evg=0] all 
reported
libxl: debug: libxl_domain.c:833:domain_death_xswatch_callback: domain death 
search done
libxl: debug: libxl_event.c:576:watchfd_callback: watch w=0x7f67c0e09880 
wpath=@releaseDomain token=3/0: event epath=@releaseDomain
libxl: debug: libxl_domain.c:767:domain_death_xswatch_callback: Domain 
4:[evg=0x7f67c0e09a20] nentries=1 rc=1 4..4
libxl: debug: libxl_domain.c:778:domain_death_xswatch_callback: Domain 
4:[evg=0x7f67c0e09a20]   got=domaininfos[0] got->domain=4
libxl: debug: libxl_domain.c:804:domain_death_xswatch_callback: Domain 4:Exists 
shutdown_reported=0 dominf.flags=10106
libxl: debug: libxl_domain.c:816:domain_death_xswatch_callback:  shutdown 
reporting
libxl: debug: libxl_domain.c:771:domain_death_xswatch_callback: [evg=0] all 
reported
libxl: debug: libxl_domain.c:833:domain_death_xswatch_callback: domain death 
search done
Domain 4 has shut down, reason code 1 0x1
Action for shutdown reason code 1 is restart
libxl: debug: libxl_qmp.c:813:libxl__qmp_initialize: Domain 4:connected to 
/var/run/xen/qmp-libxl-4
libxl: debug: libxl_qmp.c:350:qmp_handle_response: Domain 4:message type: qmp
libxl: debug: libxl_qmp.c:365:qmp_handle_response: Domain 4:QEMU version: 3.0.0
libxl: debug: libxl_qmp.c:666:qmp_send_prepare: Domain 4:next qmp command: 
'{"execute":"qmp_capabilities","id":1}
'
libxl: debug: libxl_qmp.c:350:qmp_handle_response: Domain 4:message type: return
libxl: debug: libxl_qmp.c:666:qmp_send_prepare: Domain 4:next qmp command: 
'{"execute":"query-cpus","id":2}
'
libxl: debug: libxl_qmp.c:350:qmp_handle_response: Domain 4:message type: return
libxl: debug: libxl_domain.c:1749:libxl_retrieve_domain_configuration: Domain 
4:No vtpm from xenstore
libxl: debug: libxl_domain.c:1749:libxl_retrieve_domain_configuration: Domain 
4:No vusb from xenstore
libxl: debug: libxl_domain.c:1749:libxl_retrieve_domain_configuration: Domain 
4:No vusb from xenstore
libxl: warning: libxl_domain.c:1767:libxl_retrieve_domain_configuration: Domain 
4:Device present in JSON but not in xenstore, ignored
libxl: debug: libxl_domain.c:1749:libxl_retrieve_domain_configuration: Domain 
4:No vdispl from xenstore
libxl: debug: libxl_domain.c:1749:libxl_retrieve_domain_configuration: Domain 
4:No vsnd from xenstore
Domain 4 needs to be cleaned up: destroying the domain
libxl: debug: libxl_domain.c:902:libxl_domain_destroy: Domain 4:ao 
0x7f67c0724f60: create: how=0 callback=0 poller=0x7f67c0e09680
libxl: debug: libxl_qmp.c:813:libxl__qmp_initialize: Domain 4:connected to 
/var/run/xen/qmp-libxl-4
libxl: debug: libxl_qmp.c:350:qmp_handle_response: Domain 4:message type: qmp
libxl: debug: libxl_qmp.c:365:qmp_handle_response: Domain 4:QEMU version: 3.0.0
libxl: debug: libxl_qmp.c:666:qmp_send_prepare: Domain 4:next qmp command: 
'{"execute":"qmp_capabilities","id":1}
'
libxl: debug: libxl_qmp.c:350:qmp_handle_response: Domain 4:message type: return
libxl: debug: libxl_qmp.c:666:qmp_send_prepare: Domain 4:next qmp command: 
'{"execute":"device_del","id":2,"arguments":{"id":"pci-pt-00_0e.0"}}
'
libxl: debug: libxl_qmp.c:350:qmp_handle_response: Domain 4:message type: return
libxl: debug: libxl_qmp.c:813:libxl__qmp_initialize: Domain 4:connected to 
/var/run/xen/qmp-libxl-4
libxl: debug: libxl_qmp.c:350:qmp_handle_response: Domain 4:message type: qmp
libxl: debug: libxl_qmp.c:365:qmp_handle_response: Domain 4:QEMU version: 3.0.0
libxl: debug: libxl_qmp.c:666:qmp_send_prepare: Domain 4:next qmp command: 
'{"execute":"qmp_capabilities","id":1}
'
libxl: debug: libxl_qmp.c:350:qmp_handle_response: Domain 4:message type: return
libxl: debug: libxl_qmp.c:666:qmp_send_prepare: Domain 4:next qmp command: 
'{"execute":"device_del","id":2,"arguments":{"id":"pci-pt-03_00.0"}}
'
libxl: debug: libxl_qmp.c:350:qmp_handle_response: Domain 4:message type: return
libxl: debug: libxl_dm.c:3008:libxl__destroy_device_model: Domain 4:Didn't find 
dm UID; destroying by pid
libxl: debug: libxl_dm.c:2877:kill_device_model: Device Model signaled
libxl: debug: libxl_event.c:639:libxl__ev_xswatch_register: watch 
w=0x7f67bfcadd90 wpath=/local/domain/0/backend/vif/4/0/state token=2/1: 
register slotnum=2
libxl: debug: libxl_domain.c:911:libxl_domain_destroy: Domain 4:ao 
0x7f67c0724f60: inprogress: poller=0x7f67c0e09680, flags=i
libxl: debug: libxl_event.c:576:watchfd_callback: watch w=0x7f67bfcadd90 
wpath=/local/domain/0/backend/vif/4/0/state token=2/1: event 
epath=/local/domain/0/backend/vif/4/0/state
libxl: debug: libxl_event.c:877:devstate_callback: backend 
/local/domain/0/backend/vif/4/0/state wanted state 6 ok
libxl: debug: libxl_event.c:676:libxl__ev_xswatch_deregister: watch 
w=0x7f67bfcadd90 wpath=/local/domain/0/backend/vif/4/0/state token=2/1: 
deregister slotnum=2
libxl: debug: libxl_device.c:1117:device_backend_callback: Domain 4:calling 
device_backend_cleanup
libxl: debug: libxl_event.c:689:libxl__ev_xswatch_deregister: watch 
w=0x7f67bfcadd90: deregister unregistered
libxl: debug: libxl_device.c:1218:device_hotplug: Domain 4:calling hotplug 
script: /etc/xen/scripts/vif-bridge offline
libxl: debug: libxl_device.c:1219:device_hotplug: Domain 4:extra args:
libxl: debug: libxl_device.c:1225:device_hotplug: Domain 4:     type_if=vif
libxl: debug: libxl_device.c:1227:device_hotplug: Domain 4:env:
libxl: debug: libxl_device.c:1234:device_hotplug: Domain 4:     script: 
/etc/xen/scripts/vif-bridge
libxl: debug: libxl_device.c:1234:device_hotplug: Domain 4:     XENBUS_TYPE: vif
libxl: debug: libxl_device.c:1234:device_hotplug: Domain 4:     XENBUS_PATH: 
backend/vif/4/0
libxl: debug: libxl_device.c:1234:device_hotplug: Domain 4:     
XENBUS_BASE_PATH: backend
libxl: debug: libxl_device.c:1234:device_hotplug: Domain 4:     netdev: 
libxl: debug: libxl_device.c:1234:device_hotplug: Domain 4:     INTERFACE: 
vif4.0-emu
libxl: debug: libxl_device.c:1234:device_hotplug: Domain 4:     vif: vif4.0
libxl: debug: libxl_aoutils.c:593:libxl__async_exec_start: forking to execute: 
/etc/xen/scripts/vif-bridge offline 
libxl: debug: libxl_event.c:689:libxl__ev_xswatch_deregister: watch 
w=0x7f67bfcade90: deregister unregistered
libxl: debug: libxl_device.c:1218:device_hotplug: Domain 4:calling hotplug 
script: /etc/xen/scripts/vif-bridge remove
libxl: debug: libxl_device.c:1219:device_hotplug: Domain 4:extra args:
libxl: debug: libxl_device.c:1225:device_hotplug: Domain 4:     type_if=tap
libxl: debug: libxl_device.c:1227:device_hotplug: Domain 4:env:
libxl: debug: libxl_device.c:1234:device_hotplug: Domain 4:     script: 
/etc/xen/scripts/vif-bridge
libxl: debug: libxl_device.c:1234:device_hotplug: Domain 4:     XENBUS_TYPE: vif
libxl: debug: libxl_device.c:1234:device_hotplug: Domain 4:     XENBUS_PATH: 
backend/vif/4/0
libxl: debug: libxl_device.c:1234:device_hotplug: Domain 4:     
XENBUS_BASE_PATH: backend
libxl: debug: libxl_device.c:1234:device_hotplug: Domain 4:     netdev: 
libxl: debug: libxl_device.c:1234:device_hotplug: Domain 4:     INTERFACE: 
vif4.0-emu
libxl: debug: libxl_device.c:1234:device_hotplug: Domain 4:     vif: vif4.0
libxl: debug: libxl_aoutils.c:593:libxl__async_exec_start: forking to execute: 
/etc/xen/scripts/vif-bridge remove 
libxl: debug: libxl_event.c:689:libxl__ev_xswatch_deregister: watch 
w=0x7f67bfcade90: deregister unregistered
libxl: debug: libxl_linux.c:226:libxl__get_hotplug_script_info: Domain 
4:num_exec 2, not running hotplug scripts
libxl: debug: libxl_device.c:1203:device_hotplug: Domain 4:No hotplug script to 
execute
libxl: debug: libxl_event.c:689:libxl__ev_xswatch_deregister: watch 
w=0x7f67bfcade90: deregister unregistered
libxl: debug: libxl_linux.c:235:libxl__get_hotplug_script_info: Domain 
4:backend_kind 3, no need to execute scripts
libxl: debug: libxl_device.c:1203:device_hotplug: Domain 4:No hotplug script to 
execute
libxl: debug: libxl_event.c:689:libxl__ev_xswatch_deregister: watch 
w=0x7f67c0724db0: deregister unregistered
libxl: debug: libxl_linux.c:235:libxl__get_hotplug_script_info: Domain 
4:backend_kind 6, no need to execute scripts
libxl: debug: libxl_device.c:1203:device_hotplug: Domain 4:No hotplug script to 
execute
libxl: debug: libxl_event.c:689:libxl__ev_xswatch_deregister: watch 
w=0x7f67bfcad950: deregister unregistered
libxl: debug: libxl_domain.c:1194:devices_destroy_cb: Domain 4:Forked pid 2217 
for destroy of domain
libxl: debug: libxl_event.c:576:watchfd_callback: watch w=0x7f67c0e09880 
wpath=@releaseDomain token=3/0: event epath=@releaseDomain
libxl: debug: libxl_domain.c:767:domain_death_xswatch_callback: Domain 
4:[evg=0x7f67c0e09a20] nentries=1 rc=1 4..4
libxl: debug: libxl_domain.c:778:domain_death_xswatch_callback: Domain 
4:[evg=0x7f67c0e09a20]   got=domaininfos[0] got->domain=4
libxl: debug: libxl_domain.c:804:domain_death_xswatch_callback: Domain 4:Exists 
shutdown_reported=1 dominf.flags=1010f
libxl: debug: libxl_domain.c:724:domain_death_occurred: Domain 4:dying
libxl: debug: libxl_domain.c:771:domain_death_xswatch_callback: [evg=0] all 
reported
libxl: debug: libxl_domain.c:833:domain_death_xswatch_callback: domain death 
search done
libxl: debug: libxl_event.c:1873:libxl__ao_complete: ao 0x7f67c0724f60: 
complete, rc=0
libxl: debug: libxl_event.c:1842:libxl__ao__destroy: ao 0x7f67c0724f60: destroy
libxl: debug: libxl_event.c:676:libxl__ev_xswatch_deregister: watch 
w=0x7f67c0e09880 wpath=@releaseDomain token=3/0: deregister slotnum=3
Done. Rebooting now
libxl: debug: libxl_create.c:1693:do_domain_create: Domain 0:ao 0x7f67c0927a00: 
create: how=0 callback=0 poller=0x7f67c0e09680
libxl: debug: libxl_device.c:397:libxl__device_disk_set_backend: Disk vdev=xvda 
spec.backend=unknown
libxl: debug: libxl_device.c:360:disk_try_backend: Disk vdev=xvda, backend phy 
unsuitable due to format qcow2
libxl: debug: libxl_device.c:432:libxl__device_disk_set_backend: Disk 
vdev=xvda, using backend qdisk
libxl: debug: libxl_create.c:1018:initiate_domain_create: Domain 5:running 
bootloader
libxl: debug: libxl_bootloader.c:328:libxl__bootloader_run: Domain 5:not a 
PV/PVH domain, skipping bootloader
libxl: debug: libxl_event.c:689:libxl__ev_xswatch_deregister: watch 
w=0x55a956584bb8: deregister unregistered
domainbuilder: detail: xc_dom_allocate: cmdline="", features=""
domainbuilder: detail: xc_dom_kernel_file: 
filename="/usr/lib/xen/boot/hvmloader"
domainbuilder: detail: xc_dom_malloc_filemap    : 179 kB
libxl: debug: libxl_dom.c:988:libxl__load_hvm_firmware_module: Loading BIOS: 
/usr/lib/xen/boot/seabios.bin
domainbuilder: detail: xc_dom_boot_xen_init: ver 4.12, caps xen-3.0-x86_64 
xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64 
domainbuilder: detail: xc_dom_parse_image: called
domainbuilder: detail: xc_dom_find_loader: trying multiboot-binary loader ... 
domainbuilder: detail: loader probe failed
domainbuilder: detail: xc_dom_find_loader: trying HVM-generic loader ... 
domainbuilder: detail: loader probe OK
xc: detail: ELF: phdr: paddr=0x100000 memsz=0x34fc4
xc: detail: ELF: memory: 0x100000 -> 0x134fc4
domainbuilder: detail: xc_dom_mem_init: mem 2040 MB, pages 0x7f800 pages, 4k 
each
domainbuilder: detail: xc_dom_mem_init: 0x7f800 pages
domainbuilder: detail: xc_dom_boot_mem_init: called
domainbuilder: detail: range: start=0x0 end=0x7f800000
domainbuilder: detail: xc_dom_malloc            : 4080 kB
xc: detail: PHYSICAL MEMORY ALLOCATION:
xc: detail:   4KB PAGES: 0x0000000000000200
xc: detail:   2MB PAGES: 0x00000000000003fb
xc: detail:   1GB PAGES: 0x0000000000000000
domainbuilder: detail: xc_dom_build_image: called
domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x100+0x35 
at 0x7f67c0fe0000
domainbuilder: detail: xc_dom_alloc_segment:   kernel       : 0x100000 -> 
0x135000  (pfn 0x100 + 0x35 pages)
xc: detail: ELF: phdr 0 at 0x7f67c0fab000 -> 0x7f67c0fd6540
domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x135+0x40 
at 0x7f67c0fa0000
domainbuilder: detail: xc_dom_alloc_segment:   System Firmware module : 
0x135000 -> 0x175000  (pfn 0x135 + 0x40 pages)
domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x175+0x1 
at 0x7f67c0f9f000
domainbuilder: detail: xc_dom_alloc_segment:   HVM start info : 0x175000 -> 
0x176000  (pfn 0x175 + 0x1 pages)
domainbuilder: detail: alloc_pgtables_hvm: doing nothing
domainbuilder: detail: xc_dom_build_image  : virt_alloc_end : 0x176000
domainbuilder: detail: xc_dom_build_image  : virt_pgtab_end : 0x0
domainbuilder: detail: xc_dom_boot_image: called
domainbuilder: detail: xc_dom_compat_check: supported guest type: xen-3.0-x86_64
domainbuilder: detail: xc_dom_compat_check: supported guest type: 
xen-3.0-x86_32p
domainbuilder: detail: xc_dom_compat_check: supported guest type: 
hvm-3.0-x86_32 <= matches
domainbuilder: detail: xc_dom_compat_check: supported guest type: 
hvm-3.0-x86_32p
domainbuilder: detail: xc_dom_compat_check: supported guest type: hvm-3.0-x86_64
domainbuilder: detail: domain builder memory footprint
domainbuilder: detail:    allocated
domainbuilder: detail:       malloc             : 4085 kB
domainbuilder: detail:       anon mmap          : 0 bytes
domainbuilder: detail:    mapped
domainbuilder: detail:       file mmap          : 179 kB
domainbuilder: detail:       domU mmap          : 472 kB
domainbuilder: detail: vcpu_hvm: called
domainbuilder: detail: xc_dom_set_gnttab_entry: d5 gnt[0] -> d0 0xfefff
domainbuilder: detail: xc_dom_set_gnttab_entry: d5 gnt[1] -> d0 0xfeffc
domainbuilder: detail: xc_dom_release: called
libxl: debug: libxl_device.c:397:libxl__device_disk_set_backend: Disk vdev=xvda 
spec.backend=qdisk
libxl: debug: libxl_linux.c:235:libxl__get_hotplug_script_info: Domain 
5:backend_kind 3, no need to execute scripts
libxl: debug: libxl_device.c:1203:device_hotplug: Domain 5:No hotplug script to 
execute
libxl: debug: libxl_event.c:689:libxl__ev_xswatch_deregister: watch 
w=0x7f67bec66a50: deregister unregistered
libxl: debug: libxl_dm.c:178:libxl__domain_get_device_model_uid: Domain 
5:dm_restrict disabled, starting QEMU as root
libxl: debug: libxl_disk.c:928:libxl__device_disk_find_local_path: Directly 
accessing local QDISK target 
/persist/img/C13945BF7C385D51F4AF24676E502BAA608AA50871FC9A7A4C88FF3DE5FA95B7-197b9eef-281e-4883-a6ed-3878d2cb7548.qcow2
libxl: debug: libxl_dm.c:2602:libxl__spawn_local_dm: Domain 5:Spawning 
device-model /usr/lib/xen/bin/qemu-system-i386 with arguments:
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  
/usr/lib/xen/bin/qemu-system-i386
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  -xen-domid
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  5
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  -chardev
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  
socket,id=libxl-cmd,path=/var/run/xen/qmp-libxl-5,server,nowait
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  -no-shutdown
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  -mon
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  
chardev=libxl-cmd,mode=control
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  -chardev
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  
socket,id=libxenstat-cmd,path=/var/run/xen/qmp-libxenstat-5,server,nowait
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  -mon
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  
chardev=libxenstat-cmd,mode=control
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  -nodefaults
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  -no-user-config
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  -name
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  
test-multi-adapters.1
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  -vnc
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  0.0.0.0:0,to=99
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  -display
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  none
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  -serial
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  pty
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  -device
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  
cirrus-vga,vgamem_mb=8
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  -boot
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  order=dc
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  -usb
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  -usbdevice
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  tablet
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  -smp
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  2,maxcpus=2
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  -device
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  
rtl8139,id=nic0,netdev=net0,mac=00:16:3e:00:01:01
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  -netdev
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  
type=tap,id=net0,ifname=vif5.0-emu,script=no,downscript=no
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  -machine
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  xenfv
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  -m
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  2040
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  -drive
libxl: debug: libxl_dm.c:2604:libxl__spawn_local_dm: Domain 5:  
file=/persist/img/C13945BF7C385D51F4AF24676E502BAA608AA50871FC9A7A4C88FF3DE5FA95B7-197b9eef-281e-4883-a6ed-3878d2cb7548.qcow2,if=ide,index=0,media=disk,format=qcow2,cache=writeback
libxl: debug: libxl_dm.c:2606:libxl__spawn_local_dm: Domain 5:Spawning 
device-model /usr/lib/xen/bin/qemu-system-i386 with additional environment:
libxl: debug: libxl_dm.c:2608:libxl__spawn_local_dm: Domain 5:  
XEN_QEMU_CONSOLE_LIMIT=1048576
libxl: debug: libxl_event.c:639:libxl__ev_xswatch_register: watch 
w=0x55a956584eb0 wpath=/local/domain/0/device-model/5/state token=3/2: register 
slotnum=3
libxl: debug: libxl_create.c:1730:do_domain_create: Domain 0:ao 0x7f67c0927a00: 
inprogress: poller=0x7f67c0e09680, flags=i
libxl: debug: libxl_event.c:576:watchfd_callback: watch w=0x55a956584eb0 
wpath=/local/domain/0/device-model/5/state token=3/2: event 
epath=/local/domain/0/device-model/5/state
libxl: debug: libxl_exec.c:407:spawn_watch_event: domain 5 device model: spawn 
watch p=(null)
libxl: debug: libxl_event.c:576:watchfd_callback: watch w=0x55a956584eb0 
wpath=/local/domain/0/device-model/5/state token=3/2: event 
epath=/local/domain/0/device-model/5/state
libxl: debug: libxl_exec.c:407:spawn_watch_event: domain 5 device model: spawn 
watch p=running
libxl: debug: libxl_event.c:676:libxl__ev_xswatch_deregister: watch 
w=0x55a956584eb0 wpath=/local/domain/0/device-model/5/state token=3/2: 
deregister slotnum=3
libxl: debug: libxl_exec.c:129:libxl_report_child_exitstatus: domain 5 device 
model (dying as expected) [2262] died due to fatal signal Killed
libxl: debug: libxl_event.c:689:libxl__ev_xswatch_deregister: watch 
w=0x55a956584eb0: deregister unregistered
libxl: debug: libxl_qmp.c:2162:libxl__ev_qmp_dispose: Domain 0: ev 
0x55a956584ec8
libxl: debug: libxl_qmp.c:813:libxl__qmp_initialize: Domain 5:connected to 
/var/run/xen/qmp-libxl-5
libxl: debug: libxl_qmp.c:350:qmp_handle_response: Domain 5:message type: qmp
libxl: debug: libxl_qmp.c:365:qmp_handle_response: Domain 5:QEMU version: 3.0.0
libxl: debug: libxl_qmp.c:666:qmp_send_prepare: Domain 5:next qmp command: 
'{"execute":"qmp_capabilities","id":1}
'
libxl: debug: libxl_qmp.c:350:qmp_handle_response: Domain 5:message type: return
libxl: debug: libxl_qmp.c:666:qmp_send_prepare: Domain 5:next qmp command: 
'{"execute":"query-chardev","id":2}
'
libxl: debug: libxl_qmp.c:350:qmp_handle_response: Domain 5:message type: return
libxl: debug: libxl_qmp.c:666:qmp_send_prepare: Domain 5:next qmp command: 
'{"execute":"query-vnc","id":3}
'
libxl: debug: libxl_qmp.c:350:qmp_handle_response: Domain 5:message type: return
libxl: debug: libxl_event.c:639:libxl__ev_xswatch_register: watch 
w=0x7f67bfeb8af0 wpath=/local/domain/0/backend/vif/5/0/state token=3/3: 
register slotnum=3
libxl: debug: libxl_event.c:576:watchfd_callback: watch w=0x7f67bfeb8af0 
wpath=/local/domain/0/backend/vif/5/0/state token=3/3: event 
epath=/local/domain/0/backend/vif/5/0/state
libxl: debug: libxl_event.c:881:devstate_callback: backend 
/local/domain/0/backend/vif/5/0/state wanted state 2 still waiting state 1
libxl: debug: libxl_event.c:576:watchfd_callback: watch w=0x7f67bfeb8af0 
wpath=/local/domain/0/backend/vif/5/0/state token=3/3: event 
epath=/local/domain/0/backend/vif/5/0/state
libxl: debug: libxl_event.c:877:devstate_callback: backend 
/local/domain/0/backend/vif/5/0/state wanted state 2 ok
libxl: debug: libxl_event.c:676:libxl__ev_xswatch_deregister: watch 
w=0x7f67bfeb8af0 wpath=/local/domain/0/backend/vif/5/0/state token=3/3: 
deregister slotnum=3
libxl: debug: libxl_device.c:1117:device_backend_callback: Domain 5:calling 
device_backend_cleanup
libxl: debug: libxl_event.c:689:libxl__ev_xswatch_deregister: watch 
w=0x7f67bfeb8af0: deregister unregistered
libxl: debug: libxl_device.c:1218:device_hotplug: Domain 5:calling hotplug 
script: /etc/xen/scripts/vif-bridge online
libxl: debug: libxl_device.c:1219:device_hotplug: Domain 5:extra args:
libxl: debug: libxl_device.c:1225:device_hotplug: Domain 5:     type_if=vif
libxl: debug: libxl_device.c:1227:device_hotplug: Domain 5:env:
libxl: debug: libxl_device.c:1234:device_hotplug: Domain 5:     script: 
/etc/xen/scripts/vif-bridge
libxl: debug: libxl_device.c:1234:device_hotplug: Domain 5:     XENBUS_TYPE: vif
libxl: debug: libxl_device.c:1234:device_hotplug: Domain 5:     XENBUS_PATH: 
backend/vif/5/0
libxl: debug: libxl_device.c:1234:device_hotplug: Domain 5:     
XENBUS_BASE_PATH: backend
libxl: debug: libxl_device.c:1234:device_hotplug: Domain 5:     netdev: 
libxl: debug: libxl_device.c:1234:device_hotplug: Domain 5:     INTERFACE: 
vif5.0-emu
libxl: debug: libxl_device.c:1234:device_hotplug: Domain 5:     vif: vif5.0
libxl: debug: libxl_aoutils.c:593:libxl__async_exec_start: forking to execute: 
/etc/xen/scripts/vif-bridge online 
libxl: debug: libxl_event.c:689:libxl__ev_xswatch_deregister: watch 
w=0x7f67bfeb8bf0: deregister unregistered
libxl: debug: libxl_device.c:1218:device_hotplug: Domain 5:calling hotplug 
script: /etc/xen/scripts/vif-bridge add
libxl: debug: libxl_device.c:1219:device_hotplug: Domain 5:extra args:
libxl: debug: libxl_device.c:1225:device_hotplug: Domain 5:     type_if=tap
libxl: debug: libxl_device.c:1227:device_hotplug: Domain 5:env:
libxl: debug: libxl_device.c:1234:device_hotplug: Domain 5:     script: 
/etc/xen/scripts/vif-bridge
libxl: debug: libxl_device.c:1234:device_hotplug: Domain 5:     XENBUS_TYPE: vif
libxl: debug: libxl_device.c:1234:device_hotplug: Domain 5:     XENBUS_PATH: 
backend/vif/5/0
libxl: debug: libxl_device.c:1234:device_hotplug: Domain 5:     
XENBUS_BASE_PATH: backend
libxl: debug: libxl_device.c:1234:device_hotplug: Domain 5:     netdev: 
libxl: debug: libxl_device.c:1234:device_hotplug: Domain 5:     INTERFACE: 
vif5.0-emu
libxl: debug: libxl_device.c:1234:device_hotplug: Domain 5:     vif: vif5.0
libxl: debug: libxl_aoutils.c:593:libxl__async_exec_start: forking to execute: 
/etc/xen/scripts/vif-bridge add 
libxl: debug: libxl_event.c:689:libxl__ev_xswatch_deregister: watch 
w=0x7f67bfeb8bf0: deregister unregistered
libxl: debug: libxl_linux.c:226:libxl__get_hotplug_script_info: Domain 
5:num_exec 2, not running hotplug scripts
libxl: debug: libxl_device.c:1203:device_hotplug: Domain 5:No hotplug script to 
execute
libxl: debug: libxl_event.c:689:libxl__ev_xswatch_deregister: watch 
w=0x7f67bfeb8bf0: deregister unregistered
libxl: debug: libxl_qmp.c:813:libxl__qmp_initialize: Domain 5:connected to 
/var/run/xen/qmp-libxl-5
libxl: debug: libxl_qmp.c:350:qmp_handle_response: Domain 5:message type: qmp
libxl: debug: libxl_qmp.c:365:qmp_handle_response: Domain 5:QEMU version: 3.0.0
libxl: debug: libxl_qmp.c:666:qmp_send_prepare: Domain 5:next qmp command: 
'{"execute":"qmp_capabilities","id":1}
'
libxl: debug: libxl_qmp.c:350:qmp_handle_response: Domain 5:message type: return
libxl: debug: libxl_qmp.c:666:qmp_send_prepare: Domain 5:next qmp command: 
'{"execute":"device_add","id":2,"arguments":{"driver":"xen-pci-passthrough","id":"pci-pt-00_0e.0","hostaddr":"0000:00:0e.0"}}
'
libxl: debug: libxl_qmp.c:350:qmp_handle_response: Domain 5:message type: return
libxl: debug: libxl_qmp.c:666:qmp_send_prepare: Domain 5:next qmp command: 
'{"execute":"query-pci","id":3}
'
libxl: debug: libxl_qmp.c:350:qmp_handle_response: Domain 5:message type: return
libxl: debug: libxl_pci.c:89:libxl__create_pci_backend: Domain 5:Creating pci 
backend
libxl: debug: libxl_event.c:2190:libxl__ao_progress_report: ao 0x7f67c0927a00: 
progress report: ignored
libxl: debug: libxl_event.c:1873:libxl__ao_complete: ao 0x7f67c0927a00: 
complete, rc=0
libxl: debug: libxl_event.c:1842:libxl__ao__destroy: ao 0x7f67c0927a00: destroy
libxl: debug: libxl_qmp.c:813:libxl__qmp_initialize: Domain 5:connected to 
/var/run/xen/qmp-libxl-5
libxl: debug: libxl_qmp.c:350:qmp_handle_response: Domain 5:message type: qmp
libxl: debug: libxl_qmp.c:365:qmp_handle_response: Domain 5:QEMU version: 3.0.0
libxl: debug: libxl_qmp.c:666:qmp_send_prepare: Domain 5:next qmp command: 
'{"execute":"qmp_capabilities","id":1}
'
libxl: debug: libxl_qmp.c:350:qmp_handle_response: Domain 5:message type: return
libxl: debug: libxl_qmp.c:666:qmp_send_prepare: Domain 5:next qmp command: 
'{"execute":"cont","id":2}
'
libxl: debug: libxl_qmp.c:350:qmp_handle_response: Domain 5:message type: return
Waiting for domain test-multi-adapters.1 (domid 5) to die [pid 1536]
libxl: debug: libxl_event.c:639:libxl__ev_xswatch_register: watch 
w=0x7f67c0e09880 wpath=@releaseDomain token=3/4: register slotnum=3
libxl: debug: libxl_event.c:576:watchfd_callback: watch w=0x7f67c0e09880 
wpath=@releaseDomain token=3/4: event epath=@releaseDomain
libxl: debug: libxl_domain.c:767:domain_death_xswatch_callback: Domain 
5:[evg=0x7f67c0317fc0] nentries=1 rc=1 5..5
libxl: debug: libxl_domain.c:778:domain_death_xswatch_callback: Domain 
5:[evg=0x7f67c0317fc0]   got=domaininfos[0] got->domain=5
libxl: debug: libxl_domain.c:804:domain_death_xswatch_callback: Domain 5:Exists 
shutdown_reported=0 dominf.flags=ffff0102
libxl: debug: libxl_domain.c:771:domain_death_xswatch_callback: [evg=0] all 
reported
libxl: debug: libxl_domain.c:833:domain_death_xswatch_callback: domain death 
search done
/tmp # 
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

Reply via email to