Re: [CentOS-virt] Centos 6 2.6.32-696.18.7.el6.x86_64 does not boot in Xen PV mode
On 01/17/2018 05:00 AM, Dan wrote: > Is this now fixed in the latest release by updating the hypervisor, the > same as CentOS 7? Or does this require something further? > > I came across https://access.redhat.com/solutions/3312501 which seems to > suggest Redhat are working on resolving the issue, so if that's the case > then maybe the solution implemented by CentOS is not the best option? > You basically have a couple choices: 1. Do not use a PV DomU. The kernel in question boots fine in HVM mode or PVHVM mode. 2. Do not use the new kernel (don't update). Wait for Red Hat to release the updated kernel source patches and CentOS will pick them up. You can update after that. 3. Upgrade the kernel to the latest 4.9.x kernel that is in the xen repo for Dom0's .. it will also run on the quest in PV mode. 4. I think the elrepo centos-6 ml kernel will boot on xen PV as well. Thanks, Johnny Hughes signature.asc Description: OpenPGP digital signature ___ CentOS-virt mailing list CentOS-virt@centos.org https://lists.centos.org/mailman/listinfo/centos-virt
[CentOS-virt] Centos 6 2.6.32-696.18.7.el6.x86_64 does not boot in Xen PV mode
Is this now fixed in the latest release by updating the hypervisor, the same as CentOS 7? Or does this require something further? I came across https://access.redhat.com/solutions/3312501 which seems to suggest Redhat are working on resolving the issue, so if that's the case then maybe the solution implemented by CentOS is not the best option? Kind Regards, Dan ___ CentOS-virt mailing list CentOS-virt@centos.org https://lists.centos.org/mailman/listinfo/centos-virt
Re: [CentOS-virt] Centos 6 2.6.32-696.18.7.el6.x86_64 does not boot in Xen PV mode
On 01/05/2018 05:26 PM, Shaun Reitan wrote: > I can confirm the issue with 2.6.32-696.18.7.el6.x86_64, but mine looks > alittle different... Maybe because i'm using pvgrub. > > = Init TPM Front > Tpmfront:Error Unable to read device/vtpm/0/backend-id during tpmfront > initialization! error = ENOENT > Tpmfront:Info Shutting down tpmfront > close blk: backend=/local/domain/0/backend/vbd/14/51712 node=device/vbd/51712 > close blk: backend=/local/domain/0/backend/vbd/14/51728 node=device/vbd/51728 > [root@devhost1]# > > -- > Shaun Reitan > NDCHost.com You need to add earlyprintk=xen. ___ CentOS-virt mailing list CentOS-virt@centos.org https://lists.centos.org/mailman/listinfo/centos-virt
Re: [CentOS-virt] Centos 6 2.6.32-696.18.7.el6.x86_64 does not boot in Xen PV mode
I can confirm the issue with 2.6.32-696.18.7.el6.x86_64, but mine looks alittle different... Maybe because i'm using pvgrub. = Init TPM Front Tpmfront:Error Unable to read device/vtpm/0/backend-id during tpmfront initialization! error = ENOENT Tpmfront:Info Shutting down tpmfront close blk: backend=/local/domain/0/backend/vbd/14/51712 node=device/vbd/51712 close blk: backend=/local/domain/0/backend/vbd/14/51728 node=device/vbd/51728 [root@devhost1]# -- Shaun Reitan NDCHost.com -- Original Message -- From: "Sarah Newman" To: "Discussion about the virtualization on CentOS" Sent: 2018-01-05 12:39:21 AM Subject: [CentOS-virt] Centos 6 2.6.32-696.18.7.el6.x86_64 does not boot in Xen PV mode Problems start before any of the kaiser code executes, though it could still be related to CONFIG_KAISER since that has effects beyond kaiser.c. --- (early) Initializing cgroup subsys cpuset (early) Initializing cgroup subsys cpu (early) Linux version 2.6.32-696.18.7.el6.x86_64 (mockbu...@c1bl.rdu2.centos.org) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-18) (GCC) ) #1 SMP Thu Jan 4 17:31:22 UTC 2018 (early) Command line: ro console=hvc0 rootflags=barrier=0 crashkernel=auto SYSFONT=latarcyrheb-sun16 LANG=en_US.UTF-8 KEYTABLE=us earlyprintk=xen (early) KERNEL supported cpus: (early) Intel GenuineIntel (early) AMD AuthenticAMD (early) Centaur CentaurHauls (early) 1 multicall(s) failed: cpu 0 (early) Pid: 0, comm: swapper Not tainted 2.6.32-696.18.7.el6.x86_64 #1 (early) Call Trace: (early) [] ? xen_mc_flush+0x1c3/0x250 (early) [] ? xen_extend_mmu_update+0xde/0x1b0 (early) [] ? xen_set_pmd_hyper+0x9d/0xc0 (early) [] ? early_ioremap_init+0x98/0x133 (early) [] ? setup_arch+0x40/0xca6 (early) [] ? vprintk_default+0xe/0x10 (early) [] ? printk+0x4f/0x52 (early) [] ? start_kernel+0xdc/0x43b (early) [] ? reserve_early+0x30/0x39 (early) [] ? x86_64_start_reservations+0x125/0x129 (early) [] ? xen_start_kernel+0x4fe/0x505 (early) [ cut here ] (early) WARNING: at arch/x86/xen/multicalls.c:182 xen_mc_flush+0x21f/0x250() (Not tainted) (early) Modules linked in: (early) Pid: 0, comm: swapper Not tainted 2.6.32-696.18.7.el6.x86_64 #1 (early) Call Trace: (early) [] ? warn_slowpath_common+0x91/0xe0 (early) [] ? __raw_callee_save_xen_restore_fl+0x11/0x1e (early) [] ? warn_slowpath_null+0x1a/0x20 (early) [] ? xen_mc_flush+0x21f/0x250 (early) [] ? xen_extend_mmu_update+0xde/0x1b0 (early) [] ? xen_extend_mmu_update+0xde/0x1b0 (early) [] ? xen_set_pmd_hyper+0x9d/0xc0 (early) [] ? early_ioremap_init+0x98/0x133 (early) [] ? setup_arch+0x40/0xca6 (early) [] ? vprintk_default+0xe/0x10 (early) [] ? printk+0x4f/0x52 (early) [] ? start_kernel+0xdc/0x43b (early) [] ? reserve_early+0x30/0x39 (early) [] ? x86_64_start_reservations+0x125/0x129 (early) [] ? xen_start_kernel+0x4fe/0x505 (early) ---[ end trace a7919e7f17c0a725 ]--- (early) ACPI in unprivileged domain disabled (early) released 0 pages of unused memory (early) BIOS-provided physical RAM map: (early) Xen: - 000a (usable) (early) Xen: 000a - 0010 (reserved) (early) Xen: 0010 - 2000 (usable) (early) bootconsole [xenboot0] enabled ___ CentOS-virt mailing list CentOS-virt@centos.org https://lists.centos.org/mailman/listinfo/centos-virt ___ CentOS-virt mailing list CentOS-virt@centos.org https://lists.centos.org/mailman/listinfo/centos-virt
Re: [CentOS-virt] Centos 6 2.6.32-696.18.7.el6.x86_64 does not boot in Xen PV mode
Forgot to post my domU config (xm/xend format):
import os, re
arch = os.uname()[4]
if re.search('64', arch):
arch_libdir = 'lib64'
else:
arch_libdir = 'lib'
name = 'domU'
bootloader = '/usr/bin/pygrub'
extra = '(hd0,0)/grub/menu.lst'
maxmem = 4096
memory = 1024
vcpus=2
vif = [ 'mac=00:16:3E:AA:BB:CC, bridge=brXXX, vifname=domU.0',
'mac=AA:00:00:AA:BB:CC, bridge=brYYY, vifname=domU.1' ]
disk = [ 'tap2:aio:/dev/VolGroup/Volume,xvda,w',
'tap2:aio:/dev/VolGroup/Volume-b,xvdb,w' ]
on_poweroff = 'destroy'
on_reboot = 'destroy'
on_crash= 'preserve'
device_model = '/usr/' + arch_libdir + '/xen/bin/qemu-dm'
boot='cd'
vfb = [ 'type=vnc, vnclisten=0.0.0.0, vncpasswd=RR, vncdisplay=NN' ]
nographic=0
stdvga=0
serial='pty'
monitor=0
localtime=0
usb=1
usbdevice='tablet'
El Viernes 05/01/2018 a las 18:05, Ricardo J. Barberis escribió:
> A CentOS 6.9 domU with kernel 2.6.32-696.18.7.el6.x86_64 also fails to boot
> on a CentOS 6.9 dom0 with kernel 4.9.63-29.el6.x86_64 and xen
> 4.4.4-34.el6.x86_64
>
> Xen logs lines like these (among others):
>
> /var/log/xen/xend.log:[2018-01-05 17:55:45 2357] WARNING (XendDomainInfo:583)
> Could not unpause blktap disk: ('unpause', '-p11520', '-m4') failed (5632 )
>
> /var/log/messages:Jan 5 17:55:45 xvm16n00 tapdisk[11520]:
> tap-err:tapdisk_vbd_resume: resume request for unpaused vbd
> aio:/dev/VolGroup/Volume
>
>
> Xenctx for vCPU 0 says:
>
> [root@dom0 ~] # /usr/lib64/xen/bin/xenctx -s
> System.map-2.6.32-696.18.7.el6.x86_64 13 0 rip: 812b7872
> __memcpy_fromio+0x12
> flags: 1202 i nz
> rsp: 81a03e00
> rax: rcx: 0004 rdx: 0010
> rbx: ff40 rsi: ff40 rdi: 81a03e68
> rbp: 81a03e48r8: r9: 7ff0
> r10: r11: r12: 81a03e58
> r13: ff40 r14: ff41 r15: 81a03e68
> cs: e033ss: e02bds: es:
> fs: @
> gs: @ 81c25000/
> Code (instr addr 812b7872)
> 00 00 00 55 48 89 e5 e8 57 e8 29 00 89 d2 48 89 d1 48 c1 e9 02 a5 f6
> c2 02 74 02 66 a5 f6 c2
>
> Stack:
> 0004 812b7872
> 0001e030 00010002 81a03e48 e02b
> 812b7869 81a03eb8 81c80153
> 81a03e98 81c872a0
>
> Call Trace:
> [] __memcpy_fromio+0x12 <--
> [] __memcpy_fromio+0x12
> [] __memcpy_fromio+0x9
> [] dmi_scan_machine+0x139
> [] setup_arch+0x424
> [] vprintk_default+0xe
> [] printk+0x4f
> [] start_kernel+0xdc
> [] x86_64_start_reservations+0x125
> [] xen_start_kernel+0x4fe
>
>
> And my domU has similar boot messages as Sarah Newman's:
>
> (early) Initializing cgroup subsys cpuset
> (early) Initializing cgroup subsys cpu
> (early) Linux version 2.6.32-696.18.7.el6.x86_64
> (mockbu...@c1bl.rdu2.centos.org) (gcc version 4.4.7 20120313 (Red Hat
> 4.4.7-18) (GCC) ) #1 SMP Thu Jan 4 17:31:22 UTC 2018
> (early) Command line: ro root=/dev/xvda3 rd_NO_LUKS rd_NO_LVM rd_NO_MD
> SYSFONT=latarcyrheb-sun16 crashkernel=auto LANG=en_US.UTF-8 KEYBOARDTYPE=pc
> KEYTABLE=us rd_NO_DM
earlyprintk=xen (hd0,0)/grub/menu.lst
> (early) KERNEL supported cpus:
> (early) Intel GenuineIntel
> (early) AMD AuthenticAMD
> (early) Centaur CentaurHauls
> (early) 1 multicall(s) failed: cpu 0
> (early) Pid: 0, comm: swapper Not tainted 2.6.32-696.18.7.el6.x86_64 #1
> (early) Call Trace:
> (early) [] ? xen_mc_flush+0x1c3/0x250
> (early) [] ? xen_extend_mmu_update+0xde/0x1b0
> (early) [] ? xen_set_pmd_hyper+0x9d/0xc0
> (early) [] ? early_ioremap_init+0x98/0x133
> (early) [] ? setup_arch+0x40/0xca6
> (early) [] ? vprintk_default+0xe/0x10
> (early) [] ? printk+0x4f/0x52
> (early) [] ? start_kernel+0xdc/0x43b
> (early) [] ? reserve_early+0x30/0x39
> (early) [] ? x86_64_start_reservations+0x125/0x129
> (early) [] ? xen_start_kernel+0x4fe/0x505
> (early) [ cut here ]
> (early) WARNING: at arch/x86/xen/multicalls.c:182 xen_mc_flush+0x21f/0x250()
> (Not tainted)
> (early) Modules linked in:
> (early) Pid: 0, comm: swapper Not tainted 2.6.32-696.18.7.el6.x86_64 #1
> (early) Call Trace:
> (early) [] ? warn_slowpath_common+0x91/0xe0
> (early) [] ? __raw_callee_save_xen_restore_fl+0x11/0x1e
> (early) [] ? warn_slowpath_null+0x1a/0x20
> (early) [] ? xen_mc_flush+0x21f/0x250
> (early) [] ? xen_extend_mmu_update+0xde/0x1b0
> (early) [] ? xen_extend_mmu_update+0xde/0x1b0
> (early) [] ? xen_set_pmd_hyper+0x9d/0xc0
> (early) [] ? early_ioremap_init+0x98/0x133
> (early) [] ? setup_arch+0x40/0xca6
> (early) [] ? vprintk_default+0xe/0x10
> (early) [] ? printk+0x4f/0x52
> (early) [] ? start_kernel+0xdc/0x43b
> (early) [] ? reserve_early+0x30/0x39
> (early) [] ? x86_64_start_reservations+0x125/0x129
Re: [CentOS-virt] Centos 6 2.6.32-696.18.7.el6.x86_64 does not boot in Xen PV mode
A CentOS 6.9 domU with kernel 2.6.32-696.18.7.el6.x86_64 also fails to boot on
a CentOS 6.9 dom0 with kernel 4.9.63-29.el6.x86_64 and xen 4.4.4-34.el6.x86_64
Xen logs lines like these (among others):
/var/log/xen/xend.log:[2018-01-05 17:55:45 2357] WARNING (XendDomainInfo:583)
Could not unpause blktap disk: ('unpause', '-p11520', '-m4') failed (5632 )
/var/log/messages:Jan 5 17:55:45 xvm16n00 tapdisk[11520]:
tap-err:tapdisk_vbd_resume: resume request for unpaused vbd
aio:/dev/VolGroup/Volume
Xenctx for vCPU 0 says:
[root@dom0 ~] # /usr/lib64/xen/bin/xenctx -s
System.map-2.6.32-696.18.7.el6.x86_64 13 0
rip: 812b7872 __memcpy_fromio+0x12
flags: 1202 i nz
rsp: 81a03e00
rax: rcx: 0004 rdx: 0010
rbx: ff40 rsi: ff40 rdi: 81a03e68
rbp: 81a03e48r8: r9: 7ff0
r10: r11: r12: 81a03e58
r13: ff40 r14: ff41 r15: 81a03e68
cs: e033ss: e02bds: es:
fs: @
gs: @ 81c25000/
Code (instr addr 812b7872)
00 00 00 55 48 89 e5 e8 57 e8 29 00 89 d2 48 89 d1 48 c1 e9 02 a5 f6 c2 02
74 02 66 a5 f6 c2
Stack:
0004 812b7872
0001e030 00010002 81a03e48 e02b
812b7869 81a03eb8 81c80153
81a03e98 81c872a0
Call Trace:
[] __memcpy_fromio+0x12 <--
[] __memcpy_fromio+0x12
[] __memcpy_fromio+0x9
[] dmi_scan_machine+0x139
[] setup_arch+0x424
[] vprintk_default+0xe
[] printk+0x4f
[] start_kernel+0xdc
[] x86_64_start_reservations+0x125
[] xen_start_kernel+0x4fe
And my domU has similar boot messages as Sarah Newman's:
(early) Initializing cgroup subsys cpuset
(early) Initializing cgroup subsys cpu
(early) Linux version 2.6.32-696.18.7.el6.x86_64
(mockbu...@c1bl.rdu2.centos.org) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-18)
(GCC) ) #1 SMP Thu Jan 4 17:31:22 UTC 2018
(early) Command line: ro root=/dev/xvda3 rd_NO_LUKS rd_NO_LVM rd_NO_MD
SYSFONT=latarcyrheb-sun16 crashkernel=auto LANG=en_US.UTF-8 KEYBOARDTYPE=pc
KEYTABLE=us rd_NO_DM
earlyprintk=xen (hd0,0)/grub/menu.lst
(early) KERNEL supported cpus:
(early) Intel GenuineIntel
(early) AMD AuthenticAMD
(early) Centaur CentaurHauls
(early) 1 multicall(s) failed: cpu 0
(early) Pid: 0, comm: swapper Not tainted 2.6.32-696.18.7.el6.x86_64 #1
(early) Call Trace:
(early) [] ? xen_mc_flush+0x1c3/0x250
(early) [] ? xen_extend_mmu_update+0xde/0x1b0
(early) [] ? xen_set_pmd_hyper+0x9d/0xc0
(early) [] ? early_ioremap_init+0x98/0x133
(early) [] ? setup_arch+0x40/0xca6
(early) [] ? vprintk_default+0xe/0x10
(early) [] ? printk+0x4f/0x52
(early) [] ? start_kernel+0xdc/0x43b
(early) [] ? reserve_early+0x30/0x39
(early) [] ? x86_64_start_reservations+0x125/0x129
(early) [] ? xen_start_kernel+0x4fe/0x505
(early) [ cut here ]
(early) WARNING: at arch/x86/xen/multicalls.c:182 xen_mc_flush+0x21f/0x250()
(Not tainted)
(early) Modules linked in:
(early) Pid: 0, comm: swapper Not tainted 2.6.32-696.18.7.el6.x86_64 #1
(early) Call Trace:
(early) [] ? warn_slowpath_common+0x91/0xe0
(early) [] ? __raw_callee_save_xen_restore_fl+0x11/0x1e
(early) [] ? warn_slowpath_null+0x1a/0x20
(early) [] ? xen_mc_flush+0x21f/0x250
(early) [] ? xen_extend_mmu_update+0xde/0x1b0
(early) [] ? xen_extend_mmu_update+0xde/0x1b0
(early) [] ? xen_set_pmd_hyper+0x9d/0xc0
(early) [] ? early_ioremap_init+0x98/0x133
(early) [] ? setup_arch+0x40/0xca6
(early) [] ? vprintk_default+0xe/0x10
(early) [] ? printk+0x4f/0x52
(early) [] ? start_kernel+0xdc/0x43b
(early) [] ? reserve_early+0x30/0x39
(early) [] ? x86_64_start_reservations+0x125/0x129
(early) [] ? xen_start_kernel+0x4fe/0x505
(early) ---[ end trace a7919e7f17c0a725 ]---
(early) ACPI in unprivileged domain disabled
(early) released 0 pages of unused memory
(early) BIOS-provided physical RAM map:
(early) Xen: - 000a (usable)
(early) Xen: 000a - 0010 (reserved)
(early) Xen: 0010 - 0001 (usable)
(early) bootconsole [xenboot0] enabled
El Viernes 05/01/2018 a las 05:39, Sarah Newman escribió:
> Problems start before any of the kaiser code executes, though it could
> still be related to CONFIG_KAISER since that has effects beyond kaiser.c.
>
> ---
> (early) Initializing cgroup subsys cpuset
> (early) Initializing cgroup subsys cpu
> (early) Linux version 2.6.32-696.18.7.el6.x86_64
> (mockbu...@c1bl.rdu2.centos.org) (gcc version 4.4.7 20120313 (Red Hat
> 4.4.7-18) (GCC) ) #1 SMP Thu Jan 4 17:31:22 UTC 2018
> (early) Command line: ro console=hvc0 rootflags=barrier=0 crashkernel=auto
> SYSFONT=latarcyrheb-sun16 LANG=en_US.UTF
[CentOS-virt] Centos 6 2.6.32-696.18.7.el6.x86_64 does not boot in Xen PV mode
Problems start before any of the kaiser code executes, though it could still be related to CONFIG_KAISER since that has effects beyond kaiser.c. --- (early) Initializing cgroup subsys cpuset (early) Initializing cgroup subsys cpu (early) Linux version 2.6.32-696.18.7.el6.x86_64 (mockbu...@c1bl.rdu2.centos.org) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-18) (GCC) ) #1 SMP Thu Jan 4 17:31:22 UTC 2018 (early) Command line: ro console=hvc0 rootflags=barrier=0 crashkernel=auto SYSFONT=latarcyrheb-sun16 LANG=en_US.UTF-8 KEYTABLE=us earlyprintk=xen (early) KERNEL supported cpus: (early) Intel GenuineIntel (early) AMD AuthenticAMD (early) Centaur CentaurHauls (early) 1 multicall(s) failed: cpu 0 (early) Pid: 0, comm: swapper Not tainted 2.6.32-696.18.7.el6.x86_64 #1 (early) Call Trace: (early) [] ? xen_mc_flush+0x1c3/0x250 (early) [] ? xen_extend_mmu_update+0xde/0x1b0 (early) [] ? xen_set_pmd_hyper+0x9d/0xc0 (early) [] ? early_ioremap_init+0x98/0x133 (early) [] ? setup_arch+0x40/0xca6 (early) [] ? vprintk_default+0xe/0x10 (early) [] ? printk+0x4f/0x52 (early) [] ? start_kernel+0xdc/0x43b (early) [] ? reserve_early+0x30/0x39 (early) [] ? x86_64_start_reservations+0x125/0x129 (early) [] ? xen_start_kernel+0x4fe/0x505 (early) [ cut here ] (early) WARNING: at arch/x86/xen/multicalls.c:182 xen_mc_flush+0x21f/0x250() (Not tainted) (early) Modules linked in: (early) Pid: 0, comm: swapper Not tainted 2.6.32-696.18.7.el6.x86_64 #1 (early) Call Trace: (early) [] ? warn_slowpath_common+0x91/0xe0 (early) [] ? __raw_callee_save_xen_restore_fl+0x11/0x1e (early) [] ? warn_slowpath_null+0x1a/0x20 (early) [] ? xen_mc_flush+0x21f/0x250 (early) [] ? xen_extend_mmu_update+0xde/0x1b0 (early) [] ? xen_extend_mmu_update+0xde/0x1b0 (early) [] ? xen_set_pmd_hyper+0x9d/0xc0 (early) [] ? early_ioremap_init+0x98/0x133 (early) [] ? setup_arch+0x40/0xca6 (early) [] ? vprintk_default+0xe/0x10 (early) [] ? printk+0x4f/0x52 (early) [] ? start_kernel+0xdc/0x43b (early) [] ? reserve_early+0x30/0x39 (early) [] ? x86_64_start_reservations+0x125/0x129 (early) [] ? xen_start_kernel+0x4fe/0x505 (early) ---[ end trace a7919e7f17c0a725 ]--- (early) ACPI in unprivileged domain disabled (early) released 0 pages of unused memory (early) BIOS-provided physical RAM map: (early) Xen: - 000a (usable) (early) Xen: 000a - 0010 (reserved) (early) Xen: 0010 - 2000 (usable) (early) bootconsole [xenboot0] enabled ___ CentOS-virt mailing list CentOS-virt@centos.org https://lists.centos.org/mailman/listinfo/centos-virt
