Re: [Xen-devel] [Xen-users] pvgrub: Error 9: Unknown boot failure

2016-12-07 Thread Sven Köhler
Am 07.12.2016 um 17:38 schrieb Samuel Thibault:
> Hello,
> 
> Jan Beulich, on Wed 07 Dec 2016 09:28:52 -0700, wrote:
>>> Right. Jan, could you please include the patch for 4.7.2? Upstream
>>> commit was 9714f6b87e19b32d3a6663a20df6610265c4bfe5.
>>
>> Samuel, could you confirm that this is okay to backport.
> 
> For 4.7, yes.
> 
>> In which case the question then is whether 4.6.5 should get it too -
>> with p2m_seg mentioned no-where else under stubdom/ I can't really
>> tell where this is coming from.
> 
> For 4.6, I don't think so:
> 
> Commit abdf3c5b2b971dc12e665e8e0cda184b416efffe ('libxc: create p2m list
> outside of kernel mapping if supported') introduced that new case, and
> it's not in 4.6.

For me, the problems started with 4.7.0. Prior to that, the domUs were
booting fine. So I can confirm that 4.6.x was not affected.

___
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel


Re: [Xen-devel] [Xen-users] pvgrub: Error 9: Unknown boot failure

2016-12-07 Thread Sven Köhler
Am 07.12.2016 um 17:33 schrieb Jan Beulich:
>>>> On 07.12.16 at 17:10, <sven.koeh...@gmail.com> wrote:
>> Am 28.09.2016 um 05:50 schrieb Juergen Gross:
>>> On 28/09/16 01:33, Sven Köhler wrote:
>>>> Am 27.09.2016 um 14:52 schrieb Juergen Gross:
>>>>> On 27/09/16 14:09, Sven Köhler wrote:
>>>>>> Am 27.09.2016 um 14:02 schrieb Juergen Gross:
>>>>>>> On 27/09/16 13:13, Sven Köhler wrote:
>>>>>>>> Am 27.09.2016 um 07:31 schrieb Juergen Gross:
>>>>>>>>> On 27/09/16 00:48, Sven Köhler wrote:
>>>>>>>>>> Am 26.09.2016 um 07:43 schrieb Juergen Gross:
>>>>>>>>>>> On 25/09/16 18:04, Sven Köhler wrote:
>>>>>>>>>>>> Hi,
>>>>>>>>>>>>
>>>>>>>>>>>> I'm experiencing the bug below which was discussed on xen-devel 
>>>>>>>>>>>> December
>>>>>>>>>>>> last year buy Ian and Juergen. I'm using xen-pvgrub-4.7.0 on 
>>>>>>>>>>>> Gentoo.
>>>>>>>>>>>>
>>>>>>>>>>>> The bug only seems to occur with the last domU booted on my 
>>>>>>>>>>>> machine.
>>>>>>>>>>>> Where do I find a patch that fixes that?
>>>>>>>>>>>
>>>>>>>>>>> The issue back in December was fixed by commit
>>>>>>>>>>> c8eb0ec277ae387e78d685523e0fee633e46f046 which is included in Xen 
>>>>>>>>>>> 4.7.
>>>>>>>>>>> Either gentoo didn't update to the official Xen 4.7 release 
>>>>>>>>>>> (including
>>>>>>>>>>> pvgrub) or you are seeing a new issue.
>>>>>>>>>>
>>>>>>>>>> From the looks of it, the Gentoo package is using the grub from the
>>>>>>>>>> xen-4.7.0 tarball.
>>>>>>>>>>
>>>>>>>>>> I downgraded to pvgrub 4.6.3 and the problem went away.
>>>>>>>>>>
>>>>>>>>>> So I assume I'm seeing a new issue. How do I debug it?
>>>>>>>>>
>>>>>>>>> Interesting. Just tested it on upstream Xen and saw the same problem
>>>>>>>>> with a rather old guest kernel (3.0 based, xen flavor), while a newer
>>>>>>>>> kernel (4.1, pvops) is working.
>>>>>>>>>
>>>>>>>>> Can you give me some more details about the kernel you are trying to
>>>>>>>>> boot?
>>>>>>>>
>>>>>>>> It's an unmodified 4.4.21 kernel which I compile by hand. The config is
>>>>>>>> attached. Does that help?
>>>>>>>
>>>>>>> Not really. OTOH I think I don't need more help, as I've found a problem
>>>>>>> in pvgrub. I have a patch which seems to correct the issue. Are you fine
>>>>>>> with me adding you as the original reporter of the problem in the patch?
>>>>>>
>>>>>> Yes, I'm fine with adding me as the reporter.
>>>>>> Do you want me to test the patch first?
>>>>>
>>>>> Sure. The attached patch is for Xen upstream, but I think it should
>>>>> apply to Xen 4.7, too.
>>>>
>>>> This patch solved the issue for me. My domU boots fine again after
>>>> recompiling pvgrub with the patch applied.
>>>>
>>>> Thanks!
>>>
>>> Thank you for the test!
>>
>> It seems this patch was not included in 4.7.1. That's a shame, cause I
>> ran into the same issue after upgrading to 4.7.1.
> 
> I don't think anyone requested its inclusion - that process is in no
> way automatic.

I reported the error for 4.7.0, and I thought that Juergen might have
suggested it for inclusion. I upgraded to 4.7.1 just a few days ago, so
I thought I should point out that this patch was missed.

___
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel


Re: [Xen-devel] [Xen-users] pvgrub: Error 9: Unknown boot failure

2016-12-07 Thread Sven Köhler
Am 28.09.2016 um 05:50 schrieb Juergen Gross:
> On 28/09/16 01:33, Sven Köhler wrote:
>> Am 27.09.2016 um 14:52 schrieb Juergen Gross:
>>> On 27/09/16 14:09, Sven Köhler wrote:
>>>> Am 27.09.2016 um 14:02 schrieb Juergen Gross:
>>>>> On 27/09/16 13:13, Sven Köhler wrote:
>>>>>> Am 27.09.2016 um 07:31 schrieb Juergen Gross:
>>>>>>> On 27/09/16 00:48, Sven Köhler wrote:
>>>>>>>> Am 26.09.2016 um 07:43 schrieb Juergen Gross:
>>>>>>>>> On 25/09/16 18:04, Sven Köhler wrote:
>>>>>>>>>> Hi,
>>>>>>>>>>
>>>>>>>>>> I'm experiencing the bug below which was discussed on xen-devel 
>>>>>>>>>> December
>>>>>>>>>> last year buy Ian and Juergen. I'm using xen-pvgrub-4.7.0 on Gentoo.
>>>>>>>>>>
>>>>>>>>>> The bug only seems to occur with the last domU booted on my machine.
>>>>>>>>>> Where do I find a patch that fixes that?
>>>>>>>>>
>>>>>>>>> The issue back in December was fixed by commit
>>>>>>>>> c8eb0ec277ae387e78d685523e0fee633e46f046 which is included in Xen 4.7.
>>>>>>>>> Either gentoo didn't update to the official Xen 4.7 release (including
>>>>>>>>> pvgrub) or you are seeing a new issue.
>>>>>>>>
>>>>>>>> From the looks of it, the Gentoo package is using the grub from the
>>>>>>>> xen-4.7.0 tarball.
>>>>>>>>
>>>>>>>> I downgraded to pvgrub 4.6.3 and the problem went away.
>>>>>>>>
>>>>>>>> So I assume I'm seeing a new issue. How do I debug it?
>>>>>>>
>>>>>>> Interesting. Just tested it on upstream Xen and saw the same problem
>>>>>>> with a rather old guest kernel (3.0 based, xen flavor), while a newer
>>>>>>> kernel (4.1, pvops) is working.
>>>>>>>
>>>>>>> Can you give me some more details about the kernel you are trying to
>>>>>>> boot?
>>>>>>
>>>>>> It's an unmodified 4.4.21 kernel which I compile by hand. The config is
>>>>>> attached. Does that help?
>>>>>
>>>>> Not really. OTOH I think I don't need more help, as I've found a problem
>>>>> in pvgrub. I have a patch which seems to correct the issue. Are you fine
>>>>> with me adding you as the original reporter of the problem in the patch?
>>>>
>>>> Yes, I'm fine with adding me as the reporter.
>>>> Do you want me to test the patch first?
>>>
>>> Sure. The attached patch is for Xen upstream, but I think it should
>>> apply to Xen 4.7, too.
>>
>> This patch solved the issue for me. My domU boots fine again after
>> recompiling pvgrub with the patch applied.
>>
>> Thanks!
> 
> Thank you for the test!

It seems this patch was not included in 4.7.1. That's a shame, cause I
ran into the same issue after upgrading to 4.7.1.


Regards,
  Sven

___
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel


Re: [Xen-devel] [Xen-users] pvgrub: Error 9: Unknown boot failure

2016-09-27 Thread Sven Köhler
Am 27.09.2016 um 14:52 schrieb Juergen Gross:
> On 27/09/16 14:09, Sven Köhler wrote:
>> Am 27.09.2016 um 14:02 schrieb Juergen Gross:
>>> On 27/09/16 13:13, Sven Köhler wrote:
>>>> Am 27.09.2016 um 07:31 schrieb Juergen Gross:
>>>>> On 27/09/16 00:48, Sven Köhler wrote:
>>>>>> Am 26.09.2016 um 07:43 schrieb Juergen Gross:
>>>>>>> On 25/09/16 18:04, Sven Köhler wrote:
>>>>>>>> Hi,
>>>>>>>>
>>>>>>>> I'm experiencing the bug below which was discussed on xen-devel 
>>>>>>>> December
>>>>>>>> last year buy Ian and Juergen. I'm using xen-pvgrub-4.7.0 on Gentoo.
>>>>>>>>
>>>>>>>> The bug only seems to occur with the last domU booted on my machine.
>>>>>>>> Where do I find a patch that fixes that?
>>>>>>>
>>>>>>> The issue back in December was fixed by commit
>>>>>>> c8eb0ec277ae387e78d685523e0fee633e46f046 which is included in Xen 4.7.
>>>>>>> Either gentoo didn't update to the official Xen 4.7 release (including
>>>>>>> pvgrub) or you are seeing a new issue.
>>>>>>
>>>>>> From the looks of it, the Gentoo package is using the grub from the
>>>>>> xen-4.7.0 tarball.
>>>>>>
>>>>>> I downgraded to pvgrub 4.6.3 and the problem went away.
>>>>>>
>>>>>> So I assume I'm seeing a new issue. How do I debug it?
>>>>>
>>>>> Interesting. Just tested it on upstream Xen and saw the same problem
>>>>> with a rather old guest kernel (3.0 based, xen flavor), while a newer
>>>>> kernel (4.1, pvops) is working.
>>>>>
>>>>> Can you give me some more details about the kernel you are trying to
>>>>> boot?
>>>>
>>>> It's an unmodified 4.4.21 kernel which I compile by hand. The config is
>>>> attached. Does that help?
>>>
>>> Not really. OTOH I think I don't need more help, as I've found a problem
>>> in pvgrub. I have a patch which seems to correct the issue. Are you fine
>>> with me adding you as the original reporter of the problem in the patch?
>>
>> Yes, I'm fine with adding me as the reporter.
>> Do you want me to test the patch first?
> 
> Sure. The attached patch is for Xen upstream, but I think it should
> apply to Xen 4.7, too.

This patch solved the issue for me. My domU boots fine again after
recompiling pvgrub with the patch applied.

Thanks!


Regards,
  Sven

___
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel


Re: [Xen-devel] [Xen-users] pvgrub: Error 9: Unknown boot failure

2016-09-27 Thread Sven Köhler
Am 27.09.2016 um 14:02 schrieb Juergen Gross:
> On 27/09/16 13:13, Sven Köhler wrote:
>> Am 27.09.2016 um 07:31 schrieb Juergen Gross:
>>> On 27/09/16 00:48, Sven Köhler wrote:
>>>> Am 26.09.2016 um 07:43 schrieb Juergen Gross:
>>>>> On 25/09/16 18:04, Sven Köhler wrote:
>>>>>> Hi,
>>>>>>
>>>>>> I'm experiencing the bug below which was discussed on xen-devel December
>>>>>> last year buy Ian and Juergen. I'm using xen-pvgrub-4.7.0 on Gentoo.
>>>>>>
>>>>>> The bug only seems to occur with the last domU booted on my machine.
>>>>>> Where do I find a patch that fixes that?
>>>>>
>>>>> The issue back in December was fixed by commit
>>>>> c8eb0ec277ae387e78d685523e0fee633e46f046 which is included in Xen 4.7.
>>>>> Either gentoo didn't update to the official Xen 4.7 release (including
>>>>> pvgrub) or you are seeing a new issue.
>>>>
>>>> From the looks of it, the Gentoo package is using the grub from the
>>>> xen-4.7.0 tarball.
>>>>
>>>> I downgraded to pvgrub 4.6.3 and the problem went away.
>>>>
>>>> So I assume I'm seeing a new issue. How do I debug it?
>>>
>>> Interesting. Just tested it on upstream Xen and saw the same problem
>>> with a rather old guest kernel (3.0 based, xen flavor), while a newer
>>> kernel (4.1, pvops) is working.
>>>
>>> Can you give me some more details about the kernel you are trying to
>>> boot?
>>
>> It's an unmodified 4.4.21 kernel which I compile by hand. The config is
>> attached. Does that help?
> 
> Not really. OTOH I think I don't need more help, as I've found a problem
> in pvgrub. I have a patch which seems to correct the issue. Are you fine
> with me adding you as the original reporter of the problem in the patch?

Yes, I'm fine with adding me as the reporter.
Do you want me to test the patch first?

___
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel


Re: [Xen-devel] [Xen-users] pvgrub: Error 9: Unknown boot failure

2016-09-27 Thread Sven Köhler
Am 27.09.2016 um 07:31 schrieb Juergen Gross:
> On 27/09/16 00:48, Sven Köhler wrote:
>> Am 26.09.2016 um 07:43 schrieb Juergen Gross:
>>> On 25/09/16 18:04, Sven Köhler wrote:
>>>> Hi,
>>>>
>>>> I'm experiencing the bug below which was discussed on xen-devel December
>>>> last year buy Ian and Juergen. I'm using xen-pvgrub-4.7.0 on Gentoo.
>>>>
>>>> The bug only seems to occur with the last domU booted on my machine.
>>>> Where do I find a patch that fixes that?
>>>
>>> The issue back in December was fixed by commit
>>> c8eb0ec277ae387e78d685523e0fee633e46f046 which is included in Xen 4.7.
>>> Either gentoo didn't update to the official Xen 4.7 release (including
>>> pvgrub) or you are seeing a new issue.
>>
>> From the looks of it, the Gentoo package is using the grub from the
>> xen-4.7.0 tarball.
>>
>> I downgraded to pvgrub 4.6.3 and the problem went away.
>>
>> So I assume I'm seeing a new issue. How do I debug it?
> 
> Interesting. Just tested it on upstream Xen and saw the same problem
> with a rather old guest kernel (3.0 based, xen flavor), while a newer
> kernel (4.1, pvops) is working.
> 
> Can you give me some more details about the kernel you are trying to
> boot?

It's an unmodified 4.4.21 kernel which I compile by hand. The config is
attached. Does that help?

> I'll investigate further.
> 
> In case you feel adventurous and want to do some debugging yourself:
> You need to build Xen from the sources. Your scenario includes debugging
> of Xen tools (probably the domain builder in tools/libxc), Mini-OS
> (extras/mini-os-remote) and grub (stubdom/grub-upstream). All paths
> mentioned are in the xen tree, some might be created only during first
> build.
> 
> 
> Juergen
> 
>>>> Once I find a patch to address the issue, I will also forward it to the
>>>> Gentoo maintainers via their bugzilla.
>>>>
>>>>
>>>> Kind Regards,
>>>>   Sven
>>>>
>>>>
>>>> output of xl create -c:
>>>>
>>>>   Booting 'Gentoo'
>>>>
>>>> root (hd0)
>>>>  Filesystem type is ext2fs, using whole disk
>>>> kernel /boot/vmlinuz ro root=/dev/xvda1 rootfstype=ext4
>>>>
>>>> = Init TPM Front 
>>>> Tpmfront:Error Unable to read device/vtpm/0/backend-id during tpmfront
>>>> initialization! error = ENOENT
>>>> Tpmfront:Info Shutting down tpmfront
>>>> pin_table(x) returned 28993
>>>>
>>>> Error 9: Unknown boot failure
>>>>
>>>> Press any key to continue...
>>>>
>>>>
>>>>
>>>> ___
>>>> Xen-users mailing list
>>>> xen-us...@lists.xen.org
>>>> https://lists.xen.org/xen-users
>>>>
>>>
>>
> 
#
# Automatically generated file; DO NOT EDIT.
# Linux/x86 4.4.21 Kernel Configuration
#
CONFIG_64BIT=y
CONFIG_X86_64=y
CONFIG_X86=y
CONFIG_INSTRUCTION_DECODER=y
CONFIG_OUTPUT_FORMAT="elf64-x86-64"
CONFIG_ARCH_DEFCONFIG="arch/x86/configs/x86_64_defconfig"
CONFIG_LOCKDEP_SUPPORT=y
CONFIG_STACKTRACE_SUPPORT=y
CONFIG_HAVE_LATENCYTOP_SUPPORT=y
CONFIG_MMU=y
CONFIG_NEED_DMA_MAP_STATE=y
CONFIG_NEED_SG_DMA_LENGTH=y
CONFIG_GENERIC_ISA_DMA=y
CONFIG_GENERIC_BUG=y
CONFIG_GENERIC_BUG_RELATIVE_POINTERS=y
CONFIG_GENERIC_HWEIGHT=y
CONFIG_ARCH_MAY_HAVE_PC_FDC=y
CONFIG_RWSEM_XCHGADD_ALGORITHM=y
CONFIG_GENERIC_CALIBRATE_DELAY=y
CONFIG_ARCH_HAS_CPU_RELAX=y
CONFIG_ARCH_HAS_CACHE_LINE_SIZE=y
CONFIG_HAVE_SETUP_PER_CPU_AREA=y
CONFIG_NEED_PER_CPU_EMBED_FIRST_CHUNK=y
CONFIG_NEED_PER_CPU_PAGE_FIRST_CHUNK=y
CONFIG_ARCH_HIBERNATION_POSSIBLE=y
CONFIG_ARCH_SUSPEND_POSSIBLE=y
CONFIG_ARCH_WANT_HUGE_PMD_SHARE=y
CONFIG_ARCH_WANT_GENERAL_HUGETLB=y
CONFIG_ZONE_DMA32=y
CONFIG_AUDIT_ARCH=y
CONFIG_ARCH_SUPPORTS_OPTIMIZED_INLINING=y
CONFIG_ARCH_SUPPORTS_DEBUG_PAGEALLOC=y
CONFIG_X86_64_SMP=y
CONFIG_ARCH_HWEIGHT_CFLAGS="-fcall-saved-rdi -fcall-saved-rsi -fcall-saved-rdx 
-fcall-saved-rcx -fcall-saved-r8 -fcall-saved-r9 -fcall-saved-r10 
-fcall-saved-r11"
CONFIG_ARCH_SUPPORTS_UPROBES=y
CONFIG_FIX_EARLYCON_MEM=y
CONFIG_PGTABLE_LEVELS=4
CONFIG_DEFCONFIG_LIST="/lib/modules/$UNAME_RELEASE/.config"
CONFIG_IRQ_WORK=y
CONFIG_BUILDTIME_EXTABLE_SORT=y

#
# General setup
#
CONFIG_INIT_ENV_ARG_LIMIT=32
CONFIG_CROSS_COMPILE=""
# CONFIG_COMPILE_TEST is not set
CONFIG_LOCALVERSION=""
CONFIG_LOCALVERSION_AUTO=y
CONFIG_HAVE_KERNEL_GZIP=y
CONFIG_HAVE_KERNEL_BZIP2=y
CONFIG_HAVE_KERNEL_LZMA=y
CONFIG_HAVE_KERNEL_XZ=y
CONFIG_HAV