Re: [PATCH] staging: vboxvideo: Fix reporting invalid suggested-offset-properties

2017-10-13 Thread Hans de Goede
Hi, On 13-10-17 08:26, Michael Thayer wrote: Hello Hans, 12.10.2017 20:10, Hans de Goede wrote: The x and y hints receives from the host are unsigned 32 bit integers and they get set to -1 (0x) when invalid. Before this commit the vboxvideo driver was storing them in an u16 causing

Re: [PATCH] staging: vboxvideo: Fix reporting invalid suggested-offset-properties

2017-10-13 Thread Michael Thayer
Hello Hans, 12.10.2017 20:10, Hans de Goede wrote: > The x and y hints receives from the host are unsigned 32 bit integers and > they get set to -1 (0x) when invalid. Before this commit the > vboxvideo driver was storing them in an u16 causing the -1 to be truncated > to 65535 which, once

[PATCH] staging: vboxvideo: Fix reporting invalid suggested-offset-properties

2017-10-12 Thread Hans de Goede
The x and y hints receives from the host are unsigned 32 bit integers and they get set to -1 (0x) when invalid. Before this commit the vboxvideo driver was storing them in an u16 causing the -1 to be truncated to 65535 which, once reported to userspace, was breaking gnome 3.26+ in Wayland