Re: [PATCH v3] vt: keyboard: avoid signed integer overflow in k_ascii

[ Sorry, forgot to CC Kyungtae ] On Mon, May 25, 2020 at 04:27:40PM -0700, Dmitry Torokhov wrote: > When k_ascii is invoked several times in a row there is a potential for > signed integer overflow: > > UBSAN: Undefined behaviour in drivers/tty/vt/keyboard.c:888:19 signed integer > overflow: > 1

[PATCH v3] vt: keyboard: avoid signed integer overflow in k_ascii

When k_ascii is invoked several times in a row there is a potential for signed integer overflow: UBSAN: Undefined behaviour in drivers/tty/vt/keyboard.c:888:19 signed integer overflow: 10 * 11 cannot be represented in type 'int' CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.6.11 #1 Hardware