This was fixed in the latest release upstream: https://github.com/wojdyr/xylib/releases but unfortunately I'm no longer able to maintain the Debian package. The only package that depends on xylib is fityk. Perhaps fityk maintainers could help.
Best wishes, Marcin
