This looks to be the same bug as https://bugs.launchpad.net/ubuntu/+source/nvidia-graphics-drivers-455/+bug/1905591, which has more info and user reports.
A user on IRC reported having this issue too, and their system is one of the ones that isn't fixed by comment #11 on the Ubuntu issue. As a result, they are thinking of switching from Debian to Arch, where it does work with the newer 470 driver. Thanks