It seems that the freeze is due to xserver-xorg 1.20. Downgrade xserver-xorg to 1.19 solve the problem. I have tried use 'root' to `startx`, which has a default plasma config, and still get the freeze. So there may be some incompatible between plasma 5.12 and xorg 1.20.
Thanks
