Great suggestion! startxfce4 loads very fast!For me the only drawback is that I often like to logout and switch between different window managers. So if I figure out a lightweight way to switch between window managers, then I will definitely use startxfce4 on a regular basis.
This is even faster than in the SysV days with startx. Cut out the display manager and things run very fast and smooth. Thanks!