I've had good success with the rpms distributed from openssh.com, for some time now.
I always grab the src.rpm, and for the last few releases I've been able to get exactly what I want with rpm --rebuild openssh-{ver}-{rel}.src.rpm \ --define 'skip_x11_askpass 1' \ --define 'skip_gnome_askpass 1' -Bennett
msg00379/pgp00000.pgp
Description: PGP signature