RFR of JDK-8171072: java/rmi/transport/handshake*/Handshake*.java, exception is not thrown when reach failure test case

[Hamlin Li]

Would you please review the below patch?

bug: https://bugs.openjdk.java.net/browse/JDK-8171072
webrev: http://cr.openjdk.java.net/~mli/8171072/webrev.00/

Thank you
-Hamlin