It turns out it was in fact a firewall problem. I discovered that I wasn't resetting the firewall to no restrictions right. I thought that resetting the policy would reset all of the rules and didn't realize I needed to do a flush first. Now that I think about it makes good sense to do it this way.
Now I just need to go in and see which rule was causing the problem. Thanks for the help Chad