Seems that "route sourceaddr" is not honoured by ping/traceroute, presumably because of raw sockets. Is this fixable?
(I haven't used sourceaddr myself before, it seems a nice idea but also seems like it would have many corner cases, so I just stayed with my old NAT rules instead - Ian mentioned this problem and I gave it a spin to check for myself).