I went back to my original config with virtual users and domains, with and without the milter. I left transport and mynetworks as they were. I have no idea why, but it's working now and I get a bounce from the remote server (= it's not yet accepting the mail). No more attempts to deliver locally or put on hold. I hope it remains that way. Thanks for the help!
Kai