Exactly. The whole notion becomes amongst other things simply a way to create and maintain various revenge fantasies--either one's own or somebody else's. If everyone is getting what they supposedly deserve, there's never any impetus to deal with personal issues responsibly, move on, or do anything for anyone else. I think the lives people live who follow this philosophy speak for themselves--they seem, at least on the surface, pretty lonely and without many meaningful relationships.
As Amma puts it, it may be someone's karma to experience suffering, but it's our karma to help them.