Because it was asked: We have to move all (including closed) bugs from a component into others to remove that component. If an component is not empty when it's removed all it's bugs also get removed.
But there is also the possibility to just leave obsolete components around forever. Jan