I think the notion of someone using your IR beaming capacity against your will is at least a possible threat (imagine what happens if I get a trojan onto your Palm that's supposed to leak data--it could just listen on the IR port, and hand over your data when I get it the right message.) Some people tape a piece of aluminum foil over the IR port of their Palm to make this class of attacks harder.
--John
