Yes, it does indeed turn on in text edit, but not off.
That particular Edit menu item, Special Characters…, is available in several applications. But I think you are correct that one is most likely to invoke that keystroke sequence accidently while in TextEdit.
