set -o vi
better yet, edit ~/.inputrc and add set editing-mode viin there. Then it works for other programs that use readline too like mysql! I almost forgot about that file, but there's a comment in there that I added some sequences for rxvt, so sweet.
That file might be a good thing to customize the hell out of.