I don't think you need to do anything special to access a local DB. What OS are you on? How have you installed Web2py (zip file? hg clone?).
I'm on a Mac and access a MySQL DB through MAMP and the one wrinkle was that I needed to noodle around with mysql.sock connection. pymsql is in gluon/contrib and so Web2py should have no trouble finding it.
