are there performance implications to increasing the cache size?

[Earle, Erik]

If I _can_ increase my cache size to the max that my hosts can support, 
_should_ I or does performance degrade with larger configs?