Actually you might want to try mercurial. It's concept-wise different from CVS, since it's a distributed system, but it is (from what I know) faster than SVN and probably even faster than CVS. But I did not benchmark it.
Try it out and let us know! ;)
