To put it another way, there are plenty of problems that can't be vectorized effectively. ODEs, matrix assembly for FEM or BEM, implementing special functions... If you do enough scientific computing, eventually you will hit a problem where you need to write your own inner loops, and then with Matlab you need to drop down to C if performance matters.
If all performance-critical computing were linear algebra, life would be a lot simpler.
