I believe that Phobos must support some common methods of linear algebra and general mathematics. I have no desire to join D with Fortran libraries :)
D definitely needs BLAS API support for matrix multiplication. Best BLAS libraries are written in assembler like openBLAS. Otherwise D will have last position in corresponding math benchmarks.
