Nevermind, I think I found a way around, from the source code of inv!
>From F the cholesky, one can overwrite M by F.factors -> copy!(M,F.factors)
Then call the LAPACK function potri!('U',M) that overwrites M by its
inverse in the upper triangular.
And finally call copytri! to recover the full inverse.Best.
