The short answer is those distributed linalg parts will not go away.
In the medium term, it's much less likely that the distributed matrix
classes will be ported over to DataFrames (though the ideal would be to
have DataFrame-backed distributed matrix classes) - given the time and
effort it's
Hey all,
I see on the MLLib website that there are plans to deprecate the RDD based API
for MLLib once the new ML API reaches feature parity with RDD based one. Are
there currently plans to reimplement all the distributed linear algebra /
matrices operations as part of this new API, or are
