Also Java serialization isn't great for cross platform compatibility.
On Tuesday, July 12, 2016, aka.fe2s wrote:
> Okay, I think I found an answer on my question. Some models (for instance
> org.apache.spark.mllib.recommendation.MatrixFactorizationModel) hold RDDs,
> so just serializing these ob
Okay, I think I found an answer on my question. Some models (for instance
org.apache.spark.mllib.recommendation.MatrixFactorizationModel) hold RDDs,
so just serializing these objects will not work.
--
Oleksiy Dyagilev
On Tue, Jul 12, 2016 at 5:40 PM, aka.fe2s wrote:
> What is the reason Spark h
What is the reason Spark has an individual implementations of read/write
routines for every model in mllib and ml? (Saveable and MLWritable trait
impls)
Wouldn't a generic implementation via Java serialization mechanism work? I
would like to use it to store the models to a custom storage.
--
Olek