[
https://issues.apache.org/jira/browse/MAHOUT-1786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15858824#comment-15858824
]
ASF GitHub Bot commented on MAHOUT-1786:
----------------------------------------
Github user dlyubimov commented on the issue:
https://github.com/apache/mahout/pull/174
@rawkintrevo i don't believe at this point this issue contains valid
assertion w.r.t. being java serializable triggering codegen serializer. Nor is
there any experimental evidence of such. And there's spark 2.0.0 guidance to
the contrary as i mentioned.
> Make classes implements Serializable for Spark 1.5+
> ---------------------------------------------------
>
> Key: MAHOUT-1786
> URL: https://issues.apache.org/jira/browse/MAHOUT-1786
> Project: Mahout
> Issue Type: Improvement
> Components: Math
> Affects Versions: 0.11.0
> Reporter: Michel Lemay
> Assignee: Pat Ferrel
> Priority: Minor
> Labels: performance
> Fix For: 0.13.1
>
>
> Spark 1.5 comes with a new very efficient serializer that uses code
> generation. It is twice as fast as kryo. When using mahout, we have to set
> KryoSerializer because some classes aren't serializable otherwise.
> I suggest to declare Math classes as "implements Serializable" where needed.
> For instance, to use coocurence package in spark 1.5, we had to modify
> AbstractMatrix, AbstractVector, DenseVector and SparseRowMatrix to make it
> work without Kryo.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
