[ 
https://issues.apache.org/jira/browse/MAHOUT-1786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pat Ferrel updated MAHOUT-1786:
-------------------------------
    Assignee: Andrew Palumbo  (was: Pat Ferrel)

Hmm, removing Kryo altogether is probably a good idea, I have never touched 
this code and do not maintain classes that need this. All my classes either use 
data that is in the above types or base scala types that have serializable. 

I'm sending this back to [~Andrew_Palumbo] for reassignment or further 
discussion. 

If the new serializer if better than Kryo by all means let's move there ASAP.

> Make classes implements Serializable for Spark 1.5+
> ---------------------------------------------------
>
>                 Key: MAHOUT-1786
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-1786
>             Project: Mahout
>          Issue Type: Improvement
>          Components: Math
>    Affects Versions: 0.11.0
>            Reporter: Michel Lemay
>            Assignee: Andrew Palumbo
>            Priority: Blocker
>              Labels: performance
>             Fix For: 0.13.0
>
>
> Spark 1.5 comes with a new very efficient serializer that uses code 
> generation.  It is twice as fast as kryo.  When using mahout, we have to set 
> KryoSerializer because some classes aren't serializable otherwise.  
> I suggest to declare Math classes as "implements Serializable" where needed.  
> For instance, to use coocurence package in spark 1.5, we had to modify 
> AbstractMatrix, AbstractVector, DenseVector and SparseRowMatrix to make it 
> work without Kryo.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to