[ 
https://issues.apache.org/jira/browse/SPARK-14850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15418534#comment-15418534
 ] 

Wenchen Fan commented on SPARK-14850:
-------------------------------------

format your code please, it's unreadable

> VectorUDT/MatrixUDT should take primitive arrays without boxing
> ---------------------------------------------------------------
>
>                 Key: SPARK-14850
>                 URL: https://issues.apache.org/jira/browse/SPARK-14850
>             Project: Spark
>          Issue Type: Improvement
>          Components: ML, SQL
>    Affects Versions: 1.5.2, 1.6.1, 2.0.0
>            Reporter: Xiangrui Meng
>            Assignee: Wenchen Fan
>            Priority: Critical
>             Fix For: 2.0.0
>
>
> In SPARK-9390, we switched to use GenericArrayData to store indices and 
> values in vector/matrix UDTs. However, GenericArrayData is not specialized 
> for primitive types. This might hurt MLlib performance badly. We should 
> consider either specialize GenericArrayData or use a different container.
> cc: [~cloud_fan] [~yhuai]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to