[
https://issues.apache.org/jira/browse/SPARK-15447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15314441#comment-15314441
]
Nick Pentreath edited comment on SPARK-15447 at 6/3/16 5:22 PM:
----------------------------------------------------------------
Added a second tab to the sheet for testing DF-based API from 2.0.0-SNAPSHOT vs
1.6.1 for SPARK-14891. Again, 2.0 is faster and no performance regression
overall.
Test time seems a bit worse on average in 2.0 - but the 1.6.1 result has very
large variance so inconclusive that performance is really worse.
was (Author: mlnick):
Added a second tab to the sheet for testing DF-based API from 2.0.0-SNAPSHOT vs
1.6.1 for SPARK-14891. Again, 2.0 is faster and no performance regression.
> Performance test for ALS in Spark 2.0
> -------------------------------------
>
> Key: SPARK-15447
> URL: https://issues.apache.org/jira/browse/SPARK-15447
> Project: Spark
> Issue Type: Task
> Components: ML
> Affects Versions: 2.0.0
> Reporter: Xiangrui Meng
> Assignee: Nick Pentreath
> Priority: Critical
> Labels: QA
>
> We made several changes to ALS in 2.0. It is necessary to run some tests to
> avoid performance regression. We should test (synthetic) datasets from 1
> million ratings to 1 billion ratings.
> cc [~mlnick] [~holdenk] Do you have time to run some large-scale performance
> tests?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
