[jira] [Updated] (SPARK-17033) GaussianMixture should use treeAggregate to improve performance

2016-08-12 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-17033: Component/s: MLlib ML > GaussianMixture should use treeAggregate to improve

[jira] [Assigned] (SPARK-16710) SparkR spark.glm should support weightCol

2016-08-10 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang reassigned SPARK-16710: --- Assignee: Yanbo Liang > SparkR spark.glm should support weightCol >

[jira] [Commented] (SPARK-15882) Discuss distributed linear algebra in spark.ml package

2016-08-10 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415345#comment-15415345 ] Yanbo Liang commented on SPARK-15882: - I think we should make this migration finished before the next

[jira] [Updated] (SPARK-6685) Use DSYRK to compute AtA in ALS

2016-08-10 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-6685: --- Shepherd: Yanbo Liang > Use DSYRK to compute AtA in ALS > --- > >

[jira] [Commented] (SPARK-10078) Vector-free L-BFGS

2016-08-09 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413623#comment-15413623 ] Yanbo Liang commented on SPARK-10078: - I posted the design document which is still WIP here. Please

[jira] [Updated] (SPARK-10078) Vector-free L-BFGS

2016-08-09 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-10078: Description: This is to implement a scalable version of vector-free L-BFGS

[jira] [Resolved] (SPARK-16933) AFTAggregator in AFTSurvivalRegression serializes unnecessary data

2016-08-09 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-16933. - Resolution: Fixed Fix Version/s: 2.1.0 Target Version/s: 2.1.0 > AFTAggregator

[jira] [Assigned] (SPARK-16933) AFTAggregator in AFTSurvivalRegression serializes unnecessary data

2016-08-09 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang reassigned SPARK-16933: --- Assignee: Yanbo Liang > AFTAggregator in AFTSurvivalRegression serializes unnecessary data

[jira] [Commented] (SPARK-16933) AFTAggregator in AFTSurvivalRegression serializes unnecessary data

2016-08-08 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15411865#comment-15411865 ] Yanbo Liang commented on SPARK-16933: - No other cases for similar issues, only for

[jira] [Created] (SPARK-16933) AFTAggregator in AFTSurvivalRegression serializes unnecessary data

2016-08-06 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-16933: --- Summary: AFTAggregator in AFTSurvivalRegression serializes unnecessary data Key: SPARK-16933 URL: https://issues.apache.org/jira/browse/SPARK-16933 Project: Spark

[jira] [Commented] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

2016-08-05 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15409629#comment-15409629 ] Yanbo Liang commented on SPARK-3181: [~dbtsai] Yes, we can have {{HuberAggregator}} in

[jira] [Updated] (SPARK-14077) Support weighted instances in naive Bayes

2016-08-05 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-14077: Shepherd: Yanbo Liang Assignee: zhengruifeng > Support weighted instances in naive Bayes >

[jira] [Commented] (SPARK-16872) Include Gaussian Naive Bayes Classifier

2016-08-05 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15409071#comment-15409071 ] Yanbo Liang commented on SPARK-16872: - [~podongfeng] This task can be worked together with

[jira] [Updated] (SPARK-16872) Include Gaussian Naive Bayes Classifier

2016-08-05 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-16872: Priority: Major (was: Minor) > Include Gaussian Naive Bayes Classifier >

[jira] [Updated] (SPARK-16872) Include Gaussian Naive Bayes Classifier

2016-08-05 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-16872: Assignee: zhengruifeng > Include Gaussian Naive Bayes Classifier >

[jira] [Updated] (SPARK-16872) Include Gaussian Naive Bayes Classifier

2016-08-05 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-16872: Issue Type: New Feature (was: Brainstorming) > Include Gaussian Naive Bayes Classifier >

[jira] [Commented] (SPARK-16872) Include Gaussian Naive Bayes Classifier

2016-08-05 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15409047#comment-15409047 ] Yanbo Liang commented on SPARK-16872: - +1 [~mlnick] But currently {{ml.NaiveBayes}} is only a wrapper

[jira] [Comment Edited] (SPARK-16857) CrossValidator and KMeans throws IllegalArgumentException

2016-08-03 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405527#comment-15405527 ] Yanbo Liang edited comment on SPARK-16857 at 8/3/16 7:57 AM: - Yes, I agree

[jira] [Commented] (SPARK-16857) CrossValidator and KMeans throws IllegalArgumentException

2016-08-03 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405527#comment-15405527 ] Yanbo Liang commented on SPARK-16857: - Yes, I agree {{MulticlassClassificationEvaluator}} is not one

[jira] [Resolved] (SPARK-16558) examples/mllib/LDAExample should use MLVector instead of MLlib Vector

2016-08-02 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-16558. - Resolution: Fixed Assignee: Xusen Yin Fix Version/s: 2.1.0

[jira] [Resolved] (SPARK-16851) Incorrect threshould length in 'setThresholds()' evoke Exception

2016-08-02 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-16851. - Resolution: Fixed Fix Version/s: 2.1.0 > Incorrect threshould length in 'setThresholds()'

[jira] [Updated] (SPARK-16851) Incorrect threshould length in 'setThresholds()' evoke Exception

2016-08-02 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-16851: Assignee: zhengruifeng > Incorrect threshould length in 'setThresholds()' evoke Exception >

[jira] [Assigned] (SPARK-10078) Vector-free L-BFGS

2016-07-29 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang reassigned SPARK-10078: --- Assignee: Yanbo Liang (was: Xiangrui Meng) > Vector-free L-BFGS > -- > >

[jira] [Comment Edited] (SPARK-8518) Log-linear models for survival analysis

2016-07-29 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399031#comment-15399031 ] Yanbo Liang edited comment on SPARK-8518 at 7/29/16 10:37 AM: --

[jira] [Comment Edited] (SPARK-8518) Log-linear models for survival analysis

2016-07-29 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399031#comment-15399031 ] Yanbo Liang edited comment on SPARK-8518 at 7/29/16 10:35 AM: --

[jira] [Comment Edited] (SPARK-8518) Log-linear models for survival analysis

2016-07-29 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399031#comment-15399031 ] Yanbo Liang edited comment on SPARK-8518 at 7/29/16 10:22 AM: --

[jira] [Commented] (SPARK-8518) Log-linear models for survival analysis

2016-07-29 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399031#comment-15399031 ] Yanbo Liang commented on SPARK-8518: [~eliano.m.marq...@gmail.com] Since we use L-BFGS to solve the

[jira] [Updated] (SPARK-16750) ML GaussianMixture training failed due to feature column type mistake

2016-07-27 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-16750: Description: ML GaussianMixture training failed due to feature column type mistake. The feature

[jira] [Updated] (SPARK-16750) ML GaussianMixture training failed due to feature column type mistake

2016-07-27 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-16750: Description: ML GaussianMixture training failed due to feature column type mistake. The feature

[jira] [Updated] (SPARK-16750) ML GaussianMixture training failed due to feature column type mistake

2016-07-27 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-16750: Description: ML GaussianMixture training failed due to feature column type mistake. The feature

[jira] [Created] (SPARK-16750) ML GaussianMixture training failed due to feature column type mistake

2016-07-27 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-16750: --- Summary: ML GaussianMixture training failed due to feature column type mistake Key: SPARK-16750 URL: https://issues.apache.org/jira/browse/SPARK-16750 Project: Spark

[jira] [Commented] (SPARK-16446) Gaussian Mixture Model wrapper in SparkR

2016-07-26 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15395003#comment-15395003 ] Yanbo Liang commented on SPARK-16446: - Will send PR soon. > Gaussian Mixture Model wrapper in SparkR

[jira] [Created] (SPARK-16710) SparkR spark.glm should support weightCol

2016-07-25 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-16710: --- Summary: SparkR spark.glm should support weightCol Key: SPARK-16710 URL: https://issues.apache.org/jira/browse/SPARK-16710 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

2016-07-19 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15384138#comment-15384138 ] Yanbo Liang edited comment on SPARK-3181 at 7/19/16 1:26 PM: - [~dbtsai] Should

[jira] [Commented] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

2016-07-19 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15384138#comment-15384138 ] Yanbo Liang commented on SPARK-3181: [~dbtsai] Should the {{HuberRegression}} share codebase with

[jira] [Commented] (SPARK-10078) Vector-free L-BFGS

2016-07-14 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376867#comment-15376867 ] Yanbo Liang commented on SPARK-10078: - Had offline discussion with [~mengxr] and [~josephkb], I will

[jira] [Updated] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

2016-07-13 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-3181: --- Labels: 2.1.0 (was: features) > Add Robust Regression Algorithm with Huber Estimator >

[jira] [Updated] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

2016-07-13 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-3181: --- Labels: features (was: 2.1.0) > Add Robust Regression Algorithm with Huber Estimator >

[jira] [Updated] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

2016-07-13 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-3181: --- Target Version/s: 2.1.0 > Add Robust Regression Algorithm with Huber Estimator >

[jira] [Updated] (SPARK-9623) RandomForestRegressor: provide variance of predictions

2016-07-12 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-9623: --- Shepherd: Yanbo Liang > RandomForestRegressor: provide variance of predictions >

[jira] [Updated] (SPARK-9623) RandomForestRegressor: provide variance of predictions

2016-07-12 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-9623: --- Assignee: Manoj Kumar > RandomForestRegressor: provide variance of predictions >

[jira] [Updated] (SPARK-16494) Upgrade breeze version to 0.12

2016-07-12 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-16494: Summary: Upgrade breeze version to 0.12 (was: Upgrade breeze to 0.12) > Upgrade breeze version to

[jira] [Updated] (SPARK-16494) Upgrade breeze to 0.12

2016-07-12 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-16494: Description: breeze 0.12 has been released for more than half a year, and it brings lots of new

[jira] [Updated] (SPARK-16494) Upgrade breeze to 0.12

2016-07-12 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-16494: Description: breeze 0.12 has been released for more than half a year, and it brings lots of new

[jira] [Created] (SPARK-16494) Upgrade breeze to 0.12

2016-07-12 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-16494: --- Summary: Upgrade breeze to 0.12 Key: SPARK-16494 URL: https://issues.apache.org/jira/browse/SPARK-16494 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-15440) Add CSRF Filter for REST APIs to Spark

2016-07-11 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-15440. - Resolution: Won't Fix > Add CSRF Filter for REST APIs to Spark >

[jira] [Comment Edited] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

2016-07-11 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370871#comment-15370871 ] Yanbo Liang edited comment on SPARK-3181 at 7/11/16 2:35 PM: - [~dbtsai]

[jira] [Comment Edited] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

2016-07-11 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370871#comment-15370871 ] Yanbo Liang edited comment on SPARK-3181 at 7/11/16 2:31 PM: - [~dbtsai]

[jira] [Commented] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

2016-07-11 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370871#comment-15370871 ] Yanbo Liang commented on SPARK-3181: [~dbtsai] [~MechCoder] There is one problem need to be discussed:

[jira] [Assigned] (SPARK-16446) Gaussian Mixture Model wrapper in SparkR

2016-07-08 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang reassigned SPARK-16446: --- Assignee: Yanbo Liang > Gaussian Mixture Model wrapper in SparkR >

[jira] [Commented] (SPARK-16446) Gaussian Mixture Model wrapper in SparkR

2016-07-08 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368916#comment-15368916 ] Yanbo Liang commented on SPARK-16446: - Sure. > Gaussian Mixture Model wrapper in SparkR >

[jira] [Commented] (SPARK-11911) spark-perf test for MultilayerPerceptron

2016-07-07 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365696#comment-15365696 ] Yanbo Liang commented on SPARK-11911: - [~josephkb] I'm interested in contributing to this JIRA. One

[jira] [Resolved] (SPARK-16307) Improve testing for DecisionTree variances

2016-07-06 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-16307. - Resolution: Fixed Fix Version/s: 2.1.0 Target Version/s: 2.1.0 > Improve

[jira] [Updated] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

2016-07-06 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-3181: --- Component/s: (was: MLlib) MLilb ML > Add Robust Regression

[jira] [Reopened] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

2016-07-06 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang reopened SPARK-3181: Assignee: Yanbo Liang (was: Fan Jiang) > Add Robust Regression Algorithm with Huber Estimator >

[jira] [Commented] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

2016-07-06 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363982#comment-15363982 ] Yanbo Liang commented on SPARK-3181: Yes, I'm working on this and will send a PR soon. I will ping

[jira] [Updated] (SPARK-16249) Change visibility of Object ml.clustering.LDA to public for loading

2016-07-06 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-16249: Assignee: yuhao yang > Change visibility of Object ml.clustering.LDA to public for loading >

[jira] [Resolved] (SPARK-16249) Change visibility of Object ml.clustering.LDA to public for loading

2016-07-06 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-16249. - Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 > Change visibility of

[jira] [Comment Edited] (SPARK-16064) Fix the GLM error caused by NA produced by reweight function

2016-07-05 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15362328#comment-15362328 ] Yanbo Liang edited comment on SPARK-16064 at 7/5/16 10:22 AM: -- [~April_ZMQ]

[jira] [Resolved] (SPARK-16064) Fix the GLM error caused by NA produced by reweight function

2016-07-05 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-16064. - Resolution: Not A Problem > Fix the GLM error caused by NA produced by reweight function >

[jira] [Comment Edited] (SPARK-16064) Fix the GLM error caused by NA produced by reweight function

2016-07-05 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15362328#comment-15362328 ] Yanbo Liang edited comment on SPARK-16064 at 7/5/16 10:21 AM: -- [~April_ZMQ]

[jira] [Commented] (SPARK-16064) Fix the GLM error caused by NA produced by reweight function

2016-07-05 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15362328#comment-15362328 ] Yanbo Liang commented on SPARK-16064: - [~April_ZMQ] After in-depth study of your problem, I think the

[jira] [Issue Comment Deleted] (SPARK-15440) Add CSRF Filter for REST APIs to Spark

2016-07-04 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-15440: Comment: was deleted (was: User 'yanboliang' has created a pull request for this issue:

[jira] [Issue Comment Deleted] (SPARK-15440) Add CSRF Filter for REST APIs to Spark

2016-07-04 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-15440: Comment: was deleted (was: User 'yanboliang' has created a pull request for this issue:

[jira] [Commented] (SPARK-15790) Audit @Since annotations in ML

2016-07-04 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15362019#comment-15362019 ] Yanbo Liang commented on SPARK-15790: - [~mlnick] Can this catch up with 2.0.0? This is the only

[jira] [Commented] (SPARK-13448) Document MLlib behavior changes in Spark 2.0

2016-07-04 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15361370#comment-15361370 ] Yanbo Liang commented on SPARK-13448: - No remaining should be documented, I will resolved this JIRA.

[jira] [Resolved] (SPARK-13448) Document MLlib behavior changes in Spark 2.0

2016-07-04 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-13448. - Resolution: Fixed Fix Version/s: 2.0.0 > Document MLlib behavior changes in Spark 2.0 >

[jira] [Commented] (SPARK-16260) PySpark ML Example Improvements and Cleanup

2016-07-04 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360900#comment-15360900 ] Yanbo Liang commented on SPARK-16260: - [~wangmiao1981] [~bryanc] I left this JIRA open, since there

[jira] [Updated] (SPARK-16307) Improve testing for DecisionTree variances

2016-07-04 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-16307: Assignee: Manoj Kumar > Improve testing for DecisionTree variances >

[jira] [Comment Edited] (SPARK-15575) Remove breeze from dependencies?

2016-07-02 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360099#comment-15360099 ] Yanbo Liang edited comment on SPARK-15575 at 7/2/16 9:41 AM: - Yes,

[jira] [Commented] (SPARK-15575) Remove breeze from dependencies?

2016-07-02 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360099#comment-15360099 ] Yanbo Liang commented on SPARK-15575: - Yes, {{LinearRegression}}, {{LogisticRegression}},

[jira] [Comment Edited] (SPARK-15575) Remove breeze from dependencies?

2016-07-02 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360099#comment-15360099 ] Yanbo Liang edited comment on SPARK-15575 at 7/2/16 9:40 AM: - Yes,

[jira] [Commented] (SPARK-16064) Fix the GLM error caused by NA produced by reweight function

2016-07-01 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15358776#comment-15358776 ] Yanbo Liang commented on SPARK-16064: - I will have a look in the next few days. > Fix the GLM error

[jira] [Assigned] (SPARK-16064) Fix the GLM error caused by NA produced by reweight function

2016-07-01 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang reassigned SPARK-16064: --- Assignee: Yanbo Liang > Fix the GLM error caused by NA produced by reweight function >

[jira] [Commented] (SPARK-16326) Evaluate sparklyr package from RStudio

2016-07-01 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15358716#comment-15358716 ] Yanbo Liang commented on SPARK-16326: - I will try to use sparklyr to get some hands-on experience and

[jira] [Comment Edited] (SPARK-16144) Add a separate Rd for ML generic methods: read.ml, write.ml, summary, predict

2016-07-01 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15358625#comment-15358625 ] Yanbo Liang edited comment on SPARK-16144 at 7/1/16 8:14 AM: - Yes, there is

[jira] [Commented] (SPARK-16144) Add a separate Rd for ML generic methods: read.ml, write.ml, summary, predict

2016-07-01 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15358625#comment-15358625 ] Yanbo Liang commented on SPARK-16144: - Yes, there is no conflict with {{summary(SparkDataFrame)}}.

[jira] [Commented] (SPARK-16144) Add a separate Rd for ML generic methods: read.ml, write.ml, summary, predict

2016-07-01 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15358460#comment-15358460 ] Yanbo Liang commented on SPARK-16144: - Should we rename {{summary(model)}} to {{summary.ml(model)}}

[jira] [Commented] (SPARK-16241) model loading backward compatibility for ml NaiveBayes

2016-06-30 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15356790#comment-15356790 ] Yanbo Liang commented on SPARK-16241: - [~srowen] Thanks! > model loading backward compatibility for

[jira] [Commented] (SPARK-16241) model loading backward compatibility for ml NaiveBayes

2016-06-30 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15356707#comment-15356707 ] Yanbo Liang commented on SPARK-16241: - It's strange that I can not assign this task to [~michelle].

[jira] [Resolved] (SPARK-16241) model loading backward compatibility for ml NaiveBayes

2016-06-30 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-16241. - Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 > model loading backward

[jira] [Commented] (SPARK-16144) Add a separate Rd for ML generic methods: read.ml, write.ml, summary, predict

2016-06-29 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15356277#comment-15356277 ] Yanbo Liang commented on SPARK-16144: - Sure. > Add a separate Rd for ML generic methods: read.ml,

[jira] [Resolved] (SPARK-16242) Wrap the Matrix conversion utils in Python

2016-06-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-16242. - Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 > Wrap the Matrix

[jira] [Created] (SPARK-16245) model loading backward compatibility for ml.feature.PCA

2016-06-27 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-16245: --- Summary: model loading backward compatibility for ml.feature.PCA Key: SPARK-16245 URL: https://issues.apache.org/jira/browse/SPARK-16245 Project: Spark Issue

[jira] [Commented] (SPARK-16132) model loading backward compatibility for tree model (DecisionTree, RF, GBT)

2016-06-27 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352301#comment-15352301 ] Yanbo Liang commented on SPARK-16132: - Since we did not support DecisionTree, RandomForest and GBT

[jira] [Commented] (SPARK-16240) model loading backward compatibility for ml.clustering.LDA

2016-06-27 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352296#comment-15352296 ] Yanbo Liang commented on SPARK-16240: - Since we did not back port

[jira] [Created] (SPARK-16242) Wrap the Matrix conversion utils in Python

2016-06-27 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-16242: --- Summary: Wrap the Matrix conversion utils in Python Key: SPARK-16242 URL: https://issues.apache.org/jira/browse/SPARK-16242 Project: Spark Issue Type:

[jira] [Commented] (SPARK-16000) Make model loading backward compatible with saved models using old vector columns

2016-06-27 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15350574#comment-15350574 ] Yanbo Liang commented on SPARK-16000: - I can help on some sub-tasks after SPARK-16187 get merged. >

[jira] [Resolved] (SPARK-15946) Wrap the conversion utils in Python

2016-06-17 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-15946. - Resolution: Fixed Fix Version/s: 2.0.0 > Wrap the conversion utils in Python >

[jira] [Commented] (SPARK-16000) Make model loading backward compatible with saved models using old vector columns

2016-06-17 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15336990#comment-15336990 ] Yanbo Liang commented on SPARK-16000: - It's a good idea to split the task into smaller ones, since

[jira] [Resolved] (SPARK-15608) Add document for ML IsotonicRegression

2016-06-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-15608. - Resolution: Fixed Fix Version/s: 2.0.0 > Add document for ML IsotonicRegression >

[jira] [Updated] (SPARK-15608) Add document for ML IsotonicRegression

2016-06-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-15608: Assignee: Weichen Xu > Add document for ML IsotonicRegression >

[jira] [Commented] (SPARK-16000) Make model loading backward compatible with saved models using old vector columns

2016-06-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334763#comment-15334763 ] Yanbo Liang commented on SPARK-16000: - We should only add for models which support save/load in Spark

[jira] [Commented] (SPARK-15643) ML 2.0 QA: migration guide update

2016-06-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334735#comment-15334735 ] Yanbo Liang commented on SPARK-15643: - Sure > ML 2.0 QA: migration guide update >

[jira] [Resolved] (SPARK-15945) Implement conversion utils in Scala/Java

2016-06-14 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-15945. - Resolution: Fixed > Implement conversion utils in Scala/Java >

[jira] [Updated] (SPARK-15957) RFormula supports forcing to index label

2016-06-14 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-15957: Assignee: (was: Yanbo Liang) > RFormula supports forcing to index label >

[jira] [Updated] (SPARK-15957) RFormula supports forcing to index label

2016-06-14 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-15957: Description: RFormula will index label only when it is string type currently. If the label is

[jira] [Updated] (SPARK-15957) RFormula supports forcing to index label

2016-06-14 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-15957: Description: RFormula will index label only when it is string type. If the label is numeric type

[jira] [Updated] (SPARK-15957) RFormula supports forcing to index label

2016-06-14 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-15957: Description: RFormula will index label only when it is string type. If the label is numeric type

[jira] [Updated] (SPARK-15957) RFormula supports forcing to index label

2016-06-14 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-15957: Description: RFormula will index label only when it is string type. If the label is numeric type

<    2   3   4   5   6   7   8   9   10   11   >