[jira] [Updated] (SPARK-13429) Unify Logistic Regression convergence tolerance of ML & MLlib

2016-02-21 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13429: Description: In order to provide better and consistent result, let's change the default value of

[jira] [Created] (SPARK-13429) Unify Logistic Regression convergence tolerance of ML & MLlib

2016-02-21 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-13429: --- Summary: Unify Logistic Regression convergence tolerance of ML & MLlib Key: SPARK-13429 URL: https://issues.apache.org/jira/browse/SPARK-13429 Project: Spark

[jira] [Updated] (SPARK-13379) MLlib LogisticRegressionWithLBFGS set regularization incorrectly

2016-02-21 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13379: Description: We should correct MLlib LogisticRegressionWithLBFGS regularization map as:

[jira] [Updated] (SPARK-13379) MLlib LogisticRegressionWithLBFGS set regularization incorrectly

2016-02-21 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13379: Description: We should correct MLlib LogisticRegressionWithLBFGS regularization map as:

[jira] [Updated] (SPARK-13379) MLlib LogisticRegressionWithLBFGS set regularization incorrectly

2016-02-21 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13379: Description: We should correct MLlib LogisticRegressionWithLBFGS regularization mapping as:

[jira] [Updated] (SPARK-13379) MLlib LogisticRegressionWithLBFGS set regularization incorrectly

2016-02-21 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13379: Description: We should correct MLlib LogisticRegressionWithLBFGS regParam setting as:

[jira] [Updated] (SPARK-13379) MLlib LogisticRegressionWithLBFGS set regularization incorrectly

2016-02-21 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13379: Description: We should correct MLlib LogisticRegressionWithLBFGS regularization setting as:

[jira] [Updated] (SPARK-13379) MLlib LogisticRegressionWithLBFGS set regularization incorrectly

2016-02-21 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13379: Description: MLlib LogisticRegressionWithLBFGS set regularization incorrectly, we should (was:

[jira] [Created] (SPARK-13389) SparkR support first/last with ignore NAs

2016-02-19 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-13389: --- Summary: SparkR support first/last with ignore NAs Key: SPARK-13389 URL: https://issues.apache.org/jira/browse/SPARK-13389 Project: Spark Issue Type:

[jira] [Created] (SPARK-13379) MLlib LogisticRegressionWithLBFGS set regularization incorrectly

2016-02-18 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-13379: --- Summary: MLlib LogisticRegressionWithLBFGS set regularization incorrectly Key: SPARK-13379 URL: https://issues.apache.org/jira/browse/SPARK-13379 Project: Spark

[jira] [Updated] (SPARK-13372) ML LogisticRegression behaves incorrectly when standardization = false && regParam = 0.0

2016-02-18 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13372: Description: At SPARK-8700 we implemented disable feature scaling by penalizing each component

[jira] [Commented] (SPARK-13322) AFTSurvivalRegression should support feature standardization

2016-02-18 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15152046#comment-15152046 ] Yanbo Liang commented on SPARK-13322: - I will start to write code after SPARK-13295 get merged. >

[jira] [Created] (SPARK-13372) ML LogisticRegression behaves incorrectly when standardization = false && regParam = 0.0

2016-02-17 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-13372: --- Summary: ML LogisticRegression behaves incorrectly when standardization = false && regParam = 0.0 Key: SPARK-13372 URL: https://issues.apache.org/jira/browse/SPARK-13372

[jira] [Updated] (SPARK-13322) AFTSurvivalRegression should support feature standardization

2016-02-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13322: Description: This bug is reported by Stuti Awasthi.

[jira] [Updated] (SPARK-13322) AFTSurvivalRegression should support feature standardization

2016-02-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13322: Description: This bug is reported by Stuti Awasthi.

[jira] [Updated] (SPARK-13322) AFTSurvivalRegression should support feature standardization

2016-02-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13322: Description: This bug is reported by Stuti Awasthi.

[jira] [Updated] (SPARK-13322) AFTSurvivalRegression should support feature standardization

2016-02-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13322: Summary: AFTSurvivalRegression should support feature standardization (was: AFTSurvivalRegression

[jira] [Updated] (SPARK-13334) ML KMeansModel/BisectingKMeansModel/QuantileDiscretizerModel should be set parent

2016-02-15 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13334: Summary: ML KMeansModel/BisectingKMeansModel/QuantileDiscretizerModel should be set parent (was:

[jira] [Updated] (SPARK-13334) ML KMeansModel/BisectingKMeansModel should be set parent

2016-02-15 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13334: Summary: ML KMeansModel/BisectingKMeansModel should be set parent (was: ML

[jira] [Updated] (SPARK-13334) ML KMeansModel / BisectingKMeansModel should be set parent

2016-02-15 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13334: Description: ML KMeansModel / BisectingKMeansModel / QuantileDiscretizer should be set parent. I

[jira] [Updated] (SPARK-13334) ML KMeansModel / BisectingKMeansModel should be set parent

2016-02-15 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13334: Description: ML KMeansModel / BisectingKMeansModel / QuantileDiscretizer should be set parent. I

[jira] [Updated] (SPARK-13334) ML KMeansModel / BisectingKMeansModel should be set parent

2016-02-15 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13334: Description: ML KMeansModel / BisectingKMeansModel / QuantileDiscretizer should be set parent. I

[jira] [Updated] (SPARK-13334) ML KMeansModel / BisectingKMeansModel should be set parent

2016-02-15 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13334: Description: ML KMeansModel / BisectingKMeansModel / QuantileDiscretizer should be set parent. I

[jira] [Created] (SPARK-13334) ML KMeansModel / BisectingKMeansModel should be set parent

2016-02-15 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-13334: --- Summary: ML KMeansModel / BisectingKMeansModel should be set parent Key: SPARK-13334 URL: https://issues.apache.org/jira/browse/SPARK-13334 Project: Spark

[jira] [Commented] (SPARK-13322) AFTSurvivalRegression should handle lossSum infinity

2016-02-15 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15147036#comment-15147036 ] Yanbo Liang commented on SPARK-13322: - I will send a PR for this issue, please assign it to me.

[jira] [Created] (SPARK-13322) AFTSurvivalRegression should handle lossSum infinity

2016-02-15 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-13322: --- Summary: AFTSurvivalRegression should handle lossSum infinity Key: SPARK-13322 URL: https://issues.apache.org/jira/browse/SPARK-13322 Project: Spark Issue

[jira] [Commented] (SPARK-8000) SQLContext.read.load() should be able to auto-detect input data

2016-02-12 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15144285#comment-15144285 ] Yanbo Liang commented on SPARK-8000: [~hyukjin.kwon] I'm not working on this issue now, please feel

[jira] [Issue Comment Deleted] (SPARK-12811) Estimator interface for generalized linear models (GLMs)

2016-02-02 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12811: Comment: was deleted (was: Should we put it under a new folder named "ml/glm"?) > Estimator

[jira] [Updated] (SPARK-13153) PySpark ML persistence failed when handle no default value parameter

2016-02-02 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13153: Affects Version/s: (was: 1.6.0) > PySpark ML persistence failed when handle no default value

[jira] [Commented] (SPARK-12811) Estimator interface for generalized linear models (GLMs)

2016-01-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15121176#comment-15121176 ] Yanbo Liang commented on SPARK-12811: - Should we put it under a new folder named "ml/glm"? >

[jira] [Created] (SPARK-13032) Basic ML Pipeline export/import functions for PySpark

2016-01-27 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-13032: --- Summary: Basic ML Pipeline export/import functions for PySpark Key: SPARK-13032 URL: https://issues.apache.org/jira/browse/SPARK-13032 Project: Spark Issue

[jira] [Created] (SPARK-13033) PySpark regression support export/import

2016-01-27 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-13033: --- Summary: PySpark regression support export/import Key: SPARK-13033 URL: https://issues.apache.org/jira/browse/SPARK-13033 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-13034) PySpark ml.classification support export/import

2016-01-27 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120648#comment-15120648 ] Yanbo Liang commented on SPARK-13034: - Hi Miao, Please feel free to take this one, thanks! I think

[jira] [Comment Edited] (SPARK-13010) Survival analysis in SparkR

2016-01-27 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15119054#comment-15119054 ] Yanbo Liang edited comment on SPARK-13010 at 1/27/16 11:09 AM: --- There are

[jira] [Comment Edited] (SPARK-13010) Survival analysis in SparkR

2016-01-27 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15119054#comment-15119054 ] Yanbo Liang edited comment on SPARK-13010 at 1/27/16 11:09 AM: --- There are

[jira] [Commented] (SPARK-13010) Survival analysis in SparkR

2016-01-27 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15119054#comment-15119054 ] Yanbo Liang commented on SPARK-13010: - There are two issues that we should discuss: 1, Support

[jira] [Created] (SPARK-13034) PySpark ml.classification support export/import

2016-01-27 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-13034: --- Summary: PySpark ml.classification support export/import Key: SPARK-13034 URL: https://issues.apache.org/jira/browse/SPARK-13034 Project: Spark Issue Type:

[jira] [Created] (SPARK-13035) PySpark ml.clustering support export/import

2016-01-27 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-13035: --- Summary: PySpark ml.clustering support export/import Key: SPARK-13035 URL: https://issues.apache.org/jira/browse/SPARK-13035 Project: Spark Issue Type:

[jira] [Commented] (SPARK-11560) Optimize KMeans implementation

2016-01-27 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118937#comment-15118937 ] Yanbo Liang commented on SPARK-11560: - [~yuhaoyan] I think the first step is to use BLAS Level 3

[jira] [Created] (SPARK-13038) PySpark ml.pipeline support export/import

2016-01-27 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-13038: --- Summary: PySpark ml.pipeline support export/import Key: SPARK-13038 URL: https://issues.apache.org/jira/browse/SPARK-13038 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-13033) PySpark ml.regression support export/import

2016-01-27 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13033: Summary: PySpark ml.regression support export/import (was: PySpark regression support

[jira] [Created] (SPARK-13037) PySpark ml.recommendation support export/import

2016-01-27 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-13037: --- Summary: PySpark ml.recommendation support export/import Key: SPARK-13037 URL: https://issues.apache.org/jira/browse/SPARK-13037 Project: Spark Issue Type:

[jira] [Created] (SPARK-13036) PySpark ml.feature support export/import

2016-01-27 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-13036: --- Summary: PySpark ml.feature support export/import Key: SPARK-13036 URL: https://issues.apache.org/jira/browse/SPARK-13036 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-12974) Add Python API for spark.ml bisecting k-means

2016-01-24 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12974: Component/s: PySpark ML > Add Python API for spark.ml bisecting k-means >

[jira] [Created] (SPARK-12974) Add Python API for spark.ml bisecting k-means

2016-01-24 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-12974: --- Summary: Add Python API for spark.ml bisecting k-means Key: SPARK-12974 URL: https://issues.apache.org/jira/browse/SPARK-12974 Project: Spark Issue Type:

[jira] [Created] (SPARK-12962) PySpark support covar_samp and covar_pop

2016-01-21 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-12962: --- Summary: PySpark support covar_samp and covar_pop Key: SPARK-12962 URL: https://issues.apache.org/jira/browse/SPARK-12962 Project: Spark Issue Type:

[jira] [Updated] (SPARK-12905) PCAModel return eigenvalues for PySpark

2016-01-19 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12905: Priority: Minor (was: Trivial) > PCAModel return eigenvalues for PySpark >

[jira] [Updated] (SPARK-12905) PCAModel return eigenvalues for PySpark

2016-01-19 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12905: Priority: Trivial (was: Minor) > PCAModel return eigenvalues for PySpark >

[jira] [Created] (SPARK-12905) PCAModel return eigenvalues for PySpark

2016-01-19 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-12905: --- Summary: PCAModel return eigenvalues for PySpark Key: SPARK-12905 URL: https://issues.apache.org/jira/browse/SPARK-12905 Project: Spark Issue Type:

[jira] [Created] (SPARK-12903) Add covar_samp and covar_pop for SparkR

2016-01-19 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-12903: --- Summary: Add covar_samp and covar_pop for SparkR Key: SPARK-12903 URL: https://issues.apache.org/jira/browse/SPARK-12903 Project: Spark Issue Type:

[jira] [Updated] (SPARK-12664) Expose raw prediction scores in MultilayerPerceptronClassificationModel

2016-01-11 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12664: Priority: Major (was: Minor) > Expose raw prediction scores in

[jira] [Commented] (SPARK-12664) Expose raw prediction scores in MultilayerPerceptronClassificationModel

2016-01-11 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15093170#comment-15093170 ] Yanbo Liang commented on SPARK-12664: - cc [~avulanov] [~mengxr] > Expose raw prediction scores in

[jira] [Updated] (SPARK-12664) Expose raw prediction scores in MultilayerPerceptronClassificationModel

2016-01-11 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12664: Component/s: (was: MLlib) > Expose raw prediction scores in

[jira] [Commented] (SPARK-12664) Expose raw prediction scores in MultilayerPerceptronClassificationModel

2016-01-11 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15093164#comment-15093164 ] Yanbo Liang commented on SPARK-12664: - I vote this as an important feature.

[jira] [Updated] (SPARK-12645) SparkR support hash function

2016-01-05 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12645: Description: Add hash function for SparkR (was: SparkR add function hash for DataFrame) > SparkR

[jira] [Updated] (SPARK-12645) SparkR add function hash

2016-01-05 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12645: Summary: SparkR add function hash (was: SparkR add function hash) > SparkR add function hash >

[jira] [Updated] (SPARK-12645) SparkR support hash function

2016-01-05 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12645: Summary: SparkR support hash function (was: SparkR add function hash ) > SparkR support hash

[jira] [Created] (SPARK-12645) SparkR add function hash

2016-01-05 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-12645: --- Summary: SparkR add function hash Key: SPARK-12645 URL: https://issues.apache.org/jira/browse/SPARK-12645 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-9835) Iteratively reweighted least squares solver for GLMs

2016-01-03 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15080618#comment-15080618 ] Yanbo Liang commented on SPARK-9835: [~mengxr] Are you working on this issue? If you are not working

[jira] [Updated] (SPARK-12603) PySpark MLlib GaussianMixtureModel should support single instance predict/predictSoft

2016-01-02 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12603: Description: PySpark MLlib GaussianMixtureModel should support single instance predict/predictSoft

[jira] [Updated] (SPARK-12603) PySpark MLlib GaussianMixtureModel should support single instance predict/predictSoft

2016-01-02 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12603: Description: PySpark MLlib GaussianMixtureModel should support single instance predict/predictSoft

[jira] [Updated] (SPARK-12603) PySpark MLlib GaussianMixtureModel should support single instance predict/predictSoft

2016-01-02 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12603: Description: PySpark MLlib GaussianMixtureModel should support single instance

[jira] [Updated] (SPARK-12603) PySpark MLlib GaussianMixtureModel should support single instance predict/predictSoft

2016-01-02 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12603: Summary: PySpark MLlib GaussianMixtureModel should support single instance predict/predictSoft

[jira] [Updated] (SPARK-12603) PySpark MLlib GaussianMixtureModel should support single instance predict/predictSoft

2016-01-02 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12603: Component/s: PySpark > PySpark MLlib GaussianMixtureModel should support single instance >

[jira] [Created] (SPARK-12603) MLlib GaussianMixtureModel should support single instance predict/predictSoft

2016-01-02 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-12603: --- Summary: MLlib GaussianMixtureModel should support single instance predict/predictSoft Key: SPARK-12603 URL: https://issues.apache.org/jira/browse/SPARK-12603 Project:

[jira] [Closed] (SPARK-12597) Use udf to replace callUDF for ML

2016-01-02 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang closed SPARK-12597. --- Resolution: Duplicate > Use udf to replace callUDF for ML > - > >

[jira] [Created] (SPARK-12597) Use udf replace callUDF for ML

2016-01-01 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-12597: --- Summary: Use udf replace callUDF for ML Key: SPARK-12597 URL: https://issues.apache.org/jira/browse/SPARK-12597 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-12597) Use udf replace callUDF for ML

2016-01-01 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12597: Description: callUDF has been deprecated and will be removed in Spark 2.0. We should replace the

[jira] [Updated] (SPARK-12597) Use udf to replace callUDF for ML

2016-01-01 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12597: Summary: Use udf to replace callUDF for ML (was: Use udf replace callUDF for ML) > Use udf to

[jira] [Commented] (SPARK-11939) PySpark support model export/import for Pipeline API

2015-12-24 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070816#comment-15070816 ] Yanbo Liang commented on SPARK-11939: - [~josephkb] I have implemented

[jira] [Updated] (SPARK-11939) PySpark support model export/import for Pipeline API

2015-12-24 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11939: Issue Type: Umbrella (was: Sub-task) Parent: (was: SPARK-11937) > PySpark support

[jira] [Comment Edited] (SPARK-12494) Array out of bound Exception in KMeans Yarn Mode

2015-12-24 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070840#comment-15070840 ] Yanbo Liang edited comment on SPARK-12494 at 12/24/15 10:15 AM:

[jira] [Comment Edited] (SPARK-12494) Array out of bound Exception in KMeans Yarn Mode

2015-12-24 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070840#comment-15070840 ] Yanbo Liang edited comment on SPARK-12494 at 12/24/15 10:14 AM:

[jira] [Commented] (SPARK-12494) Array out of bound Exception in KMeans Yarn Mode

2015-12-24 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070840#comment-15070840 ] Yanbo Liang commented on SPARK-12494: - [~anandr...@gmail.com] Can this issue be reproduced? It looks

[jira] [Commented] (SPARK-12461) Add ExpressionDescription to math functions

2015-12-24 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070844#comment-15070844 ] Yanbo Liang commented on SPARK-12461: - I can work on it. > Add ExpressionDescription to math

[jira] [Issue Comment Deleted] (SPARK-12461) Add ExpressionDescription to math functions

2015-12-24 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12461: Comment: was deleted (was: I can work on it.) > Add ExpressionDescription to math functions >

[jira] [Commented] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2015-12-17 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061761#comment-15061761 ] Yanbo Liang commented on SPARK-12363: - {quote} Does it improve if you increase the number of

[jira] [Comment Edited] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2015-12-17 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061761#comment-15061761 ] Yanbo Liang edited comment on SPARK-12363 at 12/17/15 9:19 AM: --- {quote}

[jira] [Comment Edited] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2015-12-17 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061761#comment-15061761 ] Yanbo Liang edited comment on SPARK-12363 at 12/17/15 9:20 AM: --- {quote}

[jira] [Updated] (SPARK-12393) Add read.text and write.text for SparkR

2015-12-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12393: Issue Type: Sub-task (was: New Feature) Parent: SPARK-12144 > Add read.text and

[jira] [Created] (SPARK-12393) Add read.text and write.text for SparkR

2015-12-16 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-12393: --- Summary: Add read.text and write.text for SparkR Key: SPARK-12393 URL: https://issues.apache.org/jira/browse/SPARK-12393 Project: Spark Issue Type: New

[jira] [Commented] (SPARK-11478) ML StringIndexer return inconsistent schema

2015-12-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061371#comment-15061371 ] Yanbo Liang commented on SPARK-11478: - [~wjur] I'm not working on this. You can work on it if you

[jira] [Created] (SPARK-12364) Add ML example for SparkR

2015-12-16 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-12364: --- Summary: Add ML example for SparkR Key: SPARK-12364 URL: https://issues.apache.org/jira/browse/SPARK-12364 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2015-12-16 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-12363: --- Summary: PowerIterationClustering test case failed if we deprecated KMeans.setRuns Key: SPARK-12363 URL: https://issues.apache.org/jira/browse/SPARK-12363 Project:

[jira] [Commented] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2015-12-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059753#comment-15059753 ] Yanbo Liang commented on SPARK-12363: - After I removed [this

[jira] [Comment Edited] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2015-12-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059753#comment-15059753 ] Yanbo Liang edited comment on SPARK-12363 at 12/16/15 9:38 AM: --- After I

[jira] [Updated] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2015-12-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12363: Component/s: (was: GraphX) > PowerIterationClustering test case failed if we deprecated

[jira] [Comment Edited] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2015-12-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059753#comment-15059753 ] Yanbo Liang edited comment on SPARK-12363 at 12/16/15 9:40 AM: --- After I

[jira] [Comment Edited] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2015-12-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059753#comment-15059753 ] Yanbo Liang edited comment on SPARK-12363 at 12/16/15 9:41 AM: --- This bug is

[jira] [Commented] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2015-12-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059763#comment-15059763 ] Yanbo Liang commented on SPARK-12363: - cc [~mengxr] [~josephkb] [~viirya] Would you mind to take a

[jira] [Comment Edited] (SPARK-12350) VectorAssembler#transform() initially throws an exception

2015-12-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059788#comment-15059788 ] Yanbo Liang edited comment on SPARK-12350 at 12/16/15 10:15 AM: I can

[jira] [Commented] (SPARK-12350) VectorAssembler#transform() initially throws an exception

2015-12-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059788#comment-15059788 ] Yanbo Liang commented on SPARK-12350: - I can reproduce this issue, but it not caused by ML because it

[jira] [Created] (SPARK-12310) Add write.json and write.parquet for SparkR

2015-12-13 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-12310: --- Summary: Add write.json and write.parquet for SparkR Key: SPARK-12310 URL: https://issues.apache.org/jira/browse/SPARK-12310 Project: Spark Issue Type:

[jira] [Updated] (SPARK-12309) Use sqlContext from MLlibTestSparkContext for spark.ml test suites

2015-12-12 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12309: Description: Use sqlContext from MLlibTestSparkContext rather than creating new one for spark.ml

[jira] [Updated] (SPARK-12309) Use sqlContext from MLlibTestSparkContext for spark.ml test suites

2015-12-12 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12309: Description: Use sqlContext from MLlibTestSparkContext rather than creating new one for each

[jira] [Created] (SPARK-12309) Use sqlContext from MLlibTestSparkContext for spark.ml test suites

2015-12-12 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-12309: --- Summary: Use sqlContext from MLlibTestSparkContext for spark.ml test suites Key: SPARK-12309 URL: https://issues.apache.org/jira/browse/SPARK-12309 Project: Spark

[jira] [Issue Comment Deleted] (SPARK-11685) Find duplicate content under examples/

2015-12-11 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11685: Comment: was deleted (was: [~josephkb] I have checked thoroughly, there are no other examples we

[jira] [Commented] (SPARK-11685) Find duplicate content under examples/

2015-12-11 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15054055#comment-15054055 ] Yanbo Liang commented on SPARK-11685: - [~josephkb] I have checked thoroughly, there are no other

[jira] [Commented] (SPARK-11685) Find duplicate content under examples/

2015-12-11 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15054058#comment-15054058 ] Yanbo Liang commented on SPARK-11685: - [~josephkb] I have checked thoroughly, there are no other

[jira] [Commented] (SPARK-11685) Find duplicate content under examples/

2015-12-11 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15054056#comment-15054056 ] Yanbo Liang commented on SPARK-11685: - [~josephkb] I have checked thoroughly, there are no other

<    5   6   7   8   9   10   11   12   13   14   >