[jira] [Updated] (SPARK-16137) Random Forest wrapper in SparkR

2016-07-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16137: -- Issue Type: Sub-task (was: New Feature) Parent: SPARK-16442 > Random Forest wrapper

[jira] [Created] (SPARK-16445) Multilayer Perceptron Classifier wrapper in SparkR

2016-07-08 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-16445: - Summary: Multilayer Perceptron Classifier wrapper in SparkR Key: SPARK-16445 URL: https://issues.apache.org/jira/browse/SPARK-16445 Project: Spark Issue

[jira] [Updated] (SPARK-16444) Isotonic Regression wrapper in SparkR

2016-07-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16444: -- Target Version/s: 2.1.0 Description: Implement Isotonic Regression wrapper and other

[jira] [Commented] (SPARK-16444) Isotonic Regression wrapper in SparkR

2016-07-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15367924#comment-15367924 ] Xiangrui Meng commented on SPARK-16444: --- [~wangmiao1981] Would you be interested in working on

[jira] [Created] (SPARK-16443) ALS wrapper in SparkR

2016-07-08 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-16443: - Summary: ALS wrapper in SparkR Key: SPARK-16443 URL: https://issues.apache.org/jira/browse/SPARK-16443 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-16444) IsotonicRegression in SparkR

2016-07-08 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-16444: - Summary: IsotonicRegression in SparkR Key: SPARK-16444 URL: https://issues.apache.org/jira/browse/SPARK-16444 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-15581) MLlib 2.1 Roadmap

2016-07-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-15581: -- Description: This is a master list for MLlib improvements we are working on for the next

[jira] [Assigned] (SPARK-16442) MLlib wrappers for SparkR 2.1

2016-07-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-16442: - Assignee: Xiangrui Meng > MLlib wrappers for SparkR 2.1 > -

[jira] [Created] (SPARK-16442) MLlib wrappers for SparkR 2.1

2016-07-08 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-16442: - Summary: MLlib wrappers for SparkR 2.1 Key: SPARK-16442 URL: https://issues.apache.org/jira/browse/SPARK-16442 Project: Spark Issue Type: Umbrella

[jira] [Resolved] (SPARK-16294) Labelling support for the include_example Jekyll plugin

2016-06-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-16294. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13972

[jira] [Commented] (SPARK-16144) Add a separate Rd for ML generic methods: read.ml, write.ml, summary, predict

2016-06-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15355601#comment-15355601 ] Xiangrui Meng commented on SPARK-16144: --- [~iamshrek] Thanks for helping! I asked Yanbo to take a

[jira] [Commented] (SPARK-16144) Add a separate Rd for ML generic methods: read.ml, write.ml, summary, predict

2016-06-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15355599#comment-15355599 ] Xiangrui Meng commented on SPARK-16144: --- [~yanboliang] Do you have time to make a final pass over

[jira] [Updated] (SPARK-16144) Add a separate Rd for ML generic methods: read.ml, write.ml, summary, predict

2016-06-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16144: -- Assignee: Yanbo Liang (was: Xin Ren) > Add a separate Rd for ML generic methods: read.ml,

[jira] [Resolved] (SPARK-16140) Group k-means method in generated doc

2016-06-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-16140. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 > Group k-means

[jira] [Updated] (SPARK-16245) model loading backward compatibility for ml.feature.PCA

2016-06-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16245: -- Assignee: Yanbo Liang > model loading backward compatibility for ml.feature.PCA >

[jira] [Resolved] (SPARK-16245) model loading backward compatibility for ml.feature.PCA

2016-06-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-16245. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by

[jira] [Updated] (SPARK-16144) Add a separate Rd for ML generic methods: read.ml, write.ml, summary, predict

2016-06-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16144: -- Assignee: Xin Ren > Add a separate Rd for ML generic methods: read.ml, write.ml, summary,

[jira] [Comment Edited] (SPARK-16144) Add a separate Rd for ML generic methods: read.ml, write.ml, summary, predict

2016-06-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352409#comment-15352409 ] Xiangrui Meng edited comment on SPARK-16144 at 6/28/16 5:57 AM: Please

[jira] [Commented] (SPARK-16144) Add a separate Rd for ML generic methods: read.ml, write.ml, summary, predict

2016-06-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352409#comment-15352409 ] Xiangrui Meng commented on SPARK-16144: --- Please hold because this should be combined with

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2016-06-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352289#comment-15352289 ] Xiangrui Meng commented on SPARK-15799: --- [~sunrui] Maybe we can download the corresponding Spark

[jira] [Updated] (SPARK-16242) Wrap the Matrix conversion utils in Python

2016-06-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16242: -- Assignee: Yanbo Liang > Wrap the Matrix conversion utils in Python >

[jira] [Resolved] (SPARK-16143) Group survival analysis methods in generated doc

2016-06-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-16143. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by

[jira] [Updated] (SPARK-16231) PySpark ML DataFrame example fails on Vector conversion

2016-06-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16231: -- Assignee: Bryan Cutler > PySpark ML DataFrame example fails on Vector conversion >

[jira] [Resolved] (SPARK-16231) PySpark ML DataFrame example fails on Vector conversion

2016-06-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-16231. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by

[jira] [Resolved] (SPARK-16187) Implement util method for ML Matrix conversion in scala/java

2016-06-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-16187. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by

[jira] [Updated] (SPARK-16187) Implement util method for ML Matrix conversion in scala/java

2016-06-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16187: -- Assignee: yuhao yang > Implement util method for ML Matrix conversion in scala/java >

[jira] [Commented] (SPARK-16164) CombineFilters should keep the ordering in the logical plan

2016-06-24 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15348438#comment-15348438 ] Xiangrui Meng commented on SPARK-16164: --- [~lian cheng] See my last comment on GitHub: I didn't use

[jira] [Commented] (SPARK-16000) Make model loading backward compatible with saved models using old vector columns

2016-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347705#comment-15347705 ] Xiangrui Meng commented on SPARK-16000: --- We can distribute the work easily if you can help create

[jira] [Updated] (SPARK-15784) Add Power Iteration Clustering to spark.ml

2016-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-15784: -- Target Version/s: 2.1.0 > Add Power Iteration Clustering to spark.ml >

[jira] [Updated] (SPARK-16133) model loading backward compatibility for ml.feature

2016-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16133: -- Assignee: yuhao yang > model loading backward compatibility for ml.feature >

[jira] [Resolved] (SPARK-16133) model loading backward compatibility for ml.feature

2016-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-16133. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by

[jira] [Resolved] (SPARK-16142) Group naive Bayes methods in generated doc

2016-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-16142. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by

[jira] [Updated] (SPARK-16177) model loading backward compatibility for ml.regression

2016-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16177: -- Assignee: yuhao yang > model loading backward compatibility for ml.regression >

[jira] [Resolved] (SPARK-16177) model loading backward compatibility for ml.regression

2016-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-16177. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by

[jira] [Updated] (SPARK-16164) CombineFilters should keep the ordering in the logical plan

2016-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16164: -- Summary: CombineFilters should keep the ordering in the logical plan (was: Filter pushdown

[jira] [Resolved] (SPARK-16164) Filter pushdown should keep the ordering in the logical plan

2016-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-16164. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by

[jira] [Updated] (SPARK-16164) Filter pushdown should keep the ordering in the logical plan

2016-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16164: -- Assignee: Dongjoon Hyun > Filter pushdown should keep the ordering in the logical plan >

[jira] [Updated] (SPARK-16143) Group survival analysis methods in generated doc

2016-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16143: -- Assignee: Junyang Qian > Group survival analysis methods in generated doc >

[jira] [Assigned] (SPARK-16142) Group naive Bayes methods in generated doc

2016-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-16142: - Assignee: Xiangrui Meng > Group naive Bayes methods in generated doc >

[jira] [Updated] (SPARK-16130) model loading backward compatibility for ml.classfication.LogisticRegression

2016-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16130: -- Assignee: yuhao yang > model loading backward compatibility for

[jira] [Updated] (SPARK-16130) model loading backward compatibility for ml.classfication.LogisticRegression

2016-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16130: -- Fix Version/s: (was: 2.0.0) 2.1.0 2.0.1 > model

[jira] [Resolved] (SPARK-16130) model loading backward compatibility for ml.classfication.LogisticRegression

2016-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-16130. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13841

[jira] [Commented] (SPARK-16140) Group k-means method in generated doc

2016-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15346758#comment-15346758 ] Xiangrui Meng commented on SPARK-16140: --- Btw, please make minimal changes and do not move the code

[jira] [Commented] (SPARK-16140) Group k-means method in generated doc

2016-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15346752#comment-15346752 ] Xiangrui Meng commented on SPARK-16140: --- Thanks! Note that this is time sensitive for the release.

[jira] [Updated] (SPARK-16140) Group k-means method in generated doc

2016-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16140: -- Assignee: Xin Ren > Group k-means method in generated doc >

[jira] [Deleted] (SPARK-16171) Filter UDFs in StringIndexer shouldn't throw exception

2016-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng deleted SPARK-16171: -- > Filter UDFs in StringIndexer shouldn't throw exception >

[jira] [Updated] (SPARK-16171) Filter UDFs in StringIndexer shouldn't throw exception

2016-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16171: -- Description: [~cmccubbin] reported a bug when he used StringIndexer in an ML pipeline with

[jira] [Updated] (SPARK-16171) Filter UDFs in StringIndexer shouldn't throw exception

2016-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16171: -- Component/s: (was: SQL) MLlib > Filter UDFs in StringIndexer shouldn't

[jira] [Created] (SPARK-16171) Filter UDFs in StringIndexer shouldn't throw exception

2016-06-23 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-16171: - Summary: Filter UDFs in StringIndexer shouldn't throw exception Key: SPARK-16171 URL: https://issues.apache.org/jira/browse/SPARK-16171 Project: Spark

[jira] [Resolved] (SPARK-16154) Update spark.ml and spark.mllib package docs

2016-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-16154. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by

[jira] [Commented] (SPARK-16164) Filter pushdown should keep the ordering in the logical plan

2016-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345958#comment-15345958 ] Xiangrui Meng commented on SPARK-16164: --- Thanks for identifying the root cause so quickly! >

[jira] [Commented] (SPARK-9478) Add class weights to Random Forest

2016-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345946#comment-15345946 ] Xiangrui Meng commented on SPARK-9478: -- Sorry for being late in the discussion! Instance weight

[jira] [Updated] (SPARK-9478) Add class weights to Random Forest

2016-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9478: - Target Version/s: 2.1.0 (was: ) > Add class weights to Random Forest >

[jira] [Commented] (SPARK-5992) Locality Sensitive Hashing (LSH) for MLlib

2016-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345890#comment-15345890 ] Xiangrui Meng commented on SPARK-5992: -- FYI, I had an offline discussion with Kelvin Chu and Erran Li

[jira] [Updated] (SPARK-16164) Filter pushdown should keep the ordering in the logical plan

2016-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16164: -- Description: [~cmccubbin] reported a bug when he used StringIndexer in an ML pipeline with

[jira] [Updated] (SPARK-16164) Filter pushdown should keep the ordering in the logical plan

2016-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16164: -- Issue Type: Bug (was: Improvement) > Filter pushdown should keep the ordering in the logical

[jira] [Updated] (SPARK-16164) Filter pushdown should keep the ordering in the logical plan

2016-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16164: -- Description: [~cmccubbin] reported a bug when he used StringIndexer in an ML pipeline with

[jira] [Created] (SPARK-16164) Filter pushdown should keep the ordering in the logical plan

2016-06-23 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-16164: - Summary: Filter pushdown should keep the ordering in the logical plan Key: SPARK-16164 URL: https://issues.apache.org/jira/browse/SPARK-16164 Project: Spark

[jira] [Resolved] (SPARK-16155) Remove package grouping in genjavadoc

2016-06-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-16155. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by

[jira] [Updated] (SPARK-16153) A single-line ScalaDoc and @deprecate annotation would break genjavadoc

2016-06-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16153: -- Fix Version/s: (was: 2.0.0) 2.0.1 2.1.0 > A

[jira] [Resolved] (SPARK-16153) A single-line ScalaDoc and @deprecate annotation would break genjavadoc

2016-06-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-16153. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13855

[jira] [Created] (SPARK-16155) Remove package grouping in genjavadoc

2016-06-22 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-16155: - Summary: Remove package grouping in genjavadoc Key: SPARK-16155 URL: https://issues.apache.org/jira/browse/SPARK-16155 Project: Spark Issue Type:

[jira] [Created] (SPARK-16154) Update spark.ml and spark.mllib package docs

2016-06-22 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-16154: - Summary: Update spark.ml and spark.mllib package docs Key: SPARK-16154 URL: https://issues.apache.org/jira/browse/SPARK-16154 Project: Spark Issue Type:

[jira] [Updated] (SPARK-16153) A single-line ScalaDoc and @deprecate annotation would break genjavadoc

2016-06-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16153: -- Description: Env: Scala 2.11.8, Java 1.7.0_79 We recently deprecated setLabelCol in

[jira] [Updated] (SPARK-16153) A single-line ScalaDoc and @deprecate annotation would break genjavadoc

2016-06-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16153: -- Description: Env: Scala 2.11.8, Java 1.7.0_79 We recently deprecated setLabelCol in

[jira] [Updated] (SPARK-16153) A single-line ScalaDoc and @deprecate annotation would break genjavadoc

2016-06-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16153: -- Description: Env: Scala 2.11.8, Java 1.7.0_79 We recently deprecated setLabelCol in

[jira] [Updated] (SPARK-16153) A single-line ScalaDoc and @deprecate annotation would break genjavadoc

2016-06-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16153: -- Description: Env: Scala 2.11.8, Java 1.7.0_79 We recently deprecated setLabelCol in

[jira] [Created] (SPARK-16153) A single-line ScalaDoc and @deprecate annotation would break genjavadoc

2016-06-22 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-16153: - Summary: A single-line ScalaDoc and @deprecate annotation would break genjavadoc Key: SPARK-16153 URL: https://issues.apache.org/jira/browse/SPARK-16153 Project:

[jira] [Updated] (SPARK-16151) Make generated params non-final

2016-06-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16151: -- Description: Currently, all generated param instances are final. There are several scenarios

[jira] [Commented] (SPARK-16151) Make generated params non-final

2016-06-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344905#comment-15344905 ] Xiangrui Meng commented on SPARK-16151: --- [~srowen] Sorry I didn't finish the full story. JIRA was

[jira] [Deleted] (SPARK-16150) Make generated params non-final

2016-06-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng deleted SPARK-16150: -- > Make generated params non-final > --- > > Key:

[jira] [Created] (SPARK-16151) Make generated params non-final

2016-06-22 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-16151: - Summary: Make generated params non-final Key: SPARK-16151 URL: https://issues.apache.org/jira/browse/SPARK-16151 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-16150) Make generated params non-final

2016-06-22 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-16150: - Summary: Make generated params non-final Key: SPARK-16150 URL: https://issues.apache.org/jira/browse/SPARK-16150 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-16149) API consistency discussion: CountVectorizer.{minDF -> minDocFreq, minTF -> minTermFreq}

2016-06-22 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-16149: - Summary: API consistency discussion: CountVectorizer.{minDF -> minDocFreq, minTF -> minTermFreq} Key: SPARK-16149 URL: https://issues.apache.org/jira/browse/SPARK-16149

[jira] [Created] (SPARK-16147) Add package docs to packages under spark.ml

2016-06-22 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-16147: - Summary: Add package docs to packages under spark.ml Key: SPARK-16147 URL: https://issues.apache.org/jira/browse/SPARK-16147 Project: Spark Issue Type:

[jira] [Updated] (SPARK-16127) Audit @Since annotations related to ml.linalg

2016-06-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16127: -- Fix Version/s: (was: 2.0.0) 2.0.1 2.1.0 > Audit

[jira] [Resolved] (SPARK-16127) Audit @Since annotations related to ml.linalg

2016-06-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-16127. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13840

[jira] [Updated] (SPARK-15644) Replace SQLContext with SparkSession in MLlib

2016-06-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-15644: -- Fix Version/s: (was: 2.0.0) 2.0.1 2.1.0 > Replace

[jira] [Commented] (SPARK-15644) Replace SQLContext with SparkSession in MLlib

2016-06-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344667#comment-15344667 ] Xiangrui Meng commented on SPARK-15644: --- Changed the fix versions to 2.0.1 and 2.1.0 since

[jira] [Updated] (SPARK-16121) ListingFileCatalog does not list in parallel anymore

2016-06-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16121: -- Fix Version/s: (was: 2.0.0) 2.0.1 2.1.0 >

[jira] [Commented] (SPARK-16121) ListingFileCatalog does not list in parallel anymore

2016-06-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344664#comment-15344664 ] Xiangrui Meng commented on SPARK-16121: --- Changed the fix versions to 2.0.1 and 2.1.0 since

[jira] [Updated] (SPARK-15162) Update PySpark LogisticRegression threshold PyDoc to be as complete as Scaladoc

2016-06-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-15162: -- Fix Version/s: (was: 2.0.0) 2.0.1 2.1.0 > Update

[jira] [Commented] (SPARK-15162) Update PySpark LogisticRegression threshold PyDoc to be as complete as Scaladoc

2016-06-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344665#comment-15344665 ] Xiangrui Meng commented on SPARK-15162: --- Changed the fix versions to 2.0.1 and 2.1.0 since

[jira] [Updated] (SPARK-15164) Mark classification algorithms as experimental where marked so in scala

2016-06-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-15164: -- Fix Version/s: (was: 2.0.0) 2.0.1 2.1.0 > Mark

[jira] [Commented] (SPARK-15164) Mark classification algorithms as experimental where marked so in scala

2016-06-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344666#comment-15344666 ] Xiangrui Meng commented on SPARK-15164: --- Changed the fix versions to 2.0.1 and 2.1.0 since

[jira] [Commented] (SPARK-16097) Encoders.tuple should handle null object correctly

2016-06-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344662#comment-15344662 ] Xiangrui Meng commented on SPARK-16097: --- Changed the fix versions to 2.0.1 and 2.1.0 since

[jira] [Updated] (SPARK-16097) Encoders.tuple should handle null object correctly

2016-06-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16097: -- Fix Version/s: (was: 2.0.0) 2.0.1 2.1.0 >

[jira] [Created] (SPARK-16144) Add a separate Rd for ML generic methods: read.ml, write.ml, summary, predict

2016-06-22 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-16144: - Summary: Add a separate Rd for ML generic methods: read.ml, write.ml, summary, predict Key: SPARK-16144 URL: https://issues.apache.org/jira/browse/SPARK-16144

[jira] [Updated] (SPARK-16143) Group survival analysis methods in generated doc

2016-06-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16143: -- Description: Follow SPARK-16107 and group the doc of spark.survreg, predict(SR), summary(SR),

[jira] [Updated] (SPARK-16142) Group naive Bayes methods in generated doc

2016-06-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16142: -- Component/s: MLlib > Group naive Bayes methods in generated doc >

[jira] [Updated] (SPARK-16140) Group k-means method in generated doc

2016-06-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16140: -- Description: Follow SPARK-16107 and group the doc of spark.kmeans, predict(KM), summary(KM),

[jira] [Updated] (SPARK-16140) Group k-means method in generated doc

2016-06-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16140: -- Component/s: MLlib > Group k-means method in generated doc >

[jira] [Updated] (SPARK-16142) Group naive Bayes methods in generated doc

2016-06-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16142: -- Description: Follow SPARK-16107 and group the doc of spark.naiveBayes: spark.naiveBayes,

[jira] [Updated] (SPARK-16143) Group survival analysis methods in generated doc

2016-06-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16143: -- Description: Group the doc of spark.survreg, predict(SR), summary(SR), read/write.ml(SR) under

[jira] [Created] (SPARK-16143) Group survival analysis methods in generated doc

2016-06-22 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-16143: - Summary: Group survival analysis methods in generated doc Key: SPARK-16143 URL: https://issues.apache.org/jira/browse/SPARK-16143 Project: Spark Issue

[jira] [Updated] (SPARK-16142) Group naive Bayes methods in generated doc

2016-06-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16142: -- Labels: starter (was: ) > Group naive Bayes methods in generated doc >

[jira] [Created] (SPARK-16142) Group naive Bayes methods in generated doc

2016-06-22 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-16142: - Summary: Group naive Bayes methods in generated doc Key: SPARK-16142 URL: https://issues.apache.org/jira/browse/SPARK-16142 Project: Spark Issue Type:

[jira] [Created] (SPARK-16140) Group k-means method in generated doc

2016-06-22 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-16140: - Summary: Group k-means method in generated doc Key: SPARK-16140 URL: https://issues.apache.org/jira/browse/SPARK-16140 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-16107) Group GLM-related methods in generated doc

2016-06-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16107: -- Fix Version/s: (was: 2.0.0) 2.1.0 2.0.1 > Group

[jira] [Commented] (SPARK-16107) Group GLM-related methods in generated doc

2016-06-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344642#comment-15344642 ] Xiangrui Meng commented on SPARK-16107: --- Set fix versions to 2.1.0 and 2.0.1 since 2.0.0-RC1 is in

<    2   3   4   5   6   7   8   9   10   11   >