[jira] [Resolved] (SPARK-10076) make MultilayerPerceptronClassifier layers and weights public

2015-08-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-10076. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8263 [https://gi

[jira] [Commented] (SPARK-9911) User guide for MulticlassClassificationEvaluator

2015-08-17 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700802#comment-14700802 ] Manoj Kumar commented on SPARK-9911: Umm. What additional advantage does the Multiclas

[jira] [Resolved] (SPARK-10038) TungstenProject code generation fails when applied to array

2015-08-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-10038. - Resolution: Fixed Fix Version/s: 1.5.0 > TungstenProject code generation fails when applie

[jira] [Commented] (SPARK-8847) String concatination with column in SparkR

2015-08-17 Thread Amar Gondaliya (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700785#comment-14700785 ] Amar Gondaliya commented on SPARK-8847: --- Yes, This covers my use cases. Thanks Siva

[jira] [Created] (SPARK-10080) Binary Incompatibility in SQLContext implicits

2015-08-17 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-10080: Summary: Binary Incompatibility in SQLContext implicits Key: SPARK-10080 URL: https://issues.apache.org/jira/browse/SPARK-10080 Project: Spark Issue

[jira] [Commented] (SPARK-6489) Optimize lateral view with explode to not read unnecessary columns

2015-08-17 Thread Jerrick Hoang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700742#comment-14700742 ] Jerrick Hoang commented on SPARK-6489: -- are people still working on this? > Optimize

[jira] [Commented] (SPARK-10079) Make `column` and `col` functions be S4 functions

2015-08-17 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700721#comment-14700721 ] Yu Ishikawa commented on SPARK-10079: - I see. I misunderstood them in SparkR since {{

[jira] [Commented] (SPARK-10079) Make `column` and `col` functions be S4 functions

2015-08-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700706#comment-14700706 ] Shivaram Venkataraman commented on SPARK-10079: --- [~yuu.ishik...@gmail.com]

[jira] [Updated] (SPARK-9949) TakeOrderedAndProject returns wrong output attributes when project is pushed in to it

2015-08-17 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9949: Fix Version/s: 1.4.2 > TakeOrderedAndProject returns wrong output attributes when project is pushed > in to

[jira] [Updated] (SPARK-7289) Combine Limit and Sort to avoid total ordering

2015-08-17 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-7289: Fix Version/s: 1.4.2 > Combine Limit and Sort to avoid total ordering >

[jira] [Created] (SPARK-10079) Make `column` and `col` functions be S4 functions

2015-08-17 Thread Yu Ishikawa (JIRA)
Yu Ishikawa created SPARK-10079: --- Summary: Make `column` and `col` functions be S4 functions Key: SPARK-10079 URL: https://issues.apache.org/jira/browse/SPARK-10079 Project: Spark Issue Type: S

[jira] [Assigned] (SPARK-9856) Add expression functions into SparkR whose params are complicated

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9856: --- Assignee: (was: Apache Spark) > Add expression functions into SparkR whose params are com

[jira] [Commented] (SPARK-9856) Add expression functions into SparkR whose params are complicated

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700688#comment-14700688 ] Apache Spark commented on SPARK-9856: - User 'yu-iskw' has created a pull request for t

[jira] [Assigned] (SPARK-9856) Add expression functions into SparkR whose params are complicated

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9856: --- Assignee: Apache Spark > Add expression functions into SparkR whose params are complicated >

[jira] [Resolved] (SPARK-7808) Scala package doc for spark.ml.feature

2015-08-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7808. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8260 [https://githu

[jira] [Resolved] (SPARK-10059) Broken test: YarnClusterSuite

2015-08-17 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-10059. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 1.5.0 > Broken te

[jira] [Updated] (SPARK-10076) make MultilayerPerceptronClassifier layers and weights public

2015-08-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10076: -- Assignee: Yanbo Liang > make MultilayerPerceptronClassifier layers and weights public > --

[jira] [Updated] (SPARK-10076) make MultilayerPerceptronClassifier layers and weights public

2015-08-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10076: -- Target Version/s: 1.5.0 > make MultilayerPerceptronClassifier layers and weights public >

[jira] [Updated] (SPARK-10076) make MultilayerPerceptronClassifier layers and weights public

2015-08-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10076: -- Shepherd: Xiangrui Meng > make MultilayerPerceptronClassifier layers and weights public >

[jira] [Commented] (SPARK-8520) Improve GLM's scalability on number of features

2015-08-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700635#comment-14700635 ] Xiangrui Meng commented on SPARK-8520: -- We already use treeReduce and treeAggregate i

[jira] [Commented] (SPARK-8520) Improve GLM's scalability on number of features

2015-08-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700634#comment-14700634 ] Xiangrui Meng commented on SPARK-8520: -- No, this is for general discussion. I created

[jira] [Created] (SPARK-10078) Vector-free L-BFGS

2015-08-17 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-10078: - Summary: Vector-free L-BFGS Key: SPARK-10078 URL: https://issues.apache.org/jira/browse/SPARK-10078 Project: Spark Issue Type: New Feature Compon

[jira] [Updated] (SPARK-8520) Improve GLM's scalability on number of features

2015-08-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8520: - Issue Type: Brainstorming (was: Improvement) > Improve GLM's scalability on number of features >

[jira] [Assigned] (SPARK-10076) make MultilayerPerceptronClassifier layers and weights public

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10076: Assignee: Apache Spark > make MultilayerPerceptronClassifier layers and weights public >

[jira] [Assigned] (SPARK-10076) make MultilayerPerceptronClassifier layers and weights public

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10076: Assignee: (was: Apache Spark) > make MultilayerPerceptronClassifier layers and weights

[jira] [Commented] (SPARK-10076) make MultilayerPerceptronClassifier layers and weights public

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700629#comment-14700629 ] Apache Spark commented on SPARK-10076: -- User 'yanboliang' has created a pull request

[jira] [Updated] (SPARK-10076) make MultilayerPerceptronClassifier layers and weights public

2015-08-17 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-10076: Summary: make MultilayerPerceptronClassifier layers and weights public (was: makes MultilayerPerc

[jira] [Updated] (SPARK-10076) make MultilayerPerceptronClassifier layers and weights public

2015-08-17 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-10076: Description: make MultilayerPerceptronClassifier layers and weights public (was: makes Multilayer

[jira] [Created] (SPARK-10077) Java package doc for spark.ml.feature

2015-08-17 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-10077: - Summary: Java package doc for spark.ml.feature Key: SPARK-10077 URL: https://issues.apache.org/jira/browse/SPARK-10077 Project: Spark Issue Type: Documenta

[jira] [Created] (SPARK-10076) makes MultilayerPerceptronClassifier layers and weights public

2015-08-17 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-10076: --- Summary: makes MultilayerPerceptronClassifier layers and weights public Key: SPARK-10076 URL: https://issues.apache.org/jira/browse/SPARK-10076 Project: Spark

[jira] [Updated] (SPARK-7808) Scala package doc for spark.ml.feature

2015-08-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7808: - Summary: Scala package doc for spark.ml.feature (was: Package doc for spark.ml.feature) > Scala

[jira] [Resolved] (SPARK-9902) Add Java and Python examples to user guide for 1-sample KS test

2015-08-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9902. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8154 [https://githu

[jira] [Commented] (SPARK-10051) Support collecting data of StructType in DataFrame

2015-08-17 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700587#comment-14700587 ] Sun Rui commented on SPARK-10051: - Yes. StructType maps well to a named list. Once SerDE

[jira] [Resolved] (SPARK-9951) Example code for Multilayer Perceptron Classifier

2015-08-17 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9951. -- Resolution: Duplicate > Example code for Multilayer Perceptron Classifier >

[jira] [Commented] (SPARK-9951) Example code for Multilayer Perceptron Classifier

2015-08-17 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700568#comment-14700568 ] Joseph K. Bradley commented on SPARK-9951: -- Just glanced at it. I think that exa

[jira] [Commented] (SPARK-9951) Example code for Multilayer Perceptron Classifier

2015-08-17 Thread Alexander Ulanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700567#comment-14700567 ] Alexander Ulanov commented on SPARK-9951: - I've submitter a PR for the user guide.

[jira] [Assigned] (SPARK-9846) User guide for Multilayer Perceptron Classifier

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9846: --- Assignee: Apache Spark (was: Alexander Ulanov) > User guide for Multilayer Perceptron Classi

[jira] [Commented] (SPARK-9846) User guide for Multilayer Perceptron Classifier

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700564#comment-14700564 ] Apache Spark commented on SPARK-9846: - User 'avulanov' has created a pull request for

[jira] [Assigned] (SPARK-9846) User guide for Multilayer Perceptron Classifier

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9846: --- Assignee: Alexander Ulanov (was: Apache Spark) > User guide for Multilayer Perceptron Classi

[jira] [Updated] (SPARK-9906) User guide for LogisticRegressionSummary

2015-08-17 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-9906: - Description: SPARK-9112 introduces {{LogisticRegressionSummary}} to provide R-like model statistic

[jira] [Created] (SPARK-10075) Add `when` expressino function in SparkR

2015-08-17 Thread Yu Ishikawa (JIRA)
Yu Ishikawa created SPARK-10075: --- Summary: Add `when` expressino function in SparkR Key: SPARK-10075 URL: https://issues.apache.org/jira/browse/SPARK-10075 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-7707) User guide and example code for KernelDensity

2015-08-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7707. -- Resolution: Fixed Fix Version/s: 1.5.0 1.4.2 Issue resolved by pull re

[jira] [Updated] (SPARK-7707) User guide and example code for KernelDensity

2015-08-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7707: - Shepherd: Xiangrui Meng > User guide and example code for KernelDensity >

[jira] [Resolved] (SPARK-9898) User guide for PrefixSpan

2015-08-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9898. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8253 [https://githu

[jira] [Assigned] (SPARK-10074) Include Float in @specialized annotation

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10074: Assignee: Apache Spark > Include Float in @specialized annotation > --

[jira] [Commented] (SPARK-10074) Include Float in @specialized annotation

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700535#comment-14700535 ] Apache Spark commented on SPARK-10074: -- User 'tedyu' has created a pull request for

[jira] [Assigned] (SPARK-10074) Include Float in @specialized annotation

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10074: Assignee: (was: Apache Spark) > Include Float in @specialized annotation > ---

[jira] [Created] (SPARK-10074) Include Float in @specialized annotation

2015-08-17 Thread Ted Yu (JIRA)
Ted Yu created SPARK-10074: -- Summary: Include Float in @specialized annotation Key: SPARK-10074 URL: https://issues.apache.org/jira/browse/SPARK-10074 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-9776) Another instance of Derby may have already booted the database

2015-08-17 Thread Sudhakar Thota (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700526#comment-14700526 ] Sudhakar Thota commented on SPARK-9776: --- Thanks Michael and Eugene for your quick re

[jira] [Updated] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

2015-08-17 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7736: - Fix Version/s: 1.6.0 > Exception not failing Python applications (in yarn cluster mode) >

[jira] [Updated] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

2015-08-17 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7736: - Target Version/s: 1.6.0, 1.5.1 (was: 1.6.0) > Exception not failing Python applications (in yarn cluster

[jira] [Updated] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

2015-08-17 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7736: - Target Version/s: 1.6.0 (was: 1.5.1) > Exception not failing Python applications (in yarn cluster mode) >

[jira] [Updated] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

2015-08-17 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7736: - Fix Version/s: (was: 1.6.0) > Exception not failing Python applications (in yarn cluster mode) > -

[jira] [Commented] (SPARK-7808) Package doc for spark.ml.feature

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700520#comment-14700520 ] Apache Spark commented on SPARK-7808: - User 'mengxr' has created a pull request for th

[jira] [Assigned] (SPARK-7808) Package doc for spark.ml.feature

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7808: --- Assignee: Xiangrui Meng (was: Apache Spark) > Package doc for spark.ml.feature > ---

[jira] [Assigned] (SPARK-7808) Package doc for spark.ml.feature

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7808: --- Assignee: Apache Spark (was: Xiangrui Meng) > Package doc for spark.ml.feature > ---

[jira] [Updated] (SPARK-9906) User guide for LogisticRegressionSummary

2015-08-17 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9906: - Shepherd: Joseph K. Bradley > User guide for LogisticRegressionSummary > -

[jira] [Resolved] (SPARK-8916) Add @since tags to mllib.regression

2015-08-17 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-8916. Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7518 [https://github.com/apache

[jira] [Resolved] (SPARK-9768) Add Python API for ml.feature.ElementwiseProduct

2015-08-17 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9768. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8061 [https

[jira] [Resolved] (SPARK-9974) SBT build: com.twitter:parquet-hadoop-bundle:1.6.0 is not packaged into the assembly jar

2015-08-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9974. Resolution: Fixed Assignee: Cheng Lian Fix Version/s: 1.5.0 > SBT build: com.twitter

[jira] [Updated] (SPARK-9550) Configuration renaming, defaults changes, and deprecation for 1.5.0 (master ticket)

2015-08-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9550: --- Description: This ticket tracks configurations which need to be renamed, deprecated, or have their de

[jira] [Commented] (SPARK-9662) ML 1.5 QA: API: Python API coverage

2015-08-17 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700460#comment-14700460 ] Joseph K. Bradley commented on SPARK-9662: -- Perfect, thanks. Also, to confirm: A

[jira] [Commented] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700451#comment-14700451 ] Apache Spark commented on SPARK-7736: - User 'vanzin' has created a pull request for th

[jira] [Resolved] (SPARK-10025) Add Python API for ml.attribute

2015-08-17 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-10025. --- Resolution: Duplicate > Add Python API for ml.attribute > ---

[jira] [Commented] (SPARK-10023) Unified DecisionTreeParams "checkpointInterval" between Scala and Python API.

2015-08-17 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700445#comment-14700445 ] Joseph K. Bradley commented on SPARK-10023: --- For this and other JIRAs, could yo

[jira] [Updated] (SPARK-9654) Add IndexToString in Pyspark

2015-08-17 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9654: - Summary: Add IndexToString in Pyspark (was: Add StringIndexer inverse in Pyspark) > Add

[jira] [Resolved] (SPARK-10021) Add Python API for ml.feature.IndexToString

2015-08-17 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-10021. --- Resolution: Duplicate > Add Python API for ml.feature.IndexToString > ---

[jira] [Commented] (SPARK-10010) Decide on a name for generating Linear/LogisticRegressionSummary on test set data

2015-08-17 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700434#comment-14700434 ] Joseph K. Bradley commented on SPARK-10010: --- +1 for evaluate. Pro: Most natural

[jira] [Assigned] (SPARK-10072) BlockGenerator can deadlock when the queue block queue of generate blocks fills up to capacity

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10072: Assignee: Apache Spark (was: Tathagata Das) > BlockGenerator can deadlock when the queue

[jira] [Commented] (SPARK-10072) BlockGenerator can deadlock when the queue block queue of generate blocks fills up to capacity

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700426#comment-14700426 ] Apache Spark commented on SPARK-10072: -- User 'tdas' has created a pull request for t

[jira] [Assigned] (SPARK-10072) BlockGenerator can deadlock when the queue block queue of generate blocks fills up to capacity

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10072: Assignee: Tathagata Das (was: Apache Spark) > BlockGenerator can deadlock when the queue

[jira] [Commented] (SPARK-6635) DataFrame.withColumn can create columns with identical names

2015-08-17 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700418#comment-14700418 ] Michael Armbrust commented on SPARK-6635: - Filed [SPARK-10073] for python. > Data

[jira] [Created] (SPARK-10073) Python withColumn for existing column name not consistent with scala

2015-08-17 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-10073: Summary: Python withColumn for existing column name not consistent with scala Key: SPARK-10073 URL: https://issues.apache.org/jira/browse/SPARK-10073 Project:

[jira] [Updated] (SPARK-10072) BlockGenerator can deadlock when the queue block queue of generate blocks fills up to capacity

2015-08-17 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-10072: -- Priority: Blocker (was: Major) > BlockGenerator can deadlock when the queue block queue of gen

[jira] [Created] (SPARK-10072) BlockGenerator can deadlock when the queue block queue of generate blocks fills up to capacity

2015-08-17 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-10072: - Summary: BlockGenerator can deadlock when the queue block queue of generate blocks fills up to capacity Key: SPARK-10072 URL: https://issues.apache.org/jira/browse/SPARK-10072

[jira] [Created] (SPARK-10071) QueueInputDStream Should Allow Checkpointing

2015-08-17 Thread Asim Jalis (JIRA)
Asim Jalis created SPARK-10071: -- Summary: QueueInputDStream Should Allow Checkpointing Key: SPARK-10071 URL: https://issues.apache.org/jira/browse/SPARK-10071 Project: Spark Issue Type: Improvem

[jira] [Closed] (SPARK-5901) [PySpark] pickle classes in main module

2015-08-17 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu closed SPARK-5901. - Resolution: Invalid Target Version/s: (was: 1.5.0) couldpickle does support to serialize class

[jira] [Created] (SPARK-10070) Remove Guava dependencies in user guides

2015-08-17 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-10070: - Summary: Remove Guava dependencies in user guides Key: SPARK-10070 URL: https://issues.apache.org/jira/browse/SPARK-10070 Project: Spark Issue Type: Improv

[jira] [Created] (SPARK-10069) Python's ReduceByKeyAndWindow DStream Keeps Growing

2015-08-17 Thread Asim Jalis (JIRA)
Asim Jalis created SPARK-10069: -- Summary: Python's ReduceByKeyAndWindow DStream Keeps Growing Key: SPARK-10069 URL: https://issues.apache.org/jira/browse/SPARK-10069 Project: Spark Issue Type: B

[jira] [Assigned] (SPARK-7808) Package doc for spark.ml.feature

2015-08-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-7808: Assignee: Xiangrui Meng > Package doc for spark.ml.feature > --

[jira] [Updated] (SPARK-9786) Test backpressure

2015-08-17 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-9786: - Description: 1. Build a test bench for generating different workloads and data with varying rates

[jira] [Commented] (SPARK-8918) Add @since tags to mllib.clustering

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700397#comment-14700397 ] Apache Spark commented on SPARK-8918: - User 'XiaoqingWang' has created a pull request

[jira] [Resolved] (SPARK-9787) Test for memory leaks using the streaming tests in spark-perf

2015-08-17 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-9787. -- Resolution: Fixed Fix Version/s: 1.5.0 > Test for memory leaks using the streaming tests

[jira] [Resolved] (SPARK-8920) Add @since tags to mllib.linalg

2015-08-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-8920. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7729 [https://githu

[jira] [Commented] (SPARK-9776) Another instance of Derby may have already booted the database

2015-08-17 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700392#comment-14700392 ] Michael Armbrust commented on SPARK-9776: - The variable is always called {{sqlCont

[jira] [Commented] (SPARK-9910) User guide for train validation split

2015-08-17 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700389#comment-14700389 ] Feynman Liang commented on SPARK-9910: -- Features for 1.5.0 are closed but since this

[jira] [Commented] (SPARK-9776) Another instance of Derby may have already booted the database

2015-08-17 Thread Sudhakar Thota (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700377#comment-14700377 ] Sudhakar Thota commented on SPARK-9776: --- Thanks Michael and Eugene. I have no probl

[jira] [Updated] (SPARK-9889) DCT User Guide

2015-08-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9889: - Shepherd: Xiangrui Meng > DCT User Guide > -- > > Key: SPARK-9889 >

[jira] [Updated] (SPARK-8473) Documentation for DCT

2015-08-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8473: - Shepherd: Xiangrui Meng > Documentation for DCT > - > > Key: S

[jira] [Commented] (SPARK-9910) User guide for train validation split

2015-08-17 Thread Martin Zapletal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700372#comment-14700372 ] Martin Zapletal commented on SPARK-9910: I noticed 1.5.0 should be closed by now.

[jira] [Resolved] (SPARK-10068) Add links to sections in MLlib's user guide

2015-08-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-10068. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8255 [https://gi

[jira] [Updated] (SPARK-10068) Add links to sections in MLlib's user guide

2015-08-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10068: -- Shepherd: Xiangrui Meng > Add links to sections in MLlib's user guide > ---

[jira] [Updated] (SPARK-10068) Add links to sections in MLlib's user guide

2015-08-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10068: -- Assignee: Feynman Liang > Add links to sections in MLlib's user guide > ---

[jira] [Commented] (SPARK-8520) Improve GLM's scalability on number of features

2015-08-17 Thread Meihua Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700357#comment-14700357 ] Meihua Wu commented on SPARK-8520: -- For 1, how about migrate to treeReduce and treeAggreg

[jira] [Updated] (SPARK-9898) User guide for PrefixSpan

2015-08-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9898: - Shepherd: Xiangrui Meng > User guide for PrefixSpan > - > >

[jira] [Assigned] (SPARK-10068) Add links to sections in MLlib's user guide

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10068: Assignee: (was: Apache Spark) > Add links to sections in MLlib's user guide >

[jira] [Commented] (SPARK-10068) Add links to sections in MLlib's user guide

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700351#comment-14700351 ] Apache Spark commented on SPARK-10068: -- User 'feynmanliang' has created a pull reque

[jira] [Assigned] (SPARK-10068) Add links to sections in MLlib's user guide

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10068: Assignee: Apache Spark > Add links to sections in MLlib's user guide > ---

[jira] [Closed] (SPARK-10063) Remove DirectParquetOutputCommitter

2015-08-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-10063. --- Resolution: Won't Fix Let's not remove it for now until we have a better alternative. > Remove Dire

[jira] [Resolved] (SPARK-9592) Last implemented based on AggregateExpression1 are calculating the values for entire DataFrame partition not on GroupedData partition.

2015-08-17 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-9592. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8172 [https:/

  1   2   3   >