[jira] [Updated] (SPARK-14153) My dataset does not provide proper prdictions in ALS

2016-03-24 Thread Dulaj Rajitha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dulaj Rajitha updated SPARK-14153: -- Summary: My dataset does not provide proper prdictions in ALS (was: My dataset does not provid

[jira] [Updated] (SPARK-14153) My dataset does not provide proper predictions in ALS

2016-03-24 Thread Dulaj Rajitha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dulaj Rajitha updated SPARK-14153: -- Summary: My dataset does not provide proper predictions in ALS (was: My dataset does not provi

[jira] [Commented] (SPARK-14153) My dataset does not provide proer prdictions in ALS

2016-03-24 Thread Dulaj Rajitha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211503#comment-15211503 ] Dulaj Rajitha commented on SPARK-14153: --- Here is my data set url : https://drive.g

[jira] [Assigned] (SPARK-14137) Conflict between NullPropagation and InferFiltersFromConstraints

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14137: Assignee: Apache Spark (was: Sameer Agarwal) > Conflict between NullPropagation and Infer

[jira] [Commented] (SPARK-14150) Infer IsNotNull constraints from non-nullable attributes

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211501#comment-15211501 ] Apache Spark commented on SPARK-14150: -- User 'sameeragarwal' has created a pull requ

[jira] [Commented] (SPARK-14137) Conflict between NullPropagation and InferFiltersFromConstraints

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211500#comment-15211500 ] Apache Spark commented on SPARK-14137: -- User 'sameeragarwal' has created a pull requ

[jira] [Assigned] (SPARK-14137) Conflict between NullPropagation and InferFiltersFromConstraints

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14137: Assignee: Sameer Agarwal (was: Apache Spark) > Conflict between NullPropagation and Infer

[jira] [Assigned] (SPARK-14150) Infer IsNotNull constraints from non-nullable attributes

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14150: Assignee: Apache Spark > Infer IsNotNull constraints from non-nullable attributes > --

[jira] [Assigned] (SPARK-14150) Infer IsNotNull constraints from non-nullable attributes

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14150: Assignee: (was: Apache Spark) > Infer IsNotNull constraints from non-nullable attribut

[jira] [Created] (SPARK-14153) My dataset does not provide proer prdictions in ALS

2016-03-24 Thread Dulaj Rajitha (JIRA)
Dulaj Rajitha created SPARK-14153: - Summary: My dataset does not provide proer prdictions in ALS Key: SPARK-14153 URL: https://issues.apache.org/jira/browse/SPARK-14153 Project: Spark Issue T

[jira] [Assigned] (SPARK-14152) MultilayerPerceptronClassifier supports save/load for Python API

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14152: Assignee: Apache Spark > MultilayerPerceptronClassifier supports save/load for Python API

[jira] [Commented] (SPARK-14152) MultilayerPerceptronClassifier supports save/load for Python API

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211492#comment-15211492 ] Apache Spark commented on SPARK-14152: -- User 'yanboliang' has created a pull request

[jira] [Assigned] (SPARK-14152) MultilayerPerceptronClassifier supports save/load for Python API

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14152: Assignee: (was: Apache Spark) > MultilayerPerceptronClassifier supports save/load for

[jira] [Created] (SPARK-14152) MultilayerPerceptronClassifier supports save/load for Python API

2016-03-24 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-14152: --- Summary: MultilayerPerceptronClassifier supports save/load for Python API Key: SPARK-14152 URL: https://issues.apache.org/jira/browse/SPARK-14152 Project: Spark

[jira] [Created] (SPARK-14151) Propose to expose Metrics Sink and Source interface

2016-03-24 Thread Saisai Shao (JIRA)
Saisai Shao created SPARK-14151: --- Summary: Propose to expose Metrics Sink and Source interface Key: SPARK-14151 URL: https://issues.apache.org/jira/browse/SPARK-14151 Project: Spark Issue Type:

[jira] [Created] (SPARK-14150) Infer IsNotNull constraints from non-nullable attributes

2016-03-24 Thread Sameer Agarwal (JIRA)
Sameer Agarwal created SPARK-14150: -- Summary: Infer IsNotNull constraints from non-nullable attributes Key: SPARK-14150 URL: https://issues.apache.org/jira/browse/SPARK-14150 Project: Spark

[jira] [Commented] (SPARK-14149) Log exceptions in tryOrIOException

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211476#comment-15211476 ] Apache Spark commented on SPARK-14149: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-14149) Log exceptions in tryOrIOException

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14149: Assignee: Reynold Xin (was: Apache Spark) > Log exceptions in tryOrIOException >

[jira] [Assigned] (SPARK-14149) Log exceptions in tryOrIOException

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14149: Assignee: Apache Spark (was: Reynold Xin) > Log exceptions in tryOrIOException >

[jira] [Created] (SPARK-14149) Log exceptions in tryOrIOException

2016-03-24 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-14149: --- Summary: Log exceptions in tryOrIOException Key: SPARK-14149 URL: https://issues.apache.org/jira/browse/SPARK-14149 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-14145) Remove the untyped version of Dataset.groupByKey

2016-03-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14145. - Resolution: Fixed > Remove the untyped version of Dataset.groupByKey > --

[jira] [Resolved] (SPARK-14142) Replace internal use of unionAll with union

2016-03-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14142. - Resolution: Fixed > Replace internal use of unionAll with union > ---

[jira] [Resolved] (SPARK-13010) Survival analysis in SparkR

2016-03-24 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-13010. --- Resolution: Fixed Fix Version/s: 2.0.0 > Survival analysis in SparkR > ---

[jira] [Updated] (SPARK-13957) Support group by ordinal in SQL

2016-03-24 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-13957: Assignee: Xiao Li > Support group by ordinal in SQL > --- > >

[jira] [Resolved] (SPARK-13957) Support group by ordinal in SQL

2016-03-24 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-13957. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11846 [https://githu

[jira] [Commented] (SPARK-13783) Model export/import for spark.ml: GBTs

2016-03-24 Thread Gayathri Murali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211407#comment-15211407 ] Gayathri Murali commented on SPARK-13783: - [~yanboliang] I am working on Random F

[jira] [Comment Edited] (SPARK-13783) Model export/import for spark.ml: GBTs

2016-03-24 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211392#comment-15211392 ] Yanbo Liang edited comment on SPARK-13783 at 3/25/16 4:15 AM: -

[jira] [Commented] (SPARK-14147) SparkR - ML predictors return features with vector datatype, however SparkR doesn't support it

2016-03-24 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211394#comment-15211394 ] Shivaram Venkataraman commented on SPARK-14147: --- cc [~mengxr] > SparkR - M

[jira] [Updated] (SPARK-14148) Kmeans Sum of squares - Within cluster, between clusters and total

2016-03-24 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Narine Kokhlikyan updated SPARK-14148: -- Component/s: SparkR ML > Kmeans Sum of squares - Within cluster, betwe

[jira] [Commented] (SPARK-14148) Kmeans Sum of squares - Within cluster, between clusters and total

2016-03-24 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211393#comment-15211393 ] Narine Kokhlikyan commented on SPARK-14148: --- I can work on. Will start after Km

[jira] [Commented] (SPARK-13783) Model export/import for spark.ml: GBTs

2016-03-24 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211392#comment-15211392 ] Yanbo Liang commented on SPARK-13783: - GBTClassificationModel contains array of Decis

[jira] [Created] (SPARK-14148) Kmeans Sum of squares - Within cluster, between clusters and total

2016-03-24 Thread Narine Kokhlikyan (JIRA)
Narine Kokhlikyan created SPARK-14148: - Summary: Kmeans Sum of squares - Within cluster, between clusters and total Key: SPARK-14148 URL: https://issues.apache.org/jira/browse/SPARK-14148 Project:

[jira] [Comment Edited] (SPARK-14147) SparkR - ML predictors return features with vector datatype, however SparkR doesn't support it

2016-03-24 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211384#comment-15211384 ] Narine Kokhlikyan edited comment on SPARK-14147 at 3/25/16 3:51 AM: ---

[jira] [Commented] (SPARK-14147) SparkR - ML predictors return features with vector datatype, however SparkR doesn't support it

2016-03-24 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211384#comment-15211384 ] Narine Kokhlikyan commented on SPARK-14147: --- This happens when we call transfor

[jira] [Comment Edited] (SPARK-14139) Dataset loses nullability in operations with RowEncoder

2016-03-24 Thread koert kuipers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211381#comment-15211381 ] koert kuipers edited comment on SPARK-14139 at 3/25/16 3:49 AM: ---

[jira] [Commented] (SPARK-14139) Dataset loses nullability in operations with RowEncoder

2016-03-24 Thread koert kuipers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211381#comment-15211381 ] koert kuipers commented on SPARK-14139: --- i believe the difference is in the definit

[jira] [Updated] (SPARK-14147) SparkR - ML predictors return features with vector datatype, however SparkR doesn't support it

2016-03-24 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Narine Kokhlikyan updated SPARK-14147: -- Component/s: SparkR > SparkR - ML predictors return features with vector datatype, howe

[jira] [Commented] (SPARK-14147) SparkR - ML predictors return features with vector datatype, however SparkR doesn't support it

2016-03-24 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211373#comment-15211373 ] Sun Rui commented on SPARK-14147: - I am not familiar with ML. my question is that is ther

[jira] [Updated] (SPARK-14147) SparkR - ML predictors return features with vector datatype, however SparkR doesn't support it

2016-03-24 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Narine Kokhlikyan updated SPARK-14147: -- Description: It seems that ML predictors in SparkR return an output which contains feat

[jira] [Commented] (SPARK-14147) SparkR - ML predictors return features with vector datatype, however SparkR doesn't support it

2016-03-24 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211364#comment-15211364 ] Narine Kokhlikyan commented on SPARK-14147: --- cc: [~sunrui] [~shivaram] > Spark

[jira] [Updated] (SPARK-14147) SparkR - ML predictors return features with vector datatype, however SparkR doesn't support it

2016-03-24 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Narine Kokhlikyan updated SPARK-14147: -- Description: It seems that ML predictors in SparkR return an output which contains feat

[jira] [Created] (SPARK-14147) SparkR - ML predictors return features with vector datatype, however SparkR doesn't support it

2016-03-24 Thread Narine Kokhlikyan (JIRA)
Narine Kokhlikyan created SPARK-14147: - Summary: SparkR - ML predictors return features with vector datatype, however SparkR doesn't support it Key: SPARK-14147 URL: https://issues.apache.org/jira/browse/SPARK

[jira] [Commented] (SPARK-14037) count(df) is very slow for dataframe constrcuted using SparkR::createDataFrame

2016-03-24 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211317#comment-15211317 ] Sun Rui commented on SPARK-14037: - I was using Spark driver UI at port 8080. You were usi

[jira] [Updated] (SPARK-14037) count(df) is very slow for dataframe constrcuted using SparkR::createDataFrame

2016-03-24 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sun Rui updated SPARK-14037: Attachment: spark_ui_ray.png > count(df) is very slow for dataframe constrcuted using SparkR::createDataFra

[jira] [Updated] (SPARK-13949) PySpark ml DecisionTreeClassifier, Regressor support export/import

2016-03-24 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13949: -- Assignee: Gayathri Murali > PySpark ml DecisionTreeClassifier, Regressor support export/import

[jira] [Resolved] (SPARK-13949) PySpark ml DecisionTreeClassifier, Regressor support export/import

2016-03-24 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-13949. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11892 [https://g

[jira] [Updated] (SPARK-13782) Model export/import for spark.ml: BisectingKMeans

2016-03-24 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13782: -- Assignee: yuhao yang > Model export/import for spark.ml: BisectingKMeans >

[jira] [Updated] (SPARK-13782) Model export/import for spark.ml: BisectingKMeans

2016-03-24 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13782: -- Shepherd: Xiangrui Meng Target Version/s: 2.0.0 > Model export/import for spark.ml:

[jira] [Resolved] (SPARK-14107) PySpark spark.ml GBT algs need seed Param

2016-03-24 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-14107. --- Resolution: Fixed Fix Version/s: 1.6.2 2.0.0 Issue resolved by pull

[jira] [Updated] (SPARK-14107) PySpark spark.ml GBT algs need seed Param

2016-03-24 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-14107: -- Assignee: Seth Hendrickson > PySpark spark.ml GBT algs need seed Param > --

[jira] [Updated] (SPARK-14146) Imported implicits can't be found in Spark REPL in some cases

2016-03-24 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-14146: Description: {code} class I(i: Int) { def double: Int = i * 2 } class Context { implicit def t

[jira] [Updated] (SPARK-14146) Imported implicits can't be found in Spark REPL in some cases

2016-03-24 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-14146: --- Affects Version/s: 2.0.0 Target Version/s: 2.0.0 Component/s: Spark Core

[jira] [Created] (SPARK-14146) imported implicit can't be found in Spark REPL in some case

2016-03-24 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-14146: --- Summary: imported implicit can't be found in Spark REPL in some case Key: SPARK-14146 URL: https://issues.apache.org/jira/browse/SPARK-14146 Project: Spark Is

[jira] [Assigned] (SPARK-14122) Show commands (Exception)

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14122: Assignee: (was: Apache Spark) > Show commands (Exception) > -

[jira] [Assigned] (SPARK-14122) Show commands (Exception)

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14122: Assignee: Apache Spark > Show commands (Exception) > - > >

[jira] [Commented] (SPARK-14122) Show commands (Exception)

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211220#comment-15211220 ] Apache Spark commented on SPARK-14122: -- User 'andrewor14' has created a pull request

[jira] [Resolved] (SPARK-13980) Incrementally serialize blocks while unrolling them in MemoryStore

2016-03-24 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-13980. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11791 [https://github.

[jira] [Commented] (SPARK-13943) The behavior of sum(booleantype) in Spark DataFrames is not intuitive

2016-03-24 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211208#comment-15211208 ] Wes McKinney commented on SPARK-13943: -- As I tried to explain on the mailing list, t

[jira] [Commented] (SPARK-14120) Import/Export commands (Exception)

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211204#comment-15211204 ] Apache Spark commented on SPARK-14120: -- User 'andrewor14' has created a pull request

[jira] [Assigned] (SPARK-14120) Import/Export commands (Exception)

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14120: Assignee: Apache Spark > Import/Export commands (Exception) >

[jira] [Assigned] (SPARK-14120) Import/Export commands (Exception)

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14120: Assignee: (was: Apache Spark) > Import/Export commands (Exception) > -

[jira] [Assigned] (SPARK-14144) Explicitly identify/catch UnsupportedOperationException during parquet reader initialization

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14144: Assignee: (was: Apache Spark) > Explicitly identify/catch UnsupportedOperationExceptio

[jira] [Assigned] (SPARK-14144) Explicitly identify/catch UnsupportedOperationException during parquet reader initialization

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14144: Assignee: Apache Spark > Explicitly identify/catch UnsupportedOperationException during pa

[jira] [Commented] (SPARK-14144) Explicitly identify/catch UnsupportedOperationException during parquet reader initialization

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211199#comment-15211199 ] Apache Spark commented on SPARK-14144: -- User 'sameeragarwal' has created a pull requ

[jira] [Assigned] (SPARK-14145) Remove the untyped version of Dataset.groupByKey

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14145: Assignee: Reynold Xin (was: Apache Spark) > Remove the untyped version of Dataset.groupBy

[jira] [Assigned] (SPARK-14145) Remove the untyped version of Dataset.groupByKey

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14145: Assignee: Apache Spark (was: Reynold Xin) > Remove the untyped version of Dataset.groupBy

[jira] [Commented] (SPARK-14145) Remove the untyped version of Dataset.groupByKey

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211194#comment-15211194 ] Apache Spark commented on SPARK-14145: -- User 'rxin' has created a pull request for t

[jira] [Created] (SPARK-14145) Remove the untyped version of Dataset.groupByKey

2016-03-24 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-14145: --- Summary: Remove the untyped version of Dataset.groupByKey Key: SPARK-14145 URL: https://issues.apache.org/jira/browse/SPARK-14145 Project: Spark Issue Type: Su

[jira] [Assigned] (SPARK-14119) Role management commands (Exception)

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14119: Assignee: Apache Spark > Role management commands (Exception) > --

[jira] [Commented] (SPARK-14119) Role management commands (Exception)

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211175#comment-15211175 ] Apache Spark commented on SPARK-14119: -- User 'andrewor14' has created a pull request

[jira] [Assigned] (SPARK-14119) Role management commands (Exception)

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14119: Assignee: (was: Apache Spark) > Role management commands (Exception) > ---

[jira] [Closed] (SPARK-14117) write.partitionBy retains partitioning column when outputting Parquet

2016-03-24 Thread Franklyn Dsouza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Franklyn Dsouza closed SPARK-14117. --- Resolution: Fixed > write.partitionBy retains partitioning column when outputting Parquet > -

[jira] [Created] (SPARK-14144) Explicitly identify/catch UnsupportedOperationException during parquet reader initialization

2016-03-24 Thread Sameer Agarwal (JIRA)
Sameer Agarwal created SPARK-14144: -- Summary: Explicitly identify/catch UnsupportedOperationException during parquet reader initialization Key: SPARK-14144 URL: https://issues.apache.org/jira/browse/SPARK-14144

[jira] [Commented] (SPARK-14143) Options for parsing NaNs, Infinity and nulls for numeric types

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211164#comment-15211164 ] Apache Spark commented on SPARK-14143: -- User 'falaki' has created a pull request for

[jira] [Assigned] (SPARK-14143) Options for parsing NaNs, Infinity and nulls for numeric types

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14143: Assignee: (was: Apache Spark) > Options for parsing NaNs, Infinity and nulls for numer

[jira] [Assigned] (SPARK-14143) Options for parsing NaNs, Infinity and nulls for numeric types

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14143: Assignee: Apache Spark > Options for parsing NaNs, Infinity and nulls for numeric types >

[jira] [Created] (SPARK-14143) Options for parsing NaNs, Infinity and nulls for numeric types

2016-03-24 Thread Hossein Falaki (JIRA)
Hossein Falaki created SPARK-14143: -- Summary: Options for parsing NaNs, Infinity and nulls for numeric types Key: SPARK-14143 URL: https://issues.apache.org/jira/browse/SPARK-14143 Project: Spark

[jira] [Updated] (SPARK-14105) Serialization issue for MessageAndMetadata in KafkaRDD

2016-03-24 Thread Liyin Tang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liyin Tang updated SPARK-14105: --- Summary: Serialization issue for MessageAndMetadata in KafkaRDD (was: Serialization issue for KafkaR

[jira] [Updated] (SPARK-14105) Serialization issue for KafkaRDD

2016-03-24 Thread Liyin Tang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liyin Tang updated SPARK-14105: --- Description: When using DISK or Memory to persistent KafkaDirectInputStream, it will serialize the F

[jira] [Updated] (SPARK-14105) Serialization issue for KafkaRDD

2016-03-24 Thread Liyin Tang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liyin Tang updated SPARK-14105: --- Description: When using DISK or Memory to persistent KafkaDirectInputStream, it will serialize the F

[jira] [Commented] (SPARK-14105) Serialization issue for KafkaRDD

2016-03-24 Thread Liyin Tang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211147#comment-15211147 ] Liyin Tang commented on SPARK-14105: https://github.com/apache/spark/pull/11921#issue

[jira] [Commented] (SPARK-14142) Replace internal use of unionAll with union

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211142#comment-15211142 ] Apache Spark commented on SPARK-14142: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-14142) Replace internal use of unionAll with union

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14142: Assignee: Apache Spark (was: Reynold Xin) > Replace internal use of unionAll with union >

[jira] [Assigned] (SPARK-14142) Replace internal use of unionAll with union

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14142: Assignee: Reynold Xin (was: Apache Spark) > Replace internal use of unionAll with union >

[jira] [Created] (SPARK-14141) Let user specify datatypes of pandas dataframe in toPandas()

2016-03-24 Thread Luke Miner (JIRA)
Luke Miner created SPARK-14141: -- Summary: Let user specify datatypes of pandas dataframe in toPandas() Key: SPARK-14141 URL: https://issues.apache.org/jira/browse/SPARK-14141 Project: Spark Iss

[jira] [Created] (SPARK-14142) Replace internal use of unionAll with union

2016-03-24 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-14142: --- Summary: Replace internal use of unionAll with union Key: SPARK-14142 URL: https://issues.apache.org/jira/browse/SPARK-14142 Project: Spark Issue Type: Sub-tas

[jira] [Updated] (SPARK-14117) write.partitionBy retains partitioning column when outputting Parquet

2016-03-24 Thread Franklyn Dsouza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Franklyn Dsouza updated SPARK-14117: Description: When writing a Dataframe as parquet using a partitionBy on the writer to gene

[jira] [Commented] (SPARK-14140) Futures timeout exception in executor logs

2016-03-24 Thread Nishkam Ravi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211122#comment-15211122 ] Nishkam Ravi commented on SPARK-14140: -- It only appears for yarn-cluster mode (and n

[jira] [Created] (SPARK-14140) Futures timeout exception in executor logs

2016-03-24 Thread Nishkam Ravi (JIRA)
Nishkam Ravi created SPARK-14140: Summary: Futures timeout exception in executor logs Key: SPARK-14140 URL: https://issues.apache.org/jira/browse/SPARK-14140 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-12569) DecisionTreeRegressor: provide variance of prediction: Python API

2016-03-24 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211109#comment-15211109 ] Miao Wang commented on SPARK-12569: --- I plan to work on this one. Thanks! Miao > Deci

[jira] [Closed] (SPARK-13832) TPC-DS Query 36 fails with Parser error

2016-03-24 Thread Roy Cecil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roy Cecil closed SPARK-13832. - Resolution: Duplicate > TPC-DS Query 36 fails with Parser error > ---

[jira] [Commented] (SPARK-13832) TPC-DS Query 36 fails with Parser error

2016-03-24 Thread Roy Cecil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211107#comment-15211107 ] Roy Cecil commented on SPARK-13832: --- I verified a few queries and I think we can close

[jira] [Assigned] (SPARK-14071) Change MLWritable.write to be a property

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14071: Assignee: (was: Apache Spark) > Change MLWritable.write to be a property > ---

[jira] [Commented] (SPARK-14071) Change MLWritable.write to be a property

2016-03-24 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211096#comment-15211096 ] Miao Wang commented on SPARK-14071: --- I submitted a pull request for this one. > Change

[jira] [Assigned] (SPARK-14071) Change MLWritable.write to be a property

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14071: Assignee: Apache Spark > Change MLWritable.write to be a property > --

[jira] [Commented] (SPARK-14071) Change MLWritable.write to be a property

2016-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211097#comment-15211097 ] Apache Spark commented on SPARK-14071: -- User 'wangmiao1981' has created a pull reque

[jira] [Created] (SPARK-14139) Dataset loses nullability in operations with RowEncoder

2016-03-24 Thread koert kuipers (JIRA)
koert kuipers created SPARK-14139: - Summary: Dataset loses nullability in operations with RowEncoder Key: SPARK-14139 URL: https://issues.apache.org/jira/browse/SPARK-14139 Project: Spark Iss

[jira] [Resolved] (SPARK-11871) Model export/import for spark.ml: Multilayer Perceptron

2016-03-24 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11871. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 9854 [https://gi

[jira] [Commented] (SPARK-13263) SQL generation support for tablesample

2016-03-24 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211047#comment-15211047 ] Ruslan Dautkhanov commented on SPARK-13263: --- Would Spark support deterministic

[jira] [Created] (SPARK-14138) Generated SpecificColumnarIterator code can exceed JVM size limit for cached DataFrames

2016-03-24 Thread Sven Krasser (JIRA)
Sven Krasser created SPARK-14138: Summary: Generated SpecificColumnarIterator code can exceed JVM size limit for cached DataFrames Key: SPARK-14138 URL: https://issues.apache.org/jira/browse/SPARK-14138

  1   2   3   >