[jira] [Commented] (SPARK-10840) SparkSQL doesn't work well with JSON

2015-09-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909145#comment-14909145 ] Sean Owen commented on SPARK-10840: --- I thought that was the idea, that one line had to contain one

[jira] [Updated] (SPARK-10842) Eliminate create duplicate stage while generate job dag

2015-09-26 Thread SuYan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SuYan updated SPARK-10842: -- Affects Version/s: 1.5.0 Priority: Minor (was: Major) Description: When we traverse

[jira] [Created] (SPARK-10842) liminate duplicate stage

2015-09-26 Thread SuYan (JIRA)
SuYan created SPARK-10842: - Summary: liminate duplicate stage Key: SPARK-10842 URL: https://issues.apache.org/jira/browse/SPARK-10842 Project: Spark Issue Type: Improvement Reporter:

[jira] [Assigned] (SPARK-10841) Add pushdown support of UDF for parquet

2015-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10841: Assignee: Apache Spark > Add pushdown support of UDF for parquet >

[jira] [Commented] (SPARK-10841) Add pushdown support of UDF for parquet

2015-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909153#comment-14909153 ] Apache Spark commented on SPARK-10841: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10841) Add pushdown support of UDF for parquet

2015-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10841: Assignee: (was: Apache Spark) > Add pushdown support of UDF for parquet >

[jira] [Created] (SPARK-10841) Add pushdown support of UDF for parquet

2015-09-26 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-10841: --- Summary: Add pushdown support of UDF for parquet Key: SPARK-10841 URL: https://issues.apache.org/jira/browse/SPARK-10841 Project: Spark Issue Type:

[jira] [Updated] (SPARK-10840) SparkSQL doesn't work well with JSON

2015-09-26 Thread Ankit Sarraf (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankit Sarraf updated SPARK-10840: - Description: Well formed JSON doesn't work with the 1.5.1 version while using

[jira] [Updated] (SPARK-10840) SparkSQL doesn't work well with JSON

2015-09-26 Thread Ankit Sarraf (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankit Sarraf updated SPARK-10840: - Description: Well formed JSON doesn't work with the 1.5.1 version while using

[jira] [Updated] (SPARK-10840) SparkSQL doesn't work well with JSON

2015-09-26 Thread Ankit Sarraf (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankit Sarraf updated SPARK-10840: - Description: Well formed JSON doesn't work with the 1.5.1 version while using

[jira] [Updated] (SPARK-10798) JsonMappingException with Spark Context Parallelize

2015-09-26 Thread Dev Lakhani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dev Lakhani updated SPARK-10798: Environment: Linux, Java 1.8.45 (was: Linux, Java 1.8.40) > JsonMappingException with Spark

[jira] [Updated] (SPARK-10798) JsonMappingException with Spark Context Parallelize

2015-09-26 Thread Dev Lakhani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dev Lakhani updated SPARK-10798: Description: When trying to create an RDD of Rows using a Java Spark Context and if I serialize

[jira] [Commented] (SPARK-10840) SparkSQL doesn't work well with JSON

2015-09-26 Thread Jordan Sarraf (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909379#comment-14909379 ] Jordan Sarraf commented on SPARK-10840: --- But should't having components in more than one line be a

[jira] [Issue Comment Deleted] (SPARK-10840) SparkSQL doesn't work well with JSON

2015-09-26 Thread Jordan Sarraf (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jordan Sarraf updated SPARK-10840: -- Comment: was deleted (was: But should't having components in more than one line be a norm?

[jira] [Commented] (SPARK-10840) SparkSQL doesn't work well with JSON

2015-09-26 Thread Jordan Sarraf (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909378#comment-14909378 ] Jordan Sarraf commented on SPARK-10840: --- But should't having components in more than one line be a

[jira] [Assigned] (SPARK-10842) Eliminate create duplicate stage while generate job dag

2015-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10842: Assignee: Apache Spark > Eliminate create duplicate stage while generate job dag >

[jira] [Assigned] (SPARK-10842) Eliminate create duplicate stage while generate job dag

2015-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10842: Assignee: (was: Apache Spark) > Eliminate create duplicate stage while generate job

[jira] [Updated] (SPARK-10842) Eliminate create duplicate stage while generate job dag

2015-09-26 Thread SuYan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SuYan updated SPARK-10842: -- Description: When we traverse RDD, to generate Stage DAG, Spark will skip to judge the stage whether was

[jira] [Created] (SPARK-10843) PMML Support for multi class problems using Logistic regression and linear SVM

2015-09-26 Thread tvmanikandan (JIRA)
tvmanikandan created SPARK-10843: Summary: PMML Support for multi class problems using Logistic regression and linear SVM Key: SPARK-10843 URL: https://issues.apache.org/jira/browse/SPARK-10843

[jira] [Created] (SPARK-10844) SparkR: Add correlation function to dataframe

2015-09-26 Thread Narine Kokhlikyan (JIRA)
Narine Kokhlikyan created SPARK-10844: - Summary: SparkR: Add correlation function to dataframe Key: SPARK-10844 URL: https://issues.apache.org/jira/browse/SPARK-10844 Project: Spark

[jira] [Created] (SPARK-10845) SQL option "spark.sql.hive.version" doesn't show up in the result of "SET -v"

2015-09-26 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-10845: -- Summary: SQL option "spark.sql.hive.version" doesn't show up in the result of "SET -v" Key: SPARK-10845 URL: https://issues.apache.org/jira/browse/SPARK-10845 Project:

[jira] [Assigned] (SPARK-10845) SQL option "spark.sql.hive.version" doesn't show up in the result of "SET -v"

2015-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10845: Assignee: Cheng Lian (was: Apache Spark) > SQL option "spark.sql.hive.version" doesn't

[jira] [Assigned] (SPARK-10845) SQL option "spark.sql.hive.version" doesn't show up in the result of "SET -v"

2015-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10845: Assignee: Apache Spark (was: Cheng Lian) > SQL option "spark.sql.hive.version" doesn't

[jira] [Commented] (SPARK-10845) SQL option "spark.sql.hive.version" doesn't show up in the result of "SET -v"

2015-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909542#comment-14909542 ] Apache Spark commented on SPARK-10845: -- User 'liancheng' has created a pull request for this issue:

[jira] [Commented] (SPARK-7129) Add generic boosting algorithm to spark.ml

2015-09-26 Thread Meihua Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909512#comment-14909512 ] Meihua Wu commented on SPARK-7129: -- [~sethah] Thank you for your comments! I have updated the design doc

[jira] [Assigned] (SPARK-10844) SparkR: Add correlation function to dataframe

2015-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10844: Assignee: (was: Apache Spark) > SparkR: Add correlation function to dataframe >

[jira] [Assigned] (SPARK-10844) SparkR: Add correlation function to dataframe

2015-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10844: Assignee: Apache Spark > SparkR: Add correlation function to dataframe >

[jira] [Commented] (SPARK-10844) SparkR: Add correlation function to dataframe

2015-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909521#comment-14909521 ] Apache Spark commented on SPARK-10844: -- User 'NarineK' has created a pull request for this issue:

[jira] [Commented] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

2015-09-26 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909530#comment-14909530 ] DB Tsai commented on SPARK-3181: Ref: Prof. Art Owen's paper, [A robust hybrid of lasso and ridge

[jira] [Comment Edited] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

2015-09-26 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909530#comment-14909530 ] DB Tsai edited comment on SPARK-3181 at 9/27/15 12:00 AM: -- Ref: Prof. Art Owen's

[jira] [Commented] (SPARK-8734) Expose all Mesos DockerInfo options to Spark

2015-09-26 Thread Chris Heller (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909541#comment-14909541 ] Chris Heller commented on SPARK-8734: - That's unfortunate the issue with the hash map. Embedding a

[jira] [Commented] (SPARK-10842) Eliminate create duplicate stage while generate job dag

2015-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909271#comment-14909271 ] Apache Spark commented on SPARK-10842: -- User 'suyanNone' has created a pull request for this issue:

[jira] [Resolved] (SPARK-4879) Missing output partitions after job completes with speculative execution

2015-09-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4879. -- Resolution: Fixed > Missing output partitions after job completes with speculative execution >

[jira] [Resolved] (SPARK-10843) PMML Support for multi class problems using Logistic regression and linear SVM

2015-09-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10843. --- Resolution: Invalid > PMML Support for multi class problems using Logistic regression and linear SVM

[jira] [Resolved] (SPARK-10845) SQL option "spark.sql.hive.version" doesn't show up in the result of "SET -v"

2015-09-26 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-10845. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8925

[jira] [Updated] (SPARK-10845) SQL option "spark.sql.hive.version" doesn't show up in the result of "SET -v"

2015-09-26 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-10845: --- Labels: backport-needed (was: ) > SQL option "spark.sql.hive.version" doesn't show up in the result

[jira] [Reopened] (SPARK-10845) SQL option "spark.sql.hive.version" doesn't show up in the result of "SET -v"

2015-09-26 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian reopened SPARK-10845: Reopening it since it's not backported to branch-1.5 yet. > SQL option "spark.sql.hive.version"

[jira] [Updated] (SPARK-10843) PMML Support for multi class problems using Logistic regression and linear SVM

2015-09-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10843: -- Component/s: ML [~tvmanikandan] have a look at