[jira] [Resolved] (SPARK-13172) Stop using RichException.getStackTrace it is deprecated

[ https://issues.apache.org/jira/browse/SPARK-13172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13172. - Resolution: Fixed Assignee: Sean Owen Fix Version/s: 2.0.0 > Stop using RichExcep

[jira] [Resolved] (SPARK-13296) Move UserDefinedFunction into sql.expressions package

[ https://issues.apache.org/jira/browse/SPARK-13296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13296. - Resolution: Fixed Fix Version/s: 2.0.0 > Move UserDefinedFunction into sql.expressions pac

[jira] [Commented] (SPARK-13312) ML Model Selection via Train Validation Split example uses incorrect data

[ https://issues.apache.org/jira/browse/SPARK-13312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15146348#comment-15146348 ] Apache Spark commented on SPARK-13312: -- User 'JeremyNixon' has created a pull reques

[jira] [Assigned] (SPARK-13312) ML Model Selection via Train Validation Split example uses incorrect data

[ https://issues.apache.org/jira/browse/SPARK-13312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13312: Assignee: (was: Apache Spark) > ML Model Selection via Train Validation Split example

[jira] [Assigned] (SPARK-13312) ML Model Selection via Train Validation Split example uses incorrect data

[ https://issues.apache.org/jira/browse/SPARK-13312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13312: Assignee: Apache Spark > ML Model Selection via Train Validation Split example uses incorr

[jira] [Created] (SPARK-13312) ML Model Selection via Train Validation Split example uses incorrect data

Jeremy created SPARK-13312: -- Summary: ML Model Selection via Train Validation Split example uses incorrect data Key: SPARK-13312 URL: https://issues.apache.org/jira/browse/SPARK-13312 Project: Spark

[jira] [Created] (SPARK-13311) prettyString of IN is not good

Davies Liu created SPARK-13311: -- Summary: prettyString of IN is not good Key: SPARK-13311 URL: https://issues.apache.org/jira/browse/SPARK-13311 Project: Spark Issue Type: Bug Componen

[jira] [Commented] (SPARK-10759) Missing Python code example in ML Programming guide

[ https://issues.apache.org/jira/browse/SPARK-10759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15146336#comment-15146336 ] Jeremy commented on SPARK-10759: It's been a few months, so I've begun to work on this he

[jira] [Updated] (SPARK-13027) Add API for updateStateByKey to provide batch time as input

[ https://issues.apache.org/jira/browse/SPARK-13027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaditya Ramesh updated SPARK-13027: --- Description: The StateDStream currently does not provide the batch time as input to the stat

[jira] [Updated] (SPARK-13027) Add API for updateStateByKey to provide batch time as input

[ https://issues.apache.org/jira/browse/SPARK-13027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaditya Ramesh updated SPARK-13027: --- Description: wwThe StateDStream currently do

[jira] [Assigned] (SPARK-13310) Missing Sorting Columns in Generate

[ https://issues.apache.org/jira/browse/SPARK-13310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13310: Assignee: (was: Apache Spark) > Missing Sorting Columns in Generate >

[jira] [Commented] (SPARK-13310) Missing Sorting Columns in Generate

[ https://issues.apache.org/jira/browse/SPARK-13310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15146293#comment-15146293 ] Apache Spark commented on SPARK-13310: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-13310) Missing Sorting Columns in Generate

[ https://issues.apache.org/jira/browse/SPARK-13310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13310: Assignee: Apache Spark > Missing Sorting Columns in Generate > ---

[jira] [Created] (SPARK-13310) Missing Sorting Columns in Generate

Xiao Li created SPARK-13310: --- Summary: Missing Sorting Columns in Generate Key: SPARK-13310 URL: https://issues.apache.org/jira/browse/SPARK-13310 Project: Spark Issue Type: Bug Component

[jira] [Commented] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15146268#comment-15146268 ] Xiangrui Meng commented on SPARK-12363: --- This bug was fixed by https://github.com/a

[jira] [Updated] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-12363: -- Fix Version/s: 2.0.0 1.6.1 1.5.3 > PowerIterationClusteri

[jira] [Updated] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-12363: -- Affects Version/s: 1.3.1 1.4.1 1.5.2

[jira] [Commented] (SPARK-13302) Cleanup persistence Docstests in ml

[ https://issues.apache.org/jira/browse/SPARK-13302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15146211#comment-15146211 ] Apache Spark commented on SPARK-13302: -- User 'holdenk' has created a pull request fo

[jira] [Assigned] (SPARK-13302) Cleanup persistence Docstests in ml

[ https://issues.apache.org/jira/browse/SPARK-13302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13302: Assignee: (was: Apache Spark) > Cleanup persistence Docstests in ml >

[jira] [Assigned] (SPARK-13302) Cleanup persistence Docstests in ml

[ https://issues.apache.org/jira/browse/SPARK-13302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13302: Assignee: Apache Spark > Cleanup persistence Docstests in ml > ---

[jira] [Commented] (SPARK-13302) Cleanup persistence Docstests in ml

[ https://issues.apache.org/jira/browse/SPARK-13302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15146202#comment-15146202 ] holdenk commented on SPARK-13302: - The same is true for persistence in regression & recom

[jira] [Updated] (SPARK-13302) Cleanup persistence Docstests in ml

[ https://issues.apache.org/jira/browse/SPARK-13302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-13302: Summary: Cleanup persistence Docstests in ml (was: Cleanup Docstests in ml/clustering.py) > Cleanup persi

[jira] [Commented] (SPARK-13236) SQL generation support for Set Operations

[ https://issues.apache.org/jira/browse/SPARK-13236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15146144#comment-15146144 ] Apache Spark commented on SPARK-13236: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-13236) SQL generation support for Set Operations

[ https://issues.apache.org/jira/browse/SPARK-13236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13236: Assignee: (was: Apache Spark) > SQL generation support for Set Operations > --

[jira] [Assigned] (SPARK-13236) SQL generation support for Set Operations

[ https://issues.apache.org/jira/browse/SPARK-13236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13236: Assignee: Apache Spark > SQL generation support for Set Operations > -

[jira] [Updated] (SPARK-13236) SQL generation support for Set Operations

[ https://issues.apache.org/jira/browse/SPARK-13236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-13236: Description: 1. Union Distinct 2. Except 3. Intersect was:checkHiveQl("SELECT * FROM t0 UNION SELECT *

[jira] [Updated] (SPARK-13236) SQL generation support for Set Operations

[ https://issues.apache.org/jira/browse/SPARK-13236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-13236: Summary: SQL generation support for Set Operations (was: SQL generation support for union) > SQL generati

[jira] [Commented] (SPARK-13307) TPCDS query 66 degraded by 30% in 1.6.0 compared to 1.4.1

[ https://issues.apache.org/jira/browse/SPARK-13307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15146140#comment-15146140 ] Xiao Li commented on SPARK-13307: - Could you provided logical plans, as suggested above?

[jira] [Commented] (SPARK-13307) TPCDS query 66 degraded by 30% in 1.6.0 compared to 1.4.1

[ https://issues.apache.org/jira/browse/SPARK-13307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15146138#comment-15146138 ] JESSE CHEN commented on SPARK-13307: Have you looked at the plans? I provided at abov

[jira] [Assigned] (SPARK-13309) Incorrect type inference for CSV data.

[ https://issues.apache.org/jira/browse/SPARK-13309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13309: Assignee: Apache Spark > Incorrect type inference for CSV data. >

[jira] [Commented] (SPARK-13309) Incorrect type inference for CSV data.

[ https://issues.apache.org/jira/browse/SPARK-13309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15146133#comment-15146133 ] Apache Spark commented on SPARK-13309: -- User 'tanwanirahul' has created a pull reque

[jira] [Assigned] (SPARK-13309) Incorrect type inference for CSV data.

[ https://issues.apache.org/jira/browse/SPARK-13309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13309: Assignee: (was: Apache Spark) > Incorrect type inference for CSV data. > -

[jira] [Created] (SPARK-13309) Incorrect type inference for CSV data.

Rahul Tanwani created SPARK-13309: - Summary: Incorrect type inference for CSV data. Key: SPARK-13309 URL: https://issues.apache.org/jira/browse/SPARK-13309 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-13309) Incorrect type inference for CSV data.

[ https://issues.apache.org/jira/browse/SPARK-13309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rahul Tanwani updated SPARK-13309: -- Description: Type inference for CSV data does not work as expected when the data is sparse. Fo

[jira] [Commented] (SPARK-11401) PMML export for Logistic Regression Multiclass Classification

[ https://issues.apache.org/jira/browse/SPARK-11401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15146091#comment-15146091 ] Vincenzo Selvaggio commented on SPARK-11401: Hi [~josephkb], could you please

[jira] [Updated] (SPARK-12962) PySpark support covar_samp and covar_pop

[ https://issues.apache.org/jira/browse/SPARK-12962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12962: -- Assignee: Yanbo Liang > PySpark support covar_samp and covar_pop >

[jira] [Commented] (SPARK-12607) spark-class.cmd produced null command strings for "exec"

[ https://issues.apache.org/jira/browse/SPARK-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15146006#comment-15146006 ] Jon Maurer commented on SPARK-12607: Does this issue still happen on the latest maste

[jira] [Updated] (SPARK-13300) Spark examples page gives errors : Liquid error: pygments

[ https://issues.apache.org/jira/browse/SPARK-13300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13300: -- Assignee: Sean Owen Affects Version/s: 1.6.0 Target Version/s: 1.6.1, 2.0.0

[jira] [Commented] (SPARK-13300) Spark examples page gives errors : Liquid error: pygments

[ https://issues.apache.org/jira/browse/SPARK-13300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15145935#comment-15145935 ] Sean Owen commented on SPARK-13300: --- I've fixed the ASF site at http://spark.apache.org

[jira] [Updated] (SPARK-13142) Problem accessing Web UI /logPage/ on Microsoft Windows

[ https://issues.apache.org/jira/browse/SPARK-13142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13142: -- Assignee: Mark Pavey > Problem accessing Web UI /logPage/ on Microsoft Windows > --

[jira] [Resolved] (SPARK-13142) Problem accessing Web UI /logPage/ on Microsoft Windows

[ https://issues.apache.org/jira/browse/SPARK-13142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13142. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-13142) Problem accessing Web UI /logPage/ on Microsoft Windows

[ https://issues.apache.org/jira/browse/SPARK-13142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13142: -- Priority: Minor (was: Major) > Problem accessing Web UI /logPage/ on Microsoft Windows > -

[jira] [Updated] (SPARK-13305) SPARK_WORKER_WEBUI_PORT handled twice in start-slave.sh script and WorkerArguments

[ https://issues.apache.org/jira/browse/SPARK-13305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13305: -- Summary: SPARK_WORKER_WEBUI_PORT handled twice in start-slave.sh script and WorkerArguments (was: SPAR

[jira] [Updated] (SPARK-13305) SPARK_WORKER_WEBUI_PORT handled twice in start-slave.sh script, --webui-port is used twice

[ https://issues.apache.org/jira/browse/SPARK-13305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13305: -- Issue Type: Improvement (was: Bug) Summary: SPARK_WORKER_WEBUI_PORT handled twice in start-slave

[jira] [Resolved] (SPARK-7367) spark-submit CLI --help -h overrides the application arguments

[ https://issues.apache.org/jira/browse/SPARK-7367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7367. -- Resolution: Cannot Reproduce > spark-submit CLI --help -h overrides the application arguments >