[jira] [Commented] (SPARK-19591) Add sample weights to decision trees

[ https://issues.apache.org/jira/browse/SPARK-19591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521855#comment-16521855 ] Apache Spark commented on SPARK-19591: -- User 'imatiach-msft' has created a pull request for this

[jira] [Assigned] (SPARK-24484) Power Iteration Clustering is giving incorrect clustering results when there are mutiple leading eigen values.

[ https://issues.apache.org/jira/browse/SPARK-24484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24484: Assignee: Apache Spark > Power Iteration Clustering is giving incorrect clustering

[jira] [Assigned] (SPARK-24484) Power Iteration Clustering is giving incorrect clustering results when there are mutiple leading eigen values.

[ https://issues.apache.org/jira/browse/SPARK-24484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24484: Assignee: (was: Apache Spark) > Power Iteration Clustering is giving incorrect

[jira] [Commented] (SPARK-24484) Power Iteration Clustering is giving incorrect clustering results when there are mutiple leading eigen values.

[ https://issues.apache.org/jira/browse/SPARK-24484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521848#comment-16521848 ] Apache Spark commented on SPARK-24484: -- User 'shahidki31' has created a pull request for this

[jira] [Commented] (SPARK-24484) Power Iteration Clustering is giving incorrect clustering results when there are mutiple leading eigen values.

[ https://issues.apache.org/jira/browse/SPARK-24484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521847#comment-16521847 ] shahid commented on SPARK-24484: I have raised a PR, https://github.com/apache/spark/pull/21627 > Power

[jira] [Assigned] (SPARK-24645) Skip parsing when csvColumnPruning enabled and partitions scanned only

[ https://issues.apache.org/jira/browse/SPARK-24645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24645: Assignee: Apache Spark > Skip parsing when csvColumnPruning enabled and partitions

[jira] [Commented] (SPARK-24645) Skip parsing when csvColumnPruning enabled and partitions scanned only

[ https://issues.apache.org/jira/browse/SPARK-24645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521844#comment-16521844 ] Apache Spark commented on SPARK-24645: -- User 'maropu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24645) Skip parsing when csvColumnPruning enabled and partitions scanned only

[ https://issues.apache.org/jira/browse/SPARK-24645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24645: Assignee: (was: Apache Spark) > Skip parsing when csvColumnPruning enabled and

[jira] [Commented] (SPARK-24362) SUM function precision issue

[ https://issues.apache.org/jira/browse/SPARK-24362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521837#comment-16521837 ] Evelyn Bayes commented on SPARK-24362: -- You only get this issue if you cast to Double and this is

[jira] [Created] (SPARK-24645) Skip parsing when csvColumnPruning enabled and partitions scanned only

Takeshi Yamamuro created SPARK-24645: Summary: Skip parsing when csvColumnPruning enabled and partitions scanned only Key: SPARK-24645 URL: https://issues.apache.org/jira/browse/SPARK-24645

[jira] [Commented] (SPARK-24362) SUM function precision issue

[ https://issues.apache.org/jira/browse/SPARK-24362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521831#comment-16521831 ] Evelyn Bayes commented on SPARK-24362: -- Yeah this has to do with the precision problems of the

[jira] [Created] (SPARK-24644) Pyarrow exception while running pandas_udf on pyspark 2.3.1

Hichame El Khalfi created SPARK-24644: - Summary: Pyarrow exception while running pandas_udf on pyspark 2.3.1 Key: SPARK-24644 URL: https://issues.apache.org/jira/browse/SPARK-24644 Project: Spark

[jira] [Commented] (SPARK-20202) Remove references to org.spark-project.hive

[ https://issues.apache.org/jira/browse/SPARK-20202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521823#comment-16521823 ] Hyukjin Kwon commented on SPARK-20202: -- [~owen.omalley] and [~rxin], what do you think about the

[jira] [Commented] (SPARK-23931) High-order function: array_zip(array1, array2[, ...]) → array

[ https://issues.apache.org/jira/browse/SPARK-23931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521797#comment-16521797 ] Apache Spark commented on SPARK-23931: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-24362) SUM function precision issue

[ https://issues.apache.org/jira/browse/SPARK-24362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521795#comment-16521795 ] Evelyn Bayes commented on SPARK-24362: -- It's related to the use of double: {code:java}

[jira] [Commented] (SPARK-23776) pyspark-sql tests should display build instructions when components are missing

[ https://issues.apache.org/jira/browse/SPARK-23776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521773#comment-16521773 ] Apache Spark commented on SPARK-23776: -- User 'bersprockets' has created a pull request for this

[jira] [Comment Edited] (SPARK-24641) Spark-Mesos integration doesn't respect request to abort itself

[ https://issues.apache.org/jira/browse/SPARK-24641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521690#comment-16521690 ] Stavros Kontopoulos edited comment on SPARK-24641 at 6/24/18 9:57 PM:

[jira] [Comment Edited] (SPARK-24641) Spark-Mesos integration doesn't respect request to abort itself

[ https://issues.apache.org/jira/browse/SPARK-24641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521690#comment-16521690 ] Stavros Kontopoulos edited comment on SPARK-24641 at 6/24/18 9:53 PM:

[jira] [Comment Edited] (SPARK-24641) Spark-Mesos integration doesn't respect request to abort itself

[ https://issues.apache.org/jira/browse/SPARK-24641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521690#comment-16521690 ] Stavros Kontopoulos edited comment on SPARK-24641 at 6/24/18 9:46 PM:

[jira] [Comment Edited] (SPARK-24641) Spark-Mesos integration doesn't respect request to abort itself

[ https://issues.apache.org/jira/browse/SPARK-24641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521690#comment-16521690 ] Stavros Kontopoulos edited comment on SPARK-24641 at 6/24/18 9:43 PM:

[jira] [Commented] (SPARK-24641) Spark-Mesos integration doesn't respect request to abort itself

[ https://issues.apache.org/jira/browse/SPARK-24641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521690#comment-16521690 ] Stavros Kontopoulos commented on SPARK-24641: - [~igor.berman] obviously since the connection

[jira] [Commented] (SPARK-24641) Spark-Mesos integration doesn't respect request to abort itself

[ https://issues.apache.org/jira/browse/SPARK-24641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521613#comment-16521613 ] Igor Berman commented on SPARK-24641: - And another comment. I'm wondering if at initial design there

[jira] [Commented] (SPARK-24641) Spark-Mesos integration doesn't respect request to abort itself

[ https://issues.apache.org/jira/browse/SPARK-24641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521609#comment-16521609 ] Igor Berman commented on SPARK-24641: - [~skonto] thanks for the comment! I'll look at link you've

[jira] [Resolved] (SPARK-24445) Schema in json format for from_json in SQL

[ https://issues.apache.org/jira/browse/SPARK-24445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-24445. Resolution: Won't Fix > Schema in json format for from_json in SQL >

[jira] [Comment Edited] (SPARK-24641) Spark-Mesos integration doesn't respect request to abort itself

[ https://issues.apache.org/jira/browse/SPARK-24641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521524#comment-16521524 ] Stavros Kontopoulos edited comment on SPARK-24641 at 6/24/18 4:57 PM:

[jira] [Comment Edited] (SPARK-24641) Spark-Mesos integration doesn't respect request to abort itself

[ https://issues.apache.org/jira/browse/SPARK-24641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521524#comment-16521524 ] Stavros Kontopoulos edited comment on SPARK-24641 at 6/24/18 4:56 PM:

[jira] [Comment Edited] (SPARK-24641) Spark-Mesos integration doesn't respect request to abort itself

[ https://issues.apache.org/jira/browse/SPARK-24641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521524#comment-16521524 ] Stavros Kontopoulos edited comment on SPARK-24641 at 6/24/18 4:27 PM:

[jira] [Comment Edited] (SPARK-24641) Spark-Mesos integration doesn't respect request to abort itself

[ https://issues.apache.org/jira/browse/SPARK-24641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521524#comment-16521524 ] Stavros Kontopoulos edited comment on SPARK-24641 at 6/24/18 4:26 PM:

[jira] [Comment Edited] (SPARK-24641) Spark-Mesos integration doesn't respect request to abort itself

[ https://issues.apache.org/jira/browse/SPARK-24641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521524#comment-16521524 ] Stavros Kontopoulos edited comment on SPARK-24641 at 6/24/18 4:26 PM:

[jira] [Comment Edited] (SPARK-24641) Spark-Mesos integration doesn't respect request to abort itself

[ https://issues.apache.org/jira/browse/SPARK-24641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521524#comment-16521524 ] Stavros Kontopoulos edited comment on SPARK-24641 at 6/24/18 4:25 PM:

[jira] [Comment Edited] (SPARK-24641) Spark-Mesos integration doesn't respect request to abort itself

[ https://issues.apache.org/jira/browse/SPARK-24641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521524#comment-16521524 ] Stavros Kontopoulos edited comment on SPARK-24641 at 6/24/18 4:25 PM:

[jira] [Comment Edited] (SPARK-24641) Spark-Mesos integration doesn't respect request to abort itself

[ https://issues.apache.org/jira/browse/SPARK-24641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521524#comment-16521524 ] Stavros Kontopoulos edited comment on SPARK-24641 at 6/24/18 4:24 PM:

[jira] [Comment Edited] (SPARK-24641) Spark-Mesos integration doesn't respect request to abort itself

[ https://issues.apache.org/jira/browse/SPARK-24641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521524#comment-16521524 ] Stavros Kontopoulos edited comment on SPARK-24641 at 6/24/18 4:24 PM:

[jira] [Comment Edited] (SPARK-24641) Spark-Mesos integration doesn't respect request to abort itself

[ https://issues.apache.org/jira/browse/SPARK-24641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521524#comment-16521524 ] Stavros Kontopoulos edited comment on SPARK-24641 at 6/24/18 4:23 PM:

[jira] [Comment Edited] (SPARK-24641) Spark-Mesos integration doesn't respect request to abort itself

[ https://issues.apache.org/jira/browse/SPARK-24641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521524#comment-16521524 ] Stavros Kontopoulos edited comment on SPARK-24641 at 6/24/18 4:22 PM:

[jira] [Comment Edited] (SPARK-24641) Spark-Mesos integration doesn't respect request to abort itself

[ https://issues.apache.org/jira/browse/SPARK-24641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521524#comment-16521524 ] Stavros Kontopoulos edited comment on SPARK-24641 at 6/24/18 3:56 PM:

[jira] [Comment Edited] (SPARK-24641) Spark-Mesos integration doesn't respect request to abort itself

[ https://issues.apache.org/jira/browse/SPARK-24641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521524#comment-16521524 ] Stavros Kontopoulos edited comment on SPARK-24641 at 6/24/18 3:54 PM:

[jira] [Comment Edited] (SPARK-24641) Spark-Mesos integration doesn't respect request to abort itself

[ https://issues.apache.org/jira/browse/SPARK-24641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521524#comment-16521524 ] Stavros Kontopoulos edited comment on SPARK-24641 at 6/24/18 3:54 PM:

[jira] [Comment Edited] (SPARK-24641) Spark-Mesos integration doesn't respect request to abort itself

[ https://issues.apache.org/jira/browse/SPARK-24641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521524#comment-16521524 ] Stavros Kontopoulos edited comment on SPARK-24641 at 6/24/18 3:53 PM:

[jira] [Comment Edited] (SPARK-24641) Spark-Mesos integration doesn't respect request to abort itself

[ https://issues.apache.org/jira/browse/SPARK-24641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521524#comment-16521524 ] Stavros Kontopoulos edited comment on SPARK-24641 at 6/24/18 3:52 PM:

[jira] [Comment Edited] (SPARK-24641) Spark-Mesos integration doesn't respect request to abort itself

[ https://issues.apache.org/jira/browse/SPARK-24641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521524#comment-16521524 ] Stavros Kontopoulos edited comment on SPARK-24641 at 6/24/18 3:51 PM:

[jira] [Commented] (SPARK-24641) Spark-Mesos integration doesn't respect request to abort itself

[ https://issues.apache.org/jira/browse/SPARK-24641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521524#comment-16521524 ] Stavros Kontopoulos commented on SPARK-24641: - [~igor.berman] The current idea of the

[jira] [Assigned] (SPARK-24642) Add a function which infers schema from a JSON column

[ https://issues.apache.org/jira/browse/SPARK-24642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24642: Assignee: (was: Apache Spark) > Add a function which infers schema from a JSON

[jira] [Commented] (SPARK-24642) Add a function which infers schema from a JSON column

[ https://issues.apache.org/jira/browse/SPARK-24642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521500#comment-16521500 ] Apache Spark commented on SPARK-24642: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24642) Add a function which infers schema from a JSON column

[ https://issues.apache.org/jira/browse/SPARK-24642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24642: Assignee: Apache Spark > Add a function which infers schema from a JSON column >

[jira] [Created] (SPARK-24643) from_json should accept an aggregate function as schema

Maxim Gekk created SPARK-24643: -- Summary: from_json should accept an aggregate function as schema Key: SPARK-24643 URL: https://issues.apache.org/jira/browse/SPARK-24643 Project: Spark Issue

[jira] [Created] (SPARK-24642) Add a function which infers schema from a JSON column

Maxim Gekk created SPARK-24642: -- Summary: Add a function which infers schema from a JSON column Key: SPARK-24642 URL: https://issues.apache.org/jira/browse/SPARK-24642 Project: Spark Issue

[jira] [Created] (SPARK-24641) Spark-Mesos integration doesn't respect request to abort itself

Igor Berman created SPARK-24641: --- Summary: Spark-Mesos integration doesn't respect request to abort itself Key: SPARK-24641 URL: https://issues.apache.org/jira/browse/SPARK-24641 Project: Spark

[jira] [Resolved] (SPARK-24379) BroadcastExchangeExec should catch SparkOutOfMemory and re-throw SparkFatalException, which wraps SparkOutOfMemory inside.

[ https://issues.apache.org/jira/browse/SPARK-24379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24379. -- Resolution: Won't Fix > BroadcastExchangeExec should catch SparkOutOfMemory and re-throw >

[jira] [Commented] (SPARK-24530) pyspark.ml doesn't generate class docs correctly

[ https://issues.apache.org/jira/browse/SPARK-24530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521401#comment-16521401 ] Hyukjin Kwon commented on SPARK-24530: -- Probably it's related with Sphinx's version just from my

[jira] [Resolved] (SPARK-24517) Bug in loading unstructured data

[ https://issues.apache.org/jira/browse/SPARK-24517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24517. -- Resolution: Invalid >From my look, it sounds specific to the datasource. Let me resolve this

[jira] [Commented] (SPARK-24568) Code refactoring for DataType equalsXXX methods

[ https://issues.apache.org/jira/browse/SPARK-24568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521394#comment-16521394 ] Hyukjin Kwon commented on SPARK-24568: -- (Please avoid to set the fix version which is usually set

[jira] [Updated] (SPARK-24568) Code refactoring for DataType equalsXXX methods

[ https://issues.apache.org/jira/browse/SPARK-24568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-24568: - Fix Version/s: (was: 2.4.0) > Code refactoring for DataType equalsXXX methods >

[jira] [Commented] (SPARK-24631) Cannot up cast column from bigint to smallint as it may truncate

[ https://issues.apache.org/jira/browse/SPARK-24631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521393#comment-16521393 ] Hyukjin Kwon commented on SPARK-24631: -- [~HadoopSiva], you mean it's resolved in the upper