[jira] [Issue Comment Deleted] (SPARK-33584) Partition predicate pushdown into Hive metastore support cast string type to date type

2020-11-28 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33584: Comment: was deleted (was: This change should after SPARK-33581, I have prepared the pr:

[jira] [Issue Comment Deleted] (SPARK-33582) Partition predicate pushdown into Hive metastore support not-equals

2020-11-28 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33582: Comment: was deleted (was: This change should after SPARK-33581, I have prepared the pr:

[jira] [Commented] (SPARK-33584) Partition predicate pushdown into Hive metastore support cast string type to date type

2020-11-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240174#comment-17240174 ] Apache Spark commented on SPARK-33584: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-33582) Partition predicate pushdown into Hive metastore support not-equals

2020-11-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240173#comment-17240173 ] Apache Spark commented on SPARK-33582: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-33581) Refactor HivePartitionFilteringSuite

2020-11-28 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240171#comment-17240171 ] Yuming Wang commented on SPARK-33581: - Issue resolved by pull request 30525

[jira] [Resolved] (SPARK-33581) Refactor HivePartitionFilteringSuite

2020-11-28 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-33581. - Fix Version/s: 3.1.0 Resolution: Fixed User 'wangyum' has created a pull request for

[jira] [Issue Comment Deleted] (SPARK-33581) Refactor HivePartitionFilteringSuite

2020-11-28 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33581: Comment: was deleted (was: User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33581) Refactor HivePartitionFilteringSuite

2020-11-28 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-33581: --- Assignee: Yuming Wang > Refactor HivePartitionFilteringSuite >

[jira] [Assigned] (SPARK-33380) Incorrect output from example script pi.py

2020-11-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33380: Assignee: (was: Apache Spark) > Incorrect output from example script pi.py >

[jira] [Commented] (SPARK-33380) Incorrect output from example script pi.py

2020-11-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240169#comment-17240169 ] Apache Spark commented on SPARK-33380: -- User 'milindvdamle' has created a pull request for this

[jira] [Assigned] (SPARK-33380) Incorrect output from example script pi.py

2020-11-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33380: Assignee: Apache Spark > Incorrect output from example script pi.py >

[jira] [Resolved] (SPARK-33564) Prometheus metrics for Master and Worker isn't working

2020-11-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33564. --- Resolution: Invalid > Prometheus metrics for Master and Worker isn't working >

[jira] [Commented] (SPARK-33564) Prometheus metrics for Master and Worker isn't working

2020-11-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240098#comment-17240098 ] Dongjoon Hyun commented on SPARK-33564: --- The following is the correct way on Apache Spark 3.1. I'd

[jira] [Commented] (SPARK-33564) Prometheus metrics for Master and Worker isn't working

2020-11-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240096#comment-17240096 ] Dongjoon Hyun commented on SPARK-33564: --- [~paulo.castro]. It looks like you missed the ending `/`,

[jira] [Updated] (SPARK-33585) The comment for SQLContext.tables() doesn't mention the `database` column

2020-11-28 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33585: --- Affects Version/s: (was: 2.4.7) (was: 3.0.1)

[jira] [Resolved] (SPARK-33580) resolveDependencyPaths should use classifier attribute of artifact

2020-11-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33580. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30524

[jira] [Assigned] (SPARK-33588) Partition spec in SHOW TABLE EXTENDED doesn't respect `spark.sql.caseSensitive`

2020-11-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33588: Assignee: Apache Spark > Partition spec in SHOW TABLE EXTENDED doesn't respect >

[jira] [Assigned] (SPARK-33588) Partition spec in SHOW TABLE EXTENDED doesn't respect `spark.sql.caseSensitive`

2020-11-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33588: Assignee: (was: Apache Spark) > Partition spec in SHOW TABLE EXTENDED doesn't

[jira] [Commented] (SPARK-33588) Partition spec in SHOW TABLE EXTENDED doesn't respect `spark.sql.caseSensitive`

2020-11-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240045#comment-17240045 ] Apache Spark commented on SPARK-33588: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Created] (SPARK-33588) Partition spec in SHOW TABLE EXTENDED doesn't respect `spark.sql.caseSensitive`

2020-11-28 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33588: -- Summary: Partition spec in SHOW TABLE EXTENDED doesn't respect `spark.sql.caseSensitive` Key: SPARK-33588 URL: https://issues.apache.org/jira/browse/SPARK-33588 Project:

[jira] [Assigned] (SPARK-33587) Kill the executor on nested fatal errors

2020-11-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33587: Assignee: Apache Spark > Kill the executor on nested fatal errors >

[jira] [Assigned] (SPARK-33587) Kill the executor on nested fatal errors

2020-11-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33587: Assignee: (was: Apache Spark) > Kill the executor on nested fatal errors >

[jira] [Commented] (SPARK-33587) Kill the executor on nested fatal errors

2020-11-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240029#comment-17240029 ] Apache Spark commented on SPARK-33587: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Created] (SPARK-33587) Kill the executor on nested fatal errors

2020-11-28 Thread Shixiong Zhu (Jira)
Shixiong Zhu created SPARK-33587: Summary: Kill the executor on nested fatal errors Key: SPARK-33587 URL: https://issues.apache.org/jira/browse/SPARK-33587 Project: Spark Issue Type:

[jira] [Created] (SPARK-33586) BisectingKMeansModel save and load implementation in pyspark

2020-11-28 Thread Iman Kermani (Jira)
Iman Kermani created SPARK-33586: Summary: BisectingKMeansModel save and load implementation in pyspark Key: SPARK-33586 URL: https://issues.apache.org/jira/browse/SPARK-33586 Project: Spark

[jira] [Commented] (SPARK-33570) Set the proper version of gssapi plugin automatically for MariaDBKrbIntegrationSuite

2020-11-28 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239994#comment-17239994 ] Kousuke Saruta commented on SPARK-33570: Issue resolved by pull request 30515

[jira] [Resolved] (SPARK-33570) Set the proper version of gssapi plugin automatically for MariaDBKrbIntegrationSuite

2020-11-28 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-33570. Fix Version/s: 3.1.0 Resolution: Fixed > Set the proper version of gssapi plugin

[jira] [Updated] (SPARK-33570) Set the proper version of gssapi plugin automatically for MariaDBKrbIntegrationSuite

2020-11-28 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-33570: --- Summary: Set the proper version of gssapi plugin automatically for

[jira] [Assigned] (SPARK-33585) The comment for SQLContext.tables() doesn't mention the `database` column

2020-11-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33585: Assignee: (was: Apache Spark) > The comment for SQLContext.tables() doesn't mention

[jira] [Commented] (SPARK-33585) The comment for SQLContext.tables() doesn't mention the `database` column

2020-11-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239991#comment-17239991 ] Apache Spark commented on SPARK-33585: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33585) The comment for SQLContext.tables() doesn't mention the `database` column

2020-11-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33585: Assignee: Apache Spark > The comment for SQLContext.tables() doesn't mention the

[jira] [Created] (SPARK-33585) The comment for SQLContext.tables() doesn't mention the `database` column

2020-11-28 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33585: -- Summary: The comment for SQLContext.tables() doesn't mention the `database` column Key: SPARK-33585 URL: https://issues.apache.org/jira/browse/SPARK-33585 Project: Spark

[jira] [Commented] (SPARK-33584) Partition predicate pushdown into Hive metastore support cast string type to date type

2020-11-28 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239935#comment-17239935 ] Yuming Wang commented on SPARK-33584: - This change should after SPARK-33581, I have prepared the pr:

[jira] [Created] (SPARK-33584) Partition predicate pushdown into Hive metastore support cast string type to date type

2020-11-28 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-33584: --- Summary: Partition predicate pushdown into Hive metastore support cast string type to date type Key: SPARK-33584 URL: https://issues.apache.org/jira/browse/SPARK-33584

[jira] [Updated] (SPARK-33582) Partition predicate pushdown into Hive metastore support not-equals

2020-11-28 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33582: Summary: Partition predicate pushdown into Hive metastore support not-equals (was: Hive

[jira] [Created] (SPARK-33583) Query on large dataset with forEachPartitionAsync performance needs to improve

2020-11-28 Thread Miron (Jira)
Miron created SPARK-33583: - Summary: Query on large dataset with forEachPartitionAsync performance needs to improve Key: SPARK-33583 URL: https://issues.apache.org/jira/browse/SPARK-33583 Project: Spark

[jira] [Updated] (SPARK-33583) Query on large dataset with foreachPartitionAsync performance needs to improve

2020-11-28 Thread Miron (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miron updated SPARK-33583: -- Summary: Query on large dataset with foreachPartitionAsync performance needs to improve (was: Query on large