[jira] [Resolved] (SPARK-33704) Support latest version of initialize() in HiveGenericUDTF

[ https://issues.apache.org/jira/browse/SPARK-33704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-33704. - Resolution: Duplicate > Support latest version of initialize() in HiveGenericUDTF >

[jira] [Created] (SPARK-33953) readImages test fails due to NoClassDefFoundError for ImageTypeSpecifier

Ted Yu created SPARK-33953: -- Summary: readImages test fails due to NoClassDefFoundError for ImageTypeSpecifier Key: SPARK-33953 URL: https://issues.apache.org/jira/browse/SPARK-33953 Project: Spark

[jira] [Commented] (SPARK-33931) Recover GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-33931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17257109#comment-17257109 ] Apache Spark commented on SPARK-33931: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-33906) SPARK UI Executors page stuck when ExecutorSummary.peakMemoryMetrics is unset

[ https://issues.apache.org/jira/browse/SPARK-33906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33906: - Assignee: Baohe Zhang > SPARK UI Executors page stuck when

[jira] [Resolved] (SPARK-33906) SPARK UI Executors page stuck when ExecutorSummary.peakMemoryMetrics is unset

[ https://issues.apache.org/jira/browse/SPARK-33906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33906. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30920

[jira] [Resolved] (SPARK-31946) Failed to register SIGPWR handler on MacOS

[ https://issues.apache.org/jira/browse/SPARK-31946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31946. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30968

[jira] [Assigned] (SPARK-31946) Failed to register SIGPWR handler on MacOS

[ https://issues.apache.org/jira/browse/SPARK-31946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31946: - Assignee: wuyi > Failed to register SIGPWR handler on MacOS >

[jira] [Comment Edited] (SPARK-19450) Replace askWithRetry with askSync.

[ https://issues.apache.org/jira/browse/SPARK-19450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17257091#comment-17257091 ] Zhongwei Zhu edited comment on SPARK-19450 at 12/31/20, 7:58 PM: - For

[jira] [Commented] (SPARK-19450) Replace askWithRetry with askSync.

[ https://issues.apache.org/jira/browse/SPARK-19450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17257091#comment-17257091 ] Zhongwei Zhu commented on SPARK-19450: -- For old askWithRetry method, it can use provided config

[jira] [Commented] (SPARK-33948) branch-3.1 jenkins test failed in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-33948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17257078#comment-17257078 ] Sean R. Owen commented on SPARK-33948: -- That looks like a possibly transient problem in the build

[jira] [Commented] (SPARK-33730) Standardize warning types

[ https://issues.apache.org/jira/browse/SPARK-33730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17257032#comment-17257032 ] Apache Spark commented on SPARK-33730: -- User 'zero323' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33730) Standardize warning types

[ https://issues.apache.org/jira/browse/SPARK-33730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33730: Assignee: Apache Spark (was: Maciej Bryński) > Standardize warning types >

[jira] [Assigned] (SPARK-33730) Standardize warning types

[ https://issues.apache.org/jira/browse/SPARK-33730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33730: Assignee: Maciej Bryński (was: Apache Spark) > Standardize warning types >

[jira] [Assigned] (SPARK-33730) Standardize warning types

[ https://issues.apache.org/jira/browse/SPARK-33730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33730: Assignee: Maciej Bryński (was: Apache Spark) > Standardize warning types >

[jira] [Commented] (SPARK-33915) Allow json expression to be pushable column

[ https://issues.apache.org/jira/browse/SPARK-33915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17257027#comment-17257027 ] Apache Spark commented on SPARK-33915: -- User 'tedyu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33915) Allow json expression to be pushable column

[ https://issues.apache.org/jira/browse/SPARK-33915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33915: Assignee: Apache Spark > Allow json expression to be pushable column >

[jira] [Assigned] (SPARK-33915) Allow json expression to be pushable column

[ https://issues.apache.org/jira/browse/SPARK-33915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33915: Assignee: (was: Apache Spark) > Allow json expression to be pushable column >

[jira] [Assigned] (SPARK-33915) Allow json expression to be pushable column

[ https://issues.apache.org/jira/browse/SPARK-33915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33915: Assignee: Apache Spark > Allow json expression to be pushable column >

[jira] [Commented] (SPARK-33915) Allow json expression to be pushable column

[ https://issues.apache.org/jira/browse/SPARK-33915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17257025#comment-17257025 ] Ted Yu commented on SPARK-33915: Opened https://github.com/apache/spark/pull/30984 > Allow json

[jira] [Comment Edited] (SPARK-33915) Allow json expression to be pushable column

[ https://issues.apache.org/jira/browse/SPARK-33915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255389#comment-17255389 ] Ted Yu edited comment on SPARK-33915 at 12/31/20, 3:16 PM: --- Here is the plan

[jira] [Commented] (SPARK-33943) Zookeeper LeaderElection Agent not being called by Spark Master

[ https://issues.apache.org/jira/browse/SPARK-33943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17256965#comment-17256965 ] Saloni commented on SPARK-33943: If we increase the timeouts/no. of retries, will that resolve the issue

[jira] [Commented] (SPARK-33943) Zookeeper LeaderElection Agent not being called by Spark Master

[ https://issues.apache.org/jira/browse/SPARK-33943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17256962#comment-17256962 ] Saloni commented on SPARK-33943: As per my understanding, the re-tries going on in the logs for

[jira] [Commented] (SPARK-33950) ALTER TABLE .. DROP PARTITION doesn't refresh cache

[ https://issues.apache.org/jira/browse/SPARK-33950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17256946#comment-17256946 ] Apache Spark commented on SPARK-33950: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33950) ALTER TABLE .. DROP PARTITION doesn't refresh cache

[ https://issues.apache.org/jira/browse/SPARK-33950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33950: Assignee: Apache Spark > ALTER TABLE .. DROP PARTITION doesn't refresh cache >

[jira] [Assigned] (SPARK-33950) ALTER TABLE .. DROP PARTITION doesn't refresh cache

[ https://issues.apache.org/jira/browse/SPARK-33950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33950: Assignee: (was: Apache Spark) > ALTER TABLE .. DROP PARTITION doesn't refresh cache

[jira] [Assigned] (SPARK-33951) Distinguish the error between filter and distinct

[ https://issues.apache.org/jira/browse/SPARK-33951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33951: Assignee: (was: Apache Spark) > Distinguish the error between filter and distinct >

[jira] [Commented] (SPARK-33951) Distinguish the error between filter and distinct

[ https://issues.apache.org/jira/browse/SPARK-33951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17256944#comment-17256944 ] Apache Spark commented on SPARK-33951: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-33951) Distinguish the error between filter and distinct

[ https://issues.apache.org/jira/browse/SPARK-33951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17256943#comment-17256943 ] Apache Spark commented on SPARK-33951: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33951) Distinguish the error between filter and distinct

[ https://issues.apache.org/jira/browse/SPARK-33951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33951: Assignee: Apache Spark > Distinguish the error between filter and distinct >

[jira] [Updated] (SPARK-33952) Python-friendly dtypes for pyspark dataframes

[ https://issues.apache.org/jira/browse/SPARK-33952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marc de Lignie updated SPARK-33952: --- Fix Version/s: 3.2.0 > Python-friendly dtypes for pyspark dataframes >

[jira] [Updated] (SPARK-33952) Python-friendly dtypes for pyspark dataframes

[ https://issues.apache.org/jira/browse/SPARK-33952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marc de Lignie updated SPARK-33952: --- Issue Type: Improvement (was: Task) > Python-friendly dtypes for pyspark dataframes >

[jira] [Updated] (SPARK-33952) Python-friendly dtypes for pyspark dataframes

[ https://issues.apache.org/jira/browse/SPARK-33952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marc de Lignie updated SPARK-33952: --- Affects Version/s: (was: 3.0.1) 3.2.0 > Python-friendly dtypes

[jira] [Created] (SPARK-33952) Python-friendly dtypes for pyspark dataframes

Marc de Lignie created SPARK-33952: -- Summary: Python-friendly dtypes for pyspark dataframes Key: SPARK-33952 URL: https://issues.apache.org/jira/browse/SPARK-33952 Project: Spark Issue

[jira] [Created] (SPARK-33951) Distinguish the error between filter and distinct

jiaan.geng created SPARK-33951: -- Summary: Distinguish the error between filter and distinct Key: SPARK-33951 URL: https://issues.apache.org/jira/browse/SPARK-33951 Project: Spark Issue Type:

[jira] [Created] (SPARK-33950) ALTER TABLE .. DROP PARTITION doesn't refresh cache

Maxim Gekk created SPARK-33950: -- Summary: ALTER TABLE .. DROP PARTITION doesn't refresh cache Key: SPARK-33950 URL: https://issues.apache.org/jira/browse/SPARK-33950 Project: Spark Issue Type:

[jira] [Updated] (SPARK-33949) Make approx_count_distinct result consistent whether Optimize rule exists or not

[ https://issues.apache.org/jira/browse/SPARK-33949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-33949: Description: This code will fail because folabe value not fold, we should keep {code:java} val

[jira] [Updated] (SPARK-33949) Make approx_count_distinct result consistent whether Optimize rule exists or not

[ https://issues.apache.org/jira/browse/SPARK-33949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-33949: Description: This code will fail because folabe value not fold, we should keep result consistent

[jira] [Created] (SPARK-33949) Make approx_count_distinct result consistent whether Optimize rule exists or not

ulysses you created SPARK-33949: --- Summary: Make approx_count_distinct result consistent whether Optimize rule exists or not Key: SPARK-33949 URL: https://issues.apache.org/jira/browse/SPARK-33949

[jira] [Commented] (SPARK-33948) branch-3.1 jenkins test failed in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-33948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17256908#comment-17256908 ] Yang Jie commented on SPARK-33948: -- seems master branch cannot reproduce this problem > branch-3.1

[jira] [Comment Edited] (SPARK-33948) branch-3.1 jenkins test failed in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-33948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17256903#comment-17256903 ] Yang Jie edited comment on SPARK-33948 at 12/31/20, 9:03 AM: - Very strange

[jira] [Commented] (SPARK-33948) branch-3.1 jenkins test failed in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-33948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17256903#comment-17256903 ] Yang Jie commented on SPARK-33948: -- Very strange for ExpressionEncoderSuite: run  {code:java} mvn

[jira] [Updated] (SPARK-33948) branch-3.1 jenkins test failed in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-33948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-33948: - Description:

[jira] [Updated] (SPARK-33948) branch-3.1 jenkins test failed in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-33948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-33948: - Environment: *   was:

[jira] [Updated] (SPARK-33947) String functions: Trim/Ltrim/Rtrim support byte array

[ https://issues.apache.org/jira/browse/SPARK-33947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-33947: --- Summary: String functions: Trim/Ltrim/Rtrim support byte array (was: String functions:

[jira] [Updated] (SPARK-33947) String functions: Trim/Ltrim/Rtrim support byte arrays

[ https://issues.apache.org/jira/browse/SPARK-33947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-33947: --- Description: String functions: Trim/Ltrim/Rtrim support byte arrays The mainstream database

[jira] [Updated] (SPARK-33947) String functions: Trim/Ltrim/Rtrim support byte arrays

[ https://issues.apache.org/jira/browse/SPARK-33947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-33947: --- Description: String functions: Trim/Ltrim/Rtrim support byte arrays The mainstream database

[jira] [Updated] (SPARK-33947) String functions: Trim/Ltrim/Rtrim support byte arrays

[ https://issues.apache.org/jira/browse/SPARK-33947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-33947: --- Description: String functions: Trim/Ltrim/Rtrim support byte arrays The mainstream database

[jira] [Created] (SPARK-33948) branch-3.1 jenkins test failed in Scala 2.13

Yang Jie created SPARK-33948: Summary: branch-3.1 jenkins test failed in Scala 2.13 Key: SPARK-33948 URL: https://issues.apache.org/jira/browse/SPARK-33948 Project: Spark Issue Type: Sub-task