[jira] [Assigned] (SPARK-35408) Improve parameter validation in DataFrame.show

2021-05-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35408: Assignee: (was: Apache Spark) > Improve parameter validation in DataFrame.show >

[jira] [Assigned] (SPARK-35408) Improve parameter validation in DataFrame.show

2021-05-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35408: Assignee: Apache Spark > Improve parameter validation in DataFrame.show > ---

[jira] [Commented] (SPARK-35408) Improve parameter validation in DataFrame.show

2021-05-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17344971#comment-17344971 ] Apache Spark commented on SPARK-35408: -- User 'gerashegalov' has created a pull requ

[jira] [Created] (SPARK-35408) Improve parameter validation in DataFrame.show

2021-05-14 Thread Gera Shegalov (Jira)
Gera Shegalov created SPARK-35408: - Summary: Improve parameter validation in DataFrame.show Key: SPARK-35408 URL: https://issues.apache.org/jira/browse/SPARK-35408 Project: Spark Issue Type:

[jira] [Updated] (SPARK-34750) Parquet with invalid chars on column name reads double as null when a clean schema is applied

2021-05-14 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-34750: Fix Version/s: (was: 2.4.8) > Parquet with invalid chars on column name reads double as null w

[jira] [Created] (SPARK-35407) Shuffle files are not exited if the Spark job doesn't successfully

2021-05-14 Thread Bhargava Vadlamani (Jira)
Bhargava Vadlamani created SPARK-35407: -- Summary: Shuffle files are not exited if the Spark job doesn't successfully Key: SPARK-35407 URL: https://issues.apache.org/jira/browse/SPARK-35407 Projec

[jira] [Created] (SPARK-35406) TaskCompletionListenerException: Premature end of Content-Length delimited message body

2021-05-14 Thread Avik Aggarwal (Jira)
Avik Aggarwal created SPARK-35406: - Summary: TaskCompletionListenerException: Premature end of Content-Length delimited message body Key: SPARK-35406 URL: https://issues.apache.org/jira/browse/SPARK-35406

[jira] [Resolved] (SPARK-35405) Submitting Applications documentation has outdated information about K8s client mode support

2021-05-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35405. --- Fix Version/s: 3.0.3 3.1.2 3.2.0 Resolution: Fix

[jira] [Assigned] (SPARK-35405) Submitting Applications documentation has outdated information about K8s client mode support

2021-05-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-35405: - Assignee: Oleksandr Shevchenko > Submitting Applications documentation has outdated inf

[jira] [Commented] (SPARK-35389) Analyzer should set progagateNull to false for magic function invocation

2021-05-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17344791#comment-17344791 ] Apache Spark commented on SPARK-35389: -- User 'sunchao' has created a pull request f

[jira] [Assigned] (SPARK-35389) Analyzer should set progagateNull to false for magic function invocation

2021-05-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35389: Assignee: Apache Spark > Analyzer should set progagateNull to false for magic function in

[jira] [Commented] (SPARK-35389) Analyzer should set progagateNull to false for magic function invocation

2021-05-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17344787#comment-17344787 ] Apache Spark commented on SPARK-35389: -- User 'sunchao' has created a pull request f

[jira] [Assigned] (SPARK-35389) Analyzer should set progagateNull to false for magic function invocation

2021-05-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35389: Assignee: (was: Apache Spark) > Analyzer should set progagateNull to false for magic

[jira] [Commented] (SPARK-18134) SQL: MapType in Group BY and Joins not working

2021-05-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-18134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17344674#comment-17344674 ] Apache Spark commented on SPARK-18134: -- User 'maropu' has created a pull request fo

[jira] [Commented] (SPARK-34819) MapType supports orderable semantics

2021-05-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17344673#comment-17344673 ] Apache Spark commented on SPARK-34819: -- User 'maropu' has created a pull request fo

[jira] [Commented] (SPARK-18134) SQL: MapType in Group BY and Joins not working

2021-05-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-18134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17344675#comment-17344675 ] Apache Spark commented on SPARK-18134: -- User 'maropu' has created a pull request fo

[jira] [Resolved] (SPARK-35206) Extract common get project path ability as function to SparkFunctionSuite

2021-05-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35206. - Fix Version/s: 3.2.0 Assignee: wuyi Resolution: Fixed > Extract common get proje

[jira] [Updated] (SPARK-35405) Submitting Applications documentation has outdated information about K8s client mode support

2021-05-14 Thread Oleksandr Shevchenko (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oleksandr Shevchenko updated SPARK-35405: - Description: [Submitting Applications doc|https://spark.apache.org/docs/latest/

[jira] [Updated] (SPARK-35405) Submitting Applications documentation has outdated information about K8s client mode support

2021-05-14 Thread Oleksandr Shevchenko (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oleksandr Shevchenko updated SPARK-35405: - Attachment: image-2021-05-14-15-11-11-621.png > Submitting Applications document

[jira] [Commented] (SPARK-35405) Submitting Applications documentation has outdated information about K8s client mode support

2021-05-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17344554#comment-17344554 ] Apache Spark commented on SPARK-35405: -- User 'o-shevchenko' has created a pull requ

[jira] [Updated] (SPARK-35405) Submitting Applications documentation has outdated information about K8s client mode support

2021-05-14 Thread Oleksandr Shevchenko (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oleksandr Shevchenko updated SPARK-35405: - Attachment: image-2021-05-14-15-10-55-987.png > Submitting Applications document

[jira] [Commented] (SPARK-35405) Submitting Applications documentation has outdated information about K8s client mode support

2021-05-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17344553#comment-17344553 ] Apache Spark commented on SPARK-35405: -- User 'o-shevchenko' has created a pull requ

[jira] [Assigned] (SPARK-35405) Submitting Applications documentation has outdated information about K8s client mode support

2021-05-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35405: Assignee: (was: Apache Spark) > Submitting Applications documentation has outdated in

[jira] [Assigned] (SPARK-35405) Submitting Applications documentation has outdated information about K8s client mode support

2021-05-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35405: Assignee: Apache Spark > Submitting Applications documentation has outdated information a

[jira] [Commented] (SPARK-35405) Submitting Applications documentation has outdated information about K8s client mode support

2021-05-14 Thread Oleksandr Shevchenko (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17344552#comment-17344552 ] Oleksandr Shevchenko commented on SPARK-35405: -- PR: https://github.com/apac

[jira] [Created] (SPARK-35405) Submitting Applications documentation has outdated information about K8s client mode support

2021-05-14 Thread Oleksandr Shevchenko (Jira)
Oleksandr Shevchenko created SPARK-35405: Summary: Submitting Applications documentation has outdated information about K8s client mode support Key: SPARK-35405 URL: https://issues.apache.org/jira/browse/S

[jira] [Resolved] (SPARK-35404) Name the timers in TaskSchedulerImpl

2021-05-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35404. -- Fix Version/s: 3.2.0 Assignee: Kent Yao Resolution: Fixed Fixed in https://git

[jira] [Updated] (SPARK-32838) Connot insert overwite different partition with same table

2021-05-14 Thread CHC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] CHC updated SPARK-32838: Summary: Connot insert overwite different partition with same table (was: Connot overwite different partition wit

[jira] [Commented] (SPARK-35332) Not Coalesce shuffle partitions when cache table

2021-05-14 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17344501#comment-17344501 ] XiDuo You commented on SPARK-35332: --- [~luxianghao] Now you can `set spark.sql.optimiz

[jira] [Commented] (SPARK-35282) Support AQE side shuffled hash join formula

2021-05-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17344395#comment-17344395 ] Apache Spark commented on SPARK-35282: -- User 'ulysses-you' has created a pull reque