[jira] [Commented] (SPARK-36379) Null at root level of a JSON array causes the parsing failure (w/ permissive mode)

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17391400#comment-17391400 ] Apache Spark commented on SPARK-36379: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-36379) Null at root level of a JSON array causes the parsing failure (w/ permissive mode)

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36379: Assignee: (was: Apache Spark) > Null at root level of a JSON array causes the parsing

[jira] [Assigned] (SPARK-36379) Null at root level of a JSON array causes the parsing failure (w/ permissive mode)

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36379: Assignee: Apache Spark > Null at root level of a JSON array causes the parsing failure (w

[jira] [Resolved] (SPARK-36372) ALTER TABLE ADD COLUMNS should check duplicates for the specified columns for v2 command

2021-08-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36372. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33600 [https://gith

[jira] [Assigned] (SPARK-36372) ALTER TABLE ADD COLUMNS should check duplicates for the specified columns for v2 command

2021-08-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36372: --- Assignee: Terry Kim > ALTER TABLE ADD COLUMNS should check duplicates for the specified col

[jira] [Created] (SPARK-36380) Simplify the logical plan names for ALTER TABLE ... COLUMN

2021-08-02 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-36380: --- Summary: Simplify the logical plan names for ALTER TABLE ... COLUMN Key: SPARK-36380 URL: https://issues.apache.org/jira/browse/SPARK-36380 Project: Spark Issu

[jira] [Commented] (SPARK-36380) Simplify the logical plan names for ALTER TABLE ... COLUMN

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17391506#comment-17391506 ] Apache Spark commented on SPARK-36380: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-36380) Simplify the logical plan names for ALTER TABLE ... COLUMN

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36380: Assignee: (was: Apache Spark) > Simplify the logical plan names for ALTER TABLE ... C

[jira] [Commented] (SPARK-36380) Simplify the logical plan names for ALTER TABLE ... COLUMN

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17391505#comment-17391505 ] Apache Spark commented on SPARK-36380: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-36380) Simplify the logical plan names for ALTER TABLE ... COLUMN

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36380: Assignee: Apache Spark > Simplify the logical plan names for ALTER TABLE ... COLUMN > ---

[jira] [Resolved] (SPARK-36237) SparkUI should bind handler after application started

2021-08-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36237. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33457 [https:

[jira] [Assigned] (SPARK-36237) SparkUI should bind handler after application started

2021-08-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-36237: -- Assignee: angerszhu > SparkUI should bind handler after application started > ---

[jira] [Created] (SPARK-36381) ALTER TABLE ADD/RENAME COLUMNS check exist does not use case sensitive for v2 command.

2021-08-02 Thread PengLei (Jira)
PengLei created SPARK-36381: --- Summary: ALTER TABLE ADD/RENAME COLUMNS check exist does not use case sensitive for v2 command. Key: SPARK-36381 URL: https://issues.apache.org/jira/browse/SPARK-36381 Project:

[jira] [Assigned] (SPARK-36381) ALTER TABLE ADD/RENAME COLUMNS check exist does not use case sensitive for v2 command.

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36381: Assignee: (was: Apache Spark) > ALTER TABLE ADD/RENAME COLUMNS check exist does not u

[jira] [Commented] (SPARK-36381) ALTER TABLE ADD/RENAME COLUMNS check exist does not use case sensitive for v2 command.

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17391559#comment-17391559 ] Apache Spark commented on SPARK-36381: -- User 'Peng-Lei' has created a pull request

[jira] [Assigned] (SPARK-36381) ALTER TABLE ADD/RENAME COLUMNS check exist does not use case sensitive for v2 command.

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36381: Assignee: Apache Spark > ALTER TABLE ADD/RENAME COLUMNS check exist does not use case sen

[jira] [Assigned] (SPARK-35918) Consolidate logic between AvroSerializer/AvroDeserializer for schema mismatch handling and error messages

2021-08-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-35918: -- Assignee: Erik Krogen > Consolidate logic between AvroSerializer/AvroDeserializer for

[jira] [Resolved] (SPARK-35918) Consolidate logic between AvroSerializer/AvroDeserializer for schema mismatch handling and error messages

2021-08-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-35918. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33308 [https:

[jira] [Created] (SPARK-36382) Remove unnecesssary footer from the summary table for metrics

2021-08-02 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36382: -- Summary: Remove unnecesssary footer from the summary table for metrics Key: SPARK-36382 URL: https://issues.apache.org/jira/browse/SPARK-36382 Project: Spark

[jira] [Updated] (SPARK-36382) Remove noisy footer from the summary table for metrics

2021-08-02 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36382: --- Summary: Remove noisy footer from the summary table for metrics (was: Remove unnecesssary f

[jira] [Commented] (SPARK-36382) Remove noisy footer from the summary table for metrics

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17391585#comment-17391585 ] Apache Spark commented on SPARK-36382: -- User 'sarutak' has created a pull request f

[jira] [Commented] (SPARK-36382) Remove noisy footer from the summary table for metrics

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17391584#comment-17391584 ] Apache Spark commented on SPARK-36382: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-36382) Remove noisy footer from the summary table for metrics

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36382: Assignee: Apache Spark (was: Kousuke Saruta) > Remove noisy footer from the summary tabl

[jira] [Assigned] (SPARK-36382) Remove noisy footer from the summary table for metrics

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36382: Assignee: Kousuke Saruta (was: Apache Spark) > Remove noisy footer from the summary tabl

[jira] [Created] (SPARK-36383) Avoid NullPointerException during executor shutdown

2021-08-02 Thread wuyi (Jira)
wuyi created SPARK-36383: Summary: Avoid NullPointerException during executor shutdown Key: SPARK-36383 URL: https://issues.apache.org/jira/browse/SPARK-36383 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-36383) NullPointerException throws during executor shutdown

2021-08-02 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-36383: - Summary: NullPointerException throws during executor shutdown (was: Avoid NullPointerException during executor

[jira] [Resolved] (SPARK-36206) Diagnose shuffle data corruption by checksum

2021-08-02 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-36206. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 334

[jira] [Assigned] (SPARK-36206) Diagnose shuffle data corruption by checksum

2021-08-02 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-36206: --- Assignee: wuyi > Diagnose shuffle data corruption by checksum > ---

[jira] [Commented] (SPARK-36325) Writing to hiveserver throught jdbc throws ParseException

2021-08-02 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-36325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17391638#comment-17391638 ] Jesús Ricardo Ballesteros Molina commented on SPARK-36325: -- Hel

[jira] [Commented] (SPARK-35275) Add checksum for shuffle blocks

2021-08-02 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17391640#comment-17391640 ] Mridul Muralidharan commented on SPARK-35275: - Do we want to add a documenta

[jira] [Commented] (SPARK-35275) Add checksum for shuffle blocks

2021-08-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17391643#comment-17391643 ] Gengliang Wang commented on SPARK-35275: [~mridulm80]+1. I will cut RC around th

[jira] [Assigned] (SPARK-36224) Use "void" as the type name of NullType

2021-08-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36224: --- Assignee: Linhong Liu > Use "void" as the type name of NullType > -

[jira] [Resolved] (SPARK-36224) Use "void" as the type name of NullType

2021-08-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36224. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33437 [https://gith

[jira] [Commented] (SPARK-35275) Add checksum for shuffle blocks

2021-08-02 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17391654#comment-17391654 ] wuyi commented on SPARK-35275: -- [~mridulm80] Yes, we shall have the doc task. Let me create

[jira] [Created] (SPARK-36384) Add documentation for shuffle checksum

2021-08-02 Thread wuyi (Jira)
wuyi created SPARK-36384: Summary: Add documentation for shuffle checksum Key: SPARK-36384 URL: https://issues.apache.org/jira/browse/SPARK-36384 Project: Spark Issue Type: Sub-task Compone

[jira] [Commented] (SPARK-36383) NullPointerException throws during executor shutdown

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17391662#comment-17391662 ] Apache Spark commented on SPARK-36383: -- User 'Ngone51' has created a pull request f

[jira] [Assigned] (SPARK-36383) NullPointerException throws during executor shutdown

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36383: Assignee: (was: Apache Spark) > NullPointerException throws during executor shutdown

[jira] [Assigned] (SPARK-36383) NullPointerException throws during executor shutdown

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36383: Assignee: Apache Spark > NullPointerException throws during executor shutdown > -

[jira] [Resolved] (SPARK-36382) Remove noisy footer from the summary table for metrics

2021-08-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36382. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33611 [https:

[jira] [Resolved] (SPARK-36086) The case of the delta table is inconsistent with parquet

2021-08-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36086. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33576 [https://gith

[jira] [Assigned] (SPARK-36086) The case of the delta table is inconsistent with parquet

2021-08-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36086: --- Assignee: angerszhu > The case of the delta table is inconsistent with parquet > --

[jira] [Commented] (SPARK-36086) The case of the delta table is inconsistent with parquet

2021-08-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17391679#comment-17391679 ] Wenchen Fan commented on SPARK-36086: - [~krivosheinruslan] please open a ticket if y

[jira] [Assigned] (SPARK-35430) Investigate the failure of "PVs with local storage" integration test on Docker driver

2021-08-02 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp reassigned SPARK-35430: --- Assignee: Attila Zsolt Piros > Investigate the failure of "PVs with local storage" integrat

[jira] [Resolved] (SPARK-35430) Investigate the failure of "PVs with local storage" integration test on Docker driver

2021-08-02 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp resolved SPARK-35430. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 32793 [https://gith

[jira] [Created] (SPARK-36385) Add possibility for jdbc insert hints

2021-08-02 Thread Nikolay Ivanitskiy (Jira)
Nikolay Ivanitskiy created SPARK-36385: -- Summary: Add possibility for jdbc insert hints Key: SPARK-36385 URL: https://issues.apache.org/jira/browse/SPARK-36385 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-36379) Null at root level of a JSON array causes the parsing failure (w/ permissive mode)

2021-08-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36379. --- Fix Version/s: 3.3.0 3.2.0 Assignee: Hyukjin Kwon Resoluti

[jira] [Commented] (SPARK-30602) SPIP: Support push-based shuffle to improve shuffle efficiency

2021-08-02 Thread Min Shen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17391745#comment-17391745 ] Min Shen commented on SPARK-30602: -- [~mridulm80], thanks for shepherding this work and

[jira] [Created] (SPARK-36386) Fix expanding to follow pandas 1.3

2021-08-02 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-36386: - Summary: Fix expanding to follow pandas 1.3 Key: SPARK-36386 URL: https://issues.apache.org/jira/browse/SPARK-36386 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-36386) Fix groupby-expanding to follow pandas 1.3

2021-08-02 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-36386: -- Summary: Fix groupby-expanding to follow pandas 1.3 (was: Fix expanding to follow pandas 1.3)

[jira] [Created] (SPARK-36387) Fix Series.astype from datetime to nullable string

2021-08-02 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-36387: - Summary: Fix Series.astype from datetime to nullable string Key: SPARK-36387 URL: https://issues.apache.org/jira/browse/SPARK-36387 Project: Spark Issue Ty

[jira] [Updated] (SPARK-36386) Fix DataFrame groupby-expanding to follow pandas 1.3

2021-08-02 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-36386: -- Summary: Fix DataFrame groupby-expanding to follow pandas 1.3 (was: Fix groupby-expanding to

[jira] [Created] (SPARK-36388) Fix DataFrame groupby-rolling to follow pandas 1.3

2021-08-02 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-36388: - Summary: Fix DataFrame groupby-rolling to follow pandas 1.3 Key: SPARK-36388 URL: https://issues.apache.org/jira/browse/SPARK-36388 Project: Spark Issue Ty

[jira] [Assigned] (SPARK-36378) Minor changes to address a few identified server side inefficiencies

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36378: Assignee: Apache Spark > Minor changes to address a few identified server side inefficien

[jira] [Assigned] (SPARK-36378) Minor changes to address a few identified server side inefficiencies

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36378: Assignee: (was: Apache Spark) > Minor changes to address a few identified server side

[jira] [Commented] (SPARK-36378) Minor changes to address a few identified server side inefficiencies

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17391832#comment-17391832 ] Apache Spark commented on SPARK-36378: -- User 'Victsm' has created a pull request fo

[jira] [Resolved] (SPARK-36137) HiveShim always fallback to getAllPartitionsOf regardless of whether directSQL is enabled in remote HMS

2021-08-02 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36137. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33382 [https://gith

[jira] [Assigned] (SPARK-36137) HiveShim always fallback to getAllPartitionsOf regardless of whether directSQL is enabled in remote HMS

2021-08-02 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36137: --- Assignee: Chao Sun > HiveShim always fallback to getAllPartitionsOf regardless of whether

[jira] [Resolved] (SPARK-36373) DecimalPrecision only add necessary cast

2021-08-02 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-36373. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33602 [https://gith

[jira] [Assigned] (SPARK-36373) DecimalPrecision only add necessary cast

2021-08-02 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-36373: --- Assignee: Yuming Wang > DecimalPrecision only add necessary cast >

[jira] [Assigned] (SPARK-36367) Fix the behavior to follow pandas >= 1.3

2021-08-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36367: Assignee: Haejoon Lee > Fix the behavior to follow pandas >= 1.3 > --

[jira] [Commented] (SPARK-36345) Add mlflow/sklearn to GHA docker image

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17391857#comment-17391857 ] Apache Spark commented on SPARK-36345: -- User 'ueshin' has created a pull request fo

[jira] [Updated] (SPARK-36367) Fix the behavior to follow pandas >= 1.3

2021-08-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36367: - Affects Version/s: (was: 3.2.0) 3.3.0 > Fix the behavior to follow pa

[jira] [Commented] (SPARK-36345) Add mlflow/sklearn to GHA docker image

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17391858#comment-17391858 ] Apache Spark commented on SPARK-36345: -- User 'ueshin' has created a pull request fo

[jira] [Updated] (SPARK-36359) Coalesce drop all expressions after the first non nullable expression

2021-08-02 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-36359: Summary: Coalesce drop all expressions after the first non nullable expression (was: Coalesce ret

[jira] [Commented] (SPARK-36367) Fix the behavior to follow pandas >= 1.3

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17391860#comment-17391860 ] Apache Spark commented on SPARK-36367: -- User 'ueshin' has created a pull request fo

[jira] [Commented] (SPARK-36374) Push-based shuffle documentation

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17391907#comment-17391907 ] Apache Spark commented on SPARK-36374: -- User 'venkata91' has created a pull request

[jira] [Assigned] (SPARK-36374) Push-based shuffle documentation

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36374: Assignee: Apache Spark > Push-based shuffle documentation > -

[jira] [Assigned] (SPARK-36374) Push-based shuffle documentation

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36374: Assignee: (was: Apache Spark) > Push-based shuffle documentation > --

[jira] [Commented] (SPARK-36374) Push-based shuffle documentation

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17391906#comment-17391906 ] Apache Spark commented on SPARK-36374: -- User 'venkata91' has created a pull request

[jira] [Created] (SPARK-36389) Revert the change that accepts negative mapId

2021-08-02 Thread Chandni Singh (Jira)
Chandni Singh created SPARK-36389: - Summary: Revert the change that accepts negative mapId Key: SPARK-36389 URL: https://issues.apache.org/jira/browse/SPARK-36389 Project: Spark Issue Type: B

[jira] [Updated] (SPARK-36389) Revert the change that accepts negative mapId

2021-08-02 Thread Chandni Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated SPARK-36389: -- Description: With SPARK-32922, we added a change that {{ShuffleBlockId}} can have a negative m

[jira] [Updated] (SPARK-36389) Revert the change that accepts negative mapId in ShuffleBlockId

2021-08-02 Thread Chandni Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated SPARK-36389: -- Summary: Revert the change that accepts negative mapId in ShuffleBlockId (was: Revert the cha

[jira] [Assigned] (SPARK-36389) Revert the change that accepts negative mapId in ShuffleBlockId

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36389: Assignee: Apache Spark > Revert the change that accepts negative mapId in ShuffleBlockId

[jira] [Commented] (SPARK-36389) Revert the change that accepts negative mapId in ShuffleBlockId

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17391912#comment-17391912 ] Apache Spark commented on SPARK-36389: -- User 'otterc' has created a pull request fo

[jira] [Assigned] (SPARK-36389) Revert the change that accepts negative mapId in ShuffleBlockId

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36389: Assignee: (was: Apache Spark) > Revert the change that accepts negative mapId in Shuf

[jira] [Commented] (SPARK-36389) Revert the change that accepts negative mapId in ShuffleBlockId

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17391913#comment-17391913 ] Apache Spark commented on SPARK-36389: -- User 'otterc' has created a pull request fo

[jira] [Assigned] (SPARK-35548) Handling new attempt has started error message in BlockPushErrorHandler in client

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35548: Assignee: Apache Spark > Handling new attempt has started error message in BlockPushError

[jira] [Assigned] (SPARK-35548) Handling new attempt has started error message in BlockPushErrorHandler in client

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35548: Assignee: (was: Apache Spark) > Handling new attempt has started error message in Blo

[jira] [Commented] (SPARK-35548) Handling new attempt has started error message in BlockPushErrorHandler in client

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17391936#comment-17391936 ] Apache Spark commented on SPARK-35548: -- User 'zhuqi-lucas' has created a pull reque

[jira] [Commented] (SPARK-35548) Handling new attempt has started error message in BlockPushErrorHandler in client

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17391937#comment-17391937 ] Apache Spark commented on SPARK-35548: -- User 'zhuqi-lucas' has created a pull reque

[jira] [Commented] (SPARK-36381) ALTER TABLE ADD/RENAME COLUMNS check exist does not use case sensitive for v2 command.

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17391947#comment-17391947 ] Apache Spark commented on SPARK-36381: -- User 'Peng-Lei' has created a pull request

[jira] [Commented] (SPARK-36381) ALTER TABLE ADD/RENAME COLUMNS check exist does not use case sensitive for v2 command.

2021-08-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17391948#comment-17391948 ] Apache Spark commented on SPARK-36381: -- User 'Peng-Lei' has created a pull request

[jira] [Assigned] (SPARK-36331) Add SQLSTATE guideline

2021-08-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36331: Assignee: Karen Feng > Add SQLSTATE guideline > -- > >

[jira] [Resolved] (SPARK-36331) Add SQLSTATE guideline

2021-08-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36331. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33560 [https://gi

[jira] [Resolved] (SPARK-36367) Fix the behavior to follow pandas >= 1.3

2021-08-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36367. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33614 [https://gi

[jira] [Updated] (SPARK-36367) Fix the behavior to follow pandas >= 1.3

2021-08-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36367: - Fix Version/s: (was: 3.2.0) > Fix the behavior to follow pandas >= 1.3 > ---

[jira] [Reopened] (SPARK-36367) Fix the behavior to follow pandas >= 1.3

2021-08-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-36367: -- > Fix the behavior to follow pandas >= 1.3 > > >

[jira] [Assigned] (SPARK-36389) Revert the change that accepts negative mapId in ShuffleBlockId

2021-08-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36389: - Assignee: Chandni Singh > Revert the change that accepts negative mapId in ShuffleBlock

[jira] [Resolved] (SPARK-36389) Revert the change that accepts negative mapId in ShuffleBlockId

2021-08-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36389. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33616 [https://

[jira] [Resolved] (SPARK-36383) NullPointerException throws during executor shutdown

2021-08-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36383. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33612 [https://

[jira] [Assigned] (SPARK-36383) NullPointerException throws during executor shutdown

2021-08-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36383: - Assignee: wuyi > NullPointerException throws during executor shutdown > ---