[jira] [Created] (SPARK-42348) Add missign SQLSTATE: 42KD9

2023-02-05 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-42348: --- Summary: Add missign SQLSTATE: 42KD9 Key: SPARK-42348 URL: https://issues.apache.org/jira/browse/SPARK-42348 Project: Spark Issue Type: Sub-task Comp

[jira] [Updated] (SPARK-42348) Add missign SQLSTATE

2023-02-05 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42348: Summary: Add missign SQLSTATE (was: Add missign SQLSTATE: 42KD9) > Add missign SQLSTATE > ---

[jira] [Updated] (SPARK-42348) Add SQLSTATE

2023-02-05 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42348: Summary: Add SQLSTATE (was: Add missign SQLSTATE) > Add SQLSTATE > > >

[jira] [Commented] (SPARK-42348) Add SQLSTATE

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17684264#comment-17684264 ] Apache Spark commented on SPARK-42348: -- User 'itholic' has created a pull request f

[jira] [Assigned] (SPARK-42348) Add SQLSTATE

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42348: Assignee: Apache Spark > Add SQLSTATE > > > Key: SPARK-42348

[jira] [Assigned] (SPARK-42348) Add SQLSTATE

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42348: Assignee: (was: Apache Spark) > Add SQLSTATE > > > Key:

[jira] [Commented] (SPARK-42348) Add SQLSTATE

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17684265#comment-17684265 ] Apache Spark commented on SPARK-42348: -- User 'itholic' has created a pull request f

[jira] [Updated] (SPARK-42336) Use OpenHashMap instead of HashMap

2023-02-05 Thread jingxiong zhong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jingxiong zhong updated SPARK-42336: Description: In ResourceAllocator, we can use `.getOrElse(address, throw new SparkExceptio

[jira] [Updated] (SPARK-42336) Use getOrElse() instead of contains() in ResourceAllocator

2023-02-05 Thread jingxiong zhong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jingxiong zhong updated SPARK-42336: Summary: Use getOrElse() instead of contains() in ResourceAllocator (was: Use getOrElse(

[jira] [Updated] (SPARK-42336) Use getOrElse() instead of contains() in

2023-02-05 Thread jingxiong zhong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jingxiong zhong updated SPARK-42336: Summary: Use getOrElse() instead of contains() in(was: Use OpenHashMap instead of Hash

[jira] [Commented] (SPARK-42346) distinct(count colname) with UNION ALL causes query analyzer bug

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17684271#comment-17684271 ] Apache Spark commented on SPARK-42346: -- User 'peter-toth' has created a pull reques

[jira] [Updated] (SPARK-42346) distinct(count colname) with UNION ALL causes query analyzer bug

2023-02-05 Thread Peter Toth (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-42346: --- Affects Version/s: 3.3.0 3.4.0 3.5.0

[jira] [Assigned] (SPARK-42346) distinct(count colname) with UNION ALL causes query analyzer bug

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42346: Assignee: (was: Apache Spark) > distinct(count colname) with UNION ALL causes query a

[jira] [Assigned] (SPARK-42346) distinct(count colname) with UNION ALL causes query analyzer bug

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42346: Assignee: Apache Spark > distinct(count colname) with UNION ALL causes query analyzer bug

[jira] [Commented] (SPARK-42346) distinct(count colname) with UNION ALL causes query analyzer bug

2023-02-05 Thread Peter Toth (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17684272#comment-17684272 ] Peter Toth commented on SPARK-42346: [~yumwang], [~RobinLinacre], https://github.com

[jira] [Assigned] (SPARK-42320) Assign name to _LEGACY_ERROR_TEMP_2188

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42320: Assignee: (was: Apache Spark) > Assign name to _LEGACY_ERROR_TEMP_2188 >

[jira] [Assigned] (SPARK-42320) Assign name to _LEGACY_ERROR_TEMP_2188

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42320: Assignee: Apache Spark > Assign name to _LEGACY_ERROR_TEMP_2188 > ---

[jira] [Commented] (SPARK-42320) Assign name to _LEGACY_ERROR_TEMP_2188

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17684274#comment-17684274 ] Apache Spark commented on SPARK-42320: -- User 'itholic' has created a pull request f

[jira] [Commented] (SPARK-42320) Assign name to _LEGACY_ERROR_TEMP_2188

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17684275#comment-17684275 ] Apache Spark commented on SPARK-42320: -- User 'itholic' has created a pull request f

[jira] [Assigned] (SPARK-42344) The default size of the CONFIG_MAP_MAXSIZE should not be greater than 1048576

2023-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42344: - Assignee: Wei Yan > The default size of the CONFIG_MAP_MAXSIZE should not be greater th

[jira] [Resolved] (SPARK-42344) The default size of the CONFIG_MAP_MAXSIZE should not be greater than 1048576

2023-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42344. --- Fix Version/s: 3.4.0 (was: 3.5.0) Resolution: Fixed Issue reso

[jira] [Updated] (SPARK-42344) The default size of the CONFIG_MAP_MAXSIZE should not be greater than 1048576

2023-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42344: -- Flags: (was: Important) > The default size of the CONFIG_MAP_MAXSIZE should not be greater t

[jira] [Updated] (SPARK-42344) The default size of the CONFIG_MAP_MAXSIZE should not be greater than 1048576

2023-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42344: -- Target Version/s: (was: 3.3.2) > The default size of the CONFIG_MAP_MAXSIZE should not be gr

[jira] [Updated] (SPARK-42344) The default size of the CONFIG_MAP_MAXSIZE should not be greater than 1048576

2023-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42344: -- Fix Version/s: 3.3.2 > The default size of the CONFIG_MAP_MAXSIZE should not be greater than 1

[jira] [Commented] (SPARK-42315) Assign name to _LEGACY_ERROR_TEMP_2092

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17684278#comment-17684278 ] Apache Spark commented on SPARK-42315: -- User 'itholic' has created a pull request f

[jira] [Assigned] (SPARK-42315) Assign name to _LEGACY_ERROR_TEMP_2092

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42315: Assignee: Apache Spark > Assign name to _LEGACY_ERROR_TEMP_2092 > ---

[jira] [Assigned] (SPARK-42315) Assign name to _LEGACY_ERROR_TEMP_2092

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42315: Assignee: (was: Apache Spark) > Assign name to _LEGACY_ERROR_TEMP_2092 >

[jira] [Commented] (SPARK-42315) Assign name to _LEGACY_ERROR_TEMP_2092

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17684279#comment-17684279 ] Apache Spark commented on SPARK-42315: -- User 'itholic' has created a pull request f

[jira] [Assigned] (SPARK-42314) Assign name to _LEGACY_ERROR_TEMP_2127

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42314: Assignee: Apache Spark > Assign name to _LEGACY_ERROR_TEMP_2127 > ---

[jira] [Assigned] (SPARK-42314) Assign name to _LEGACY_ERROR_TEMP_2127

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42314: Assignee: (was: Apache Spark) > Assign name to _LEGACY_ERROR_TEMP_2127 >

[jira] [Commented] (SPARK-42314) Assign name to _LEGACY_ERROR_TEMP_2127

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17684282#comment-17684282 ] Apache Spark commented on SPARK-42314: -- User 'itholic' has created a pull request f

[jira] [Commented] (SPARK-42314) Assign name to _LEGACY_ERROR_TEMP_2127

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17684283#comment-17684283 ] Apache Spark commented on SPARK-42314: -- User 'itholic' has created a pull request f

[jira] [Assigned] (SPARK-42318) Assign name to _LEGACY_ERROR_TEMP_2125

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42318: Assignee: (was: Apache Spark) > Assign name to _LEGACY_ERROR_TEMP_2125 >

[jira] [Assigned] (SPARK-42318) Assign name to _LEGACY_ERROR_TEMP_2125

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42318: Assignee: Apache Spark > Assign name to _LEGACY_ERROR_TEMP_2125 > ---

[jira] [Commented] (SPARK-42318) Assign name to _LEGACY_ERROR_TEMP_2125

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17684291#comment-17684291 ] Apache Spark commented on SPARK-42318: -- User 'itholic' has created a pull request f

[jira] [Commented] (SPARK-42318) Assign name to _LEGACY_ERROR_TEMP_2125

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17684294#comment-17684294 ] Apache Spark commented on SPARK-42318: -- User 'itholic' has created a pull request f

[jira] [Assigned] (SPARK-42319) Assign name to _LEGACY_ERROR_TEMP_2123

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42319: Assignee: Apache Spark > Assign name to _LEGACY_ERROR_TEMP_2123 > ---

[jira] [Commented] (SPARK-42319) Assign name to _LEGACY_ERROR_TEMP_2123

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17684295#comment-17684295 ] Apache Spark commented on SPARK-42319: -- User 'itholic' has created a pull request f

[jira] [Assigned] (SPARK-42319) Assign name to _LEGACY_ERROR_TEMP_2123

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42319: Assignee: (was: Apache Spark) > Assign name to _LEGACY_ERROR_TEMP_2123 >

[jira] [Updated] (SPARK-42252) Deprecate spark.shuffle.unsafe.file.output.buffer and add a new config

2023-02-05 Thread Wei Guo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-42252: Target Version/s: 3.5.0 (was: 3.4.0) > Deprecate spark.shuffle.unsafe.file.output.buffer and add a new co

[jira] [Updated] (SPARK-42252) Deprecate spark.shuffle.unsafe.file.output.buffer and add a new config

2023-02-05 Thread Wei Guo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-42252: Affects Version/s: 3.3.0 3.2.0 3.1.0 3

[jira] [Updated] (SPARK-42252) Deprecate spark.shuffle.unsafe.file.output.buffer and add a new config

2023-02-05 Thread Wei Guo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-42252: Fix Version/s: 3.5.0 (was: 3.4.0) > Deprecate spark.shuffle.unsafe.file.output.buff

[jira] [Updated] (SPARK-42335) Pass the comment option through to univocity if users set it explicity in CSV dataSource

2023-02-05 Thread Wei Guo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-42335: Summary: Pass the comment option through to univocity if users set it explicity in CSV dataSource (was: A

[jira] [Updated] (SPARK-42335) Pass the comment option through to univocity if users set it explicity in CSV dataSource

2023-02-05 Thread Wei Guo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-42335: Description: In PR [https://github.com/apache/spark/pull/29516], in order to fix some bugs, univocity-par

[jira] [Updated] (SPARK-42335) Pass the comment option through to univocity if users set it explicity in CSV dataSource

2023-02-05 Thread Wei Guo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-42335: Description: In PR [https://github.com/apache/spark/pull/29516], in order to fix some bugs, univocity-par

[jira] [Updated] (SPARK-42335) Pass the comment option through to univocity if users set it explicity in CSV dataSource

2023-02-05 Thread Wei Guo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-42335: Description: In PR [https://github.com/apache/spark/pull/29516], in order to fix some bugs, univocity-par

[jira] [Updated] (SPARK-42335) Pass the comment option through to univocity if users set it explicity in CSV dataSource

2023-02-05 Thread Wei Guo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-42335: Description: In PR [https://github.com/apache/spark/pull/29516], in order to fix some bugs, univocity-par

[jira] [Updated] (SPARK-42335) Pass the comment option through to univocity if users set it explicity in CSV dataSource

2023-02-05 Thread Wei Guo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-42335: Description: In PR [https://github.com/apache/spark/pull/29516], in order to fix some bugs, univocity-par

[jira] [Updated] (SPARK-42335) Pass the comment option through to univocity if users set it explicitly in CSV dataSource

2023-02-05 Thread Wei Guo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-42335: Summary: Pass the comment option through to univocity if users set it explicitly in CSV dataSource (was:

[jira] [Commented] (SPARK-42346) distinct(count colname) with UNION ALL causes query analyzer bug

2023-02-05 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17684332#comment-17684332 ] L. C. Hsieh commented on SPARK-42346: - I will wait for this patch before cutting RC1

[jira] [Created] (SPARK-42349) Support pandas cogroup with multiple df

2023-02-05 Thread Santosh Pingale (Jira)
Santosh Pingale created SPARK-42349: --- Summary: Support pandas cogroup with multiple df Key: SPARK-42349 URL: https://issues.apache.org/jira/browse/SPARK-42349 Project: Spark Issue Type: Imp

[jira] [Commented] (SPARK-42349) Support pandas cogroup with multiple df

2023-02-05 Thread Santosh Pingale (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17684337#comment-17684337 ] Santosh Pingale commented on SPARK-42349: - >From https://lists.apache.org/thread

[jira] [Assigned] (SPARK-41295) Assign a name to the error class _LEGACY_ERROR_TEMP_1105

2023-02-05 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-41295: Assignee: Narek Karapetian > Assign a name to the error class _LEGACY_ERROR_TEMP_1105 > -

[jira] [Resolved] (SPARK-41295) Assign a name to the error class _LEGACY_ERROR_TEMP_1105

2023-02-05 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-41295. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39501 [https://github.com

[jira] [Updated] (SPARK-41296) Assign a name to the error class _LEGACY_ERROR_TEMP_1106

2023-02-05 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-41296: - Fix Version/s: 3.4.0 > Assign a name to the error class _LEGACY_ERROR_TEMP_1106 > --

[jira] [Resolved] (SPARK-41296) Assign a name to the error class _LEGACY_ERROR_TEMP_1106

2023-02-05 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-41296. -- Assignee: Narek Karapetian Resolution: Fixed Resolved by https://github.com/apache/spark/pull/39

[jira] [Commented] (SPARK-37581) sql hang at planning stage

2023-02-05 Thread Ritika Maheshwari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17684361#comment-17684361 ] Ritika Maheshwari commented on SPARK-37581: --- Just executed this on 3.3.0  and

[jira] [Updated] (SPARK-42340) Implement GroupedData.applyInPandas

2023-02-05 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42340: - Parent: (was: SPARK-41661) Issue Type: New Feature (was: Sub-task) > Implement Grou

[jira] [Updated] (SPARK-42340) Implement GroupedData.applyInPandas

2023-02-05 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42340: - Epic Link: SPARK-39375 > Implement GroupedData.applyInPandas > -

[jira] [Commented] (SPARK-37581) sql hang at planning stage

2023-02-05 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17684376#comment-17684376 ] XiDuo You commented on SPARK-37581: --- This should be resovled by SPARK-38138. The root

[jira] [Commented] (SPARK-40045) The order of filtering predicates is not reasonable

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17684380#comment-17684380 ] Apache Spark commented on SPARK-40045: -- User 'huaxingao' has created a pull request

[jira] [Commented] (SPARK-40045) The order of filtering predicates is not reasonable

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17684381#comment-17684381 ] Apache Spark commented on SPARK-40045: -- User 'huaxingao' has created a pull request

[jira] [Resolved] (SPARK-42348) Add SQLSTATE

2023-02-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42348. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39886 [https://gith

[jira] [Assigned] (SPARK-42348) Add SQLSTATE

2023-02-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42348: --- Assignee: Haejoon Lee > Add SQLSTATE > > > Key: SPARK-42348 >

[jira] [Updated] (SPARK-42336) Use getOrElse() instead of contains() in ResourceAllocator

2023-02-05 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-42336: - Priority: Trivial (was: Minor) > Use getOrElse() instead of contains() in ResourceAllocator >

[jira] [Assigned] (SPARK-42336) Use getOrElse() instead of contains() in ResourceAllocator

2023-02-05 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-42336: Assignee: jingxiong zhong > Use getOrElse() instead of contains() in ResourceAllocator >

[jira] [Resolved] (SPARK-42336) Use getOrElse() instead of contains() in ResourceAllocator

2023-02-05 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42336. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 39879 [https://gi

[jira] [Resolved] (SPARK-39347) Generate wrong time window when (timestamp-startTime) % slideDuration < 0

2023-02-05 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-39347. -- Fix Version/s: 3.4.0 3.5.0 Assignee: Wei Liu Resolution: Fix

[jira] [Created] (SPARK-42350) Replcace `get().getOrElse` with `getOrElse`

2023-02-05 Thread Yang Jie (Jira)
Yang Jie created SPARK-42350: Summary: Replcace `get().getOrElse` with `getOrElse` Key: SPARK-42350 URL: https://issues.apache.org/jira/browse/SPARK-42350 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-42350) Replcace `get().getOrElse` with `getOrElse`

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17684422#comment-17684422 ] Apache Spark commented on SPARK-42350: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-42350) Replcace `get().getOrElse` with `getOrElse`

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42350: Assignee: (was: Apache Spark) > Replcace `get().getOrElse` with `getOrElse` > ---

[jira] [Assigned] (SPARK-42350) Replcace `get().getOrElse` with `getOrElse`

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42350: Assignee: Apache Spark > Replcace `get().getOrElse` with `getOrElse` > --

[jira] [Created] (SPARK-42351) Protobuf serializer for FsHistoryProviderMetadata

2023-02-05 Thread Yang Jie (Jira)
Yang Jie created SPARK-42351: Summary: Protobuf serializer for FsHistoryProviderMetadata Key: SPARK-42351 URL: https://issues.apache.org/jira/browse/SPARK-42351 Project: Spark Issue Type: Improve

[jira] [Commented] (SPARK-42351) Protobuf serializer for FsHistoryProviderMetadata

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17684436#comment-17684436 ] Apache Spark commented on SPARK-42351: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-42351) Protobuf serializer for FsHistoryProviderMetadata

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42351: Assignee: Apache Spark > Protobuf serializer for FsHistoryProviderMetadata >

[jira] [Assigned] (SPARK-42351) Protobuf serializer for FsHistoryProviderMetadata

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42351: Assignee: (was: Apache Spark) > Protobuf serializer for FsHistoryProviderMetadata > -

[jira] [Commented] (SPARK-40149) Star expansion after outer join asymmetrically includes joining key

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17684465#comment-17684465 ] Apache Spark commented on SPARK-40149: -- User 'allisonwang-db' has created a pull re

[jira] [Commented] (SPARK-40149) Star expansion after outer join asymmetrically includes joining key

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17684467#comment-17684467 ] Apache Spark commented on SPARK-40149: -- User 'allisonwang-db' has created a pull re

[jira] [Created] (SPARK-42352) Upgrade maven to 3.8.7

2023-02-05 Thread Yang Jie (Jira)
Yang Jie created SPARK-42352: Summary: Upgrade maven to 3.8.7 Key: SPARK-42352 URL: https://issues.apache.org/jira/browse/SPARK-42352 Project: Spark Issue Type: Improvement Components:

[jira] [Assigned] (SPARK-42352) Upgrade maven to 3.8.7

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42352: Assignee: (was: Apache Spark) > Upgrade maven to 3.8.7 > -- > >

[jira] [Commented] (SPARK-42352) Upgrade maven to 3.8.7

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17684476#comment-17684476 ] Apache Spark commented on SPARK-42352: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-42352) Upgrade maven to 3.8.7

2023-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42352: Assignee: Apache Spark > Upgrade maven to 3.8.7 > -- > >

[jira] [Created] (SPARK-42353) Cleanup orphan sst and log files in RocksDB checkpoint directory

2023-02-05 Thread Chaoqin Li (Jira)
Chaoqin Li created SPARK-42353: -- Summary: Cleanup orphan sst and log files in RocksDB checkpoint directory Key: SPARK-42353 URL: https://issues.apache.org/jira/browse/SPARK-42353 Project: Spark