[jira] [Updated] (SPARK-39198) Cannot refer to nested CTE within a nested CTE in a subquery.

[ https://issues.apache.org/jira/browse/SPARK-39198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarno Rajala updated SPARK-39198: - Affects Version/s: 3.3.0 > Cannot refer to nested CTE within a nested CTE in a subquery. > -

[jira] [Assigned] (SPARK-40186) mergedShuffleCleaner should have been shutdown before db closed

[ https://issues.apache.org/jira/browse/SPARK-40186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40186: Assignee: Apache Spark > mergedShuffleCleaner should have been shutdown before db closed

[jira] [Commented] (SPARK-40186) mergedShuffleCleaner should have been shutdown before db closed

[ https://issues.apache.org/jira/browse/SPARK-40186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17583435#comment-17583435 ] Apache Spark commented on SPARK-40186: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-40186) mergedShuffleCleaner should have been shutdown before db closed

[ https://issues.apache.org/jira/browse/SPARK-40186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40186: Assignee: (was: Apache Spark) > mergedShuffleCleaner should have been shutdown before

[jira] [Created] (SPARK-40188) Spark Direct Streaming: Read messages of a certain bytes or count in batches from Kafka is not working.

Madhav Madhu created SPARK-40188: Summary: Spark Direct Streaming: Read messages of a certain bytes or count in batches from Kafka is not working. Key: SPARK-40188 URL: https://issues.apache.org/jira/browse/SPARK-

[jira] [Updated] (SPARK-40188) Spark Direct Streaming: Read messages of a certain bytes or count in batches from Kafka is not working.

[ https://issues.apache.org/jira/browse/SPARK-40188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Madhav Madhu updated SPARK-40188: - Description: Spark Kafka consumer is unable to read messages, of a certain size or count in bat

[jira] [Assigned] (SPARK-40173) Make pyspark.taskcontext examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40173: Assignee: Hyukjin Kwon > Make pyspark.taskcontext examples self-contained > -

[jira] [Resolved] (SPARK-40173) Make pyspark.taskcontext examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40173. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37623 [https://gi

[jira] [Assigned] (SPARK-40177) Simplify join condition of form (a==b) || (a==null&&b==null) to a<=>b

[ https://issues.apache.org/jira/browse/SPARK-40177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40177: Assignee: (was: Apache Spark) > Simplify join condition of form (a==b) || (a==null&&b

[jira] [Assigned] (SPARK-40177) Simplify join condition of form (a==b) || (a==null&&b==null) to a<=>b

[ https://issues.apache.org/jira/browse/SPARK-40177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40177: Assignee: Apache Spark > Simplify join condition of form (a==b) || (a==null&&b==null) to

[jira] [Commented] (SPARK-40177) Simplify join condition of form (a==b) || (a==null&&b==null) to a<=>b

[ https://issues.apache.org/jira/browse/SPARK-40177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17583450#comment-17583450 ] Apache Spark commented on SPARK-40177: -- User 'ayushi-agarwal' has created a pull re

[jira] [Commented] (SPARK-40177) Simplify join condition of form (a==b) || (a==null&&b==null) to a<=>b

[ https://issues.apache.org/jira/browse/SPARK-40177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17583454#comment-17583454 ] Apache Spark commented on SPARK-40177: -- User 'ayushi-agarwal' has created a pull re

[jira] [Created] (SPARK-40189) Support json_array_get/json_array_length function

melin created SPARK-40189: - Summary: Support json_array_get/json_array_length function Key: SPARK-40189 URL: https://issues.apache.org/jira/browse/SPARK-40189 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-40190) Support json_array_get and json_array_length function

melin created SPARK-40190: - Summary: Support json_array_get and json_array_length function Key: SPARK-40190 URL: https://issues.apache.org/jira/browse/SPARK-40190 Project: Spark Issue Type: Improveme

[jira] [Resolved] (SPARK-40190) Support json_array_get and json_array_length function

[ https://issues.apache.org/jira/browse/SPARK-40190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin resolved SPARK-40190. --- Resolution: Duplicate > Support json_array_get and json_array_length function >

[jira] [Commented] (SPARK-40189) Support json_array_get/json_array_length function

[ https://issues.apache.org/jira/browse/SPARK-40189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17583473#comment-17583473 ] melin commented on SPARK-40189: --- [~maxgekk]  > Support json_array_get/json_array_length f

[jira] [Commented] (SPARK-40152) Codegen compilation error when using split_part

[ https://issues.apache.org/jira/browse/SPARK-40152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17583498#comment-17583498 ] Apache Spark commented on SPARK-40152: -- User 'wangyum' has created a pull request f

[jira] [Commented] (SPARK-40152) Codegen compilation error when using split_part

[ https://issues.apache.org/jira/browse/SPARK-40152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17583500#comment-17583500 ] Apache Spark commented on SPARK-40152: -- User 'wangyum' has created a pull request f

[jira] [Created] (SPARK-40191) Make pyspark.resource examples self-contained

Hyukjin Kwon created SPARK-40191: Summary: Make pyspark.resource examples self-contained Key: SPARK-40191 URL: https://issues.apache.org/jira/browse/SPARK-40191 Project: Spark Issue Type: Sub

[jira] [Assigned] (SPARK-40191) Make pyspark.resource examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40191: Assignee: (was: Apache Spark) > Make pyspark.resource examples self-contained > -

[jira] [Commented] (SPARK-40191) Make pyspark.resource examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17583510#comment-17583510 ] Apache Spark commented on SPARK-40191: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-40191) Make pyspark.resource examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40191: Assignee: Apache Spark > Make pyspark.resource examples self-contained >

[jira] [Assigned] (SPARK-40191) Make pyspark.resource examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40191: Assignee: Apache Spark > Make pyspark.resource examples self-contained >

[jira] [Created] (SPARK-40192) Remove redundant groupby

deshanxiao created SPARK-40192: -- Summary: Remove redundant groupby Key: SPARK-40192 URL: https://issues.apache.org/jira/browse/SPARK-40192 Project: Spark Issue Type: Improvement Compon

[jira] [Commented] (SPARK-40192) Remove redundant groupby

[ https://issues.apache.org/jira/browse/SPARK-40192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17583532#comment-17583532 ] Apache Spark commented on SPARK-40192: -- User 'deshanxiao' has created a pull reques

[jira] [Assigned] (SPARK-40192) Remove redundant groupby

[ https://issues.apache.org/jira/browse/SPARK-40192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40192: Assignee: (was: Apache Spark) > Remove redundant groupby > >

[jira] [Assigned] (SPARK-40192) Remove redundant groupby

[ https://issues.apache.org/jira/browse/SPARK-40192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40192: Assignee: Apache Spark > Remove redundant groupby > > >

[jira] [Commented] (SPARK-40160) Make pyspark.broadcast examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17583556#comment-17583556 ] Apache Spark commented on SPARK-40160: -- User 'dcoliversun' has created a pull reque

[jira] [Assigned] (SPARK-40160) Make pyspark.broadcast examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40160: Assignee: (was: Apache Spark) > Make pyspark.broadcast examples self-contained >

[jira] [Assigned] (SPARK-40160) Make pyspark.broadcast examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40160: Assignee: Apache Spark > Make pyspark.broadcast examples self-contained > ---

[jira] [Created] (SPARK-40193) Merge different filters when merging subquery plans

Peter Toth created SPARK-40193: -- Summary: Merge different filters when merging subquery plans Key: SPARK-40193 URL: https://issues.apache.org/jira/browse/SPARK-40193 Project: Spark Issue Type: I

[jira] [Updated] (SPARK-40193) Merge subquery plans with different filters

[ https://issues.apache.org/jira/browse/SPARK-40193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-40193: --- Summary: Merge subquery plans with different filters (was: Merge different filters when merging sub

[jira] [Commented] (SPARK-40193) Merge subquery plans with different filters

[ https://issues.apache.org/jira/browse/SPARK-40193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17583658#comment-17583658 ] Apache Spark commented on SPARK-40193: -- User 'peter-toth' has created a pull reques

[jira] [Assigned] (SPARK-40193) Merge subquery plans with different filters

[ https://issues.apache.org/jira/browse/SPARK-40193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40193: Assignee: (was: Apache Spark) > Merge subquery plans with different filters > ---

[jira] [Assigned] (SPARK-40193) Merge subquery plans with different filters

[ https://issues.apache.org/jira/browse/SPARK-40193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40193: Assignee: Apache Spark > Merge subquery plans with different filters > --

[jira] [Resolved] (SPARK-40183) Use error class NUMERIC_VALUE_OUT_OF_RANGE for overflow in decimal conversion

[ https://issues.apache.org/jira/browse/SPARK-40183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-40183. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37620 [https:

[jira] [Assigned] (SPARK-40089) Sorting of at least Decimal(20, 2) fails for some values near the max.

[ https://issues.apache.org/jira/browse/SPARK-40089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-40089: - Assignee: Robert Joseph Evans (was: Apache Spark) > Sorting of at least Decimal(20, 2)

[jira] [Updated] (SPARK-40172) Temporarily disable flaky test cases in ImageFileFormatSuite

[ https://issues.apache.org/jira/browse/SPARK-40172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-40172: -- Fix Version/s: 3.3.1 3.2.3 > Temporarily disable flaky test cases in ImageF

[jira] [Updated] (SPARK-40171) Fix flaky tests in ImageFileFormatSuite

[ https://issues.apache.org/jira/browse/SPARK-40171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-40171: -- Affects Version/s: 3.3.1 3.2.3 > Fix flaky tests in ImageFileFormatSuit

[jira] [Updated] (SPARK-40172) Temporarily disable flaky test cases in ImageFileFormatSuite

[ https://issues.apache.org/jira/browse/SPARK-40172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-40172: -- Affects Version/s: 3.2.2 3.3.0 > Temporarily disable flaky test cases i

[jira] [Updated] (SPARK-40171) Fix flaky tests in ImageFileFormatSuite

[ https://issues.apache.org/jira/browse/SPARK-40171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-40171: -- Affects Version/s: 3.2.2 3.3.0 (was: 3.3.1)

[jira] [Commented] (SPARK-34631) Caught Hive MetaException when query by partition (partition col start with ‘$’)

[ https://issues.apache.org/jira/browse/SPARK-34631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17583785#comment-17583785 ] Brendan Morin commented on SPARK-34631: --- For other users encountering this issue s

[jira] [Comment Edited] (SPARK-34631) Caught Hive MetaException when query by partition (partition col start with ‘$’)

[ https://issues.apache.org/jira/browse/SPARK-34631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17583785#comment-17583785 ] Brendan Morin edited comment on SPARK-34631 at 8/23/22 6:18 PM: --

[jira] [Comment Edited] (SPARK-34631) Caught Hive MetaException when query by partition (partition col start with ‘$’)

[ https://issues.apache.org/jira/browse/SPARK-34631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17583785#comment-17583785 ] Brendan Morin edited comment on SPARK-34631 at 8/23/22 6:52 PM: --

[jira] [Created] (SPARK-40194) SPLIT function on empty regex should truncate trailing empty string.

Vitalii Li created SPARK-40194: -- Summary: SPLIT function on empty regex should truncate trailing empty string. Key: SPARK-40194 URL: https://issues.apache.org/jira/browse/SPARK-40194 Project: Spark

[jira] [Assigned] (SPARK-40194) SPLIT function on empty regex should truncate trailing empty string.

[ https://issues.apache.org/jira/browse/SPARK-40194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40194: Assignee: (was: Apache Spark) > SPLIT function on empty regex should truncate trailin

[jira] [Commented] (SPARK-40194) SPLIT function on empty regex should truncate trailing empty string.

[ https://issues.apache.org/jira/browse/SPARK-40194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17583877#comment-17583877 ] Apache Spark commented on SPARK-40194: -- User 'vitaliili-db' has created a pull requ

[jira] [Assigned] (SPARK-40194) SPLIT function on empty regex should truncate trailing empty string.

[ https://issues.apache.org/jira/browse/SPARK-40194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40194: Assignee: Apache Spark > SPLIT function on empty regex should truncate trailing empty str

[jira] [Created] (SPARK-40195) Add PrunedScanWithAQESuite

Kazuyuki Tanimura created SPARK-40195: - Summary: Add PrunedScanWithAQESuite Key: SPARK-40195 URL: https://issues.apache.org/jira/browse/SPARK-40195 Project: Spark Issue Type: Test

[jira] [Created] (SPARK-40196) Consolidate `lit` function with NumPy input in sql and pandas module

Xinrong Meng created SPARK-40196: Summary: Consolidate `lit` function with NumPy input in sql and pandas module Key: SPARK-40196 URL: https://issues.apache.org/jira/browse/SPARK-40196 Project: Spark

[jira] [Updated] (SPARK-40196) Consolidate `lit` function with NumPy input in sql and pandas module

[ https://issues.apache.org/jira/browse/SPARK-40196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40196: - Description: Per [https://github.com/apache/spark/pull/37560#discussion_r952882996,] function `

[jira] [Resolved] (SPARK-40191) Make pyspark.resource examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-40191. --- Fix Version/s: 3.4.0 Assignee: Hyukjin Kwon (was: Apache Spark) Resolution:

[jira] [Created] (SPARK-40197) Replace query plan with context for MULTI_VALUE_SUBQUERY_ERROR

Vitalii Li created SPARK-40197: -- Summary: Replace query plan with context for MULTI_VALUE_SUBQUERY_ERROR Key: SPARK-40197 URL: https://issues.apache.org/jira/browse/SPARK-40197 Project: Spark I

[jira] [Assigned] (SPARK-40197) Replace query plan with context for MULTI_VALUE_SUBQUERY_ERROR

[ https://issues.apache.org/jira/browse/SPARK-40197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40197: Assignee: (was: Apache Spark) > Replace query plan with context for MULTI_VALUE_SUBQU

[jira] [Commented] (SPARK-40197) Replace query plan with context for MULTI_VALUE_SUBQUERY_ERROR

[ https://issues.apache.org/jira/browse/SPARK-40197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17583901#comment-17583901 ] Apache Spark commented on SPARK-40197: -- User 'vitaliili-db' has created a pull requ

[jira] [Assigned] (SPARK-40197) Replace query plan with context for MULTI_VALUE_SUBQUERY_ERROR

[ https://issues.apache.org/jira/browse/SPARK-40197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40197: Assignee: Apache Spark > Replace query plan with context for MULTI_VALUE_SUBQUERY_ERROR >

[jira] [Created] (SPARK-40198) Enable spark.storage.decommission.(rdd|shuffle)Blocks.enabled by default

Dongjoon Hyun created SPARK-40198: - Summary: Enable spark.storage.decommission.(rdd|shuffle)Blocks.enabled by default Key: SPARK-40198 URL: https://issues.apache.org/jira/browse/SPARK-40198 Project: S

[jira] [Commented] (SPARK-40198) Enable spark.storage.decommission.(rdd|shuffle)Blocks.enabled by default

[ https://issues.apache.org/jira/browse/SPARK-40198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17583903#comment-17583903 ] Apache Spark commented on SPARK-40198: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-40198) Enable spark.storage.decommission.(rdd|shuffle)Blocks.enabled by default

[ https://issues.apache.org/jira/browse/SPARK-40198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40198: Assignee: Apache Spark > Enable spark.storage.decommission.(rdd|shuffle)Blocks.enabled by

[jira] [Assigned] (SPARK-40198) Enable spark.storage.decommission.(rdd|shuffle)Blocks.enabled by default

[ https://issues.apache.org/jira/browse/SPARK-40198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40198: Assignee: (was: Apache Spark) > Enable spark.storage.decommission.(rdd|shuffle)Blocks

[jira] [Resolved] (SPARK-40078) Make pyspark.sql.column examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40078. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37521 [https://gi

[jira] [Assigned] (SPARK-40078) Make pyspark.sql.column examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40078: Assignee: Qian Sun > Make pyspark.sql.column examples self-contained > --

[jira] [Assigned] (SPARK-39150) Remove `# doctest: +SKIP` of SPARK-38947/SPARK-39326 when infra dump pandas to 1.4+

[ https://issues.apache.org/jira/browse/SPARK-39150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39150: Assignee: (was: Yikun Jiang) > Remove `# doctest: +SKIP` of SPARK-38947/SPARK-39326 w

[jira] [Updated] (SPARK-39150) Remove `# doctest: +SKIP` of SPARK-38947/SPARK-39326 when infra dump pandas to 1.4+

[ https://issues.apache.org/jira/browse/SPARK-39150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39150: - Fix Version/s: (was: 3.4.0) > Remove `# doctest: +SKIP` of SPARK-38947/SPARK-39326 when infr

[jira] [Reopened] (SPARK-39150) Remove `# doctest: +SKIP` of SPARK-38947/SPARK-39326 when infra dump pandas to 1.4+

[ https://issues.apache.org/jira/browse/SPARK-39150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-39150: -- > Remove `# doctest: +SKIP` of SPARK-38947/SPARK-39326 when infra dump pandas > to 1.4+ > ---

[jira] [Resolved] (SPARK-39150) Remove `# doctest: +SKIP` of SPARK-38947/SPARK-39326 when infra dump pandas to 1.4+

[ https://issues.apache.org/jira/browse/SPARK-39150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39150. -- Resolution: Not A Problem Reverted at https://github.com/apache/spark/commit/d32a67f92cfcc7c6

[jira] [Updated] (SPARK-40124) Update TPCDS v1.4 q32 for Plan Stability tests

[ https://issues.apache.org/jira/browse/SPARK-40124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-40124: -- Fix Version/s: 3.3.1 > Update TPCDS v1.4 q32 for Plan Stability tests > --

[jira] [Created] (SPARK-40199) Spark throws NPE without useful message when NULL value appears in non-null schema

Erik Krogen created SPARK-40199: --- Summary: Spark throws NPE without useful message when NULL value appears in non-null schema Key: SPARK-40199 URL: https://issues.apache.org/jira/browse/SPARK-40199 Proj

[jira] [Closed] (SPARK-39150) Remove `# doctest: +SKIP` of SPARK-38947/SPARK-39326 when infra dump pandas to 1.4+

[ https://issues.apache.org/jira/browse/SPARK-39150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-39150. - > Remove `# doctest: +SKIP` of SPARK-38947/SPARK-39326 when infra dump pandas > to 1.4+ > -

[jira] [Assigned] (SPARK-40199) Spark throws NPE without useful message when NULL value appears in non-null schema

[ https://issues.apache.org/jira/browse/SPARK-40199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40199: Assignee: Apache Spark > Spark throws NPE without useful message when NULL value appears

[jira] [Assigned] (SPARK-40199) Spark throws NPE without useful message when NULL value appears in non-null schema

[ https://issues.apache.org/jira/browse/SPARK-40199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40199: Assignee: (was: Apache Spark) > Spark throws NPE without useful message when NULL val

[jira] [Commented] (SPARK-40199) Spark throws NPE without useful message when NULL value appears in non-null schema

[ https://issues.apache.org/jira/browse/SPARK-40199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17583916#comment-17583916 ] Apache Spark commented on SPARK-40199: -- User 'xkrogen' has created a pull request f

[jira] [Commented] (SPARK-40131) Support NumPy ndarray in built-in functions

[ https://issues.apache.org/jira/browse/SPARK-40131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17583917#comment-17583917 ] Apache Spark commented on SPARK-40131: -- User 'xinrong-meng' has created a pull requ

[jira] [Assigned] (SPARK-40131) Support NumPy ndarray in built-in functions

[ https://issues.apache.org/jira/browse/SPARK-40131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40131: Assignee: (was: Apache Spark) > Support NumPy ndarray in built-in functions > ---

[jira] [Created] (SPARK-40200) unpersist cascades with Kryo, MEMORY_AND_DISK_SER and monotonically_increasing_id

Calvin Pietersen created SPARK-40200: Summary: unpersist cascades with Kryo, MEMORY_AND_DISK_SER and monotonically_increasing_id Key: SPARK-40200 URL: https://issues.apache.org/jira/browse/SPARK-40200

[jira] [Assigned] (SPARK-40131) Support NumPy ndarray in built-in functions

[ https://issues.apache.org/jira/browse/SPARK-40131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40131: Assignee: Apache Spark > Support NumPy ndarray in built-in functions > --

[jira] [Updated] (SPARK-40200) unpersist cascades with Kryo, MEMORY_AND_DISK_SER and monotonically_increasing_id

[ https://issues.apache.org/jira/browse/SPARK-40200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Calvin Pietersen updated SPARK-40200: - Description: Unpersist of a parent dataset which has a column from `monotonically_incre

[jira] [Updated] (SPARK-40200) unpersist cascades with Kryo, MEMORY_AND_DISK_SER and monotonically_increasing_id

[ https://issues.apache.org/jira/browse/SPARK-40200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Calvin Pietersen updated SPARK-40200: - Description: Unpersist of a parent dataset which has a column from `monotonically_incre

[jira] [Updated] (SPARK-40200) unpersist cascades with Kryo, MEMORY_AND_DISK_SER and monotonically_increasing_id

[ https://issues.apache.org/jira/browse/SPARK-40200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Calvin Pietersen updated SPARK-40200: - Description: Unpersist of a parent dataset which has a column from _*monotonically_incr

[jira] [Updated] (SPARK-40200) unpersist cascades with Kryo, MEMORY_AND_DISK_SER and monotonically_increasing_id

[ https://issues.apache.org/jira/browse/SPARK-40200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Calvin Pietersen updated SPARK-40200: - Affects Version/s: 3.2.1 > unpersist cascades with Kryo, MEMORY_AND_DISK_SER and > mono

[jira] [Commented] (SPARK-40152) Codegen compilation error when using split_part

[ https://issues.apache.org/jira/browse/SPARK-40152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17583923#comment-17583923 ] Apache Spark commented on SPARK-40152: -- User 'wangyum' has created a pull request f

[jira] [Commented] (SPARK-40152) Codegen compilation error when using split_part

[ https://issues.apache.org/jira/browse/SPARK-40152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17583924#comment-17583924 ] Apache Spark commented on SPARK-40152: -- User 'wangyum' has created a pull request f

[jira] [Commented] (SPARK-40156) url_decode() exposes a Java error

[ https://issues.apache.org/jira/browse/SPARK-40156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17583925#comment-17583925 ] Apache Spark commented on SPARK-40156: -- User 'ming95' has created a pull reques

[jira] [Assigned] (SPARK-40156) url_decode() exposes a Java error

[ https://issues.apache.org/jira/browse/SPARK-40156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40156: Assignee: Apache Spark > url_decode() exposes a Java error >

[jira] [Assigned] (SPARK-40156) url_decode() exposes a Java error

[ https://issues.apache.org/jira/browse/SPARK-40156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40156: Assignee: (was: Apache Spark) > url_decode() exposes a Java error > -

[jira] [Commented] (SPARK-33573) Server side metrics related to push-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-33573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17583926#comment-17583926 ] Apache Spark commented on SPARK-33573: -- User 'rmcyang' has created a pull request f

[jira] [Commented] (SPARK-33573) Server side metrics related to push-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-33573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17583927#comment-17583927 ] Apache Spark commented on SPARK-33573: -- User 'rmcyang' has created a pull request f

[jira] [Commented] (SPARK-40165) Update test plugins to latest versions

[ https://issues.apache.org/jira/browse/SPARK-40165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17583933#comment-17583933 ] Apache Spark commented on SPARK-40165: -- User 'panbingkun' has created a pull reques

[jira] [Commented] (SPARK-40165) Update test plugins to latest versions

[ https://issues.apache.org/jira/browse/SPARK-40165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17583934#comment-17583934 ] Apache Spark commented on SPARK-40165: -- User 'panbingkun' has created a pull reques

[jira] [Assigned] (SPARK-38752) Test the error class: UNSUPPORTED_DATATYPE

[ https://issues.apache.org/jira/browse/SPARK-38752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38752: Assignee: Apache Spark > Test the error class: UNSUPPORTED_DATATYPE > ---

[jira] [Commented] (SPARK-38752) Test the error class: UNSUPPORTED_DATATYPE

[ https://issues.apache.org/jira/browse/SPARK-38752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17583943#comment-17583943 ] Apache Spark commented on SPARK-38752: -- User 'lvshaokang' has created a pull reques

[jira] [Commented] (SPARK-38752) Test the error class: UNSUPPORTED_DATATYPE

[ https://issues.apache.org/jira/browse/SPARK-38752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17583944#comment-17583944 ] Apache Spark commented on SPARK-38752: -- User 'lvshaokang' has created a pull reques

[jira] [Assigned] (SPARK-38752) Test the error class: UNSUPPORTED_DATATYPE

[ https://issues.apache.org/jira/browse/SPARK-38752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38752: Assignee: (was: Apache Spark) > Test the error class: UNSUPPORTED_DATATYPE >

[jira] [Created] (SPARK-40201) Improve v1 write test coverage

XiDuo You created SPARK-40201: - Summary: Improve v1 write test coverage Key: SPARK-40201 URL: https://issues.apache.org/jira/browse/SPARK-40201 Project: Spark Issue Type: Improvement Co

[jira] [Commented] (SPARK-40201) Improve v1 write test coverage

[ https://issues.apache.org/jira/browse/SPARK-40201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17583972#comment-17583972 ] Apache Spark commented on SPARK-40201: -- User 'ulysses-you' has created a pull reque

[jira] [Assigned] (SPARK-40201) Improve v1 write test coverage

[ https://issues.apache.org/jira/browse/SPARK-40201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40201: Assignee: Apache Spark > Improve v1 write test coverage > --

[jira] [Assigned] (SPARK-40201) Improve v1 write test coverage

[ https://issues.apache.org/jira/browse/SPARK-40201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40201: Assignee: (was: Apache Spark) > Improve v1 write test coverage >

[jira] [Resolved] (SPARK-40198) Enable spark.storage.decommission.(rdd|shuffle)Blocks.enabled by default

[ https://issues.apache.org/jira/browse/SPARK-40198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-40198. --- Fix Version/s: 3.4.0 Assignee: Dongjoon Hyun Resolution: Fixed This is resol

[jira] [Created] (SPARK-40202) Allow a map in SparkSession.config in PySpark

Hyukjin Kwon created SPARK-40202: Summary: Allow a map in SparkSession.config in PySpark Key: SPARK-40202 URL: https://issues.apache.org/jira/browse/SPARK-40202 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-40202) Allow a dictionary in SparkSession.config in PySpark

[ https://issues.apache.org/jira/browse/SPARK-40202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40202: - Summary: Allow a dictionary in SparkSession.config in PySpark (was: Allow a map in SparkSession

  1   2   >