[jira] [Commented] (SPARK-42114) Test of uniform parquet encryption

[ https://issues.apache.org/jira/browse/SPARK-42114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679035#comment-17679035 ] Apache Spark commented on SPARK-42114: -- User 'ggershinsky' has created a pull request for this

[jira] [Created] (SPARK-42130) Handle null string values in AccumulableInfo and ProcessSummary

Gengliang Wang created SPARK-42130: -- Summary: Handle null string values in AccumulableInfo and ProcessSummary Key: SPARK-42130 URL: https://issues.apache.org/jira/browse/SPARK-42130 Project: Spark

[jira] [Assigned] (SPARK-42114) Test of uniform parquet encryption

[ https://issues.apache.org/jira/browse/SPARK-42114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42114: Assignee: (was: Apache Spark) > Test of uniform parquet encryption >

[jira] [Assigned] (SPARK-42114) Test of uniform parquet encryption

[ https://issues.apache.org/jira/browse/SPARK-42114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42114: Assignee: Apache Spark > Test of uniform parquet encryption >

[jira] [Commented] (SPARK-42114) Test of uniform parquet encryption

[ https://issues.apache.org/jira/browse/SPARK-42114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679025#comment-17679025 ] Apache Spark commented on SPARK-42114: -- User 'ggershinsky' has created a pull request for this

[jira] [Assigned] (SPARK-41976) Improve error message for `INDEX_NOT_FOUND`

[ https://issues.apache.org/jira/browse/SPARK-41976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41976: --- Assignee: Haejoon Lee > Improve error message for `INDEX_NOT_FOUND` >

[jira] [Resolved] (SPARK-41976) Improve error message for `INDEX_NOT_FOUND`

[ https://issues.apache.org/jira/browse/SPARK-41976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41976. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39498

[jira] [Assigned] (SPARK-42070) Change the default value of argument of Mask udf from -1 to NULL

[ https://issues.apache.org/jira/browse/SPARK-42070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-42070: -- Assignee: Vinod KC > Change the default value of argument of Mask udf from -1 to

[jira] [Resolved] (SPARK-42070) Change the default value of argument of Mask udf from -1 to NULL

[ https://issues.apache.org/jira/browse/SPARK-42070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-42070. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39577

[jira] [Assigned] (SPARK-41884) DataFrame `toPandas` parity in return types

[ https://issues.apache.org/jira/browse/SPARK-41884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41884: Assignee: Hyukjin Kwon > DataFrame `toPandas` parity in return types >

[jira] [Resolved] (SPARK-41884) DataFrame `toPandas` parity in return types

[ https://issues.apache.org/jira/browse/SPARK-41884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41884. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39661

[jira] [Commented] (SPARK-41557) Union of tables with and without metadata column fails when used in join

[ https://issues.apache.org/jira/browse/SPARK-41557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679004#comment-17679004 ] Shardul Mahadik commented on SPARK-41557: - Confirmed that the test work fine in master now.

[jira] [Resolved] (SPARK-41557) Union of tables with and without metadata column fails when used in join

[ https://issues.apache.org/jira/browse/SPARK-41557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shardul Mahadik resolved SPARK-41557. - Resolution: Fixed > Union of tables with and without metadata column fails when used in

[jira] [Commented] (SPARK-40925) Fix late record filtering to support chaining of steteful operators

[ https://issues.apache.org/jira/browse/SPARK-40925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679003#comment-17679003 ] Apache Spark commented on SPARK-40925: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Commented] (SPARK-42129) Upgrade rocksdbjni to 7.9.2

[ https://issues.apache.org/jira/browse/SPARK-42129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679002#comment-17679002 ] Apache Spark commented on SPARK-42129: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-42129) Upgrade rocksdbjni to 7.9.2

[ https://issues.apache.org/jira/browse/SPARK-42129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42129: Assignee: (was: Apache Spark) > Upgrade rocksdbjni to 7.9.2 >

[jira] [Assigned] (SPARK-42105) Document work (Release note & Guide doc) for SPARK-40925

[ https://issues.apache.org/jira/browse/SPARK-42105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42105: Assignee: Apache Spark > Document work (Release note & Guide doc) for SPARK-40925 >

[jira] [Commented] (SPARK-42105) Document work (Release note & Guide doc) for SPARK-40925

[ https://issues.apache.org/jira/browse/SPARK-42105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679000#comment-17679000 ] Apache Spark commented on SPARK-42105: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Assigned] (SPARK-42105) Document work (Release note & Guide doc) for SPARK-40925

[ https://issues.apache.org/jira/browse/SPARK-42105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42105: Assignee: (was: Apache Spark) > Document work (Release note & Guide doc) for

[jira] [Assigned] (SPARK-42129) Upgrade rocksdbjni to 7.9.2

[ https://issues.apache.org/jira/browse/SPARK-42129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42129: Assignee: Apache Spark > Upgrade rocksdbjni to 7.9.2 > --- > >

[jira] [Commented] (SPARK-42129) Upgrade rocksdbjni to 7.9.2

[ https://issues.apache.org/jira/browse/SPARK-42129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679001#comment-17679001 ] Apache Spark commented on SPARK-42129: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-42129) Upgrade rocksdbjni to 7.9.2

Yang Jie created SPARK-42129: Summary: Upgrade rocksdbjni to 7.9.2 Key: SPARK-42129 URL: https://issues.apache.org/jira/browse/SPARK-42129 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-40925) Fix late record filtering to support chaining of steteful operators

[ https://issues.apache.org/jira/browse/SPARK-40925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-40925: - Labels: release-notes (was: ) > Fix late record filtering to support chaining of steteful

[jira] [Resolved] (SPARK-38591) Add sortWithinGroups to KeyValueGroupedDataset

[ https://issues.apache.org/jira/browse/SPARK-38591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38591. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39640

[jira] [Assigned] (SPARK-41884) DataFrame `toPandas` parity in return types

[ https://issues.apache.org/jira/browse/SPARK-41884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41884: Assignee: Apache Spark > DataFrame `toPandas` parity in return types >

[jira] [Assigned] (SPARK-41884) DataFrame `toPandas` parity in return types

[ https://issues.apache.org/jira/browse/SPARK-41884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41884: Assignee: (was: Apache Spark) > DataFrame `toPandas` parity in return types >

[jira] [Commented] (SPARK-41884) DataFrame `toPandas` parity in return types

[ https://issues.apache.org/jira/browse/SPARK-41884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678984#comment-17678984 ] Apache Spark commented on SPARK-41884: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-42128) Limit pushdown for MS SQL Server

[ https://issues.apache.org/jira/browse/SPARK-42128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678983#comment-17678983 ] Apache Spark commented on SPARK-42128: -- User 'sadikovi' has created a pull request for this issue:

[jira] [Commented] (SPARK-42128) Limit pushdown for MS SQL Server

[ https://issues.apache.org/jira/browse/SPARK-42128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678982#comment-17678982 ] Apache Spark commented on SPARK-42128: -- User 'sadikovi' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42128) Limit pushdown for MS SQL Server

[ https://issues.apache.org/jira/browse/SPARK-42128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42128: Assignee: Apache Spark > Limit pushdown for MS SQL Server >

[jira] [Assigned] (SPARK-42128) Limit pushdown for MS SQL Server

[ https://issues.apache.org/jira/browse/SPARK-42128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42128: Assignee: (was: Apache Spark) > Limit pushdown for MS SQL Server >

[jira] [Created] (SPARK-42128) Limit pushdown for MS SQL Server

Ivan Sadikov created SPARK-42128: Summary: Limit pushdown for MS SQL Server Key: SPARK-42128 URL: https://issues.apache.org/jira/browse/SPARK-42128 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-42127) Spark 3.3.0, Error with java.io.IOException: Mkdirs failed to create file

shamim created SPARK-42127: -- Summary: Spark 3.3.0, Error with java.io.IOException: Mkdirs failed to create file Key: SPARK-42127 URL: https://issues.apache.org/jira/browse/SPARK-42127 Project: Spark

[jira] [Created] (SPARK-42126) Support user-specified return type in DDL-formatted string

Xinrong Meng created SPARK-42126: Summary: Support user-specified return type in DDL-formatted string Key: SPARK-42126 URL: https://issues.apache.org/jira/browse/SPARK-42126 Project: Spark

[jira] [Created] (SPARK-42125) Pandas UDF in Spark Connect

Xinrong Meng created SPARK-42125: Summary: Pandas UDF in Spark Connect Key: SPARK-42125 URL: https://issues.apache.org/jira/browse/SPARK-42125 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-42124) Scalar Inline Python UDF in Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-42124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42124: Assignee: (was: Apache Spark) > Scalar Inline Python UDF in Spark Connect >

[jira] [Assigned] (SPARK-42124) Scalar Inline Python UDF in Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-42124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42124: Assignee: Apache Spark > Scalar Inline Python UDF in Spark Connect >

[jira] [Commented] (SPARK-42124) Scalar Inline Python UDF in Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-42124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678978#comment-17678978 ] Apache Spark commented on SPARK-42124: -- User 'xinrong-meng' has created a pull request for this

[jira] [Created] (SPARK-42124) Scalar Inline Python UDF in Spark Connect

Xinrong Meng created SPARK-42124: Summary: Scalar Inline Python UDF in Spark Connect Key: SPARK-42124 URL: https://issues.apache.org/jira/browse/SPARK-42124 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-42096) Code cleanup for connect module

[ https://issues.apache.org/jira/browse/SPARK-42096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42096. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39620

[jira] [Assigned] (SPARK-42096) Code cleanup for connect module

[ https://issues.apache.org/jira/browse/SPARK-42096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42096: - Assignee: Yang Jie > Code cleanup for connect module > ---

[jira] [Resolved] (SPARK-42112) Add null check before `ContinuousWriteRDD#compute` method close dataWriter

[ https://issues.apache.org/jira/browse/SPARK-42112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42112. --- Fix Version/s: 3.4.0 Assignee: Yang Jie Resolution: Fixed This is resolved

[jira] [Commented] (SPARK-40034) PathOutputCommitters to work with dynamic partition overwrite

[ https://issues.apache.org/jira/browse/SPARK-40034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678962#comment-17678962 ] Dongjoon Hyun commented on SPARK-40034: --- May I ask when Apache Hadoop 3.3.5 is going to be

[jira] [Resolved] (SPARK-42043) Basic Scala Client Result Implementation

[ https://issues.apache.org/jira/browse/SPARK-42043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42043. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39658

[jira] [Assigned] (SPARK-42043) Basic Scala Client Result Implementation

[ https://issues.apache.org/jira/browse/SPARK-42043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42043: - Assignee: Zhen Li > Basic Scala Client Result Implementation >

[jira] [Commented] (SPARK-42043) Basic Scala Client Result Implementation

[ https://issues.apache.org/jira/browse/SPARK-42043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678951#comment-17678951 ] Apache Spark commented on SPARK-42043: -- User 'zhenlineo' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42123) Include column default values in DESCRIBE output

[ https://issues.apache.org/jira/browse/SPARK-42123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42123: Assignee: (was: Apache Spark) > Include column default values in DESCRIBE output >

[jira] [Commented] (SPARK-42123) Include column default values in DESCRIBE output

[ https://issues.apache.org/jira/browse/SPARK-42123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678944#comment-17678944 ] Apache Spark commented on SPARK-42123: -- User 'dtenedor' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42123) Include column default values in DESCRIBE output

[ https://issues.apache.org/jira/browse/SPARK-42123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42123: Assignee: Apache Spark > Include column default values in DESCRIBE output >

[jira] [Assigned] (SPARK-40550) DataSource V2: Handle DELETE commands for delta-based sources

[ https://issues.apache.org/jira/browse/SPARK-40550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-40550: - Assignee: Anton Okolnychyi > DataSource V2: Handle DELETE commands for delta-based

[jira] [Resolved] (SPARK-40550) DataSource V2: Handle DELETE commands for delta-based sources

[ https://issues.apache.org/jira/browse/SPARK-40550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-40550. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38005

[jira] [Created] (SPARK-42123) Include column default values in DESCRIBE output

Daniel created SPARK-42123: -- Summary: Include column default values in DESCRIBE output Key: SPARK-42123 URL: https://issues.apache.org/jira/browse/SPARK-42123 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-42119) Add built-in table-valued functions inline and inline_outer

[ https://issues.apache.org/jira/browse/SPARK-42119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678931#comment-17678931 ] Apache Spark commented on SPARK-42119: -- User 'allisonwang-db' has created a pull request for this

[jira] [Assigned] (SPARK-42119) Add built-in table-valued functions inline and inline_outer

[ https://issues.apache.org/jira/browse/SPARK-42119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42119: Assignee: (was: Apache Spark) > Add built-in table-valued functions inline and

[jira] [Assigned] (SPARK-42119) Add built-in table-valued functions inline and inline_outer

[ https://issues.apache.org/jira/browse/SPARK-42119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42119: Assignee: Apache Spark > Add built-in table-valued functions inline and inline_outer >

[jira] [Updated] (SPARK-42121) Add built-in table-valued functions posexplode and posexplode_outer

[ https://issues.apache.org/jira/browse/SPARK-42121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-42121: - Description: Add `posexplode` and `posexplode_outer` to the built-in table function registry.

[jira] [Updated] (SPARK-42120) Add built-in table-valued function json_tuple

[ https://issues.apache.org/jira/browse/SPARK-42120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-42120: - Description: Add `json_tuple` to the built-in table function registry. Add new SQL tests in

[jira] [Updated] (SPARK-42122) Add built-in table-valued function stack

[ https://issues.apache.org/jira/browse/SPARK-42122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-42122: - Description: Add `stack` to the built-in table function registry. Add new SQL tests in

[jira] [Updated] (SPARK-42120) Add built-in table-valued function json_tuple

[ https://issues.apache.org/jira/browse/SPARK-42120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-42120: - Description: Add `json_tuple` to built-in table function registry. Add new SQL tests in

[jira] [Created] (SPARK-42122) Add built-in table-valued function stack

Allison Wang created SPARK-42122: Summary: Add built-in table-valued function stack Key: SPARK-42122 URL: https://issues.apache.org/jira/browse/SPARK-42122 Project: Spark Issue Type:

[jira] [Updated] (SPARK-42119) Add built-in table-valued functions inline and inline_outer

[ https://issues.apache.org/jira/browse/SPARK-42119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-42119: - Description: Add `inline` and `inline_outer` to the built-in table function registry. Add new

[jira] [Created] (SPARK-42121) Add built-in table-valued functions posexplode and posexplode_outer

Allison Wang created SPARK-42121: Summary: Add built-in table-valued functions posexplode and posexplode_outer Key: SPARK-42121 URL: https://issues.apache.org/jira/browse/SPARK-42121 Project: Spark

[jira] [Created] (SPARK-42120) Add built-in table-valued function json_tuple

Allison Wang created SPARK-42120: Summary: Add built-in table-valued function json_tuple Key: SPARK-42120 URL: https://issues.apache.org/jira/browse/SPARK-42120 Project: Spark Issue Type:

[jira] [Created] (SPARK-42119) Add built-in table-valued functions inline and inline_outer

Allison Wang created SPARK-42119: Summary: Add built-in table-valued functions inline and inline_outer Key: SPARK-42119 URL: https://issues.apache.org/jira/browse/SPARK-42119 Project: Spark

[jira] [Assigned] (SPARK-41759) Use `weakIntern` on string values in create new objects during deserialization

[ https://issues.apache.org/jira/browse/SPARK-41759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-41759: -- Assignee: BingKun Pan > Use `weakIntern` on string values in create new objects

[jira] [Resolved] (SPARK-41759) Use `weakIntern` on string values in create new objects during deserialization

[ https://issues.apache.org/jira/browse/SPARK-41759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-41759. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39275

[jira] [Updated] (SPARK-42118) Wrong result when parsing a multiline JSON file with differing types for same column

[ https://issues.apache.org/jira/browse/SPARK-42118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dilip Biswal updated SPARK-42118: - Description: Here is a simple reproduction of the problem. We have a JSON file whose content

[jira] [Created] (SPARK-42118) Wrong result when parsing a multiline JSON file with differing types for same column

Dilip Biswal created SPARK-42118: Summary: Wrong result when parsing a multiline JSON file with differing types for same column Key: SPARK-42118 URL: https://issues.apache.org/jira/browse/SPARK-42118

[jira] [Resolved] (SPARK-42116) Mark ColumnarBatchSuite as ExtendedSQLTest

[ https://issues.apache.org/jira/browse/SPARK-42116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42116. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39655

[jira] [Assigned] (SPARK-42116) Mark ColumnarBatchSuite as ExtendedSQLTest

[ https://issues.apache.org/jira/browse/SPARK-42116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42116: - Assignee: Dongjoon Hyun > Mark ColumnarBatchSuite as ExtendedSQLTest >

[jira] [Created] (SPARK-42117) Upgrade kubernetes-client from 6.3.1 to 6.4.0

Bjørn Jørgensen created SPARK-42117: --- Summary: Upgrade kubernetes-client from 6.3.1 to 6.4.0 Key: SPARK-42117 URL: https://issues.apache.org/jira/browse/SPARK-42117 Project: Spark Issue

[jira] [Assigned] (SPARK-42116) Mark ColumnarBatchSuite as ExtendedSQLTest

[ https://issues.apache.org/jira/browse/SPARK-42116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42116: Assignee: (was: Apache Spark) > Mark ColumnarBatchSuite as ExtendedSQLTest >

[jira] [Assigned] (SPARK-42116) Mark ColumnarBatchSuite as ExtendedSQLTest

[ https://issues.apache.org/jira/browse/SPARK-42116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42116: Assignee: Apache Spark > Mark ColumnarBatchSuite as ExtendedSQLTest >

[jira] [Commented] (SPARK-42116) Mark ColumnarBatchSuite as ExtendedSQLTest

[ https://issues.apache.org/jira/browse/SPARK-42116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678827#comment-17678827 ] Apache Spark commented on SPARK-42116: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-42116) Mark ColumnarBatchSuite as ExtendedSQLTest

Dongjoon Hyun created SPARK-42116: - Summary: Mark ColumnarBatchSuite as ExtendedSQLTest Key: SPARK-42116 URL: https://issues.apache.org/jira/browse/SPARK-42116 Project: Spark Issue Type:

[jira] [Commented] (SPARK-40034) PathOutputCommitters to work with dynamic partition overwrite

[ https://issues.apache.org/jira/browse/SPARK-40034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678814#comment-17678814 ] Steve Loughran commented on SPARK-40034: Note that these changes aren't sufficient. The hadoop

[jira] [Assigned] (SPARK-42113) Upgrade pandas to 1.5.3

[ https://issues.apache.org/jira/browse/SPARK-42113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42113: - Assignee: Haejoon Lee > Upgrade pandas to 1.5.3 > --- > >

[jira] [Resolved] (SPARK-42113) Upgrade pandas to 1.5.3

[ https://issues.apache.org/jira/browse/SPARK-42113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42113. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39651

[jira] [Updated] (SPARK-41793) Incorrect result for window frames defined by a range clause on large decimals

[ https://issues.apache.org/jira/browse/SPARK-41793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-41793: -- Labels: correctness (was: ) > Incorrect result for window frames defined by a range clause

[jira] [Updated] (SPARK-41793) Incorrect result for window frames defined by a range clause on large decimals

[ https://issues.apache.org/jira/browse/SPARK-41793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-41793: -- Priority: Blocker (was: Major) > Incorrect result for window frames defined by a range

[jira] [Commented] (SPARK-41793) Incorrect result for window frames defined by a range clause on large decimals

[ https://issues.apache.org/jira/browse/SPARK-41793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678744#comment-17678744 ] Thomas Graves commented on SPARK-41793: --- this sounds like a correctness issue - [~cloud_fan]

[jira] [Resolved] (SPARK-42080) Add guideline for PySpark errors.

[ https://issues.apache.org/jira/browse/SPARK-42080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42080. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39639

[jira] [Assigned] (SPARK-42080) Add guideline for PySpark errors.

[ https://issues.apache.org/jira/browse/SPARK-42080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42080: Assignee: Haejoon Lee > Add guideline for PySpark errors. >

[jira] [Assigned] (SPARK-42111) Mark Orc*FilterSuite/OrcV*SchemaPruningSuite as ExtendedSQLTest

[ https://issues.apache.org/jira/browse/SPARK-42111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42111: Assignee: Dongjoon Hyun > Mark Orc*FilterSuite/OrcV*SchemaPruningSuite as

[jira] [Resolved] (SPARK-42111) Mark Orc*FilterSuite/OrcV*SchemaPruningSuite as ExtendedSQLTest

[ https://issues.apache.org/jira/browse/SPARK-42111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42111. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39649

[jira] [Assigned] (SPARK-42115) Push down limit through Python UDFs

[ https://issues.apache.org/jira/browse/SPARK-42115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42115: Assignee: (was: Apache Spark) > Push down limit through Python UDFs >

[jira] [Commented] (SPARK-42115) Push down limit through Python UDFs

[ https://issues.apache.org/jira/browse/SPARK-42115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678689#comment-17678689 ] Apache Spark commented on SPARK-42115: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-42115) Push down limit through Python UDFs

[ https://issues.apache.org/jira/browse/SPARK-42115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42115: Assignee: Apache Spark > Push down limit through Python UDFs >

[jira] [Updated] (SPARK-42115) Push down limit through Python UDFs

[ https://issues.apache.org/jira/browse/SPARK-42115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42115: - Description: {code} from pyspark.sql.functions import udf

[jira] [Updated] (SPARK-42115) Push down limit through Python UDFs

[ https://issues.apache.org/jira/browse/SPARK-42115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42115: - Description: {code} from pyspark.sql.functions import udf

[jira] [Created] (SPARK-42115) Push down limit through Python UDFs

Hyukjin Kwon created SPARK-42115: Summary: Push down limit through Python UDFs Key: SPARK-42115 URL: https://issues.apache.org/jira/browse/SPARK-42115 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678654#comment-17678654 ] Nikhil Sharma edited comment on SPARK-22588 at 1/19/23 11:47 AM: - Thank

[jira] [Comment Edited] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678654#comment-17678654 ] Nikhil Sharma edited comment on SPARK-22588 at 1/19/23 11:46 AM: - Thank

[jira] [Commented] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678654#comment-17678654 ] Nikhil Sharma commented on SPARK-22588: --- Thank you for sharing the information. The [AWS DevOps

[jira] [Comment Edited] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678654#comment-17678654 ] Nikhil Sharma edited comment on SPARK-22588 at 1/19/23 11:45 AM: - Thank

[jira] [Created] (SPARK-42114) Test of uniform parquet encryption

Gidon Gershinsky created SPARK-42114: Summary: Test of uniform parquet encryption Key: SPARK-42114 URL: https://issues.apache.org/jira/browse/SPARK-42114 Project: Spark Issue Type:

[jira] [Commented] (SPARK-40599) Add multiTransform methods to TreeNode to generate alternatives

[ https://issues.apache.org/jira/browse/SPARK-40599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678641#comment-17678641 ] Apache Spark commented on SPARK-40599: -- User 'peter-toth' has created a pull request for this

[jira] [Assigned] (SPARK-42113) Upgrade pandas to 1.5.3

[ https://issues.apache.org/jira/browse/SPARK-42113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42113: Assignee: (was: Apache Spark) > Upgrade pandas to 1.5.3 > --- >

[jira] [Assigned] (SPARK-42113) Upgrade pandas to 1.5.3

[ https://issues.apache.org/jira/browse/SPARK-42113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42113: Assignee: Apache Spark > Upgrade pandas to 1.5.3 > --- > >

[jira] [Commented] (SPARK-42113) Upgrade pandas to 1.5.3

[ https://issues.apache.org/jira/browse/SPARK-42113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678582#comment-17678582 ] Apache Spark commented on SPARK-42113: -- User 'itholic' has created a pull request for this issue:

  1   2   >