[jira] [Updated] (SPARK-48449) Using `getPropertyInfo` instead of `reflection` to obtain `JAAS application name`

2024-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48449: --- Labels: pull-request-available (was: ) > Using `getPropertyInfo` instead of `reflect

[jira] [Created] (SPARK-48449) Using `getPropertyInfo` instead of `reflection` to obtain `JAAS application name`

2024-05-28 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48449: --- Summary: Using `getPropertyInfo` instead of `reflection` to obtain `JAAS application name` Key: SPARK-48449 URL: https://issues.apache.org/jira/browse/SPARK-48449

[jira] [Updated] (SPARK-48448) Mismatched Row Count for Tables in Text Format Created by CTAS

2024-05-28 Thread dohongdayi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dohongdayi updated SPARK-48448: --- Description: After I executed the following Spark SQL with default hive file format 'text

[jira] [Updated] (SPARK-48448) Mismatched Row Count for Tables in Text Format Created by CTAS

2024-05-28 Thread dohongdayi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dohongdayi updated SPARK-48448: --- Description: After I executed the following Spark SQL with default hive file format 'text

[jira] [Resolved] (SPARK-48445) Don't inline UDFs with non-cheap children in CollapseProject

2024-05-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48445. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46780 [https

[jira] [Created] (SPARK-48448) Mismatched Row Count for Tables in Text Format Created by CTAS

2024-05-28 Thread dohongdayi (Jira)
dohongdayi created SPARK-48448: -- Summary: Mismatched Row Count for Tables in Text Format Created by CTAS Key: SPARK-48448 URL: https://issues.apache.org/jira/browse/SPARK-48448 Project: Spark

[jira] [Assigned] (SPARK-48445) Don't inline UDFs with non-cheap children in CollapseProject

2024-05-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48445: Assignee: Kelvin Jiang > Don't inline UDFs with non-cheap children in CollapseProj

[jira] [Resolved] (SPARK-48436) Use `c.m.c.j.Driver` instead of `c.m.j.Driver` in `MySQLNamespaceSuite`

2024-05-28 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48436. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46773 [https

[jira] [Commented] (SPARK-23015) spark-submit fails when submitting several jobs in parallel

2024-05-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17850230#comment-17850230 ] Hyukjin Kwon commented on SPARK-23015: -- Fixed in https://github.com/apache/spark/pull/43706

[jira] [Reopened] (SPARK-23015) spark-submit fails when submitting several jobs in parallel

2024-05-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-23015: -- > spark-submit fails when submitting several jobs in paral

[jira] [Resolved] (SPARK-23015) spark-submit fails when submitting several jobs in parallel

2024-05-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23015. -- Fix Version/s: 4.0.0 Resolution: Fixed > spark-submit fails when submitting seve

[jira] [Assigned] (SPARK-42965) metadata mismatch for StructField when running some tests.

2024-05-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42965: Assignee: Ruifeng Zheng > metadata mismatch for StructField when running some te

[jira] [Resolved] (SPARK-48322) Drop internal metadata in `DataFrame.schema`

2024-05-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48322. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46636 [https

[jira] [Resolved] (SPARK-42965) metadata mismatch for StructField when running some tests.

2024-05-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42965. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46636 [https

[jira] [Assigned] (SPARK-48322) Drop internal metadata in `DataFrame.schema`

2024-05-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48322: Assignee: Ruifeng Zheng > Drop internal metadata in `DataFrame.sch

[jira] [Resolved] (SPARK-48438) Directly use the parent column class

2024-05-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48438. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46775 [https

[jira] [Updated] (SPARK-48447) Check state store provider class before invoking the constructor

2024-05-28 Thread Yuchen Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuchen Liu updated SPARK-48447: --- Priority: Major (was: Minor) > Check state store provider class before invoking the construc

[jira] [Created] (SPARK-48447) Check state store provider class before invoking the constructor

2024-05-28 Thread Yuchen Liu (Jira)
Yuchen Liu created SPARK-48447: -- Summary: Check state store provider class before invoking the constructor Key: SPARK-48447 URL: https://issues.apache.org/jira/browse/SPARK-48447 Project: Spark

[jira] [Created] (SPARK-48446) Update SS Doc of dropDuplicatesWithinWatermark to use the right syntax

2024-05-28 Thread Yuchen Liu (Jira)
Yuchen Liu created SPARK-48446: -- Summary: Update SS Doc of dropDuplicatesWithinWatermark to use the right syntax Key: SPARK-48446 URL: https://issues.apache.org/jira/browse/SPARK-48446 Project: Spark

[jira] [Updated] (SPARK-48445) Don't inline UDFs with non-cheap children in CollapseProject

2024-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48445: --- Labels: pull-request-available (was: ) > Don't inline UDFs with non-cheap child

[jira] [Created] (SPARK-48445) Don't inline UDFs with non-cheap children in CollapseProject

2024-05-28 Thread Kelvin Jiang (Jira)
Kelvin Jiang created SPARK-48445: Summary: Don't inline UDFs with non-cheap children in CollapseProject Key: SPARK-48445 URL: https://issues.apache.org/jira/browse/SPARK-48445 Project: Spark

[jira] [Updated] (SPARK-48442) Add parenthesis to awaitTermination call

2024-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48442: --- Labels: correctness pull-request-available starter (was: correctness starter) >

[jira] [Updated] (SPARK-48444) Refactor SQLQuerySuite

2024-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48444: --- Labels: pull-request-available (was: ) > Refactor SQLQuerySu

[jira] [Created] (SPARK-48444) Refactor SQLQuerySuite

2024-05-28 Thread Rui Wang (Jira)
Rui Wang created SPARK-48444: Summary: Refactor SQLQuerySuite Key: SPARK-48444 URL: https://issues.apache.org/jira/browse/SPARK-48444 Project: Spark Issue Type: Sub-task Components

[jira] [Created] (SPARK-48443) Use withSQLConf in tests

2024-05-28 Thread Rui Wang (Jira)
Rui Wang created SPARK-48443: Summary: Use withSQLConf in tests Key: SPARK-48443 URL: https://issues.apache.org/jira/browse/SPARK-48443 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-48442) Add parenthesis to awaitTermination call

2024-05-28 Thread Riya Verma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Riya Verma updated SPARK-48442: --- Description: In {{test_stream_reader}} and {{test_stream_writer

[jira] [Created] (SPARK-48442) Add parenthesis to awaitTermination call

2024-05-28 Thread Riya Verma (Jira)
Riya Verma created SPARK-48442: -- Summary: Add parenthesis to awaitTermination call Key: SPARK-48442 URL: https://issues.apache.org/jira/browse/SPARK-48442 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-48221) Alter string search logic for: startsWith, endsWith, contains, locate (UTF8_BINARY_LCASE)

2024-05-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48221: --- Assignee: Uroš Bojanić > Alter string search logic for: startsWith, endsWith, conta

[jira] [Resolved] (SPARK-48221) Alter string search logic for: startsWith, endsWith, contains, locate (UTF8_BINARY_LCASE)

2024-05-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48221. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46511 [https

[jira] [Assigned] (SPARK-48273) Late rewrite of PlanWithUnresolvedIdentifier

2024-05-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48273: --- Assignee: Nikola Mandic > Late rewrite of PlanWithUnresolvedIdentif

[jira] [Resolved] (SPARK-48159) Datetime expressions (all collations)

2024-05-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48159. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46618 [https

[jira] [Resolved] (SPARK-48273) Late rewrite of PlanWithUnresolvedIdentifier

2024-05-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48273. - Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-46841) Language support for collations

2024-05-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46841. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46180 [https

[jira] [Assigned] (SPARK-46841) Language support for collations

2024-05-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46841: --- Assignee: Nikola Mandic > Language support for collati

[jira] [Updated] (SPARK-47260) Assign classes to Row to JSON errors

2024-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47260: --- Labels: pull-request-available starter (was: starter) > Assign classes to Row to J

[jira] [Created] (SPARK-48440) Alter string search logic for: translate (UTF8_BINARY_LCASE)

2024-05-28 Thread Jira
Uroš Bojanić created SPARK-48440: Summary: Alter string search logic for: translate (UTF8_BINARY_LCASE) Key: SPARK-48440 URL: https://issues.apache.org/jira/browse/SPARK-48440 Project: Spark

[jira] [Created] (SPARK-48441) Alter string search logic for: trim (UTF8_BINARY_LCASE)

2024-05-28 Thread Jira
Uroš Bojanić created SPARK-48441: Summary: Alter string search logic for: trim (UTF8_BINARY_LCASE) Key: SPARK-48441 URL: https://issues.apache.org/jira/browse/SPARK-48441 Project: Spark

[jira] [Updated] (SPARK-47361) Improve JDBC data sources

2024-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47361: --- Labels: pull-request-available releasenotes (was: releasenotes) > Improve JDBC d

[jira] [Created] (SPARK-48439) Derby: Retain as many significant digits as possible when decimal precision greater than 31

2024-05-28 Thread Kent Yao (Jira)
Kent Yao created SPARK-48439: Summary: Derby: Retain as many significant digits as possible when decimal precision greater than 31 Key: SPARK-48439 URL: https://issues.apache.org/jira/browse/SPARK-48439

[jira] [Updated] (SPARK-48409) Upgrade MySQL & Postgres & mariadb docker image version

2024-05-28 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-48409: - Parent: SPARK-47361 Issue Type: Sub-task (was: Improvement) > Upgrade MySQL & P

[jira] [Updated] (SPARK-48438) Directly use the parent column class

2024-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48438: --- Labels: pull-request-available (was: ) > Directly use the parent column cl

[jira] [Updated] (SPARK-48437) Improve IsolatedClientLoader

2024-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48437: --- Labels: pull-request-available (was: ) > Improve IsolatedClientLoa

[jira] [Updated] (SPARK-48436) Use `c.m.c.j.Driver` instead of `c.m.j.Driver` in `MySQLNamespaceSuite`

2024-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48436: --- Labels: pull-request-available (was: ) > Use `c.m.c.j.Driver` instead of `c.m.j.Dri

[jira] [Updated] (SPARK-48436) `c.m.c.j.Driver` instead of `c.m.j.Driver` in `MySQLNamespaceSuite`

2024-05-28 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-48436: Summary: `c.m.c.j.Driver` instead of `c.m.j.Driver` in `MySQLNamespaceSuite` (was: Use

[jira] [Updated] (SPARK-48436) Use `c.m.c.j.Driver` instead of `c.m.j.Driver` in `MySQLNamespaceSuite`

2024-05-28 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-48436: Summary: Use `c.m.c.j.Driver` instead of `c.m.j.Driver` in `MySQLNamespaceSuite

[jira] [Created] (SPARK-48436) Use `com.mysql.cj.jdbc.Driver` instead of `com.mysql.jdbc.Driver` in tests

2024-05-28 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48436: --- Summary: Use `com.mysql.cj.jdbc.Driver` instead of `com.mysql.jdbc.Driver` in tests Key: SPARK-48436 URL: https://issues.apache.org/jira/browse/SPARK-48436 Project

[jira] [Assigned] (SPARK-47258) Assign error classes to SHOW CREATE TABLE errors

2024-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47258: -- Assignee: (was: Apache Spark) > Assign error classes to SHOW CREATE TABLE err

[jira] [Assigned] (SPARK-48435) UNICODE collation should not support binary equality

2024-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48435: -- Assignee: (was: Apache Spark) > UNICODE collation should not support bin

[jira] [Assigned] (SPARK-48435) UNICODE collation should not support binary equality

2024-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48435: -- Assignee: Apache Spark > UNICODE collation should not support binary equal

[jira] [Assigned] (SPARK-47258) Assign error classes to SHOW CREATE TABLE errors

2024-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47258: -- Assignee: Apache Spark > Assign error classes to SHOW CREATE TABLE err

[jira] [Assigned] (SPARK-47258) Assign error classes to SHOW CREATE TABLE errors

2024-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47258: -- Assignee: (was: Apache Spark) > Assign error classes to SHOW CREATE TABLE err

[jira] [Assigned] (SPARK-47258) Assign error classes to SHOW CREATE TABLE errors

2024-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47258: -- Assignee: Apache Spark > Assign error classes to SHOW CREATE TABLE err

[jira] [Updated] (SPARK-48435) UNICODE collation should not support binary equality

2024-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48435: --- Labels: pull-request-available (was: ) > UNICODE collation should not support bin

[jira] [Created] (SPARK-48435) UNICODE collation should not support binary equality

2024-05-28 Thread Jira
Uroš Bojanić created SPARK-48435: Summary: UNICODE collation should not support binary equality Key: SPARK-48435 URL: https://issues.apache.org/jira/browse/SPARK-48435 Project: Spark Issue

[jira] [Updated] (SPARK-48394) Cleanup mapIdToMapIndex on mapoutput unregister

2024-05-28 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-48394: - Description: There is only one valid mapstatus for the same {{mapIndex}} at the same time in Spark

[jira] [Updated] (SPARK-48394) Cleanup mapIdToMapIndex on mapoutput unregister

2024-05-28 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-48394: - Issue Type: Bug (was: Improvement) > Cleanup mapIdToMapIndex on mapoutput unregis

[jira] [Updated] (SPARK-47258) Assign error classes to SHOW CREATE TABLE errors

2024-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47258: --- Labels: pull-request-available starter (was: starter) > Assign error classes to S

[jira] [Resolved] (SPARK-48420) Upgrade netty to `4.1.110.Final`

2024-05-27 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-48420. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46744 [https

[jira] [Assigned] (SPARK-48420) Upgrade netty to `4.1.110.Final`

2024-05-27 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-48420: Assignee: BingKun Pan > Upgrade netty to `4.1.110.Fi

[jira] [Resolved] (SPARK-48434) Make printSchema use the cached schema

2024-05-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48434. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46764 [https

[jira] [Assigned] (SPARK-48434) Make printSchema use the cached schema

2024-05-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48434: Assignee: Ruifeng Zheng > Make printSchema use the cached sch

[jira] [Updated] (SPARK-48434) Make printSchema use the cached schema

2024-05-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48434: --- Labels: pull-request-available (was: ) > Make printSchema use the cached sch

[jira] [Created] (SPARK-48434) Make printSchema use the cached schema

2024-05-27 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-48434: - Summary: Make printSchema use the cached schema Key: SPARK-48434 URL: https://issues.apache.org/jira/browse/SPARK-48434 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-48434) Make printSchema use the cached schema

2024-05-27 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-48434: -- Issue Type: Improvement (was: New Feature) > Make printSchema use the cached sch

[jira] [Resolved] (SPARK-48415) TypeName support parameterized datatypes

2024-05-27 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-48415. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46738 [https

[jira] [Assigned] (SPARK-48432) Unnecessary Integer unboxing in UnivocityParser

2024-05-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48432: Assignee: Vladimir Golubev > Unnecessary Integer unboxing in UnivocityPar

[jira] [Resolved] (SPARK-48432) Unnecessary Integer unboxing in UnivocityParser

2024-05-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48432. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46759 [https

[jira] [Updated] (SPARK-48433) Upgrade `checkstyle` to 10.17.0

2024-05-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48433: --- Labels: pull-request-available (was: ) > Upgrade `checkstyle` to 10.1

[jira] [Created] (SPARK-48433) Upgrade `checkstyle` to 10.17.0

2024-05-27 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48433: --- Summary: Upgrade `checkstyle` to 10.17.0 Key: SPARK-48433 URL: https://issues.apache.org/jira/browse/SPARK-48433 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-47193) Converting dataframe to rdd results in data loss

2024-05-27 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17849785#comment-17849785 ] Bruce Robbins commented on SPARK-47193: --- Thanks for the update. This issue is seemingly

[jira] [Updated] (SPARK-48431) Do not forward predicates on collated columns to file readers

2024-05-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48431: --- Labels: pull-request-available (was: ) > Do not forward predicates on collated colu

[jira] [Updated] (SPARK-48432) Unnecessary Integer unboxing in UnivocityParser

2024-05-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48432: --- Labels: pull-request-available (was: ) > Unnecessary Integer unboxing in UnivocityPar

[jira] [Created] (SPARK-48432) Unnecessary Integer unboxing in UnivocityParser

2024-05-27 Thread Vladimir Golubev (Jira)
Vladimir Golubev created SPARK-48432: Summary: Unnecessary Integer unboxing in UnivocityParser Key: SPARK-48432 URL: https://issues.apache.org/jira/browse/SPARK-48432 Project: Spark

[jira] [Comment Edited] (SPARK-48361) Correctness: CSV corrupt record filter with aggregate ignored

2024-05-27 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17849747#comment-17849747 ] Bruce Robbins edited comment on SPARK-48361 at 5/27/24 2:29 PM: After

[jira] [Commented] (SPARK-48361) Correctness: CSV corrupt record filter with aggregate ignored

2024-05-27 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17849747#comment-17849747 ] Bruce Robbins commented on SPARK-48361: --- After looking at this, I see that this is arguably

[jira] [Updated] (SPARK-48430) Fix map value extraction when map contains collated strings

2024-05-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48430: --- Labels: pull-request-available (was: ) > Fix map value extraction when map conta

[jira] [Created] (SPARK-48431) Do not forward predicates on collated columns to file readers

2024-05-27 Thread Jan-Ole Sasse (Jira)
Jan-Ole Sasse created SPARK-48431: - Summary: Do not forward predicates on collated columns to file readers Key: SPARK-48431 URL: https://issues.apache.org/jira/browse/SPARK-48431 Project: Spark

[jira] [Created] (SPARK-48430) Fix map value extraction when map contains collated strings

2024-05-27 Thread Nikola Mandic (Jira)
Nikola Mandic created SPARK-48430: - Summary: Fix map value extraction when map contains collated strings Key: SPARK-48430 URL: https://issues.apache.org/jira/browse/SPARK-48430 Project: Spark

[jira] [Commented] (SPARK-48429) CleanupDynamicPruningFilters does not take effect for V2ScanRelation

2024-05-27 Thread Zhen Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17849690#comment-17849690 ] Zhen Wang commented on SPARK-48429: --- Should we keep pushed filters like `PruneHiveTablePartitions`? cc

[jira] [Updated] (SPARK-48429) CleanupDynamicPruningFilters does not take effect for V2ScanRelation

2024-05-27 Thread Zhen Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Wang updated SPARK-48429: -- Description: org.apache.spark.sql.execution.datasources.v2.V2ScanRelationPushDown removes pushed

[jira] [Updated] (SPARK-48429) CleanupDynamicPruningFilters does not take effect for V2ScanRelation

2024-05-27 Thread Zhen Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Wang updated SPARK-48429: -- Description: *org.apache.spark.sql.execution.datasources.v2.V2ScanRelationPushDown* removes pushed

[jira] [Updated] (SPARK-48429) CleanupDynamicPruningFilters does not take effect for V2ScanRelation

2024-05-27 Thread Zhen Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Wang updated SPARK-48429: -- Affects Version/s: 4.0.0 (was: 3.5.0) > CleanupDynamicPruningFilters d

[jira] [Created] (SPARK-48429) CleanupDynamicPruningFilters does not take effect for V2ScanRelation

2024-05-27 Thread Zhen Wang (Jira)
Zhen Wang created SPARK-48429: - Summary: CleanupDynamicPruningFilters does not take effect for V2ScanRelation Key: SPARK-48429 URL: https://issues.apache.org/jira/browse/SPARK-48429 Project: Spark

[jira] [Commented] (SPARK-47193) Converting dataframe to rdd results in data loss

2024-05-27 Thread Ivan Bova (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17849687#comment-17849687 ] Ivan Bova commented on SPARK-47193: --- Hello [~bersprockets]! I have determined that this happens when

[jira] [Assigned] (SPARK-48427) Upgrade scala-parser-combinators to 2.4

2024-05-27 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48427: Assignee: Yang Jie > Upgrade scala-parser-combinators to

[jira] [Resolved] (SPARK-48427) Upgrade scala-parser-combinators to 2.4

2024-05-27 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48427. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46754 [https

[jira] [Updated] (SPARK-39743) Unable to set zstd compression level while writing parquet files

2024-05-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-39743: --- Labels: pull-request-available (was: ) > Unable to set zstd compression level wh

[jira] [Updated] (SPARK-48426) Make a documentation for SQL Operators with clear precedence defined

2024-05-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48426: --- Labels: pull-request-available (was: ) > Make a documentation for SQL Operators with cl

[jira] [Updated] (SPARK-48428) IllegalStateException due to nested column aliasing

2024-05-27 Thread Emil Ejbyfeldt (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Emil Ejbyfeldt updated SPARK-48428: --- Description: {code:java} val f = udf[((Int, Int), Int), ((Int, Int), Int)](identity) val

[jira] [Updated] (SPARK-48428) IllegalStateException due to nested column aliasing

2024-05-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48428: --- Labels: pull-request-available (was: ) > IllegalStateException due to nested col

[jira] [Created] (SPARK-48428) IllegalStateException due to nested column aliasing

2024-05-27 Thread Emil Ejbyfeldt (Jira)
Emil Ejbyfeldt created SPARK-48428: -- Summary: IllegalStateException due to nested column aliasing Key: SPARK-48428 URL: https://issues.apache.org/jira/browse/SPARK-48428 Project: Spark

[jira] [Updated] (SPARK-48427) Upgrade scala-parser-combinators to 2.4

2024-05-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48427: --- Labels: pull-request-available (was: ) > Upgrade scala-parser-combinators to

[jira] [Created] (SPARK-48427) Upgrade scala-parser-combinators to 2.4

2024-05-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-48427: Summary: Upgrade scala-parser-combinators to 2.4 Key: SPARK-48427 URL: https://issues.apache.org/jira/browse/SPARK-48427 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-48426) Make a documentation for SQL Operators with clear precedence defined

2024-05-26 Thread Kent Yao (Jira)
Kent Yao created SPARK-48426: Summary: Make a documentation for SQL Operators with clear precedence defined Key: SPARK-48426 URL: https://issues.apache.org/jira/browse/SPARK-48426 Project: Spark

[jira] [Resolved] (SPARK-48425) Replaces pyspark-connect to pyspark_connect for its output name

2024-05-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48425. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46751 [https

[jira] [Assigned] (SPARK-48425) Replaces pyspark-connect to pyspark_connect for its output name

2024-05-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48425: Assignee: Hyukjin Kwon > Replaces pyspark-connect to pyspark_connect for its output n

[jira] [Updated] (SPARK-48425) Replaces pyspark-connect to pyspark_connect for its output name

2024-05-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-48425: - Description: The issue is at setuptools from 69.X.X. It replaces dash in package name

[jira] [Updated] (SPARK-48425) Replaces pyspark-connect to pyspark_connect for its output name

2024-05-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48425: --- Labels: pull-request-available (was: ) > Replaces pyspark-connect to pyspark_conn

[jira] [Created] (SPARK-48425) Replaces pyspark-connect to pyspark_connect for its output name

2024-05-26 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-48425: Summary: Replaces pyspark-connect to pyspark_connect for its output name Key: SPARK-48425 URL: https://issues.apache.org/jira/browse/SPARK-48425 Project: Spark

[jira] [Resolved] (SPARK-48424) Make dev/is-changed.py to return true it it fails

2024-05-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48424. -- Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue resolved by pull

<    3   4   5   6   7   8   9   10   11   12   >