[jira] [Resolved] (SPARK-47234) Upgrade Scala to 2.13.13

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47234. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45342

[jira] [Updated] (SPARK-47406) Handle TIMESTAMP and DATETIME in MYSQLDialect

2024-03-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47406: --- Labels: pull-request-available (was: ) > Handle TIMESTAMP and DATETIME in MYSQLDialect >

[jira] [Created] (SPARK-47406) Handle TIMESTAMP and DATETIME in MYSQLDialect

2024-03-14 Thread Kent Yao (Jira)
Kent Yao created SPARK-47406: Summary: Handle TIMESTAMP and DATETIME in MYSQLDialect Key: SPARK-47406 URL: https://issues.apache.org/jira/browse/SPARK-47406 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-47405) Remove `JLine 2` dependency

2024-03-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47405: --- Labels: pull-request-available (was: ) > Remove `JLine 2` dependency >

[jira] [Created] (SPARK-47405) Remove `JLine 2` dependency

2024-03-14 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47405: - Summary: Remove `JLine 2` dependency Key: SPARK-47405 URL: https://issues.apache.org/jira/browse/SPARK-47405 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-47366) Implement parse_json

2024-03-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47366. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45479

[jira] [Assigned] (SPARK-47366) Implement parse_json

2024-03-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47366: --- Assignee: Chenhao Li > Implement parse_json > > >

[jira] [Updated] (SPARK-47404) Add hooks to release the ANTLR DFA cache after parsing SQL

2024-03-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47404: --- Labels: pull-request-available (was: ) > Add hooks to release the ANTLR DFA cache after

[jira] [Created] (SPARK-47404) Add hooks to release the ANTLR DFA cache after parsing SQL

2024-03-14 Thread Mark Jarvin (Jira)
Mark Jarvin created SPARK-47404: --- Summary: Add hooks to release the ANTLR DFA cache after parsing SQL Key: SPARK-47404 URL: https://issues.apache.org/jira/browse/SPARK-47404 Project: Spark

[jira] [Updated] (SPARK-45376) Add netty-tcnative-boringssl-static dependency

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45376: -- Summary: Add netty-tcnative-boringssl-static dependency (was: [CORE] Add

[jira] [Closed] (SPARK-47342) Support TimestampNTZ for DB2 TIMESTAMP WITH TIME ZONE

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-47342. - > Support TimestampNTZ for DB2 TIMESTAMP WITH TIME ZONE >

[jira] (SPARK-47342) Support TimestampNTZ for DB2 TIMESTAMP WITH TIME ZONE

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47342 ] Dongjoon Hyun deleted comment on SPARK-47342: --- was (Author: dongjoon): Issue resolved by pull request 45471 [https://github.com/apache/spark/pull/45471] > Support TimestampNTZ for DB2

[jira] [Commented] (SPARK-47342) Support TimestampNTZ for DB2 TIMESTAMP WITH TIME ZONE

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827258#comment-17827258 ] Dongjoon Hyun commented on SPARK-47342: --- Thank you for providing the context. > Support

[jira] [Resolved] (SPARK-47402) Upgrade `ZooKeeper` to 3.9.2

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47402. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45524

[jira] [Updated] (SPARK-46305) Remove the special Zookeeper version in the `streaming-kafka-0-10` and `sql-kafka-0-10` modules

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46305: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Remove the special

[jira] [Commented] (SPARK-39420) Support ANALYZE TABLE on v2 tables

2024-03-14 Thread Felipe (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827234#comment-17827234 ] Felipe commented on SPARK-39420: Hi. The PR [https://github.com/apache/spark/pull/4] has been closed

[jira] [Updated] (SPARK-39420) Support ANALYZE TABLE on v2 tables

2024-03-14 Thread Felipe (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felipe updated SPARK-39420: --- Affects Version/s: 3.3.4 3.5.1 > Support ANALYZE TABLE on v2 tables >

[jira] [Resolved] (SPARK-47396) Add a general mapping for TIME WITHOUT TIME ZONE to TimestampNTZType

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47396. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45519

[jira] [Commented] (SPARK-47398) AQE doesn't allow for extension of InMemoryTableScanExec

2024-03-14 Thread Raza Jafri (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827206#comment-17827206 ] Raza Jafri commented on SPARK-47398: In `AdaptiveSparkPlanExec` we are wrapping

[jira] [Updated] (SPARK-47398) AQE doesn't allow for extension of InMemoryTableScanExec

2024-03-14 Thread Raza Jafri (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raza Jafri updated SPARK-47398: --- Description: As part of SPARK-42101, we added support to AQE for handling InMemoryTableScanExec. 

[jira] [Updated] (SPARK-47398) AQE doesn't allow for extension of InMemoryTableScanExec

2024-03-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47398: --- Labels: pull-request-available (was: ) > AQE doesn't allow for extension of

[jira] [Updated] (SPARK-47398) AQE doesn't allow for extension of InMemoryTableScanExec

2024-03-14 Thread Raza Jafri (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raza Jafri updated SPARK-47398: --- Description: As part of SPARK-42101, we added support to AQE for handling InMemoryTableScanExec. 

[jira] [Updated] (SPARK-47398) AQE doesn't allow for extension of InMemoryTableScanExec

2024-03-14 Thread Raza Jafri (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raza Jafri updated SPARK-47398: --- Description: As part of SPARK-42101, we added support to AQE for handling InMemoryTableScanExec. 

[jira] [Updated] (SPARK-47398) AQE doesn't allow for extension of InMemoryTableScanExec

2024-03-14 Thread Raza Jafri (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raza Jafri updated SPARK-47398: --- Description: As part of SPARK-42101, we added support to AQE for handling InMemoryTableScanExec. 

[jira] [Resolved] (SPARK-47387) Remove some unused error classes

2024-03-14 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-47387. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45509

[jira] [Assigned] (SPARK-47387) Remove some unused error classes

2024-03-14 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-47387: Assignee: BingKun Pan > Remove some unused error classes > > >

[jira] [Updated] (SPARK-47398) AQE doesn't allow for extension of InMemoryTableScanExec

2024-03-14 Thread Raza Jafri (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raza Jafri updated SPARK-47398: --- Description: As part of SPARK-42101 we added support to AQE for handling InMemoryTableScanExec. 

[jira] [Updated] (SPARK-47398) AQE doesn't allow for extension of InMemoryTableScanExec

2024-03-14 Thread Raza Jafri (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raza Jafri updated SPARK-47398: --- Description: As part of SPARK-42101 we added support to AQE for handling InMemoryTableScanExec. 

[jira] [Updated] (SPARK-47398) AQE doesn't allow for extension of InMemoryTableScanExec

2024-03-14 Thread Raza Jafri (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raza Jafri updated SPARK-47398: --- Description: As part of SPARK-42101 we added support to AQE for handling InMemoryTableScanExec. 

[jira] [Updated] (SPARK-47398) AQE doesn't allow for extension of InMemoryTableScanExec

2024-03-14 Thread Raza Jafri (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raza Jafri updated SPARK-47398: --- Target Version/s: (was: 4.0.0) > AQE doesn't allow for extension of InMemoryTableScanExec >

[jira] [Resolved] (SPARK-47401) Update `YuniKorn` docs with v1.5

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47401. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45523

[jira] [Assigned] (SPARK-47401) Update `YuniKorn` docs with v1.5

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47401: - Assignee: Dongjoon Hyun > Update `YuniKorn` docs with v1.5 >

[jira] [Updated] (SPARK-46210) Update `YuniKorn` docs with v1.4

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46210: -- Summary: Update `YuniKorn` docs with v1.4 (was: Update YuniKorn docs with v1.4) > Update

[jira] [Updated] (SPARK-47401) Update `YuniKorn` docs with v1.5

2024-03-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47401: --- Labels: pull-request-available (was: ) > Update `YuniKorn` docs with v1.5 >

[jira] [Created] (SPARK-47401) Update `YuniKorn` docs with v1.5

2024-03-14 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47401: - Summary: Update `YuniKorn` docs with v1.5 Key: SPARK-47401 URL: https://issues.apache.org/jira/browse/SPARK-47401 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-47400) Upgrade `gcs-connector` to 2.2.20

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47400. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45521

[jira] [Updated] (SPARK-44197) Upgrade Hadoop to 3.3.6

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44197: -- Fix Version/s: 4.0.0 (was: 3.5.0) > Upgrade Hadoop to 3.3.6 >

[jira] [Updated] (SPARK-47337) Bump DB2 Docker version to 11.5.8.0

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47337: -- Parent Issue: SPARK-47361 (was: SPARK-47046) > Bump DB2 Docker version to 11.5.8.0 >

[jira] [Commented] (SPARK-47337) Bump DB2 Docker version to 11.5.8.0

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827152#comment-17827152 ] Dongjoon Hyun commented on SPARK-47337: --- I changed this subtask from SPARK-47046 to SPARK-47361 .

[jira] [Updated] (SPARK-45850) Upgrade oracle jdbc driver to 23.3.0.23.09

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45850: -- Parent Issue: SPARK-47361 (was: SPARK-47046) > Upgrade oracle jdbc driver to 23.3.0.23.09 >

[jira] [Resolved] (SPARK-47384) Upgrade RoaringBitmap to 1.0.5

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47384. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45507

[jira] [Updated] (SPARK-47395) Add collate and collation to non-sql APIs

2024-03-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47395: --- Labels: pull-request-available (was: ) > Add collate and collation to non-sql APIs >

[jira] [Updated] (SPARK-47399) Disable generated columns on expressions with collations

2024-03-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47399: --- Labels: pull-request-available (was: ) > Disable generated columns on expressions with

[jira] [Created] (SPARK-47399) Disable generated columns on expressions with collations

2024-03-14 Thread Stefan Kandic (Jira)
Stefan Kandic created SPARK-47399: - Summary: Disable generated columns on expressions with collations Key: SPARK-47399 URL: https://issues.apache.org/jira/browse/SPARK-47399 Project: Spark

[jira] [Created] (SPARK-47398) AQE doesn't allow for extension of InMemoryTableScanExec

2024-03-14 Thread Raza Jafri (Jira)
Raza Jafri created SPARK-47398: -- Summary: AQE doesn't allow for extension of InMemoryTableScanExec Key: SPARK-47398 URL: https://issues.apache.org/jira/browse/SPARK-47398 Project: Spark Issue

[jira] [Commented] (SPARK-46876) Data is silently lost in Tab separated CSV with empty (whitespace) rows

2024-03-14 Thread Martin Rueckl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827135#comment-17827135 ] Martin Rueckl commented on SPARK-46876: --- [~doki] any chance to make progress on this? > Data is

[jira] [Updated] (SPARK-47397) count_distinct ignores null values

2024-03-14 Thread Martin Rueckl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Rueckl updated SPARK-47397: -- Description: The documentation states, that in group by and count statements, null values

[jira] [Updated] (SPARK-47397) count_distinct ignores null values

2024-03-14 Thread Martin Rueckl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Rueckl updated SPARK-47397: -- Attachment: image-2024-03-14-16-13-03-107.png > count_distinct ignores null values >

[jira] [Updated] (SPARK-47397) count_distinct ignores null values

2024-03-14 Thread Martin Rueckl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Rueckl updated SPARK-47397: -- Description: The documentation states, that in group by and count statements, null values

[jira] [Created] (SPARK-47397) count_distinct ignores null values

2024-03-14 Thread Martin Rueckl (Jira)
Martin Rueckl created SPARK-47397: - Summary: count_distinct ignores null values Key: SPARK-47397 URL: https://issues.apache.org/jira/browse/SPARK-47397 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-47397) count_distinct ignores null values

2024-03-14 Thread Martin Rueckl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Rueckl updated SPARK-47397: -- Attachment: image-2024-03-14-16-12-35-267.png > count_distinct ignores null values >

[jira] [Resolved] (SPARK-47391) Remove the test case workaround for JDK 8

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47391. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45514

[jira] [Assigned] (SPARK-47394) Support TIMESTAMP WITH TIME ZONE for H2Dialect

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47394: - Assignee: Kent Yao > Support TIMESTAMP WITH TIME ZONE for H2Dialect >

[jira] [Resolved] (SPARK-47394) Support TIMESTAMP WITH TIME ZONE for H2Dialect

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47394. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45516

[jira] [Assigned] (SPARK-47208) Allow overriding base overhead memory

2024-03-14 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-47208: - Assignee: Joao Correia > Allow overriding base overhead memory >

[jira] [Resolved] (SPARK-47388) Pass messageParameters by name to require()

2024-03-14 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-47388. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45511

[jira] [Resolved] (SPARK-47208) Allow overriding base overhead memory

2024-03-14 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-47208. --- Fix Version/s: 4.0.0 Resolution: Fixed > Allow overriding base overhead memory >

[jira] [Updated] (SPARK-47388) Pass messageParameters by name to require()

2024-03-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47388: --- Labels: pull-request-available (was: ) > Pass messageParameters by name to require() >

[jira] [Commented] (SPARK-47336) Provide to PySpark a functionality to get estimated size of DataFrame in bytes

2024-03-14 Thread Semyon Sinchenko (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827078#comment-17827078 ] Semyon Sinchenko commented on SPARK-47336: -- [~grundprinzip-db] what do you think about

[jira] [Commented] (SPARK-47336) Provide to PySpark a functionality to get estimated size of DataFrame in bytes

2024-03-14 Thread Martin Grund (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827077#comment-17827077 ] Martin Grund commented on SPARK-47336: -- I think the general idea is great! I would like to propose

[jira] [Updated] (SPARK-47379) Improve docker jdbc suite test reliability

2024-03-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47379: --- Labels: pull-request-available (was: ) > Improve docker jdbc suite test reliability >

[jira] [Assigned] (SPARK-47390) PostgresDialect distinguishes TIMESTAMP from TIMESTAMP_TZ

2024-03-14 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47390: Assignee: Kent Yao > PostgresDialect distinguishes TIMESTAMP from TIMESTAMP_TZ >

[jira] [Resolved] (SPARK-47390) PostgresDialect distinguishes TIMESTAMP from TIMESTAMP_TZ

2024-03-14 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47390. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45513

[jira] [Created] (SPARK-47395) Add collate and collation to non-sql APIs

2024-03-14 Thread Stefan Kandic (Jira)
Stefan Kandic created SPARK-47395: - Summary: Add collate and collation to non-sql APIs Key: SPARK-47395 URL: https://issues.apache.org/jira/browse/SPARK-47395 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47394) Support TIMESTAMP WITH TIME ZONE for H2Dialect

2024-03-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47394: --- Labels: pull-request-available (was: ) > Support TIMESTAMP WITH TIME ZONE for H2Dialect >

[jira] [Created] (SPARK-47394) Support TIMESTAMP WITH TIME ZONE for H2Dialect

2024-03-14 Thread Kent Yao (Jira)
Kent Yao created SPARK-47394: Summary: Support TIMESTAMP WITH TIME ZONE for H2Dialect Key: SPARK-47394 URL: https://issues.apache.org/jira/browse/SPARK-47394 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-47393) Collation info should be exposed through system view

2024-03-14 Thread Aleksandar Tomic (Jira)
Aleksandar Tomic created SPARK-47393: Summary: Collation info should be exposed through system view Key: SPARK-47393 URL: https://issues.apache.org/jira/browse/SPARK-47393 Project: Spark

[jira] [Created] (SPARK-47392) Compiler stats should respect collation

2024-03-14 Thread Aleksandar Tomic (Jira)
Aleksandar Tomic created SPARK-47392: Summary: Compiler stats should respect collation Key: SPARK-47392 URL: https://issues.apache.org/jira/browse/SPARK-47392 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47391) Remove the test case workaround for JDK 8

2024-03-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47391: --- Labels: pull-request-available (was: ) > Remove the test case workaround for JDK 8 >

[jira] [Created] (SPARK-47391) Remove the test case workaround for JDK 8

2024-03-14 Thread Jiaan Geng (Jira)
Jiaan Geng created SPARK-47391: -- Summary: Remove the test case workaround for JDK 8 Key: SPARK-47391 URL: https://issues.apache.org/jira/browse/SPARK-47391 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-47390) PostgresDialect distinguishes TIMESTAMP from TIMESTAMP_TZ

2024-03-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47390: --- Labels: pull-request-available (was: ) > PostgresDialect distinguishes TIMESTAMP from

[jira] [Created] (SPARK-47390) PostgresDialect distinguishes TIMESTAMP from TIMESTAMP_TZ

2024-03-14 Thread Kent Yao (Jira)
Kent Yao created SPARK-47390: Summary: PostgresDialect distinguishes TIMESTAMP from TIMESTAMP_TZ Key: SPARK-47390 URL: https://issues.apache.org/jira/browse/SPARK-47390 Project: Spark Issue

[jira] [Created] (SPARK-47389) spark jdbc one insert with multiple values

2024-03-14 Thread melin (Jira)
melin created SPARK-47389: - Summary: spark jdbc one insert with multiple values Key: SPARK-47389 URL: https://issues.apache.org/jira/browse/SPARK-47389 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-47388) Pass messageParameters by name to require()

2024-03-14 Thread Max Gekk (Jira)
Max Gekk created SPARK-47388: Summary: Pass messageParameters by name to require() Key: SPARK-47388 URL: https://issues.apache.org/jira/browse/SPARK-47388 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-47385) Tuple encoder produces wrong results with Option inputs

2024-03-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47385. - Fix Version/s: 3.4.3 3.5.2 4.0.0 Resolution: Fixed

[jira] [Assigned] (SPARK-47385) Tuple encoder produces wrong results with Option inputs

2024-03-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47385: --- Assignee: Chenhao Li > Tuple encoder produces wrong results with Option inputs >

[jira] [Updated] (SPARK-47387) Remove some unused error classes

2024-03-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47387: --- Labels: pull-request-available (was: ) > Remove some unused error classes >

[jira] [Resolved] (SPARK-47374) Fix connect-repl `usage prompt` & `docs link`

2024-03-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47374. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45494

[jira] [Assigned] (SPARK-47374) Fix connect-repl `usage prompt` & `docs link`

2024-03-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47374: Assignee: BingKun Pan > Fix connect-repl `usage prompt` & `docs link` >

[jira] [Assigned] (SPARK-47377) Factor out tests from `SparkConnectSQLTestCase`

2024-03-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47377: Assignee: Ruifeng Zheng > Factor out tests from `SparkConnectSQLTestCase` >

[jira] [Resolved] (SPARK-47377) Factor out tests from `SparkConnectSQLTestCase`

2024-03-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47377. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45497

[jira] [Created] (SPARK-47387) Remove some unused error classes

2024-03-14 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47387: --- Summary: Remove some unused error classes Key: SPARK-47387 URL: https://issues.apache.org/jira/browse/SPARK-47387 Project: Spark Issue Type: Improvement