[jira] [Resolved] (SPARK-48623) Structured Logging Framework Scala Style Migration

2024-06-18 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48623. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46980 [https:

[jira] [Assigned] (SPARK-48623) Structured Logging Framework Scala Style Migration

2024-06-18 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-48623: -- Assignee: Amanda Liu > Structured Logging Framework Scala Style Migration > -

[jira] [Updated] (SPARK-48652) Casting Issue in Spark SQL: String Column Compared to Integer Value Yields Empty Results

2024-06-18 Thread Abhishek Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Singh updated SPARK-48652: --- Description: In Spark SQL, comparing a string column to an integer value can lead to unexpe

[jira] [Updated] (SPARK-48660) The result of explain is incorrect for CreateTableAsSelect

2024-06-18 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-48660: Description: How to reproduce: {code:sql} CREATE TABLE order_history_version_audit_rno ( eventi

[jira] [Commented] (SPARK-48660) The result of explain is incorrect for CreateTableAsSelect

2024-06-18 Thread Wei Guo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17856122#comment-17856122 ] Wei Guo commented on SPARK-48660: - I am working on this and thank your for recommendatio

[jira] [Comment Edited] (SPARK-48660) The result of explain is incorrect for CreateTableAsSelect

2024-06-18 Thread Wei Guo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17856122#comment-17856122 ] Wei Guo edited comment on SPARK-48660 at 6/19/24 4:18 AM: -- I am

[jira] [Created] (SPARK-48661) Upgrade RoaringBitmap to 1.1.0

2024-06-18 Thread Wei Guo (Jira)
Wei Guo created SPARK-48661: --- Summary: Upgrade RoaringBitmap to 1.1.0 Key: SPARK-48661 URL: https://issues.apache.org/jira/browse/SPARK-48661 Project: Spark Issue Type: Sub-task Component

[jira] [Updated] (SPARK-48660) The result of explain is incorrect for CreateTableAsSelect

2024-06-18 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-48660: Description: How to reproduce: {code:sql} CREATE TABLE order_history_version_audit_rno ( eventi

[jira] [Created] (SPARK-48660) The result of explain is incorrect for CreateTableAsSelect

2024-06-18 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-48660: --- Summary: The result of explain is incorrect for CreateTableAsSelect Key: SPARK-48660 URL: https://issues.apache.org/jira/browse/SPARK-48660 Project: Spark Issu

[jira] [Created] (SPARK-48659) Unify v1 and v2 ALTER TABLE .. SET TBLPROPERTIES tests

2024-06-18 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48659: --- Summary: Unify v1 and v2 ALTER TABLE .. SET TBLPROPERTIES tests Key: SPARK-48659 URL: https://issues.apache.org/jira/browse/SPARK-48659 Project: Spark Issue Ty

[jira] [Reopened] (SPARK-48567) Pyspark StreamingQuery lastProgress and friend should return actual StreamingQueryProgress

2024-06-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-48567: -- Assignee: (was: Wei Liu) Reverted at https://github.com/apache/spark/commit/d067fc6c163

[jira] [Updated] (SPARK-48567) Pyspark StreamingQuery lastProgress and friend should return actual StreamingQueryProgress

2024-06-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-48567: - Fix Version/s: (was: 4.0.0) > Pyspark StreamingQuery lastProgress and friend should return a

[jira] [Resolved] (SPARK-48651) Document configuring different JDK for Spark on YARN

2024-06-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48651. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47010 [https://gith

[jira] [Assigned] (SPARK-48651) Document configuring different JDK for Spark on YARN

2024-06-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48651: --- Assignee: Cheng Pan > Document configuring different JDK for Spark on YARN > --

[jira] [Created] (SPARK-48658) Encode/Decode functions report coding error instead of mojibake

2024-06-18 Thread Kent Yao (Jira)
Kent Yao created SPARK-48658: Summary: Encode/Decode functions report coding error instead of mojibake Key: SPARK-48658 URL: https://issues.apache.org/jira/browse/SPARK-48658 Project: Spark Issu

[jira] [Resolved] (SPARK-48601) Fix Spark internal error when setting null value for jdbc option

2024-06-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48601. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46955 [https://gith

[jira] [Assigned] (SPARK-48649) Add "ignoreInvalidPartitionPaths" and "spark.sql.files.ignoreInvalidPartitionPaths" configs to allow ignoring invalid partition paths

2024-06-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48649: --- Assignee: Ivan Sadikov > Add "ignoreInvalidPartitionPaths" and > "spark.sql.files.ignoreIn

[jira] [Resolved] (SPARK-48649) Add "ignoreInvalidPartitionPaths" and "spark.sql.files.ignoreInvalidPartitionPaths" configs to allow ignoring invalid partition paths

2024-06-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48649. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47006 [https://gith

[jira] [Created] (SPARK-48657) The document is out of date and needs to be updated

2024-06-18 Thread BrevinFu (Jira)
BrevinFu created SPARK-48657: Summary: The document is out of date and needs to be updated Key: SPARK-48657 URL: https://issues.apache.org/jira/browse/SPARK-48657 Project: Spark Issue Type: IT He

[jira] [Assigned] (SPARK-48634) Avoid statically initialize threadpool at ExecutePlanResponseReattachableIterator

2024-06-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48634: Assignee: Hyukjin Kwon > Avoid statically initialize threadpool at > ExecutePlanResponse

[jira] [Resolved] (SPARK-48634) Avoid statically initialize threadpool at ExecutePlanResponseReattachableIterator

2024-06-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48634. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46993 [https://gi

[jira] [Created] (SPARK-48656) ArrayIndexOutOfBoundsException in CartesianRDD getPartitions

2024-06-18 Thread Nick Young (Jira)
Nick Young created SPARK-48656: -- Summary: ArrayIndexOutOfBoundsException in CartesianRDD getPartitions Key: SPARK-48656 URL: https://issues.apache.org/jira/browse/SPARK-48656 Project: Spark Iss

[jira] [Resolved] (SPARK-48646) Refine Python data source API docstring and type hints

2024-06-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48646. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47003 [https://gi

[jira] [Created] (SPARK-48655) SPJ: Add tests for shuffle skipping for aggregate queries

2024-06-18 Thread Szehon Ho (Jira)
Szehon Ho created SPARK-48655: - Summary: SPJ: Add tests for shuffle skipping for aggregate queries Key: SPARK-48655 URL: https://issues.apache.org/jira/browse/SPARK-48655 Project: Spark Issue Typ

[jira] [Created] (SPARK-48654) Kafka source should allow "enable.auto.commit" setting

2024-06-18 Thread Raghu Angadi (Jira)
Raghu Angadi created SPARK-48654: Summary: Kafka source should allow "enable.auto.commit" setting Key: SPARK-48654 URL: https://issues.apache.org/jira/browse/SPARK-48654 Project: Spark Issue

[jira] [Updated] (SPARK-48586) Remove lock acquisition in doMaintenance() by making a deep copy of RocksDBFileManager in load()

2024-06-18 Thread Riya Verma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Riya Verma updated SPARK-48586: --- Summary: Remove lock acquisition in doMaintenance() by making a deep copy of RocksDBFileManager in l

[jira] [Updated] (SPARK-48653) Fix Python data source error class references

2024-06-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48653: --- Labels: pull-request-available (was: ) > Fix Python data source error class references > --

[jira] [Created] (SPARK-48653) Fix Python data source error class references

2024-06-18 Thread Allison Wang (Jira)
Allison Wang created SPARK-48653: Summary: Fix Python data source error class references Key: SPARK-48653 URL: https://issues.apache.org/jira/browse/SPARK-48653 Project: Spark Issue Type: Sub

[jira] [Created] (SPARK-48652) Casting Issue in Spark SQL: String Column Compared to Integer Value Yields Empty Results

2024-06-18 Thread Abhishek Singh (Jira)
Abhishek Singh created SPARK-48652: -- Summary: Casting Issue in Spark SQL: String Column Compared to Integer Value Yields Empty Results Key: SPARK-48652 URL: https://issues.apache.org/jira/browse/SPARK-48652

[jira] [Updated] (SPARK-48573) Upgrade ICU version

2024-06-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48573: --- Labels: pull-request-available (was: ) > Upgrade ICU version > --- > >

[jira] [Updated] (SPARK-48573) Upgrade ICU version

2024-06-18 Thread Mihailo Milosevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Milosevic updated SPARK-48573: -- Parent: (was: SPARK-46837) Issue Type: Bug (was: Sub-task) > Upgrade ICU

[jira] [Updated] (SPARK-48573) Upgrade ICU version

2024-06-18 Thread Mihailo Milosevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Milosevic updated SPARK-48573: -- Epic Link: SPARK-46830 > Upgrade ICU version > --- > >

[jira] [Updated] (SPARK-48573) Upgrade ICU version

2024-06-18 Thread Mihailo Milosevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Milosevic updated SPARK-48573: -- Summary: Upgrade ICU version (was: TBD) > Upgrade ICU version > --- >

[jira] [Updated] (SPARK-48651) Document configuring different JDK for Spark on YARN

2024-06-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48651: --- Labels: pull-request-available (was: ) > Document configuring different JDK for Spark on YA

[jira] [Created] (SPARK-48651) Document configuring different JDK for Spark on YARN

2024-06-18 Thread Cheng Pan (Jira)
Cheng Pan created SPARK-48651: - Summary: Document configuring different JDK for Spark on YARN Key: SPARK-48651 URL: https://issues.apache.org/jira/browse/SPARK-48651 Project: Spark Issue Type: Do

[jira] [Assigned] (SPARK-48280) Improve collation testing surface area using expression walking

2024-06-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48280: -- Assignee: (was: Apache Spark) > Improve collation testing surface area using expr

[jira] [Assigned] (SPARK-48280) Improve collation testing surface area using expression walking

2024-06-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48280: -- Assignee: Apache Spark > Improve collation testing surface area using expression walk

[jira] [Resolved] (SPARK-48459) Implement DataFrameQueryContext in Spark Connect

2024-06-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48459. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46789 [https://gi

[jira] [Assigned] (SPARK-48459) Implement DataFrameQueryContext in Spark Connect

2024-06-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48459: Assignee: Hyukjin Kwon > Implement DataFrameQueryContext in Spark Connect > -

[jira] [Updated] (SPARK-48650) Display correct call site from IPython Notebook

2024-06-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48650: --- Labels: pull-request-available (was: ) > Display correct call site from IPython Notebook >

[jira] [Created] (SPARK-48650) Display correct call site from IPython Notebook

2024-06-18 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-48650: --- Summary: Display correct call site from IPython Notebook Key: SPARK-48650 URL: https://issues.apache.org/jira/browse/SPARK-48650 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-48342) [M0] Parser support

2024-06-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48342. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46665 [https://gith

[jira] [Assigned] (SPARK-48342) [M0] Parser support

2024-06-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48342: --- Assignee: David Milicevic > [M0] Parser support > --- > > K