[jira] [Resolved] (SPARK-46208) Adding a link for latest Pandas API specifications.

2023-12-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46208. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44115

[jira] [Assigned] (SPARK-46208) Adding a link for latest Pandas API specifications.

2023-12-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46208: Assignee: Haejoon Lee > Adding a link for latest Pandas API specifications. >

[jira] [Resolved] (SPARK-46206) Use a narrower scope exception for SQL processor

2023-12-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46206. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44114

[jira] [Resolved] (SPARK-46069) Support unwrap timestamp type to date type

2023-12-02 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-46069. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43982

[jira] [Assigned] (SPARK-46069) Support unwrap timestamp type to date type

2023-12-02 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-46069: --- Assignee: Wan Kun > Support unwrap timestamp type to date type >

[jira] [Resolved] (SPARK-46215) Improve `FileSystemPersistenceEngine` to allow non-exist parents

2023-12-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46215. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44127

[jira] [Resolved] (SPARK-43228) Join keys also match PartitioningCollection

2023-12-02 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-43228. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44128

[jira] [Assigned] (SPARK-43228) Join keys also match PartitioningCollection

2023-12-02 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-43228: --- Assignee: Yuming Wang > Join keys also match PartitioningCollection >

[jira] [Updated] (SPARK-46216) Improve `FileSystemPersistenceEngine` to support compressions

2023-12-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46216: --- Labels: pull-request-available (was: ) > Improve `FileSystemPersistenceEngine` to support

[jira] [Created] (SPARK-46216) Improve `FileSystemPersistenceEngine` to support compressions

2023-12-02 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-46216: - Summary: Improve `FileSystemPersistenceEngine` to support compressions Key: SPARK-46216 URL: https://issues.apache.org/jira/browse/SPARK-46216 Project: Spark

[jira] [Assigned] (SPARK-46215) Improve `FileSystemPersistenceEngine` to allow non-exist parents

2023-12-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46215: - Assignee: Dongjoon Hyun > Improve `FileSystemPersistenceEngine` to allow non-exist

[jira] [Updated] (SPARK-46208) Adding a link for latest Pandas API specifications.

2023-12-02 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46208: Summary: Adding a link for latest Pandas API specifications. (was: Use specific Pandas version

[jira] [Updated] (SPARK-43228) Join keys also match PartitioningCollection

2023-12-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43228: --- Labels: pull-request-available (was: ) > Join keys also match PartitioningCollection >

[jira] [Updated] (SPARK-44943) CONV produces incorrect result near Long.MIN_VALUE, fails to detect overflow

2023-12-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44943: --- Labels: pull-request-available (was: ) > CONV produces incorrect result near

[jira] [Updated] (SPARK-43521) Support CREATE TABLE LIKE FILE for PARQUET

2023-12-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43521: --- Labels: pull-request-available (was: ) > Support CREATE TABLE LIKE FILE for PARQUET >

[jira] [Updated] (SPARK-46215) Improve `FileSystemPersistenceEngine` to allow non-exist parents

2023-12-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46215: --- Labels: pull-request-available (was: ) > Improve `FileSystemPersistenceEngine` to allow

[jira] [Updated] (SPARK-46215) Improve `FileSystemPersistenceEngine` to allow non-exist parents

2023-12-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46215: -- Description: To prevent the following {code} info] java.io.IOException: No such file or

[jira] [Created] (SPARK-46215) Improve `FileSystemPersistenceEngine` to allow non-exist parents

2023-12-02 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-46215: - Summary: Improve `FileSystemPersistenceEngine` to allow non-exist parents Key: SPARK-46215 URL: https://issues.apache.org/jira/browse/SPARK-46215 Project: Spark

[jira] [Resolved] (SPARK-46213) Add PySparkImportError for error framework

2023-12-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46213. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44123

[jira] [Assigned] (SPARK-46213) Add PySparkImportError for error framework

2023-12-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46213: - Assignee: Haejoon Lee > Add PySparkImportError for error framework >

[jira] [Resolved] (SPARK-46210) Update YuniKorn docs with v1.4

2023-12-02 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46210. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44117

[jira] [Commented] (SPARK-45975) STORE_ASSIGNMENT_POLICY should be reset in HiveCompatibilitySuite

2023-12-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17792422#comment-17792422 ] Dongjoon Hyun commented on SPARK-45975: --- This is backported to branch-3.5 via

[jira] [Updated] (SPARK-45975) STORE_ASSIGNMENT_POLICY should be reset in HiveCompatibilitySuite

2023-12-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45975: -- Fix Version/s: 3.5.1 > STORE_ASSIGNMENT_POLICY should be reset in HiveCompatibilitySuite >

[jira] [Resolved] (SPARK-46092) Overflow in Parquet row group filter creation causes incorrect results

2023-12-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46092. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44006

[jira] [Assigned] (SPARK-46214) Upgrade commons-io to 2.15.1

2023-12-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46214: - Assignee: BingKun Pan > Upgrade commons-io to 2.15.1 > >

[jira] [Resolved] (SPARK-46214) Upgrade commons-io to 2.15.1

2023-12-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46214. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44125

[jira] [Updated] (SPARK-46214) Upgrade commons-io to 2.15.1

2023-12-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46214: --- Labels: pull-request-available (was: ) > Upgrade commons-io to 2.15.1 >

[jira] [Created] (SPARK-46214) Upgrade commons-io to 2.15.1

2023-12-02 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46214: --- Summary: Upgrade commons-io to 2.15.1 Key: SPARK-46214 URL: https://issues.apache.org/jira/browse/SPARK-46214 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-46209) Add docker java 11 only publish workflow for version before v3.5

2023-12-02 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-46209. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 58

[jira] [Updated] (SPARK-46213) Add PySparkImportError for error framework

2023-12-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46213: --- Labels: pull-request-available (was: ) > Add PySparkImportError for error framework >

[jira] [Created] (SPARK-46213) Add PySparkImportError for error framework

2023-12-02 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46213: --- Summary: Add PySparkImportError for error framework Key: SPARK-46213 URL: https://issues.apache.org/jira/browse/SPARK-46213 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-46208) Use specific Pandas version for API specifications

2023-12-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46208: -- Assignee: (was: Apache Spark) > Use specific Pandas version for API

[jira] [Assigned] (SPARK-46208) Use specific Pandas version for API specifications

2023-12-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46208: -- Assignee: (was: Apache Spark) > Use specific Pandas version for API

[jira] [Updated] (SPARK-41532) DF operations that involve multiple data frames should fail if sessions don't match

2023-12-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-41532: --- Labels: pull-request-available (was: ) > DF operations that involve multiple data frames