[jira] [Updated] (SPARK-40966) FIX `read_parquet` with `pandas_metadata`

2022-10-29 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-40966: Parent: SPARK-40576 Issue Type: Sub-task (was: Bug) > FIX `read_parquet` with `pandas_met

[jira] [Updated] (SPARK-40948) Introduce new error class: PATH_NOT_FOUND

2022-10-29 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-40948: Summary: Introduce new error class: PATH_NOT_FOUND (was: Introduce new error class: DATA_PATH_NOT

[jira] [Assigned] (SPARK-40966) FIX `read_parquet` with `pandas_metadata`

2022-10-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40966: Assignee: (was: Apache Spark) > FIX `read_parquet` with `pandas_metadata` > -

[jira] [Assigned] (SPARK-40966) FIX `read_parquet` with `pandas_metadata`

2022-10-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40966: Assignee: Apache Spark > FIX `read_parquet` with `pandas_metadata` >

[jira] [Commented] (SPARK-40966) FIX `read_parquet` with `pandas_metadata`

2022-10-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17626172#comment-17626172 ] Apache Spark commented on SPARK-40966: -- User 'itholic' has created a pull request f

[jira] [Commented] (SPARK-40966) FIX `read_parquet` with `pandas_metadata`

2022-10-29 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17626170#comment-17626170 ] Haejoon Lee commented on SPARK-40966: - I'm working on it > FIX `read_parquet` with

[jira] [Created] (SPARK-40966) FIX `read_parquet` with `pandas_metadata`

2022-10-29 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-40966: --- Summary: FIX `read_parquet` with `pandas_metadata` Key: SPARK-40966 URL: https://issues.apache.org/jira/browse/SPARK-40966 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-40963) containsNull in array type attributes is not updated from child output

2022-10-29 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-40963: -- Description: Example: {noformat} select c1, explode(c4) as c5 from ( select c1, array(c3) as

[jira] [Assigned] (SPARK-40965) Assign a name to the legacy error class _LEGACY_ERROR_TEMP_1208

2022-10-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40965: Assignee: Max Gekk (was: Apache Spark) > Assign a name to the legacy error class _LEGACY

[jira] [Assigned] (SPARK-40965) Assign a name to the legacy error class _LEGACY_ERROR_TEMP_1208

2022-10-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40965: Assignee: Apache Spark (was: Max Gekk) > Assign a name to the legacy error class _LEGACY

[jira] [Commented] (SPARK-40965) Assign a name to the legacy error class _LEGACY_ERROR_TEMP_1208

2022-10-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17626065#comment-17626065 ] Apache Spark commented on SPARK-40965: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-40965) Assign a name to the legacy error class _LEGACY_ERROR_TEMP_1208

2022-10-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17626066#comment-17626066 ] Apache Spark commented on SPARK-40965: -- User 'MaxGekk' has created a pull request f

[jira] [Created] (SPARK-40965) Assign a name to the legacy error class _LEGACY_ERROR_TEMP_1208

2022-10-29 Thread Max Gekk (Jira)
Max Gekk created SPARK-40965: Summary: Assign a name to the legacy error class _LEGACY_ERROR_TEMP_1208 Key: SPARK-40965 URL: https://issues.apache.org/jira/browse/SPARK-40965 Project: Spark Issu

[jira] [Assigned] (SPARK-40752) Migrate type check failures of misc expressions onto error classes

2022-10-29 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40752: Assignee: BingKun Pan > Migrate type check failures of misc expressions onto error classes >

[jira] [Resolved] (SPARK-40752) Migrate type check failures of misc expressions onto error classes

2022-10-29 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40752. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38350 [https://github.com

[jira] [Resolved] (SPARK-40933) Make df.stat.{cov, corr} consistent with sql functions

2022-10-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40933. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38411 [https://gi

[jira] [Assigned] (SPARK-40933) Make df.stat.{cov, corr} consistent with sql functions

2022-10-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40933: Assignee: Ruifeng Zheng > Make df.stat.{cov, corr} consistent with sql functions > --

[jira] [Closed] (SPARK-35904) Collapse above RebalancePartitions

2022-10-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-35904. - > Collapse above RebalancePartitions > -- > > Key: S

[jira] [Resolved] (SPARK-40808) Infer schema for CSV files - wrong behavior using header + merge schema

2022-10-29 Thread zzzzming95 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ming95 resolved SPARK-40808. Resolution: Fixed expected behavior > Infer schema for CSV files - wrong behavior using header +