[jira] [Updated] (SPARK-48428) IllegalStateException due to nested column aliasing

2024-05-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48428: --- Labels: pull-request-available (was: ) > IllegalStateException due to nested column aliasin

[jira] [Updated] (SPARK-48428) IllegalStateException due to nested column aliasing

2024-05-27 Thread Emil Ejbyfeldt (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Emil Ejbyfeldt updated SPARK-48428: --- Description: {code:java} val f = udf[((Int, Int), Int), ((Int, Int), Int)](identity) val ds1

[jira] [Updated] (SPARK-48426) Make a documentation for SQL Operators with clear precedence defined

2024-05-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48426: --- Labels: pull-request-available (was: ) > Make a documentation for SQL Operators with clear

[jira] [Updated] (SPARK-39743) Unable to set zstd compression level while writing parquet files

2024-05-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-39743: --- Labels: pull-request-available (was: ) > Unable to set zstd compression level while writing

[jira] [Resolved] (SPARK-48427) Upgrade scala-parser-combinators to 2.4

2024-05-27 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48427. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46754 [https://github.com

[jira] [Assigned] (SPARK-48427) Upgrade scala-parser-combinators to 2.4

2024-05-27 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48427: Assignee: Yang Jie > Upgrade scala-parser-combinators to 2.4 > --

[jira] [Commented] (SPARK-47193) Converting dataframe to rdd results in data loss

2024-05-27 Thread Ivan Bova (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17849687#comment-17849687 ] Ivan Bova commented on SPARK-47193: --- Hello [~bersprockets]! I have determined that thi

[jira] [Created] (SPARK-48429) CleanupDynamicPruningFilters does not take effect for V2ScanRelation

2024-05-27 Thread Zhen Wang (Jira)
Zhen Wang created SPARK-48429: - Summary: CleanupDynamicPruningFilters does not take effect for V2ScanRelation Key: SPARK-48429 URL: https://issues.apache.org/jira/browse/SPARK-48429 Project: Spark

[jira] [Updated] (SPARK-48429) CleanupDynamicPruningFilters does not take effect for V2ScanRelation

2024-05-27 Thread Zhen Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Wang updated SPARK-48429: -- Affects Version/s: 4.0.0 (was: 3.5.0) > CleanupDynamicPruningFilters does n

[jira] [Updated] (SPARK-48429) CleanupDynamicPruningFilters does not take effect for V2ScanRelation

2024-05-27 Thread Zhen Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Wang updated SPARK-48429: -- Description: *org.apache.spark.sql.execution.datasources.v2.V2ScanRelationPushDown* removes pushed fi

[jira] [Updated] (SPARK-48429) CleanupDynamicPruningFilters does not take effect for V2ScanRelation

2024-05-27 Thread Zhen Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Wang updated SPARK-48429: -- Description: org.apache.spark.sql.execution.datasources.v2.V2ScanRelationPushDown removes pushed filt

[jira] [Commented] (SPARK-48429) CleanupDynamicPruningFilters does not take effect for V2ScanRelation

2024-05-27 Thread Zhen Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17849690#comment-17849690 ] Zhen Wang commented on SPARK-48429: --- Should we keep pushed filters like `PruneHiveTabl

[jira] [Created] (SPARK-48430) Fix map value extraction when map contains collated strings

2024-05-27 Thread Nikola Mandic (Jira)
Nikola Mandic created SPARK-48430: - Summary: Fix map value extraction when map contains collated strings Key: SPARK-48430 URL: https://issues.apache.org/jira/browse/SPARK-48430 Project: Spark

[jira] [Created] (SPARK-48431) Do not forward predicates on collated columns to file readers

2024-05-27 Thread Jan-Ole Sasse (Jira)
Jan-Ole Sasse created SPARK-48431: - Summary: Do not forward predicates on collated columns to file readers Key: SPARK-48431 URL: https://issues.apache.org/jira/browse/SPARK-48431 Project: Spark

[jira] [Updated] (SPARK-48430) Fix map value extraction when map contains collated strings

2024-05-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48430: --- Labels: pull-request-available (was: ) > Fix map value extraction when map contains collate

[jira] [Commented] (SPARK-48361) Correctness: CSV corrupt record filter with aggregate ignored

2024-05-27 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17849747#comment-17849747 ] Bruce Robbins commented on SPARK-48361: --- After looking at this, I see that this is

[jira] [Comment Edited] (SPARK-48361) Correctness: CSV corrupt record filter with aggregate ignored

2024-05-27 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17849747#comment-17849747 ] Bruce Robbins edited comment on SPARK-48361 at 5/27/24 2:29 PM: --

[jira] [Created] (SPARK-48432) Unnecessary Integer unboxing in UnivocityParser

2024-05-27 Thread Vladimir Golubev (Jira)
Vladimir Golubev created SPARK-48432: Summary: Unnecessary Integer unboxing in UnivocityParser Key: SPARK-48432 URL: https://issues.apache.org/jira/browse/SPARK-48432 Project: Spark Issue

[jira] [Updated] (SPARK-48432) Unnecessary Integer unboxing in UnivocityParser

2024-05-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48432: --- Labels: pull-request-available (was: ) > Unnecessary Integer unboxing in UnivocityParser >

[jira] [Updated] (SPARK-48431) Do not forward predicates on collated columns to file readers

2024-05-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48431: --- Labels: pull-request-available (was: ) > Do not forward predicates on collated columns to f

[jira] [Commented] (SPARK-47193) Converting dataframe to rdd results in data loss

2024-05-27 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17849785#comment-17849785 ] Bruce Robbins commented on SPARK-47193: --- Thanks for the update. This issue is see

[jira] [Created] (SPARK-48433) Upgrade `checkstyle` to 10.17.0

2024-05-27 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48433: --- Summary: Upgrade `checkstyle` to 10.17.0 Key: SPARK-48433 URL: https://issues.apache.org/jira/browse/SPARK-48433 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-48433) Upgrade `checkstyle` to 10.17.0

2024-05-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48433: --- Labels: pull-request-available (was: ) > Upgrade `checkstyle` to 10.17.0 >

[jira] [Resolved] (SPARK-48432) Unnecessary Integer unboxing in UnivocityParser

2024-05-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48432. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46759 [https://gi

[jira] [Assigned] (SPARK-48432) Unnecessary Integer unboxing in UnivocityParser

2024-05-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48432: Assignee: Vladimir Golubev > Unnecessary Integer unboxing in UnivocityParser > --

[jira] [Resolved] (SPARK-48415) TypeName support parameterized datatypes

2024-05-27 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-48415. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46738 [https://

[jira] [Updated] (SPARK-48434) Make printSchema use the cached schema

2024-05-27 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-48434: -- Issue Type: Improvement (was: New Feature) > Make printSchema use the cached schema > ---

[jira] [Created] (SPARK-48434) Make printSchema use the cached schema

2024-05-27 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-48434: - Summary: Make printSchema use the cached schema Key: SPARK-48434 URL: https://issues.apache.org/jira/browse/SPARK-48434 Project: Spark Issue Type: New Feat

[jira] [Updated] (SPARK-48434) Make printSchema use the cached schema

2024-05-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48434: --- Labels: pull-request-available (was: ) > Make printSchema use the cached schema > -

[jira] [Assigned] (SPARK-48434) Make printSchema use the cached schema

2024-05-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48434: Assignee: Ruifeng Zheng > Make printSchema use the cached schema > --

[jira] [Resolved] (SPARK-48434) Make printSchema use the cached schema

2024-05-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48434. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46764 [https://gi

[jira] [Assigned] (SPARK-48420) Upgrade netty to `4.1.110.Final`

2024-05-27 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-48420: Assignee: BingKun Pan > Upgrade netty to `4.1.110.Final` > > >

[jira] [Resolved] (SPARK-48420) Upgrade netty to `4.1.110.Final`

2024-05-27 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-48420. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46744 [https://github.com