[jira] [Resolved] (SPARK-40323) Update ORC to 1.8.0

2022-09-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-40323. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37787

[jira] [Assigned] (SPARK-40323) Update ORC to 1.8.0

2022-09-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-40323: - Assignee: William Hyun > Update ORC to 1.8.0 > --- > >

[jira] [Assigned] (SPARK-40323) Update ORC to 1.8.0

2022-09-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40323: Assignee: (was: Apache Spark) > Update ORC to 1.8.0 > --- > >

[jira] [Assigned] (SPARK-40323) Update ORC to 1.8.0

2022-09-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40323: Assignee: Apache Spark > Update ORC to 1.8.0 > --- > >

[jira] [Commented] (SPARK-40323) Update ORC to 1.8.0

2022-09-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1763#comment-1763 ] Apache Spark commented on SPARK-40323: -- User 'williamhyun' has created a pull request for this

[jira] [Created] (SPARK-40323) Update ORC to 1.8.0

2022-09-03 Thread William Hyun (Jira)
William Hyun created SPARK-40323: Summary: Update ORC to 1.8.0 Key: SPARK-40323 URL: https://issues.apache.org/jira/browse/SPARK-40323 Project: Spark Issue Type: Bug Components:

[jira] [Assigned] (SPARK-40308) str_to_map should accept non-foldable delimiter arguments

2022-09-03 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40308: Assignee: Bruce Robbins > str_to_map should accept non-foldable delimiter arguments >

[jira] [Resolved] (SPARK-40308) str_to_map should accept non-foldable delimiter arguments

2022-09-03 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40308. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37763

[jira] (SPARK-40316) Upgrading to Spark 3 is giving NullPointerException

2022-09-03 Thread Sachit (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40316 ] Sachit deleted comment on SPARK-40316: was (Author: JIRAUSER287754): Hi [~srowen] , Yes even I have tried that. Please see the what UDF gives when we put it in spark-shell Earlier Version

[jira] [Commented] (SPARK-40142) Make pyspark.sql.functions examples self-contained

2022-09-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17599984#comment-17599984 ] Apache Spark commented on SPARK-40142: -- User 'khalidmammadov' has created a pull request for this

[jira] [Commented] (SPARK-40142) Make pyspark.sql.functions examples self-contained

2022-09-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17599983#comment-17599983 ] Apache Spark commented on SPARK-40142: -- User 'khalidmammadov' has created a pull request for this

[jira] [Updated] (SPARK-40288) After `RemoveRedundantAggregates`, `PullOutGroupingExpressions` should applied to avoid attribute missing when use complex expression.

2022-09-03 Thread hgs (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hgs updated SPARK-40288: Description: {{--table}} {{create}}  {{table}} {{miss_expr(id }}{{{}int{}}}{{{},{}}}{{{}name{}}}  {{string,age 

[jira] [Commented] (SPARK-40288) After `RemoveRedundantAggregates`, `PullOutGroupingExpressions` should applied to avoid attribute missing when use complex expression.

2022-09-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17599975#comment-17599975 ] Apache Spark commented on SPARK-40288: -- User 'hgs19921112' has created a pull request for this

[jira] [Commented] (SPARK-40288) After `RemoveRedundantAggregates`, `PullOutGroupingExpressions` should applied to avoid attribute missing when use complex expression.

2022-09-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17599974#comment-17599974 ] Apache Spark commented on SPARK-40288: -- User 'hgs19921112' has created a pull request for this

[jira] [Commented] (SPARK-40288) After `RemoveRedundantAggregates`, `PullOutGroupingExpressions` should applied to avoid attribute missing when use complex expression.

2022-09-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17599972#comment-17599972 ] Apache Spark commented on SPARK-40288: -- User 'hgs19921112' has created a pull request for this

[jira] [Commented] (SPARK-40288) After `RemoveRedundantAggregates`, `PullOutGroupingExpressions` should applied to avoid attribute missing when use complex expression.

2022-09-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17599971#comment-17599971 ] Apache Spark commented on SPARK-40288: -- User 'hgs19921112' has created a pull request for this

[jira] [Commented] (SPARK-40316) Upgrading to Spark 3 is giving NullPointerException

2022-09-03 Thread Sachit (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17599961#comment-17599961 ] Sachit commented on SPARK-40316: Hi [~srowen] , Yes even I have tried that. Please see the what UDF

[jira] [Commented] (SPARK-40316) Upgrading to Spark 3 is giving NullPointerException

2022-09-03 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17599960#comment-17599960 ] Sean R. Owen commented on SPARK-40316: -- It's possible this was handled differently in earlier

[jira] [Resolved] (SPARK-40316) Upgrading to Spark 3 is giving NullPointerException

2022-09-03 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40316. -- Resolution: Not A Problem > Upgrading to Spark 3 is giving NullPointerException >

[jira] [Comment Edited] (SPARK-40316) Upgrading to Spark 3 is giving NullPointerException

2022-09-03 Thread Sachit (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17599931#comment-17599931 ] Sachit edited comment on SPARK-40316 at 9/3/22 4:01 PM: Hi [~srowen]  Yes , but

[jira] (SPARK-39996) Upgrade postgresql to 42.5.0

2022-09-03 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-39996 ] Bjørn Jørgensen deleted comment on SPARK-39996: - was (Author: bjornjorgensen): [GA testes failed|https://github.com/bjornjorgensen/spark/runs/7705423158?check_suite_focus=true] >

[jira] [Created] (SPARK-40322) Fix all dead links

2022-09-03 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-40322: --- Summary: Fix all dead links Key: SPARK-40322 URL: https://issues.apache.org/jira/browse/SPARK-40322 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-40316) Upgrading to Spark 3 is giving NullPointerException

2022-09-03 Thread Sachit (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17599931#comment-17599931 ] Sachit commented on SPARK-40316: Yes , but this was working in Spark 2.4 , are there any changes as post

[jira] [Commented] (SPARK-40316) Upgrading to Spark 3 is giving NullPointerException

2022-09-03 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17599930#comment-17599930 ] Sean R. Owen commented on SPARK-40316: -- This says your UDF returns a Seq containing null, but the

[jira] [Commented] (SPARK-40321) Upgrade rocksdbjni to 7.5.3

2022-09-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17599919#comment-17599919 ] Apache Spark commented on SPARK-40321: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-40321) Upgrade rocksdbjni to 7.5.3

2022-09-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40321: Assignee: (was: Apache Spark) > Upgrade rocksdbjni to 7.5.3 >

[jira] [Commented] (SPARK-40321) Upgrade rocksdbjni to 7.5.3

2022-09-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17599918#comment-17599918 ] Apache Spark commented on SPARK-40321: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-40321) Upgrade rocksdbjni to 7.5.3

2022-09-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40321: Assignee: Apache Spark > Upgrade rocksdbjni to 7.5.3 > --- > >

[jira] [Created] (SPARK-40321) Upgrade rocksdbjni to 7.5.3

2022-09-03 Thread Yang Jie (Jira)
Yang Jie created SPARK-40321: Summary: Upgrade rocksdbjni to 7.5.3 Key: SPARK-40321 URL: https://issues.apache.org/jira/browse/SPARK-40321 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-40288) After `RemoveRedundantAggregates`, `PullOutGroupingExpressions` should applied to avoid attribute missing when use complex expression.

2022-09-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17599912#comment-17599912 ] Apache Spark commented on SPARK-40288: -- User 'hgs19921112' has created a pull request for this

[jira] [Commented] (SPARK-40288) After `RemoveRedundantAggregates`, `PullOutGroupingExpressions` should applied to avoid attribute missing when use complex expression.

2022-09-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17599911#comment-17599911 ] Apache Spark commented on SPARK-40288: -- User 'hgs19921112' has created a pull request for this

[jira] [Comment Edited] (SPARK-33861) Simplify conditional in predicate

2022-09-03 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17599868#comment-17599868 ] Yuming Wang edited comment on SPARK-33861 at 9/3/22 8:54 AM: - Note that only

[jira] [Resolved] (SPARK-33861) Simplify conditional in predicate

2022-09-03 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-33861. - Resolution: Won't Fix Note that only 3.2.0, 3.2.1 and 3.3.0 include this optimization. We

[jira] [Reopened] (SPARK-33861) Simplify conditional in predicate

2022-09-03 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reopened SPARK-33861: - Assignee: (was: Yuming Wang) > Simplify conditional in predicate >

[jira] [Updated] (SPARK-33861) Simplify conditional in predicate

2022-09-03 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33861: Fix Version/s: (was: 3.2.0) > Simplify conditional in predicate >

[jira] [Commented] (SPARK-40316) Upgrading to Spark 3 is giving NullPointerException

2022-09-03 Thread Sachit (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17599862#comment-17599862 ] Sachit commented on SPARK-40316: Hello [~srowen] ,  Please let me know if there is any suggestion.

[jira] [Resolved] (SPARK-40033) Nested schema pruning support through element_at

2022-09-03 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-40033. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37463

[jira] [Assigned] (SPARK-40033) Nested schema pruning support through element_at

2022-09-03 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-40033: --- Assignee: XiDuo You > Nested schema pruning support through element_at >