[jira] [Updated] (SPARK-43258) Assign a name to the error class _LEGACY_ERROR_TEMP_202[3,4,5]

[ https://issues.apache.org/jira/browse/SPARK-43258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43258: --- Labels: pull-request-available starter (was: starter) > Assign a name to the error class

[jira] [Updated] (SPARK-43258) Assign a name to the error class _LEGACY_ERROR_TEMP_202[3,4,5]

[ https://issues.apache.org/jira/browse/SPARK-43258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deng Ziming updated SPARK-43258: Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_202[3,4,5] (was: Assign a name to

[jira] [Created] (SPARK-45893) Support drop multiple partitions in batch for hive

Wechar created SPARK-45893: -- Summary: Support drop multiple partitions in batch for hive Key: SPARK-45893 URL: https://issues.apache.org/jira/browse/SPARK-45893 Project: Spark Issue Type:

[jira] [Commented] (SPARK-45869) Revisit and Improve Spark Standalone Cluster

[ https://issues.apache.org/jira/browse/SPARK-45869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785148#comment-17785148 ] Kent Yao commented on SPARK-45869: -- Thank you [~dongjoon]  > Revisit and Improve Spark Standalone

[jira] [Assigned] (SPARK-45686) Fix `method copyArrayToImmutableIndexedSeq in class LowPriorityImplicits2 is deprecated`

[ https://issues.apache.org/jira/browse/SPARK-45686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-45686: Assignee: Yang Jie > Fix `method copyArrayToImmutableIndexedSeq in class

[jira] [Resolved] (SPARK-45686) Fix `method copyArrayToImmutableIndexedSeq in class LowPriorityImplicits2 is deprecated`

[ https://issues.apache.org/jira/browse/SPARK-45686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-45686. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43670

[jira] [Updated] (SPARK-40129) Decimal multiply can produce the wrong answer because it rounds twice

[ https://issues.apache.org/jira/browse/SPARK-40129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-40129: --- Labels: pull-request-available (was: ) > Decimal multiply can produce the wrong answer

[jira] [Assigned] (SPARK-45877) ExecutorFailureTracker support for standalone mode

[ https://issues.apache.org/jira/browse/SPARK-45877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45877: - Assignee: Kent Yao > ExecutorFailureTracker support for standalone mode >

[jira] [Commented] (SPARK-45892) Refactor the optimizer plan validation

[ https://issues.apache.org/jira/browse/SPARK-45892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785090#comment-17785090 ] Xi Liang commented on SPARK-45892: -- cc [~cloud_fan] here's the PR

[jira] [Updated] (SPARK-45892) Refactor the optimizer plan validation

[ https://issues.apache.org/jira/browse/SPARK-45892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45892: --- Labels: pull-request-available (was: ) > Refactor the optimizer plan validation >

[jira] [Created] (SPARK-45892) Refactor the optimizer plan validation

Xi Liang created SPARK-45892: Summary: Refactor the optimizer plan validation Key: SPARK-45892 URL: https://issues.apache.org/jira/browse/SPARK-45892 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-45731) Update partition statistics with ANALYZE TABLE command

[ https://issues.apache.org/jira/browse/SPARK-45731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45731: -- Affects Version/s: 4.0.0 (was: 3.5.0) > Update partition

[jira] [Updated] (SPARK-45827) Add Variant data type in Spark

[ https://issues.apache.org/jira/browse/SPARK-45827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-45827: --- Summary: Add Variant data type in Spark (was: Add variant data type in Spark) > Add Variant data

[jira] [Created] (SPARK-45891) Support Variant data type

Chenhao Li created SPARK-45891: -- Summary: Support Variant data type Key: SPARK-45891 URL: https://issues.apache.org/jira/browse/SPARK-45891 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-45884) Upgrade ORC to 1.8.6

[ https://issues.apache.org/jira/browse/SPARK-45884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45884: -- Affects Version/s: 3.4.1 (was: 3.4.2) > Upgrade ORC to 1.8.6 >

[jira] [Resolved] (SPARK-45884) Upgrade ORC to 1.8.6

[ https://issues.apache.org/jira/browse/SPARK-45884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45884. --- Fix Version/s: 3.4.2 Resolution: Fixed Issue resolved by pull request 43755

[jira] [Resolved] (SPARK-45885) Upgrade ORC to 1.7.10

[ https://issues.apache.org/jira/browse/SPARK-45885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45885. --- Fix Version/s: 3.3.4 Resolution: Fixed Issue resolved by pull request 43756

[jira] [Resolved] (SPARK-45883) Upgrade ORC to 1.9.2

[ https://issues.apache.org/jira/browse/SPARK-45883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45883. --- Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by

[jira] [Updated] (SPARK-45889) Implement push-down filter with partition ID and grouping key (if possible) for state data source reader

[ https://issues.apache.org/jira/browse/SPARK-45889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-45889: - Summary: Implement push-down filter with partition ID and grouping key (if possible) for state

[jira] [Created] (SPARK-45890) Implement limit push down for state data source reader

Jungtaek Lim created SPARK-45890: Summary: Implement limit push down for state data source reader Key: SPARK-45890 URL: https://issues.apache.org/jira/browse/SPARK-45890 Project: Spark Issue

[jira] [Created] (SPARK-45889) Implement push-down filter with partition ID and grouping key (if possible)

Jungtaek Lim created SPARK-45889: Summary: Implement push-down filter with partition ID and grouping key (if possible) Key: SPARK-45889 URL: https://issues.apache.org/jira/browse/SPARK-45889 Project:

[jira] [Created] (SPARK-45888) Apply error class framework to state data source & state metadata data source

Jungtaek Lim created SPARK-45888: Summary: Apply error class framework to state data source & state metadata data source Key: SPARK-45888 URL: https://issues.apache.org/jira/browse/SPARK-45888

[jira] [Resolved] (SPARK-45687) Fix `Passing an explicit array value to a Scala varargs method is deprecated`

[ https://issues.apache.org/jira/browse/SPARK-45687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-45687. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43642

[jira] [Assigned] (SPARK-45687) Fix `Passing an explicit array value to a Scala varargs method is deprecated`

[ https://issues.apache.org/jira/browse/SPARK-45687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-45687: Assignee: Tengfei Huang > Fix `Passing an explicit array value to a Scala varargs method

[jira] [Resolved] (SPARK-45878) ConcurrentModificationException in CliSuite

[ https://issues.apache.org/jira/browse/SPARK-45878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-45878. -- Fix Version/s: 3.5.1 4.0.0 3.4.2 Resolution: Fixed Issue

[jira] [Assigned] (SPARK-45878) ConcurrentModificationException in CliSuite

[ https://issues.apache.org/jira/browse/SPARK-45878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-45878: Assignee: Kent Yao > ConcurrentModificationException in CliSuite >

[jira] [Updated] (SPARK-45886) Output full stack trace in callSite of DataFrame context

[ https://issues.apache.org/jira/browse/SPARK-45886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45886: --- Labels: pull-request-available (was: ) > Output full stack trace in callSite of DataFrame

[jira] [Created] (SPARK-45886) Output full stack trace in callSite of DataFrame context

Max Gekk created SPARK-45886: Summary: Output full stack trace in callSite of DataFrame context Key: SPARK-45886 URL: https://issues.apache.org/jira/browse/SPARK-45886 Project: Spark Issue Type:

[jira] [Updated] (SPARK-45851) (Scala) Support different retry policies for connect client

[ https://issues.apache.org/jira/browse/SPARK-45851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45851: --- Labels: pull-request-available (was: ) > (Scala) Support different retry policies for

[jira] [Updated] (SPARK-45885) Upgrade ORC to 1.7.10

[ https://issues.apache.org/jira/browse/SPARK-45885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45885: --- Labels: pull-request-available (was: ) > Upgrade ORC to 1.7.10 > - > >

[jira] [Updated] (SPARK-45884) Upgrade ORC to 1.8.6

[ https://issues.apache.org/jira/browse/SPARK-45884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45884: --- Labels: pull-request-available (was: ) > Upgrade ORC to 1.8.6 > > >

[jira] [Created] (SPARK-45884) Upgrade ORC to 1.8.6

Dongjoon Hyun created SPARK-45884: - Summary: Upgrade ORC to 1.8.6 Key: SPARK-45884 URL: https://issues.apache.org/jira/browse/SPARK-45884 Project: Spark Issue Type: Bug Components:

[jira] [Created] (SPARK-45883) Upgrade ORC to 1.9.2

Dongjoon Hyun created SPARK-45883: - Summary: Upgrade ORC to 1.9.2 Key: SPARK-45883 URL: https://issues.apache.org/jira/browse/SPARK-45883 Project: Spark Issue Type: Bug Components:

[jira] [Updated] (SPARK-45882) BroadcastHashJoinExec propagate partitioning should respect CoalescedHashPartitioning

[ https://issues.apache.org/jira/browse/SPARK-45882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45882: --- Labels: pull-request-available (was: ) > BroadcastHashJoinExec propagate partitioning

[jira] [Updated] (SPARK-45881) Use Higher Order aggregate functions from SQL

[ https://issues.apache.org/jira/browse/SPARK-45881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45881: --- Labels: pull-request-available (was: ) > Use Higher Order aggregate functions from SQL >

[jira] [Created] (SPARK-45882) BroadcastHashJoinExec propagate partitioning should respect CoalescedHashPartitioning

XiDuo You created SPARK-45882: - Summary: BroadcastHashJoinExec propagate partitioning should respect CoalescedHashPartitioning Key: SPARK-45882 URL: https://issues.apache.org/jira/browse/SPARK-45882

[jira] [Created] (SPARK-45881) Use Higher Order aggregate functions from SQL

Steven Aerts created SPARK-45881: Summary: Use Higher Order aggregate functions from SQL Key: SPARK-45881 URL: https://issues.apache.org/jira/browse/SPARK-45881 Project: Spark Issue Type:

[jira] [Updated] (SPARK-45879) Number check for InputFileBlockSources is missing for V2 source (BatchScan) ?

[ https://issues.apache.org/jira/browse/SPARK-45879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liangcai li updated SPARK-45879: Description: When doing a join with the "input_file_name()" function, it will blow up with a

[jira] [Updated] (SPARK-45879) Number check for InputFileBlockSources is missing for V2 source (BatchScan) ?

[ https://issues.apache.org/jira/browse/SPARK-45879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liangcai li updated SPARK-45879: Description: When doing a join with the "input_file_name()" function, it will blow up with a

[jira] [Updated] (SPARK-45879) Number check for InputFileBlockSources is missing for V2 source (BatchScan) ?

[ https://issues.apache.org/jira/browse/SPARK-45879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liangcai li updated SPARK-45879: Environment: I tried on Spark 323 and Spark 341, and both can reproduce this issue. (was: I

[jira] [Updated] (SPARK-45879) Number check for InputFileBlockSources is missing for V2 source (BatchScan) ?

[ https://issues.apache.org/jira/browse/SPARK-45879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liangcai li updated SPARK-45879: Environment: I tried on Spark 323 and Spark 341, and both reproduced this issue. (was: I tried

[jira] [Updated] (SPARK-45879) Number check for InputFileBlockSources is missing for V2 source (BatchScan) ?

[ https://issues.apache.org/jira/browse/SPARK-45879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liangcai li updated SPARK-45879: Description: When doing a join with the "input_file_name()" function, it will blow up with a

[jira] [Updated] (SPARK-45879) Number check for InputFileBlockSources is missing for V2 source (BatchScan) ?

[ https://issues.apache.org/jira/browse/SPARK-45879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liangcai li updated SPARK-45879: Description: When doing a join with the "input_file_name()" function, it will blow up with a

[jira] [Updated] (SPARK-45879) Number check for InputFileBlockSources is missing for V2 source (BatchScan) ?

[ https://issues.apache.org/jira/browse/SPARK-45879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liangcai li updated SPARK-45879: Description: When doing a join with the "input_file_name()" function, it will blow up with a

[jira] [Updated] (SPARK-45879) Number check for InputFileBlockSources is missing for V2 source (BatchScan) ?

[ https://issues.apache.org/jira/browse/SPARK-45879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liangcai li updated SPARK-45879: Description: When doing a join with the "input_file_name()" function, it will blow up with a

[jira] [Updated] (SPARK-45879) Number check for InputFileBlockSources is missing for V2 source (BatchScan) ?

[ https://issues.apache.org/jira/browse/SPARK-45879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liangcai li updated SPARK-45879: Description: When doing a join with the "input_file_name()" function, it will blow up with a

[jira] [Created] (SPARK-45879) Number check for InputFileBlockSources is missing for V2 source (BatchScan) ?

Liangcai li created SPARK-45879: --- Summary: Number check for InputFileBlockSources is missing for V2 source (BatchScan) ? Key: SPARK-45879 URL: https://issues.apache.org/jira/browse/SPARK-45879 Project:

[jira] [Assigned] (SPARK-45837) Report underlying error in scala client

[ https://issues.apache.org/jira/browse/SPARK-45837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45837: Assignee: Alice Sayutina > Report underlying error in scala client >

[jira] [Resolved] (SPARK-45837) Report underlying error in scala client

[ https://issues.apache.org/jira/browse/SPARK-45837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45837. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43719

[jira] [Resolved] (SPARK-45852) Gracefully deal with recursion exception during Spark Connect logging

[ https://issues.apache.org/jira/browse/SPARK-45852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45852. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43732