[jira] [Updated] (SPARK-47085) Preformance issue on thrift API

2024-02-19 Thread Izek Greenfield (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Izek Greenfield updated SPARK-47085: Description: This new complexity was introduced in SPARK-39041. In class `RowSetUtils`

[jira] [Updated] (SPARK-47085) Preformance issue on thrift API

2024-02-19 Thread Izek Greenfield (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Izek Greenfield updated SPARK-47085: Description: This new complexity introduced in SPARK-39041. In class `RowSetUtils` there

[jira] [Updated] (SPARK-47085) Preformance issue on thrift API

2024-02-19 Thread Izek Greenfield (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Izek Greenfield updated SPARK-47085: Issue Type: Bug (was: Improvement) > Preformance issue on thrift API >

[jira] [Updated] (SPARK-45615) Remove redundant"Auto-application to `()` is deprecated" compile suppression rules.

2024-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45615: --- Labels: pull-request-available (was: ) > Remove redundant"Auto-application to `()` is

[jira] [Resolved] (SPARK-45789) Support DESCRIBE TABLE for clustering columns

2024-02-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45789. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45077

[jira] [Assigned] (SPARK-45789) Support DESCRIBE TABLE for clustering columns

2024-02-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45789: --- Assignee: Terry Kim > Support DESCRIBE TABLE for clustering columns >

[jira] [Assigned] (SPARK-47080) Fix `HistoryServerSuite` to get `getNumJobs` in `eventually`

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47080: - Assignee: Dongjoon Hyun > Fix `HistoryServerSuite` to get `getNumJobs` in `eventually`

[jira] [Resolved] (SPARK-47080) Fix `HistoryServerSuite` to get `getNumJobs` in `eventually`

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47080. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45147

[jira] [Resolved] (SPARK-47016) Upgrade scalatest related dependencies to the 3.2.18 series

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47016. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45174

[jira] [Updated] (SPARK-47016) Upgrade scalatest related dependencies to the 3.2.18 series

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47016: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade scalatest

[jira] [Assigned] (SPARK-47016) Upgrade scalatest related dependencies to the 3.2.18 series

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47016: - Assignee: Yang Jie > Upgrade scalatest related dependencies to the 3.2.18 series >

[jira] [Updated] (SPARK-45376) [CORE] Add netty-tcnative-boringssl-static dependency

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45376: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Task) > [CORE] Add

[jira] [Assigned] (SPARK-47100) Upgrade netty to 4.1.107.Final and netty-tcnative to 2.0.62.Final

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47100: - Assignee: Dongjoon Hyun > Upgrade netty to 4.1.107.Final and netty-tcnative to

[jira] [Updated] (SPARK-45376) [CORE] Add netty-tcnative-boringssl-static dependency

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45376: -- Epic Link: (was: SPARK-44937) > [CORE] Add netty-tcnative-boringssl-static dependency >

[jira] [Updated] (SPARK-47100) Upgrade netty to 4.1.107.Final and netty-tcnative to 2.0.62.Final

2024-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47100: --- Labels: pull-request-available (was: ) > Upgrade netty to 4.1.107.Final and netty-tcnative

[jira] [Updated] (SPARK-47100) Upgrade netty to 4.1.107.Final and netty-tcnative to 2.0.62.Final

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47100: -- Summary: Upgrade netty to 4.1.107.Final and netty-tcnative to 2.0.62.Final (was: Upgrade

[jira] [Created] (SPARK-47100) Upgrade Netty to 4.1.107.Final

2024-02-19 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47100: - Summary: Upgrade Netty to 4.1.107.Final Key: SPARK-47100 URL: https://issues.apache.org/jira/browse/SPARK-47100 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-46432) Upgrade Netty to 4.1.106.Final

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46432: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade Netty to

[jira] [Commented] (SPARK-46934) Unable to create Hive View from certain Spark Dataframe StructType

2024-02-19 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17818634#comment-17818634 ] Jungtaek Lim commented on SPARK-46934: -- Maybe the priority also has to be updated as well - we

[jira] [Commented] (SPARK-46934) Unable to create Hive View from certain Spark Dataframe StructType

2024-02-19 Thread Yu-Ting LIN (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17818633#comment-17818633 ] Yu-Ting LIN commented on SPARK-46934: - [~dongjoon] What do you mean for regression ? > Unable to

[jira] [Commented] (SPARK-46934) Unable to create Hive View from certain Spark Dataframe StructType

2024-02-19 Thread Yu-Ting LIN (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17818629#comment-17818629 ] Yu-Ting LIN commented on SPARK-46934: - [~dongjoon] we are mainly using Spark 3.3 and have a plan to

[jira] [Updated] (SPARK-47080) Fix `HistoryServerSuite` to get `getNumJobs` in `eventually`

2024-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47080: --- Labels: pull-request-available (was: ) > Fix `HistoryServerSuite` to get `getNumJobs` in

[jira] [Updated] (SPARK-47099) The `start` value of `paramIndex` for the error class `UNEXPECTED_INPUT_TYPE` should be `1`1

2024-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47099: --- Labels: pull-request-available (was: ) > The `start` value of `paramIndex` for the error

[jira] [Created] (SPARK-47099) The `start` value of `paramIndex` for the error class `UNEXPECTED_INPUT_TYPE` should be `1`1

2024-02-19 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47099: --- Summary: The `start` value of `paramIndex` for the error class `UNEXPECTED_INPUT_TYPE` should be `1`1 Key: SPARK-47099 URL: https://issues.apache.org/jira/browse/SPARK-47099

[jira] [Assigned] (SPARK-47097) Deflake "interrupt tag" at SparkSessionE2ESuite

2024-02-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47097: Assignee: Hyukjin Kwon > Deflake "interrupt tag" at SparkSessionE2ESuite >

[jira] [Resolved] (SPARK-47097) Deflake "interrupt tag" at SparkSessionE2ESuite

2024-02-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47097. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45173

[jira] [Updated] (SPARK-46973) Add table cache for V2 tables

2024-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46973: --- Labels: pull-request-available (was: ) > Add table cache for V2 tables >

[jira] [Updated] (SPARK-47016) Upgrade scalatest related dependencies to the 3.2.18 series

2024-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47016: --- Labels: pull-request-available (was: ) > Upgrade scalatest related dependencies to the

[jira] [Resolved] (SPARK-46820) Fix error message regression by restoring new_msg

2024-02-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46820. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44859

[jira] [Assigned] (SPARK-46820) Fix error message regression by restoring new_msg

2024-02-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46820: Assignee: Haejoon Lee > Fix error message regression by restoring new_msg >

[jira] [Resolved] (SPARK-47093) Upgrade `mockito` to 5.10.0

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47093. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45169

[jira] [Updated] (SPARK-47097) Deflake "interrupt tag" at SparkSessionE2ESuite

2024-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47097: --- Labels: pull-request-available (was: ) > Deflake "interrupt tag" at SparkSessionE2ESuite >

[jira] [Updated] (SPARK-47097) Deflake "interrupt tag" at SparkSessionE2ESuite

2024-02-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47097: - Issue Type: Test (was: Improvement) > Deflake "interrupt tag" at SparkSessionE2ESuite >

[jira] [Created] (SPARK-47097) Deflake "interrupt tag" at SparkSessionE2ESuite

2024-02-19 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47097: Summary: Deflake "interrupt tag" at SparkSessionE2ESuite Key: SPARK-47097 URL: https://issues.apache.org/jira/browse/SPARK-47097 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47062) Make Spark Connect Plugins Java Compatible

2024-02-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47062. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45114

[jira] [Assigned] (SPARK-37434) Disable unsupported `ExtendedLevelDBTest` on `MacOS/aarch64`

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37434: - Assignee: Yang Jie (was: Apache Spark) > Disable unsupported `ExtendedLevelDBTest` on

[jira] [Updated] (SPARK-47096) Upgrade Python to 3.11 in Maven builds

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47096: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Upgrade Python to 3.11

[jira] [Updated] (SPARK-47096) Upgrade Python to 3.11 in Maven builds

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47096: -- Summary: Upgrade Python to 3.11 in Maven builds (was: Upgrade Python version in Maven

[jira] [Resolved] (SPARK-47096) Upgrade Python version in Maven build in macos-14 build

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47096. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45172

[jira] [Assigned] (SPARK-47096) Upgrade Python version in Maven build in macos-14 build

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47096: - Assignee: Hyukjin Kwon > Upgrade Python version in Maven build in macos-14 build >

[jira] [Updated] (SPARK-47096) Upgrade Python version in Maven builds

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47096: -- Summary: Upgrade Python version in Maven builds (was: Upgrade Python version in Maven build

[jira] [Updated] (SPARK-47096) Upgrade Python version in Maven build in macos-14 build

2024-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47096: --- Labels: pull-request-available (was: ) > Upgrade Python version in Maven build in macos-14

[jira] [Updated] (SPARK-47096) Upgrade Python version in Maven build in macos-14 build

2024-02-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47096: - Description: {code} Error: dyld[4738]: Library not loaded:

[jira] [Updated] (SPARK-47096) Upgrade Python version in Maven build in macos-14 build

2024-02-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47096: - Summary: Upgrade Python version in Maven build in macos-14 build (was: Upgrade Python version

[jira] [Created] (SPARK-47096) Upgrade Python version in Maven build for macos compatibility

2024-02-19 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47096: Summary: Upgrade Python version in Maven build for macos compatibility Key: SPARK-47096 URL: https://issues.apache.org/jira/browse/SPARK-47096 Project: Spark

[jira] [Resolved] (SPARK-37434) Disable unsupported `ExtendedLevelDBTest` on `MacOS/aarch64`

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37434. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45170

[jira] [Assigned] (SPARK-37434) Disable unsupported `ExtendedLevelDBTest` on `MacOS/aarch64`

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37434: - Assignee: Apache Spark > Disable unsupported `ExtendedLevelDBTest` on `MacOS/aarch64`

[jira] [Resolved] (SPARK-47095) Uses proper options for command script in macos-14 build

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47095. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45171

[jira] [Updated] (SPARK-47095) Uses proper options for command script in macos-14 build

2024-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47095: --- Labels: pull-request-available (was: ) > Uses proper options for command script in

[jira] [Updated] (SPARK-47095) Uses proper options for command script in macos-14 build

2024-02-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47095: - Description: https://github.com/apache/spark/actions/runs/7964626045/job/21742573399 It fails

[jira] [Updated] (SPARK-47095) Uses proper options for command script for macos-14 build

2024-02-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47095: - Summary: Uses proper options for command script for macos-14 build (was: Uses Mac dedicated

[jira] [Assigned] (SPARK-47095) Uses proper options for command script for macos-14 build

2024-02-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47095: Assignee: Hyukjin Kwon > Uses proper options for command script for macos-14 build >

[jira] [Updated] (SPARK-47095) Uses Mac dedicated options for command script for macos-14 build

2024-02-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47095: - Summary: Uses Mac dedicated options for command script for macos-14 build (was: Uses Mac

[jira] [Updated] (SPARK-47095) Uses proper options for command script in macos-14 build

2024-02-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47095: - Summary: Uses proper options for command script in macos-14 build (was: Uses proper options

[jira] [Created] (SPARK-47095) Uses Mac dedicated options for command script

2024-02-19 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47095: Summary: Uses Mac dedicated options for command script Key: SPARK-47095 URL: https://issues.apache.org/jira/browse/SPARK-47095 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47092) Add `getUriBuilder` to `o.a.s.u.Utils` and use it

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47092. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45168

[jira] [Created] (SPARK-47094) SPJ : Dynamically rebalance number of buckets when they are not equal

2024-02-19 Thread Himadri Pal (Jira)
Himadri Pal created SPARK-47094: --- Summary: SPJ : Dynamically rebalance number of buckets when they are not equal Key: SPARK-47094 URL: https://issues.apache.org/jira/browse/SPARK-47094 Project: Spark

[jira] [Updated] (SPARK-37434) Disable unsupported `ExtendedLevelDBTest` on `MacOS/aarch64`

2024-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-37434: --- Labels: pull-request-available (was: ) > Disable unsupported `ExtendedLevelDBTest` on

[jira] [Updated] (SPARK-37434) Disable unsupported `ExtendedLevelDBTest` on `MacOS/aarch64`

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37434: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Test) > Disable unsupported

[jira] [Updated] (SPARK-37434) Disable unsupported `ExtendedLevelDBTest` on `MacOS/aarch64`

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37434: -- Summary: Disable unsupported `ExtendedLevelDBTest` on `MacOS/aarch64` (was: Disable

[jira] [Updated] (SPARK-37434) Disable `ExtendedLevelDBTest` on `MacOS/aarch64`

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37434: -- Affects Version/s: 4.0.0 (was: 3.3.0) > Disable

[jira] [Updated] (SPARK-37434) Disable `ExtendedLevelDBTest` on `MacOS/aarch64`

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37434: -- Summary: Disable `ExtendedLevelDBTest` on `MacOS/aarch64` (was: Add a new profile to auto

[jira] [Updated] (SPARK-37434) Disable `ExtendedLevelDBTest` on `MacOS/aarch64`

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37434: -- Priority: Minor (was: Major) > Disable `ExtendedLevelDBTest` on `MacOS/aarch64` >

[jira] [Updated] (SPARK-37434) Disable `ExtendedLevelDBTest` on `MacOS/aarch64`

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37434: -- Issue Type: Test (was: Improvement) > Disable `ExtendedLevelDBTest` on `MacOS/aarch64` >

[jira] [Updated] (SPARK-47093) Upgrade `mockito` to 5.10.0

2024-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47093: --- Labels: pull-request-available (was: ) > Upgrade `mockito` to 5.10.0 >

[jira] [Commented] (SPARK-46934) Unable to create Hive View from certain Spark Dataframe StructType

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17818565#comment-17818565 ] Dongjoon Hyun commented on SPARK-46934: --- This is resolved at Apache Spark 4.0.0. Do you think

[jira] [Comment Edited] (SPARK-46934) Unable to create Hive View from certain Spark Dataframe StructType

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17818565#comment-17818565 ] Dongjoon Hyun edited comment on SPARK-46934 at 2/19/24 7:57 PM: This is

[jira] [Resolved] (SPARK-46934) Unable to create Hive View from certain Spark Dataframe StructType

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46934. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45039

[jira] [Assigned] (SPARK-46934) Unable to create Hive View from certain Spark Dataframe StructType

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46934: - Assignee: Kent Yao > Unable to create Hive View from certain Spark Dataframe

[jira] [Resolved] (SPARK-44826) Resolve testing timeout issue from Spark Connect

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44826. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45166

[jira] [Assigned] (SPARK-44826) Resolve testing timeout issue from Spark Connect

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44826: - Assignee: Haejoon Lee > Resolve testing timeout issue from Spark Connect >

[jira] [Assigned] (SPARK-47092) Add `getUriBuilder` to `o.a.s.u.Utils` and use it

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47092: - Assignee: Dongjoon Hyun > Add `getUriBuilder` to `o.a.s.u.Utils` and use it >

[jira] [Resolved] (SPARK-47089) Migrate mockito 4 to mockito5

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47089. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45158

[jira] [Assigned] (SPARK-47089) Migrate mockito 4 to mockito5

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47089: - Assignee: BingKun Pan > Migrate mockito 4 to mockito5 > -

[jira] [Updated] (SPARK-47089) Migrate mockito 4 to mockito5

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47089: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Migrate mockito 4 to

[jira] [Updated] (SPARK-47092) Add `getUriBuilder` to `o.a.s.u.Utils` and use it

2024-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47092: --- Labels: pull-request-available (was: ) > Add `getUriBuilder` to `o.a.s.u.Utils` and use it

[jira] [Updated] (SPARK-47092) Add `getUriBuilder` to `o.a.s.u.Utils` and use it

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47092: -- Summary: Add `getUriBuilder` to `o.a.s.u.Utils` and use it (was: Add `getUriBuilder` to

[jira] [Created] (SPARK-47092) Add `getUriBuilder` to `o.a.s.u.Utils`

2024-02-19 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47092: - Summary: Add `getUriBuilder` to `o.a.s.u.Utils` Key: SPARK-47092 URL: https://issues.apache.org/jira/browse/SPARK-47092 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47067) Add Daily Apple Silicon Github Action Job (Java/Scala)

2024-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47067. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45162

[jira] [Resolved] (SPARK-47087) Raise Spark's exception with an error class in config value check

2024-02-19 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-47087. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45156

[jira] [Updated] (SPARK-24578) Reading remote cache block behavior changes and causes timeout issue

2024-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-24578: --- Labels: pull-request-available (was: ) > Reading remote cache block behavior changes and

[jira] [Updated] (SPARK-47088) Utilize BigDecimal to calculate the GPU resource

2024-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47088: --- Labels: pull-request-available (was: ) > Utilize BigDecimal to calculate the GPU resource

[jira] [Updated] (SPARK-44826) Resolve testing timeout issue from Spark Connect

2024-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44826: --- Labels: pull-request-available (was: ) > Resolve testing timeout issue from Spark Connect

[jira] [Resolved] (SPARK-47090) Skip JDK 17/21 Maven build in branch-3.4 scheduled job

2024-02-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47090. -- Resolution: Invalid > Skip JDK 17/21 Maven build in branch-3.4 scheduled job >

[jira] [Created] (SPARK-47091) An error occurs when executing the pyspark program

2024-02-19 Thread jackyjfhu (Jira)
jackyjfhu created SPARK-47091: - Summary: An error occurs when executing the pyspark program Key: SPARK-47091 URL: https://issues.apache.org/jira/browse/SPARK-47091 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-9174) Add documentation for all public SQLConfs

2024-02-19 Thread Nandini (Jira)
[ https://issues.apache.org/jira/browse/SPARK-9174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17818378#comment-17818378 ] Nandini commented on SPARK-9174: Hi Team, I was not able to find the doc for