[jira] [Updated] (SPARK-48072) Improve SQLQuerySuite test output - use `===` instead of `sameElements` for Arrays

[ https://issues.apache.org/jira/browse/SPARK-48072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48072: -- Summary: Improve SQLQuerySuite test output - use `===` instead of `sameElements` for Arrays

[jira] [Assigned] (SPARK-48072) Test output is not descriptive for some Array comparisons in SQLQuerySuite

[ https://issues.apache.org/jira/browse/SPARK-48072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48072: - Assignee: Vladimir Golubev > Test output is not descriptive for some Array comparis

[jira] [Resolved] (SPARK-48072) Test output is not descriptive for some Array comparisons in SQLQuerySuite

[ https://issues.apache.org/jira/browse/SPARK-48072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48072. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46318 [https

[jira] [Resolved] (SPARK-48080) Promote `*MainAppResource` and `NonJVMResource` to `DeveloperApi`

[ https://issues.apache.org/jira/browse/SPARK-48080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48080. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46332 [https

[jira] [Updated] (SPARK-25875) Merge code to set up driver features for different languages

[ https://issues.apache.org/jira/browse/SPARK-25875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25875: -- Fix Version/s: 3.0.0 > Merge code to set up driver features for different langua

[jira] [Created] (SPARK-48080) Promote `*MainAppResource` and `NonJVMResource` to `DeveloperApi`

Dongjoon Hyun created SPARK-48080: - Summary: Promote `*MainAppResource` and `NonJVMResource` to `DeveloperApi` Key: SPARK-48080 URL: https://issues.apache.org/jira/browse/SPARK-48080 Project: Spark

[jira] [Updated] (SPARK-45923) Spark Kubernetes Operator

[ https://issues.apache.org/jira/browse/SPARK-45923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45923: -- Summary: Spark Kubernetes Operator (was: SPIP: Spark Kubernetes Operator) > Spark Kuberne

[jira] [Assigned] (SPARK-45923) SPIP: Spark Kubernetes Operator

[ https://issues.apache.org/jira/browse/SPARK-45923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45923: - Assignee: Zhou Jiang > SPIP: Spark Kubernetes Opera

[jira] [Resolved] (SPARK-48077) Promote `KubernetesClientUtils` to `DeveloperApi`

[ https://issues.apache.org/jira/browse/SPARK-48077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48077. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46327 [https

[jira] [Resolved] (SPARK-48076) Promote `KubernetesVolumeUtils` to `DeveloperApi`

[ https://issues.apache.org/jira/browse/SPARK-48076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48076. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46326 [https

[jira] [Created] (SPARK-48077) Promote `KubernetesClientUtils` to `DeveloperApi`

Dongjoon Hyun created SPARK-48077: - Summary: Promote `KubernetesClientUtils` to `DeveloperApi` Key: SPARK-48077 URL: https://issues.apache.org/jira/browse/SPARK-48077 Project: Spark Issue

[jira] [Created] (SPARK-48076) Promote `KubernetesVolumeUtils` to `DeveloperApi`

Dongjoon Hyun created SPARK-48076: - Summary: Promote `KubernetesVolumeUtils` to `DeveloperApi` Key: SPARK-48076 URL: https://issues.apache.org/jira/browse/SPARK-48076 Project: Spark Issue

[jira] [Updated] (SPARK-43923) Post listenerBus events during ExecutePlanRequest

[ https://issues.apache.org/jira/browse/SPARK-43923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-43923: -- Summary: Post listenerBus events during ExecutePlanRequest (was: [CONNECT] Post listenerBus

[jira] [Updated] (SPARK-47911) Introduces a universal BinaryFormatter to make binary output consistent

[ https://issues.apache.org/jira/browse/SPARK-47911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47911: -- Labels: releasenotes (was: pull-request-available) > Introduces a universal BinaryFormat

[jira] [Assigned] (SPARK-47911) Introduces a universal BinaryFormatter to make binary output consistent

[ https://issues.apache.org/jira/browse/SPARK-47911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47911: - Assignee: Kent Yao > Introduces a universal BinaryFormatter to make binary out

[jira] [Resolved] (SPARK-47911) Introduces a universal BinaryFormatter to make binary output consistent

[ https://issues.apache.org/jira/browse/SPARK-47911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47911. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46133 [https

[jira] [Updated] (SPARK-47934) Ensure trailing slashes in `HistoryServer` URL redirections

[ https://issues.apache.org/jira/browse/SPARK-47934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47934: -- Summary: Ensure trailing slashes in `HistoryServer` URL redirections (was: Inefficient

[jira] [Updated] (SPARK-47934) Ensure trailing slashes in `HistoryServer` URL redirections

[ https://issues.apache.org/jira/browse/SPARK-47934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47934: -- Parent: SPARK-45869 Issue Type: Sub-task (was: Improvement) > Ensure trail

[jira] [Updated] (SPARK-47934) Ensure trailing slashes in `HistoryServer` URL redirections

[ https://issues.apache.org/jira/browse/SPARK-47934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47934: -- Affects Version/s: 4.0.0 (was: 3.3.2

[jira] [Assigned] (SPARK-47934) Inefficient Redirect Handling Due to Missing Trailing Slashes in URL Redirection

[ https://issues.apache.org/jira/browse/SPARK-47934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47934: - Assignee: huangzhir > Inefficient Redirect Handling Due to Missing Trailing Slas

[jira] [Resolved] (SPARK-47934) Inefficient Redirect Handling Due to Missing Trailing Slashes in URL Redirection

[ https://issues.apache.org/jira/browse/SPARK-47934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47934. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46157 [https

[jira] [Resolved] (SPARK-48074) Improve the readability of JSON loggings

[ https://issues.apache.org/jira/browse/SPARK-48074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48074. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46322 [https

[jira] [Commented] (SPARK-48016) Fix a bug in try_divide function when with decimals

[ https://issues.apache.org/jira/browse/SPARK-48016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842788#comment-17842788 ] Dongjoon Hyun commented on SPARK-48016: --- This is tested and landed back to branch-3.5 via

[jira] [Updated] (SPARK-48016) Fix a bug in try_divide function when with decimals

[ https://issues.apache.org/jira/browse/SPARK-48016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48016: -- Fix Version/s: 3.5.2 > Fix a bug in try_divide function when with decim

[jira] [Assigned] (SPARK-48070) Support AdaptiveQueryExecSuite to skip check results

[ https://issues.apache.org/jira/browse/SPARK-48070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48070: - Assignee: dzcxzl > Support AdaptiveQueryExecSuite to skip check resu

[jira] [Resolved] (SPARK-48070) Support AdaptiveQueryExecSuite to skip check results

[ https://issues.apache.org/jira/browse/SPARK-48070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48070. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46316 [https

[jira] [Comment Edited] (SPARK-48016) Fix a bug in try_divide function when with decimals

[ https://issues.apache.org/jira/browse/SPARK-48016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842734#comment-17842734 ] Dongjoon Hyun edited comment on SPARK-48016 at 5/1/24 6:21 PM

[jira] [Commented] (SPARK-48016) Fix a bug in try_divide function when with decimals

[ https://issues.apache.org/jira/browse/SPARK-48016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842734#comment-17842734 ] Dongjoon Hyun commented on SPARK-48016: --- This is reverted from `branch-3.5` because the cherry

[jira] [Updated] (SPARK-48016) Fix a bug in try_divide function when with decimals

[ https://issues.apache.org/jira/browse/SPARK-48016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48016: -- Fix Version/s: (was: 3.5.2) > Fix a bug in try_divide function when with decim

[jira] [Updated] (SPARK-48068) `mypy` should have `--python-executable` parameter

[ https://issues.apache.org/jira/browse/SPARK-48068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48068: -- Description: We assumed that `PYTHON_EXECUTABLE` is used for `dev/lint-python` like

[jira] [Updated] (SPARK-48068) `mypy` should have `--python-executable` parameter

[ https://issues.apache.org/jira/browse/SPARK-48068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48068: -- Component/s: Project Infra > `mypy` should have `--python-executable` parame

[jira] [Resolved] (SPARK-48068) `mypy` should have `--python-executable` parameter

[ https://issues.apache.org/jira/browse/SPARK-48068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48068. --- Fix Version/s: 3.4.4 3.5.2 4.0.0 Resolution

[jira] [Resolved] (ORC-1707) Fix sun.util.calendar IllegalAccessException when SparkBenchmark runs on JDK17

[ https://issues.apache.org/jira/browse/ORC-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1707. Fix Version/s: 2.0.1 2.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (ORC-1707) Fix sun.util.calendar IllegalAccessException when SparkBenchmark runs on JDK17

[ https://issues.apache.org/jira/browse/ORC-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1707: -- Assignee: dzcxzl > Fix sun.util.calendar IllegalAccessException when SparkBenchmark r

Re: [DISCUSS] Spark 4.0.0 release

es targeting the Delta 4.0 release are still incomplete. >>> >>> Thanks! >>> >>> >>> On Wed, Apr 17, 2024 at 8:35 AM Wenchen Fan wrote: >>> >>>> Thank you all for the replies! >>>> >>>> To @Nicholas Chammas : Th

[jira] [Updated] (SPARK-48068) `mypy` should have `--python-executable` parameter

[ https://issues.apache.org/jira/browse/SPARK-48068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48068: -- Summary: `mypy` should have `--python-executable` parameter (was: Fix `mypy` failure

[jira] [Updated] (SPARK-48068) Fix `mypy` failure in Python 3.10 and 3.11

[ https://issues.apache.org/jira/browse/SPARK-48068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48068: -- Description: We assumed that `PYTHON_EXECUTABLE` is used for `dev/lint-python` like

[jira] [Updated] (SPARK-48068) Fix `mypy` failure in Python 3.10 and 3.11

[ https://issues.apache.org/jira/browse/SPARK-48068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48068: -- Affects Version/s: 3.4.3 3.3.4 3.5.1

[jira] [Updated] (SPARK-48071) Use Python 3.10 in `Python Linter` step

[ https://issues.apache.org/jira/browse/SPARK-48071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48071: -- Issue Type: Improvement (was: Bug) > Use Python 3.10 in `Python Linter` s

[jira] [Resolved] (SPARK-48069) Handle PEP-632 by checking `ModuleNotFoundError` on `setuptools` in Python 3.12

[ https://issues.apache.org/jira/browse/SPARK-48069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48069. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46315 [https

[jira] [Updated] (SPARK-48069) Handle PEP-632 by checking `ModuleNotFoundError` on `setuptools` in Python 3.12

[ https://issues.apache.org/jira/browse/SPARK-48069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48069: -- Summary: Handle PEP-632 by checking `ModuleNotFoundError` on `setuptools` in Python 3.12

[jira] [Updated] (SPARK-48068) Fix `mypy` failure in Python 3.10 and 3.11

[ https://issues.apache.org/jira/browse/SPARK-48068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48068: -- Summary: Fix `mypy` failure in Python 3.10 and 3.11 (was: Fix `mypy` failure in Python 3.10

[jira] [Created] (SPARK-48069) Handle PEP-632 by checking `ModuleNotFoundError` on `setuptools`

Dongjoon Hyun created SPARK-48069: - Summary: Handle PEP-632 by checking `ModuleNotFoundError` on `setuptools` Key: SPARK-48069 URL: https://issues.apache.org/jira/browse/SPARK-48069 Project: Spark

[jira] [Assigned] (SPARK-48069) Handle PEP-632 by checking `ModuleNotFoundError` on `setuptools`

[ https://issues.apache.org/jira/browse/SPARK-48069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48069: - Assignee: Dongjoon Hyun > Handle PEP-632 by checking `ModuleNotFoundEr

[jira] [Assigned] (SPARK-48068) Fix `mypy` failure in Python 3.10+

[ https://issues.apache.org/jira/browse/SPARK-48068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48068: - Assignee: Dongjoon Hyun > Fix `mypy` failure in Python 3

[jira] [Updated] (SPARK-48068) Fix `mypy` failure in Python 3.10+

[ https://issues.apache.org/jira/browse/SPARK-48068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48068: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Bug) > Fix `mypy` failure in Pyt

[jira] [Updated] (SPARK-48068) Fix `mypy` failure in Python 3.10+

[ https://issues.apache.org/jira/browse/SPARK-48068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48068: -- Description: {code} $ python3 --version Python 3.10.13 $ dev/lint-python --mypy starting

[jira] [Updated] (SPARK-48068) Fix `mypy` failure in Python 3.10+

[ https://issues.apache.org/jira/browse/SPARK-48068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48068: -- Summary: Fix `mypy` failure in Python 3.10+ (was: Fix `mypy` failure in Python 3.10) >

[jira] [Updated] (SPARK-48068) Fix `mypy` failure in Python 3.10

[ https://issues.apache.org/jira/browse/SPARK-48068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48068: -- Description: {code} $ python3 --version Python 3.10.13 $ dev/lint-python --mypy starting

[jira] [Created] (SPARK-48068) Fix `mypy` failure in Python 3.10

Dongjoon Hyun created SPARK-48068: - Summary: Fix `mypy` failure in Python 3.10 Key: SPARK-48068 URL: https://issues.apache.org/jira/browse/SPARK-48068 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-48028) Regenerate benchmark results after turning ANSI on

[ https://issues.apache.org/jira/browse/SPARK-48028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48028. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46266 [https

[jira] [Resolved] (SPARK-48063) Enable `spark.stage.ignoreDecommissionFetchFailure` by default

[ https://issues.apache.org/jira/browse/SPARK-48063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48063. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46308 [https

[jira] [Assigned] (SPARK-48063) Enable `spark.stage.ignoreDecommissionFetchFailure` by default

[ https://issues.apache.org/jira/browse/SPARK-48063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48063: - Assignee: Dongjoon Hyun > Enable `spark.stage.ignoreDecommissionFetchFail

[jira] [Created] (SPARK-48063) Enable `spark.stage.ignoreDecommissionFetchFailure` by default

Dongjoon Hyun created SPARK-48063: - Summary: Enable `spark.stage.ignoreDecommissionFetchFailure` by default Key: SPARK-48063 URL: https://issues.apache.org/jira/browse/SPARK-48063 Project: Spark

[jira] [Updated] (SPARK-48060) Fix StreamingQueryHashPartitionVerifySuite to update golden files correctly

[ https://issues.apache.org/jira/browse/SPARK-48060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48060: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Test) >

[jira] [Resolved] (SPARK-48060) Fix StreamingQueryHashPartitionVerifySuite to update golden files correctly

[ https://issues.apache.org/jira/browse/SPARK-48060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48060. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46304 [https

[jira] [Resolved] (SPARK-48057) Enable `GroupedApplyInPandasTests. test_grouped_with_empty_partition`

[ https://issues.apache.org/jira/browse/SPARK-48057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48057. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46299 [https

[jira] [Resolved] (SPARK-48061) Parameterize max limits of `spark.sql.test.randomDataGenerator`

[ https://issues.apache.org/jira/browse/SPARK-48061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48061. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46305 [https

[jira] [Assigned] (SPARK-48061) Parameterize max limits of `spark.sql.test.randomDataGenerator`

[ https://issues.apache.org/jira/browse/SPARK-48061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48061: - Assignee: Dongjoon Hyun > Parameterize max lim

[jira] [Updated] (SPARK-48061) Parameterize max limits of `spark.sql.test.randomDataGenerator`

[ https://issues.apache.org/jira/browse/SPARK-48061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48061: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Test) > Parameterize max lim

[jira] [Created] (SPARK-48061) Parameterize max limits of `spark.sql.test.randomDataGenerator`

Dongjoon Hyun created SPARK-48061: - Summary: Parameterize max limits of `spark.sql.test.randomDataGenerator` Key: SPARK-48061 URL: https://issues.apache.org/jira/browse/SPARK-48061 Project: Spark

[jira] [Created] (SPARK-48060) Fix StreamingQueryHashPartitionVerifySuite to update golden files correctly

Dongjoon Hyun created SPARK-48060: - Summary: Fix StreamingQueryHashPartitionVerifySuite to update golden files correctly Key: SPARK-48060 URL: https://issues.apache.org/jira/browse/SPARK-48060

[jira] [Resolved] (SPARK-46122) Set `spark.sql.legacy.createHiveTableByDefault` to `false` by default

[ https://issues.apache.org/jira/browse/SPARK-46122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46122. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46207 [https

[VOTE][RESULT] SPARK-46122: Set spark.sql.legacy.createHiveTableByDefault to false

The vote passes with 11 +1s (6 binding +1s) and one -1. Thanks to all who helped with the vote! (* = binding) +1: - Dongjoon Hyun * - Gengliang Wang * - Liang-Chi Hsieh * - Holden Karau * - Zhou Jiang - Cheng Pan - Hyukjin Kwon * - DB Tsai * - Ye Xianjin - XiDuo You - Nimrod Ofek +0: None -1

[jira] [Commented] (SPARK-48016) Fix a bug in try_divide function when with decimals

[ https://issues.apache.org/jira/browse/SPARK-48016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842200#comment-17842200 ] Dongjoon Hyun commented on SPARK-48016: --- Thank you so much! > Fix a bug in try_divide funct

[jira] [Commented] (SPARK-48016) Fix a bug in try_divide function when with decimals

[ https://issues.apache.org/jira/browse/SPARK-48016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842191#comment-17842191 ] Dongjoon Hyun commented on SPARK-48016: --- Hi, [~Gengliang.Wang] . - I updated the JIRA title

[jira] [Updated] (SPARK-48016) Fix a bug in try_divide function when with decimals

[ https://issues.apache.org/jira/browse/SPARK-48016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48016: -- Summary: Fix a bug in try_divide function when with decimals (was: Binary Arithmetic

Re: [DISCUSS] SPARK-46122: Set spark.sql.legacy.createHiveTableByDefault to false

sand > expert opinions (Werner <https://en.wikipedia.org/wiki/Wernher_von_Braun>Von > Braun <https://en.wikipedia.org/wiki/Wernher_von_Braun>)". > > > On Mon, 29 Apr 2024 at 17:32, Dongjoon Hyun wrote: > > > It's a surprise to me to see t

[jira] [Resolved] (SPARK-48042) Don't use a copy of timestamp formatter with a new override zone for each value

[ https://issues.apache.org/jira/browse/SPARK-48042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48042. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46282 [https

[jira] [Resolved] (SPARK-48044) Cache `DataFrame.isStreaming`

[ https://issues.apache.org/jira/browse/SPARK-48044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48044. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46281 [https

[jira] [Resolved] (SPARK-48046) Remove `clock` parameter from `DriverServiceFeatureStep`

[ https://issues.apache.org/jira/browse/SPARK-48046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48046. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46284 [https

[jira] [Assigned] (SPARK-48046) Remove `clock` parameter from `DriverServiceFeatureStep`

[ https://issues.apache.org/jira/browse/SPARK-48046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48046: - Assignee: Dongjoon Hyun > Remove `clock` parameter from `DriverServiceFeatureS

Re: [DISCUSS] SPARK-46122: Set spark.sql.legacy.createHiveTableByDefault to false

t; 1) Hive provides a more mature and widely adopted catalog >>>>>>>>>>> solution that integrates well with other components in the Hadoop >>>>>>>>>>> ecosystem, such as HDFS, HBase, and YARN. IIf you are Hadoop >&g

[jira] [Created] (SPARK-48046) Remove `clock` parameter from `DriverServiceFeatureStep`

Dongjoon Hyun created SPARK-48046: - Summary: Remove `clock` parameter from `DriverServiceFeatureStep` Key: SPARK-48046 URL: https://issues.apache.org/jira/browse/SPARK-48046 Project: Spark

[jira] [Assigned] (SPARK-48038) Promote driverServiceName to KubernetesDriverConf

[ https://issues.apache.org/jira/browse/SPARK-48038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48038: - Assignee: Cheng Pan > Promote driverServiceName to KubernetesDriverC

[jira] [Resolved] (SPARK-48038) Promote driverServiceName to KubernetesDriverConf

[ https://issues.apache.org/jira/browse/SPARK-48038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48038. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46276 [https

[jira] [Resolved] (SPARK-48036) Update `sql-ref-ansi-compliance.md` and `sql-ref-identifier.md`

[ https://issues.apache.org/jira/browse/SPARK-48036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48036. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46271 [https

[jira] [Resolved] (SPARK-48029) Update the packages name removed in building the spark docker image

[ https://issues.apache.org/jira/browse/SPARK-48029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48029. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46258 [https

[jira] [Assigned] (SPARK-48029) Update the packages name removed in building the spark docker image

[ https://issues.apache.org/jira/browse/SPARK-48029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48029: - Assignee: BingKun Pan > Update the packages name removed in building the spark doc

[jira] [Created] (SPARK-48036) Update `sql-ref-ansi-compliance.md` and `sql-ref-identifier.md`

Dongjoon Hyun created SPARK-48036: - Summary: Update `sql-ref-ansi-compliance.md` and `sql-ref-identifier.md` Key: SPARK-48036 URL: https://issues.apache.org/jira/browse/SPARK-48036 Project: Spark

[jira] [Resolved] (SPARK-48032) Upgrade `commons-codec` to 1.17.0

[ https://issues.apache.org/jira/browse/SPARK-48032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48032. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46268 [https

[jira] [Updated] (SPARK-47730) Support APP_ID and EXECUTOR_ID placeholder in labels

[ https://issues.apache.org/jira/browse/SPARK-47730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47730: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Support APP

[jira] [Resolved] (SPARK-47730) Support APP_ID and EXECUTOR_ID placeholder in labels

[ https://issues.apache.org/jira/browse/SPARK-47730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47730. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46149 [https

[jira] [Assigned] (SPARK-47730) Support APP_ID and EXECUTOR_ID placeholder in labels

[ https://issues.apache.org/jira/browse/SPARK-47730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47730: - Assignee: Xi Chen > Support APP_ID and EXECUTOR_ID placeholder in lab

[jira] [Assigned] (SPARK-48021) Add `--add-modules=jdk.incubator.vector` to `JavaModuleOptions`

[ https://issues.apache.org/jira/browse/SPARK-48021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48021: - Assignee: BingKun Pan > Add `--add-modules=jdk.incubator.vector` to `JavaModuleOpti

[jira] [Resolved] (SPARK-48021) Add `--add-modules=jdk.incubator.vector` to `JavaModuleOptions`

[ https://issues.apache.org/jira/browse/SPARK-48021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48021. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46246 [https

[jira] [Resolved] (SPARK-47408) Fix mathExpressions that use StringType

[ https://issues.apache.org/jira/browse/SPARK-47408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47408. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46227 [https

[jira] [Updated] (SPARK-47943) Add Operator CI Task for Java Build and Test

[ https://issues.apache.org/jira/browse/SPARK-47943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47943: -- Fix Version/s: kubernetes-operator-0.1.0 (was: 4.0.0) > Add Opera

[jira] [Assigned] (SPARK-48015) Update `build.gradle` to fix deprecation warnings

[ https://issues.apache.org/jira/browse/SPARK-48015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48015: - Assignee: Dongjoon Hyun > Update `build.gradle` to fix deprecation warni

[jira] [Resolved] (SPARK-48015) Update `build.gradle` to fix deprecation warnings

[ https://issues.apache.org/jira/browse/SPARK-48015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48015. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 9 [https

[jira] [Updated] (SPARK-47929) Setup Static Analysis for Operator

[ https://issues.apache.org/jira/browse/SPARK-47929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47929: -- Fix Version/s: kubernetes-operator-0.1.0 (was: 4.0.0) > Setup Sta

[jira] [Updated] (SPARK-47950) Add Java API Module for Spark Operator

[ https://issues.apache.org/jira/browse/SPARK-47950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47950: -- Fix Version/s: kubernetes-operator-0.1.0 (was: 4.0.0) > Add Java

[jira] [Updated] (SPARK-48015) Update `build.gradle` to fix deprecation warnings

[ https://issues.apache.org/jira/browse/SPARK-48015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48015: -- Fix Version/s: kubernetes-operator-0.1.0 (was: 4.0.0) > Upd

[jira] [Created] (SPARK-48015) Update `build.gradle` to fix deprecation warnings

Dongjoon Hyun created SPARK-48015: - Summary: Update `build.gradle` to fix deprecation warnings Key: SPARK-48015 URL: https://issues.apache.org/jira/browse/SPARK-48015 Project: Spark Issue

[jira] [Assigned] (SPARK-47950) Add Java API Module for Spark Operator

[ https://issues.apache.org/jira/browse/SPARK-47950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47950: - Assignee: Zhou JIANG > Add Java API Module for Spark Opera

[jira] [Resolved] (SPARK-47950) Add Java API Module for Spark Operator

[ https://issues.apache.org/jira/browse/SPARK-47950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47950. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 8 [https

[jira] [Resolved] (SPARK-48010) Avoid repeated calls to conf.resolver in resolveExpression

[ https://issues.apache.org/jira/browse/SPARK-48010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48010. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46248 [https

[jira] [Assigned] (SPARK-46122) Set `spark.sql.legacy.createHiveTableByDefault` to `false` by default

[ https://issues.apache.org/jira/browse/SPARK-46122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46122: - Assignee: Dongjoon Hyun > Set `spark.sql.legacy.createHiveTableByDefault` to `fa

[jira] [Resolved] (SPARK-48005) Enable `DefaultIndexParityTests. test_index_distributed_sequence_cleanup`

[ https://issues.apache.org/jira/browse/SPARK-48005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48005. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46242 [https

Re: [VOTE] SPARK-46122: Set spark.sql.legacy.createHiveTableByDefault to false

I'll start with my +1. Dongjoon. On 2024/04/26 16:45:51 Dongjoon Hyun wrote: > Please vote on SPARK-46122 to set spark.sql.legacy.createHiveTableByDefault > to `false` by default. The technical scope is defined in the following PR. > > - DISCUSSION: > https://lists.ap

<    1   2   3   4   5   6   7   8   9   10   >