[jira] [Updated] (SPARK-48094) Reduce GitHub Action usage according to ASF project allowance

[ https://issues.apache.org/jira/browse/SPARK-48094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48094: -- Description: h2. ASF INFRA POLICY - https://infra.apache.org/github-actions-policy.html h2.

[jira] [Updated] (SPARK-48094) Reduce GitHub Action usage according to ASF project allowance

[ https://issues.apache.org/jira/browse/SPARK-48094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48094: -- Attachment: Screenshot 2024-05-02 at 20.59.18.png > Reduce GitHub Action usage according to

[jira] [Assigned] (SPARK-48106) Use `Python 3.11` in `pyspark` tests of `build_and_test.yml`

[ https://issues.apache.org/jira/browse/SPARK-48106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48106: - Assignee: Dongjoon Hyun > Use `Python 3.11` in `pyspark` tests of `build_and_test.yml`

[jira] [Updated] (SPARK-48106) Use `Python 3.11` in `pyspark` tests of `build_and_test.yml`

[ https://issues.apache.org/jira/browse/SPARK-48106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48106: -- Description: - https://docs.python.org/3/whatsnew/3.11.html#summary-release-highlights bq.

[jira] [Updated] (SPARK-48106) Use `Python 3.11` in `pyspark` tests of `build_and_test.yml`

[ https://issues.apache.org/jira/browse/SPARK-48106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48106: -- Description: - https://docs.python.org/3/whatsnew/3.11.html#summary-release-highlights >

[jira] [Created] (SPARK-48106) Use `Python 3.11` in `pyspark` tests of `build_and_test.yml`

Dongjoon Hyun created SPARK-48106: - Summary: Use `Python 3.11` in `pyspark` tests of `build_and_test.yml` Key: SPARK-48106 URL: https://issues.apache.org/jira/browse/SPARK-48106 Project: Spark

[jira] [Assigned] (SPARK-48104) Run `publish_snapshot.yml` once per day

[ https://issues.apache.org/jira/browse/SPARK-48104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48104: - Assignee: Dongjoon Hyun > Run `publish_snapshot.yml` once per day >

[jira] [Resolved] (SPARK-48104) Run `publish_snapshot.yml` once per day

[ https://issues.apache.org/jira/browse/SPARK-48104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48104. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46352

[jira] [Created] (SPARK-48104) Run `publish_snapshot.yml` once per day

Dongjoon Hyun created SPARK-48104: - Summary: Run `publish_snapshot.yml` once per day Key: SPARK-48104 URL: https://issues.apache.org/jira/browse/SPARK-48104 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47671) Enable structured logging in log4j2.properties.template and update `configuration.md`

[ https://issues.apache.org/jira/browse/SPARK-47671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47671. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46349

[jira] [Resolved] (SPARK-48099) Run `maven-build` test only on `Java 21 on MacOS 14 (Apple Silicon)`

[ https://issues.apache.org/jira/browse/SPARK-48099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48099. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46347

[jira] [Assigned] (SPARK-48099) Run `maven-build` test only on `Java 21 on MacOS 14 (Apple Silicon)`

[ https://issues.apache.org/jira/browse/SPARK-48099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48099: - Assignee: Dongjoon Hyun > Run `maven-build` test only on `Java 21 on MacOS 14 (Apple

[jira] [Assigned] (SPARK-48097) Limit GHA job execution time to up to 3 hours in `build_and_test.yml`

[ https://issues.apache.org/jira/browse/SPARK-48097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48097: - Assignee: Dongjoon Hyun > Limit GHA job execution time to up to 3 hours in

[jira] [Resolved] (SPARK-48097) Limit GHA job execution time to up to 3 hours in `build_and_test.yml`

[ https://issues.apache.org/jira/browse/SPARK-48097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48097. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46344

[jira] [Updated] (SPARK-48099) Run `maven-build` test only on `Java 21 on MacOS 14 (Apple Silicon)`

[ https://issues.apache.org/jira/browse/SPARK-48099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48099: -- Description: `Java 21 on MacOS 14` is the fastest Maven test and covers both Java 17 and

[jira] [Updated] (SPARK-48099) Run `maven-build` test only on `Java 21 on MacOS 14 (Apple Silicon)`

[ https://issues.apache.org/jira/browse/SPARK-48099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48099: -- Description: !Screenshot 2024-05-02 at 14.59.14.png!width=100%! > Run `maven-build` test

[jira] [Updated] (SPARK-48099) Run `maven-build` test only on `Java 21 on MacOS 14 (Apple Silicon)`

[ https://issues.apache.org/jira/browse/SPARK-48099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48099: -- Description: !Screenshot 2024-05-02 at 14.59.14.png! (was: !Screenshot 2024-05-02 at

[jira] [Updated] (SPARK-48099) Run `maven-build` test only on `Java 21 on MacOS 14 (Apple Silicon)`

[ https://issues.apache.org/jira/browse/SPARK-48099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48099: -- Description: !Screenshot 2024-05-02 at 14.59.14.png|width=100%! (was: !Screenshot

[jira] [Created] (SPARK-48099) Run `maven-build` test only on `Java 21 on MacOS 14 (Apple Silicon)`

Dongjoon Hyun created SPARK-48099: - Summary: Run `maven-build` test only on `Java 21 on MacOS 14 (Apple Silicon)` Key: SPARK-48099 URL: https://issues.apache.org/jira/browse/SPARK-48099 Project:

[jira] [Updated] (SPARK-48099) Run `maven-build` test only on `Java 21 on MacOS 14 (Apple Silicon)`

[ https://issues.apache.org/jira/browse/SPARK-48099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48099: -- Attachment: Screenshot 2024-05-02 at 14.59.14.png > Run `maven-build` test only on `Java 21

[jira] [Updated] (SPARK-48094) Reduce GitHub Action usage according to ASF project allowance

[ https://issues.apache.org/jira/browse/SPARK-48094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48094: -- Issue Type: Umbrella (was: Task) > Reduce GitHub Action usage according to ASF project

[jira] [Created] (SPARK-48098) Enable `NOLINT_ON_COMPILE` for all except `linter` job

Dongjoon Hyun created SPARK-48098: - Summary: Enable `NOLINT_ON_COMPILE` for all except `linter` job Key: SPARK-48098 URL: https://issues.apache.org/jira/browse/SPARK-48098 Project: Spark

[jira] [Updated] (SPARK-48094) Reduce GitHub Action usage according to ASF project allowance

[ https://issues.apache.org/jira/browse/SPARK-48094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48094: -- Description: h2. ASF INFRA POLICY - https://infra.apache.org/github-actions-policy.html h2.

[jira] [Created] (SPARK-48097) Limit GHA job execution time to up to 3 hours in `build_and_test.yml`

Dongjoon Hyun created SPARK-48097: - Summary: Limit GHA job execution time to up to 3 hours in `build_and_test.yml` Key: SPARK-48097 URL: https://issues.apache.org/jira/browse/SPARK-48097 Project:

[jira] [Assigned] (SPARK-48095) Run `build_non_ansi.yml` once per day

[ https://issues.apache.org/jira/browse/SPARK-48095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48095: - Assignee: Dongjoon Hyun > Run `build_non_ansi.yml` once per day >

[jira] [Resolved] (SPARK-48095) Run `build_non_ansi.yml` once per day

[ https://issues.apache.org/jira/browse/SPARK-48095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48095. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46342

[jira] [Updated] (SPARK-48094) Reduce GitHub Action usage according to ASF project allowance

[ https://issues.apache.org/jira/browse/SPARK-48094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48094: -- Description: h2. ASF INFRA POLICY - https://infra.apache.org/github-actions-policy.html h2.

[jira] [Updated] (SPARK-48094) Reduce GitHub Action usage according to ASF project allowance

[ https://issues.apache.org/jira/browse/SPARK-48094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48094: -- Description: h2. MONITORING [https://infra-reports.apache.org/#ghactions=spark=168] h2.

[jira] [Updated] (SPARK-48094) Reduce GitHub Action usage according to ASF project allowance

[ https://issues.apache.org/jira/browse/SPARK-48094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48094: -- Description: h1. MONITORING [https://infra-reports.apache.org/#ghactions=spark=168] h1.

[jira] [Updated] (SPARK-48094) Reduce GitHub Action usage according to ASF project allowance

[ https://issues.apache.org/jira/browse/SPARK-48094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48094: -- Description: *{*}MONITORING{*}* [https://infra-reports.apache.org/#ghactions=spark=168]

[jira] [Updated] (SPARK-48094) Reduce GitHub Action usage according to ASF project allowance

[ https://issues.apache.org/jira/browse/SPARK-48094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48094: -- Description: h1. MONITORING [https://infra-reports.apache.org/#ghactions=spark=168] h1.

[jira] [Updated] (SPARK-48094) Reduce GitHub Action usage according to ASF project allowance

[ https://issues.apache.org/jira/browse/SPARK-48094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48094: -- Attachment: Screenshot 2024-05-02 at 13.18.42.png > Reduce GitHub Action usage according to

[jira] [Created] (SPARK-48095) Run `build_non_ansi.yml` once per day

Dongjoon Hyun created SPARK-48095: - Summary: Run `build_non_ansi.yml` once per day Key: SPARK-48095 URL: https://issues.apache.org/jira/browse/SPARK-48095 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-48081) Fix ClassCastException in NTile.checkInputDataTypes() when argument is non-foldable or of wrong type

[ https://issues.apache.org/jira/browse/SPARK-48081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48081: -- Fix Version/s: 3.5.2 3.4.4 > Fix ClassCastException in

[jira] [Updated] (SPARK-45988) Fix `pyspark.pandas.tests.computation.test_apply_func` in Python 3.11

[ https://issues.apache.org/jira/browse/SPARK-45988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45988: -- Fix Version/s: 3.4.4 > Fix `pyspark.pandas.tests.computation.test_apply_func` in Python 3.11

[jira] [Updated] (SPARK-45989) Fix `pyspark.pandas.tests.connect.computation.test_parity_apply_func` in Python 3.11

[ https://issues.apache.org/jira/browse/SPARK-45989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45989: -- Fix Version/s: 3.4.4 > Fix `pyspark.pandas.tests.connect.computation.test_parity_apply_func`

[jira] [Updated] (SPARK-48081) Fix ClassCastException in NTile.checkInputDataTypes() when argument is non-foldable or of wrong type

[ https://issues.apache.org/jira/browse/SPARK-48081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48081: -- Fix Version/s: (was: 3.5.2) (was: 3.4.4) > Fix ClassCastException

[jira] [Resolved] (SPARK-48079) Upgrade maven-install/deploy-plugin to 3.1.2

[ https://issues.apache.org/jira/browse/SPARK-48079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48079. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46330

[jira] [Resolved] (SPARK-48081) Fix ClassCastException in NTile.checkInputDataTypes() when argument is non-foldable or of wrong type

[ https://issues.apache.org/jira/browse/SPARK-48081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48081. --- Fix Version/s: 3.4.4 3.5.2 4.0.0 Resolution:

[jira] [Updated] (SPARK-48072) Improve SQLQuerySuite test output - use `===` instead of `sameElements` for Arrays

[ https://issues.apache.org/jira/browse/SPARK-48072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48072: -- Summary: Improve SQLQuerySuite test output - use `===` instead of `sameElements` for Arrays

[jira] [Assigned] (SPARK-48072) Test output is not descriptive for some Array comparisons in SQLQuerySuite

[ https://issues.apache.org/jira/browse/SPARK-48072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48072: - Assignee: Vladimir Golubev > Test output is not descriptive for some Array comparisons

[jira] [Resolved] (SPARK-48072) Test output is not descriptive for some Array comparisons in SQLQuerySuite

[ https://issues.apache.org/jira/browse/SPARK-48072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48072. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46318

[jira] [Resolved] (SPARK-48080) Promote `*MainAppResource` and `NonJVMResource` to `DeveloperApi`

[ https://issues.apache.org/jira/browse/SPARK-48080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48080. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46332

[jira] [Updated] (SPARK-25875) Merge code to set up driver features for different languages

[ https://issues.apache.org/jira/browse/SPARK-25875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25875: -- Fix Version/s: 3.0.0 > Merge code to set up driver features for different languages >

[jira] [Created] (SPARK-48080) Promote `*MainAppResource` and `NonJVMResource` to `DeveloperApi`

Dongjoon Hyun created SPARK-48080: - Summary: Promote `*MainAppResource` and `NonJVMResource` to `DeveloperApi` Key: SPARK-48080 URL: https://issues.apache.org/jira/browse/SPARK-48080 Project: Spark

[jira] [Updated] (SPARK-45923) Spark Kubernetes Operator

[ https://issues.apache.org/jira/browse/SPARK-45923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45923: -- Summary: Spark Kubernetes Operator (was: SPIP: Spark Kubernetes Operator) > Spark Kubernetes

[jira] [Assigned] (SPARK-45923) SPIP: Spark Kubernetes Operator

[ https://issues.apache.org/jira/browse/SPARK-45923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45923: - Assignee: Zhou Jiang > SPIP: Spark Kubernetes Operator >

[jira] [Resolved] (SPARK-48077) Promote `KubernetesClientUtils` to `DeveloperApi`

[ https://issues.apache.org/jira/browse/SPARK-48077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48077. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46327

[jira] [Resolved] (SPARK-48076) Promote `KubernetesVolumeUtils` to `DeveloperApi`

[ https://issues.apache.org/jira/browse/SPARK-48076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48076. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46326

[jira] [Created] (SPARK-48077) Promote `KubernetesClientUtils` to `DeveloperApi`

Dongjoon Hyun created SPARK-48077: - Summary: Promote `KubernetesClientUtils` to `DeveloperApi` Key: SPARK-48077 URL: https://issues.apache.org/jira/browse/SPARK-48077 Project: Spark Issue

[jira] [Created] (SPARK-48076) Promote `KubernetesVolumeUtils` to `DeveloperApi`

Dongjoon Hyun created SPARK-48076: - Summary: Promote `KubernetesVolumeUtils` to `DeveloperApi` Key: SPARK-48076 URL: https://issues.apache.org/jira/browse/SPARK-48076 Project: Spark Issue

[jira] [Updated] (SPARK-43923) Post listenerBus events during ExecutePlanRequest

[ https://issues.apache.org/jira/browse/SPARK-43923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-43923: -- Summary: Post listenerBus events during ExecutePlanRequest (was: [CONNECT] Post listenerBus

[jira] [Updated] (SPARK-47911) Introduces a universal BinaryFormatter to make binary output consistent

[ https://issues.apache.org/jira/browse/SPARK-47911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47911: -- Labels: releasenotes (was: pull-request-available) > Introduces a universal BinaryFormatter

[jira] [Assigned] (SPARK-47911) Introduces a universal BinaryFormatter to make binary output consistent

[ https://issues.apache.org/jira/browse/SPARK-47911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47911: - Assignee: Kent Yao > Introduces a universal BinaryFormatter to make binary output

[jira] [Resolved] (SPARK-47911) Introduces a universal BinaryFormatter to make binary output consistent

[ https://issues.apache.org/jira/browse/SPARK-47911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47911. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46133

[jira] [Updated] (SPARK-47934) Ensure trailing slashes in `HistoryServer` URL redirections

[ https://issues.apache.org/jira/browse/SPARK-47934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47934: -- Summary: Ensure trailing slashes in `HistoryServer` URL redirections (was: Inefficient

[jira] [Updated] (SPARK-47934) Ensure trailing slashes in `HistoryServer` URL redirections

[ https://issues.apache.org/jira/browse/SPARK-47934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47934: -- Parent: SPARK-45869 Issue Type: Sub-task (was: Improvement) > Ensure trailing

[jira] [Updated] (SPARK-47934) Ensure trailing slashes in `HistoryServer` URL redirections

[ https://issues.apache.org/jira/browse/SPARK-47934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47934: -- Affects Version/s: 4.0.0 (was: 3.3.2)

[jira] [Assigned] (SPARK-47934) Inefficient Redirect Handling Due to Missing Trailing Slashes in URL Redirection

[ https://issues.apache.org/jira/browse/SPARK-47934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47934: - Assignee: huangzhir > Inefficient Redirect Handling Due to Missing Trailing Slashes in

[jira] [Resolved] (SPARK-47934) Inefficient Redirect Handling Due to Missing Trailing Slashes in URL Redirection

[ https://issues.apache.org/jira/browse/SPARK-47934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47934. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46157

[jira] [Resolved] (SPARK-48074) Improve the readability of JSON loggings

[ https://issues.apache.org/jira/browse/SPARK-48074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48074. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46322

[jira] [Commented] (SPARK-48016) Fix a bug in try_divide function when with decimals

[ https://issues.apache.org/jira/browse/SPARK-48016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842788#comment-17842788 ] Dongjoon Hyun commented on SPARK-48016: --- This is tested and landed back to branch-3.5 via the

[jira] [Updated] (SPARK-48016) Fix a bug in try_divide function when with decimals

[ https://issues.apache.org/jira/browse/SPARK-48016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48016: -- Fix Version/s: 3.5.2 > Fix a bug in try_divide function when with decimals >

[jira] [Assigned] (SPARK-48070) Support AdaptiveQueryExecSuite to skip check results

[ https://issues.apache.org/jira/browse/SPARK-48070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48070: - Assignee: dzcxzl > Support AdaptiveQueryExecSuite to skip check results >

[jira] [Resolved] (SPARK-48070) Support AdaptiveQueryExecSuite to skip check results

[ https://issues.apache.org/jira/browse/SPARK-48070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48070. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46316

[jira] [Comment Edited] (SPARK-48016) Fix a bug in try_divide function when with decimals

[ https://issues.apache.org/jira/browse/SPARK-48016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842734#comment-17842734 ] Dongjoon Hyun edited comment on SPARK-48016 at 5/1/24 6:21 PM: --- This is

[jira] [Commented] (SPARK-48016) Fix a bug in try_divide function when with decimals

[ https://issues.apache.org/jira/browse/SPARK-48016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842734#comment-17842734 ] Dongjoon Hyun commented on SPARK-48016: --- This is reverted from `branch-3.5` because the

[jira] [Updated] (SPARK-48016) Fix a bug in try_divide function when with decimals

[ https://issues.apache.org/jira/browse/SPARK-48016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48016: -- Fix Version/s: (was: 3.5.2) > Fix a bug in try_divide function when with decimals >

[jira] [Updated] (SPARK-48068) `mypy` should have `--python-executable` parameter

[ https://issues.apache.org/jira/browse/SPARK-48068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48068: -- Description: We assumed that `PYTHON_EXECUTABLE` is used for `dev/lint-python` like the

[jira] [Updated] (SPARK-48068) `mypy` should have `--python-executable` parameter

[ https://issues.apache.org/jira/browse/SPARK-48068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48068: -- Component/s: Project Infra > `mypy` should have `--python-executable` parameter >

[jira] [Resolved] (SPARK-48068) `mypy` should have `--python-executable` parameter

[ https://issues.apache.org/jira/browse/SPARK-48068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48068. --- Fix Version/s: 3.4.4 3.5.2 4.0.0 Resolution:

[jira] [Resolved] (ORC-1707) Fix sun.util.calendar IllegalAccessException when SparkBenchmark runs on JDK17

[ https://issues.apache.org/jira/browse/ORC-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1707. Fix Version/s: 2.0.1 2.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (ORC-1707) Fix sun.util.calendar IllegalAccessException when SparkBenchmark runs on JDK17

[ https://issues.apache.org/jira/browse/ORC-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1707: -- Assignee: dzcxzl > Fix sun.util.calendar IllegalAccessException when SparkBenchmark runs on

[jira] [Updated] (SPARK-48068) `mypy` should have `--python-executable` parameter

[ https://issues.apache.org/jira/browse/SPARK-48068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48068: -- Summary: `mypy` should have `--python-executable` parameter (was: Fix `mypy` failure in

[jira] [Updated] (SPARK-48068) Fix `mypy` failure in Python 3.10 and 3.11

[ https://issues.apache.org/jira/browse/SPARK-48068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48068: -- Description: We assumed that `PYTHON_EXECUTABLE` is used for `dev/lint-python` like the

[jira] [Updated] (SPARK-48068) Fix `mypy` failure in Python 3.10 and 3.11

[ https://issues.apache.org/jira/browse/SPARK-48068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48068: -- Affects Version/s: 3.4.3 3.3.4 3.5.1

[jira] [Updated] (SPARK-48071) Use Python 3.10 in `Python Linter` step

[ https://issues.apache.org/jira/browse/SPARK-48071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48071: -- Issue Type: Improvement (was: Bug) > Use Python 3.10 in `Python Linter` step >

[jira] [Resolved] (SPARK-48069) Handle PEP-632 by checking `ModuleNotFoundError` on `setuptools` in Python 3.12

[ https://issues.apache.org/jira/browse/SPARK-48069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48069. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46315

[jira] [Updated] (SPARK-48069) Handle PEP-632 by checking `ModuleNotFoundError` on `setuptools` in Python 3.12

[ https://issues.apache.org/jira/browse/SPARK-48069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48069: -- Summary: Handle PEP-632 by checking `ModuleNotFoundError` on `setuptools` in Python 3.12

[jira] [Updated] (SPARK-48068) Fix `mypy` failure in Python 3.10 and 3.11

[ https://issues.apache.org/jira/browse/SPARK-48068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48068: -- Summary: Fix `mypy` failure in Python 3.10 and 3.11 (was: Fix `mypy` failure in Python

[jira] [Created] (SPARK-48069) Handle PEP-632 by checking `ModuleNotFoundError` on `setuptools`

Dongjoon Hyun created SPARK-48069: - Summary: Handle PEP-632 by checking `ModuleNotFoundError` on `setuptools` Key: SPARK-48069 URL: https://issues.apache.org/jira/browse/SPARK-48069 Project: Spark

[jira] [Assigned] (SPARK-48069) Handle PEP-632 by checking `ModuleNotFoundError` on `setuptools`

[ https://issues.apache.org/jira/browse/SPARK-48069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48069: - Assignee: Dongjoon Hyun > Handle PEP-632 by checking `ModuleNotFoundError` on

[jira] [Assigned] (SPARK-48068) Fix `mypy` failure in Python 3.10+

[ https://issues.apache.org/jira/browse/SPARK-48068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48068: - Assignee: Dongjoon Hyun > Fix `mypy` failure in Python 3.10+ >

[jira] [Updated] (SPARK-48068) Fix `mypy` failure in Python 3.10+

[ https://issues.apache.org/jira/browse/SPARK-48068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48068: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Bug) > Fix `mypy` failure in Python

[jira] [Updated] (SPARK-48068) Fix `mypy` failure in Python 3.10+

[ https://issues.apache.org/jira/browse/SPARK-48068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48068: -- Description: {code} $ python3 --version Python 3.10.13 $ dev/lint-python --mypy starting

[jira] [Updated] (SPARK-48068) Fix `mypy` failure in Python 3.10+

[ https://issues.apache.org/jira/browse/SPARK-48068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48068: -- Summary: Fix `mypy` failure in Python 3.10+ (was: Fix `mypy` failure in Python 3.10) > Fix

[jira] [Updated] (SPARK-48068) Fix `mypy` failure in Python 3.10

[ https://issues.apache.org/jira/browse/SPARK-48068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48068: -- Description: {code} $ python3 --version Python 3.10.13 $ dev/lint-python --mypy starting

[jira] [Created] (SPARK-48068) Fix `mypy` failure in Python 3.10

Dongjoon Hyun created SPARK-48068: - Summary: Fix `mypy` failure in Python 3.10 Key: SPARK-48068 URL: https://issues.apache.org/jira/browse/SPARK-48068 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-48028) Regenerate benchmark results after turning ANSI on

[ https://issues.apache.org/jira/browse/SPARK-48028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48028. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46266

[jira] [Resolved] (SPARK-48063) Enable `spark.stage.ignoreDecommissionFetchFailure` by default

[ https://issues.apache.org/jira/browse/SPARK-48063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48063. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46308

[jira] [Assigned] (SPARK-48063) Enable `spark.stage.ignoreDecommissionFetchFailure` by default

[ https://issues.apache.org/jira/browse/SPARK-48063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48063: - Assignee: Dongjoon Hyun > Enable `spark.stage.ignoreDecommissionFetchFailure` by

[jira] [Created] (SPARK-48063) Enable `spark.stage.ignoreDecommissionFetchFailure` by default

Dongjoon Hyun created SPARK-48063: - Summary: Enable `spark.stage.ignoreDecommissionFetchFailure` by default Key: SPARK-48063 URL: https://issues.apache.org/jira/browse/SPARK-48063 Project: Spark

[jira] [Updated] (SPARK-48060) Fix StreamingQueryHashPartitionVerifySuite to update golden files correctly

[ https://issues.apache.org/jira/browse/SPARK-48060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48060: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Test) > Fix

[jira] [Resolved] (SPARK-48060) Fix StreamingQueryHashPartitionVerifySuite to update golden files correctly

[ https://issues.apache.org/jira/browse/SPARK-48060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48060. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46304

[jira] [Resolved] (SPARK-48057) Enable `GroupedApplyInPandasTests. test_grouped_with_empty_partition`

[ https://issues.apache.org/jira/browse/SPARK-48057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48057. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46299

[jira] [Resolved] (SPARK-48061) Parameterize max limits of `spark.sql.test.randomDataGenerator`

[ https://issues.apache.org/jira/browse/SPARK-48061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48061. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46305

[jira] [Assigned] (SPARK-48061) Parameterize max limits of `spark.sql.test.randomDataGenerator`

[ https://issues.apache.org/jira/browse/SPARK-48061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48061: - Assignee: Dongjoon Hyun > Parameterize max limits of

[jira] [Updated] (SPARK-48061) Parameterize max limits of `spark.sql.test.randomDataGenerator`

[ https://issues.apache.org/jira/browse/SPARK-48061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48061: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Test) > Parameterize max limits of

[jira] [Created] (SPARK-48061) Parameterize max limits of `spark.sql.test.randomDataGenerator`

Dongjoon Hyun created SPARK-48061: - Summary: Parameterize max limits of `spark.sql.test.randomDataGenerator` Key: SPARK-48061 URL: https://issues.apache.org/jira/browse/SPARK-48061 Project: Spark

[jira] [Created] (SPARK-48060) Fix StreamingQueryHashPartitionVerifySuite to update golden files correctly

Dongjoon Hyun created SPARK-48060: - Summary: Fix StreamingQueryHashPartitionVerifySuite to update golden files correctly Key: SPARK-48060 URL: https://issues.apache.org/jira/browse/SPARK-48060

<    1   2   3   4   5   6   7   8   9   10   >