(spark) branch master updated: [SPARK-48116][INFRA] Run `pyspark-pandas*` only in PR builder and Daily Python CIs

2024-05-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1904dee475d7 [SPARK-48116][INFRA] Run `pyspark

(spark) branch master updated: [SPARK-48056][PYTHON][CONNECT][FOLLOW-UP] Use `assertEqual` instead of `assertEquals` for Python 3.12

2024-05-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new be998221fc93 [SPARK-48056][PYTHON][CONNECT

(spark) branch master updated: [SPARK-47969][PYTHON][TESTS][FOLLOWUP] Make Test `test_creation_index` deterministic

2024-05-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5d1f976f85fe [SPARK-47969][PYTHON][TESTS

(spark) branch master updated: [SPARK-47097][CONNECT][TESTS][FOLLOWUP] Increase timeout to `1 minute` for `interrupt tag` test

2024-05-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7f08df4af95d [SPARK-47097][CONNECT][TESTS

(spark) branch master updated: [SPARK-48121][K8S] Promote `KubernetesDriverConf` to `DeveloperApi`

2024-05-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c3a462ce2966 [SPARK-48121][K8S] Promote

(spark-kubernetes-operator) branch main updated: [SPARK-48120] Enable autolink to SPARK jira issue

2024-05-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/spark-kubernetes-operator.git The following commit(s) were added to refs/heads/main by this push: new 91ecc93 [SPARK-48120] Enable

(spark) branch master updated (85902880d709 -> b42d235c2930)

2024-05-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 85902880d709 [SPARK-48119][K8S] Promote `KubernetesDriverSpec` to `DeveloperApi` add b42d235c2930 [SPARK-48114

(spark) branch master updated: [SPARK-48119][K8S] Promote `KubernetesDriverSpec` to `DeveloperApi`

2024-05-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 85902880d709 [SPARK-48119][K8S] Promote

(spark) branch master updated (aa00b00c18e6 -> d6ca2c5c3c4b)

2024-05-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from aa00b00c18e6 [SPARK-48115][INFRA] Remove `Python 3.11` from `build_python.yml` add d6ca2c5c3c4b [SPARK-48118

(spark) branch master updated: [SPARK-48115][INFRA] Remove `Python 3.11` from `build_python.yml`

2024-05-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new aa00b00c18e6 [SPARK-48115][INFRA] Remove

(spark) branch master updated: [SPARK-48088][PYTHON][CONNECT][TESTS] Prepare backward compatibility test 4.0 <> above

2024-05-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new cd789acb5e51 [SPARK-48088][PYTHON][CONNECT

(spark) branch master updated: [SPARK-48111][INFRA] Disable Docker integration test and TPC-DS in commit builder

2024-05-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2d346fbb9c5c [SPARK-48111][INFRA] Disable

(spark) branch master updated: [SPARK-48110][INFRA] Remove all Maven compilation build

2024-05-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new defda8663c05 [SPARK-48110][INFRA] Remove all

(spark) branch master updated: [SPARK-48107][PYTHON] Exclude tests from Python distribution

2024-05-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8d70f4ba5396 [SPARK-48107][PYTHON] Exclude

(spark) branch master updated: [SPARK-48106][INFRA] Use `Python 3.11` in `pyspark` tests of `build_and_test.yml`

2024-05-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ddc1f6b2a466 [SPARK-48106][INFRA] Use `Python

(spark) branch master updated (63837020ed29 -> f044748efeac)

2024-05-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 63837020ed29 [SPARK-48109][INFRA] Enable `k8s-integration-tests` only for `kubernetes` module change add

(spark) branch master updated: [SPARK-48109][INFRA] Enable `k8s-integration-tests` only for `kubernetes` module change

2024-05-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 63837020ed29 [SPARK-48109][INFRA] Enable `k8s

(spark) branch master updated: [SPARK-48108][INFRA] Skip `tpcds-1g` and `docker-integration-tests` tests from `RocksDB UI-Backend` job

2024-05-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 111df27d21ee [SPARK-48108][INFRA] Skip `tpcds

(spark) branch master updated: [SPARK-48104][INFRA] Run `publish_snapshot.yml` once per day

2024-05-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7b472e30db99 [SPARK-48104][INFRA] Run

(spark) branch master updated: [SPARK-47671][CORE] Enable structured logging in log4j2.properties.template and update docs

2024-05-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c6696cdcd611 [SPARK-47671][CORE] Enable

(spark) branch master updated (7f6a1399a56b -> 8d9e7c9c6623)

2024-05-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 7f6a1399a56b [SPARK-48098][INFRA] Enable `NOLINT_ON_COMPILE` for all except `lint` job add 8d9e7c9c6623 [SPARK

(spark) branch master updated: [SPARK-48098][INFRA] Enable `NOLINT_ON_COMPILE` for all except `lint` job

2024-05-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7f6a1399a56b [SPARK-48098][INFRA] Enable

(spark) branch master updated: [SPARK-48097][INFRA] Limit GHA job execution time to up to 3 hours in `build_and_test.yml`

2024-05-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1321dd604480 [SPARK-48097][INFRA] Limit GHA

(spark) branch master updated: [SPARK-48096][INFRA] Run `build_maven_java21_macos14.yml` every two days

2024-05-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 53d4cdb4eefa [SPARK-48096][INFRA] Run

(spark) branch master updated: [SPARK-48095][INFRA] Run `build_non_ansi.yml` once per day

2024-05-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 48df28f6b311 [SPARK-48095][INFRA] Run

(spark) branch branch-3.4 updated: [SPARK-48081][SQL][3.4] Fix ClassCastException in NTile.checkInputDataTypes() when argument is non-foldable or of wrong type

2024-05-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 681a1de72bdf [SPARK-48081][SQL][3.4

(spark) branch branch-3.5 updated: [SPARK-48081][SQL][3.5] Fix ClassCastException in NTile.checkInputDataTypes() when argument is non-foldable or of wrong type

2024-05-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 9cd312574e97 [SPARK-48081][SQL][3.5

(spark) branch branch-3.4 updated: [SPARK-45988][SPARK-45989][PYTHON] Fix typehints to handle `list` GenericAlias in Python 3.11+

2024-05-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new a75c93be9c0a [SPARK-45988][SPARK-45989

(spark) branch branch-3.4 updated: Revert "[SPARK-48081] Fix ClassCastException in NTile.checkInputDataTypes() when argument is non-foldable or of wrong type"

2024-05-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 4baf5ee19ba4 Revert "[SPARK-48081

(spark) branch branch-3.5 updated: Revert "[SPARK-48081] Fix ClassCastException in NTile.checkInputDataTypes() when argument is non-foldable or of wrong type"

2024-05-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new d82403f98033 Revert "[SPARK-48081

(spark) branch master updated (b99a64b0fd1c -> bf1300835503)

2024-05-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from b99a64b0fd1c [SPARK-48081] Fix ClassCastException in NTile.checkInputDataTypes() when argument is non-foldable

(spark) branch branch-3.4 updated: [SPARK-48081] Fix ClassCastException in NTile.checkInputDataTypes() when argument is non-foldable or of wrong type

2024-05-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 32789ba3bbaa [SPARK-48081] Fix

(spark) branch branch-3.5 updated: [SPARK-48081] Fix ClassCastException in NTile.checkInputDataTypes() when argument is non-foldable or of wrong type

2024-05-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 3d72063ccec6 [SPARK-48081] Fix

(spark) branch master updated: [SPARK-48081] Fix ClassCastException in NTile.checkInputDataTypes() when argument is non-foldable or of wrong type

2024-05-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b99a64b0fd1c [SPARK-48081] Fix

(spark) branch master updated: [SPARK-48072][SQL][TESTS] Improve SQLQuerySuite test output - use `===` instead of `sameElements` for Arrays

2024-05-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5bbbc6c25bb7 [SPARK-48072][SQL][TESTS] Improve

(spark) branch master updated: [SPARK-48080][K8S] Promote `*MainAppResource` and `NonJVMResource` to `DeveloperApi`

2024-05-01 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 66e2a350fc55 [SPARK-48080][K8S] Promote

(spark) branch master updated: [SPARK-48078][K8S] Promote `o.a.s.d.k8s.Constants` to `DeveloperApi`

2024-05-01 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4b16238784e0 [SPARK-48078][K8S] Promote

(spark) branch master updated: [SPARK-48077][K8S] Promote `KubernetesClientUtils` to `DeveloperApi`

2024-05-01 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a42eef9e029a [SPARK-48077][K8S] Promote

(spark) branch master updated (04f3a938895c -> 0fc7c4a29c46)

2024-05-01 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 04f3a938895c [SPARK-48076][K8S] Promote `KubernetesVolumeUtils` to `DeveloperApi` add 0fc7c4a29c46 [SPARK

(spark) branch master updated (e521d3c1f357 -> 04f3a938895c)

2024-05-01 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from e521d3c1f357 [MINOR] Fix the grammar of some comments on renaming error classes add 04f3a938895c [SPARK-48076

(spark) branch master updated (69ea082fc69a -> fd57c3493af7)

2024-05-01 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 69ea082fc69a [SPARK-47934][CORE] Ensure trailing slashes in `HistoryServer` URL redirections add fd57c3493af7

(spark) branch master updated (5ac803079b30 -> 69ea082fc69a)

2024-05-01 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 5ac803079b30 [SPARK-48074][CORE] Improve the readability of JSON loggings add 69ea082fc69a [SPARK-47934][CORE

(spark) branch master updated (35767bb09fe1 -> 5ac803079b30)

2024-05-01 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 35767bb09fe1 [SPARK-48070][SQL][TESTS] Support `AdaptiveQueryExecSuite.runAdaptiveAndVerifyResult` to skip check

(spark) branch master updated: [SPARK-48070][SQL][TESTS] Support `AdaptiveQueryExecSuite.runAdaptiveAndVerifyResult` to skip check results

2024-05-01 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 35767bb09fe1 [SPARK-48070][SQL][TESTS] Support

(spark) branch master updated: [SPARK-46009][SQL][FOLLOWUP] Remove unused PERCENTILE_CONT and PERCENTILE_DISC in g4

2024-05-01 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ad63eef20617 [SPARK-46009][SQL][FOLLOWUP

(spark) branch branch-3.5 updated: Revert "[SPARK-48016][SQL] Fix a bug in try_divide function when with decimals"

2024-05-01 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new fc0ef07f2949 Revert "[SPARK-48016

(spark) branch branch-3.4 updated: [SPARK-48068][PYTHON] `mypy` should have `--python-executable` parameter

2024-05-01 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 70ce67cc77cc [SPARK-48068][PYTHON

(spark) branch branch-3.5 updated: [SPARK-48068][PYTHON] `mypy` should have `--python-executable` parameter

2024-05-01 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 953d7f90c6db [SPARK-48068][PYTHON

(spark) branch master updated: [SPARK-48068][PYTHON] `mypy` should have `--python-executable` parameter

2024-05-01 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 26c871f18030 [SPARK-48068][PYTHON] `mypy

(spark) branch master updated: [SPARK-48069][INFRA] Handle `PEP-632` by checking `ModuleNotFoundError` on `setuptools` in Python 3.12

2024-05-01 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ff401dde5034 [SPARK-48069][INFRA] Handle `PEP

(spark) branch master updated: [SPARK-48016][SQL][TESTS][FOLLOWUP] Update Java 21 golden file

2024-04-30 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 65cf5b18648a [SPARK-48016][SQL][TESTS

(spark) branch master updated: [SPARK-48047][SQL] Reduce memory pressure of empty TreeNode tags

2024-04-30 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 02206cd66dbf [SPARK-48047][SQL] Reduce memory

(spark) branch master updated: [SPARK-48063][CORE] Enable `spark.stage.ignoreDecommissionFetchFailure` by default

2024-04-30 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f3cc8f930383 [SPARK-48063][CORE] Enable

(spark) branch master updated: [SPARK-48060][SS][TESTS] Fix `StreamingQueryHashPartitionVerifySuite` to update golden files correctly

2024-04-30 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new faab553cac70 [SPARK-48060][SS][TESTS] Fix

(spark) branch master updated: [SPARK-48057][PYTHON][CONNECT][TESTS] Enable `GroupedApplyInPandasTests.test_grouped_with_empty_partition`

2024-04-30 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new dab20b31388b [SPARK-48057][PYTHON][CONNECT

(spark) branch master updated (0329479acb67 -> 9caa6f7f8b8e)

2024-04-30 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 0329479acb67 [SPARK-47359][SQL] Support TRANSLATE function to work with collated strings add 9caa6f7f8b8e

(spark) branch master updated: [SPARK-46122][SQL] Set `spark.sql.legacy.createHiveTableByDefault` to `false` by default

2024-04-30 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9e8c4aa3f43a [SPARK-46122][SQL] Set

(spark) branch master updated: [SPARK-48042][SQL] Use a timestamp formatter with timezone at class level instead of making copies at method level

2024-04-29 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c9ed9dfccb72 [SPARK-48042][SQL] Use

(spark) branch master updated (f781d153a5e4 -> c35a21e5984f)

2024-04-29 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from f781d153a5e4 [SPARK-48046][K8S] Remove `clock` parameter from `DriverServiceFeatureStep` add c35a21e5984f

(spark) branch master updated (d42c10d9411d -> f781d153a5e4)

2024-04-29 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from d42c10d9411d [SPARK-47693][TESTS][FOLLOWUP] Reduce CollationBenchmarks time add f781d153a5e4 [SPARK-48046][K8S

(spark) branch master updated (ccb0eb699f7c -> d42c10d9411d)

2024-04-29 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from ccb0eb699f7c [SPARK-48038][K8S] Promote driverServiceName to KubernetesDriverConf add d42c10d9411d [SPARK

(spark) branch master updated: [SPARK-48038][K8S] Promote driverServiceName to KubernetesDriverConf

2024-04-29 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ccb0eb699f7c [SPARK-48038][K8S] Promote

(spark) branch master updated: [MINOR][DOCS] Remove space in the middle of configuration name in Arrow-optimized Python UDF page

2024-04-28 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ff0751a56f01 [MINOR][DOCS] Remove space

(spark) branch master updated (9a42610d5ad8 -> e1445e3f1cf5)

2024-04-28 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 9a42610d5ad8 [SPARK-48029][INFRA] Update the packages name removed in building the spark docker image add

(spark) branch master updated: [SPARK-48029][INFRA] Update the packages name removed in building the spark docker image

2024-04-28 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9a42610d5ad8 [SPARK-48029][INFRA] Update

(spark) branch master updated (3d62dd72a58f -> 8f1634e833ce)

2024-04-28 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 3d62dd72a58f [SPARK-47730][K8S] Support `APP_ID` and `EXECUTOR_ID` placeholders in labels add 8f1634e833ce

(spark) branch master updated: [SPARK-47730][K8S] Support `APP_ID` and `EXECUTOR_ID` placeholders in labels

2024-04-28 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3d62dd72a58f [SPARK-47730][K8S] Support

(spark) branch master updated: [SPARK-48021][ML][BUILD] Add `--add-modules=jdk.incubator.vector` to `JavaModuleOptions`

2024-04-27 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 64d321926bbc [SPARK-48021][ML][BUILD] Add

(spark) branch master updated: [SPARK-47408][SQL] Fix mathExpressions that use StringType

2024-04-26 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b623601910a3 [SPARK-47408][SQL] Fix

(spark-kubernetes-operator) branch main updated: [SPARK-48015] Update `build.gradle` to fix deprecation warnings

2024-04-26 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/spark-kubernetes-operator.git The following commit(s) were added to refs/heads/main by this push: new 167047a [SPARK-48015] Update

(spark-kubernetes-operator) branch main updated: [SPARK-47950] Add Java API Module for Spark Operator

2024-04-26 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/spark-kubernetes-operator.git The following commit(s) were added to refs/heads/main by this push: new 28ff3e0 [SPARK-47950] Add

(spark) branch master updated: [SPARK-48011][CORE] Store LogKey name as a value to avoid generating new string instances

2024-04-26 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2b2a33cc35a8 [SPARK-48011][CORE] Store LogKey

(spark) branch master updated: [SPARK-48010][SQL] Avoid repeated calls to conf.resolver in resolveExpression

2024-04-26 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6098bd944f66 [SPARK-48010][SQL] Avoid repeated

(spark) branch master updated: [SPARK-48005][PS][CONNECT][TESTS] Enable `DefaultIndexParityTests.test_index_distributed_sequence_cleanup`

2024-04-26 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 78b19d5af08e [SPARK-48005][PS][CONNECT][TESTS

(spark) branch master updated: [SPARK-48007][BUILD][TESTS] Upgrade `mssql.jdbc` to `12.6.1.jre11`

2024-04-26 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4ee528f9b29f [SPARK-48007][BUILD][TESTS

(spark) branch master updated: [SPARK-47991][SQL][TEST] Arrange the test cases for window frames and window functions

2024-04-25 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ea4b7a242910 [SPARK-47991][SQL][TEST] Arrange

(spark) branch master updated: [SPARK-47933][CONNECT][PYTHON][FOLLOW-UP] Avoid referencing _to_seq in `pyspark-connect`

2024-04-25 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 79357c8ccd22 [SPARK-47933][CONNECT][PYTHON

(spark) branch master updated: [SPARK-45425][DOCS][FOLLOWUP] Add a migration guide for TINYINT type mapping change

2024-04-25 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e1d021214c61 [SPARK-45425][DOCS][FOLLOWUP] Add

(spark) branch master updated (de5c512e0179 -> 287d02073929)

2024-04-25 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from de5c512e0179 [SPARK-47987][PYTHON][CONNECT][TESTS] Enable `ArrowParityTests.test_createDataFrame_empty_partition

(spark) branch master updated: [SPARK-47987][PYTHON][CONNECT][TESTS] Enable `ArrowParityTests.test_createDataFrame_empty_partition`

2024-04-25 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new de5c512e0179 [SPARK-47987][PYTHON][CONNECT

(spark) branch master updated: [SPARK-47990][BUILD] Upgrade `zstd-jni` to 1.5.6-3

2024-04-25 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5810554ce0fa [SPARK-47990][BUILD] Upgrade

(spark) branch master updated: [SPARK-47979][SQL][TESTS] Use Hive tables explicitly for Hive table capability tests

2024-04-24 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0fcced63be99 [SPARK-47979][SQL][TESTS] Use

(spark) branch branch-3.5 updated: [SPARK-47633][SQL][3.5] Include right-side plan output in `LateralJoin#allAttributes` for more consistent canonicalization

2024-04-24 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new ce19bfc10682 [SPARK-47633][SQL][3.5

(spark) branch master updated (09ed09cb18e7 -> 03d4ea6a707c)

2024-04-24 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 09ed09cb18e7 [SPARK-47958][TESTS] Change LocalSchedulerBackend to notify scheduler of executor on start add

(spark) branch master updated: [SPARK-47969][PYTHON][TESTS] Make `test_creation_index` deterministic

2024-04-24 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new cb1e1f5cd49a [SPARK-47969][PYTHON][TESTS] Make

(spark) branch master updated: [SPARK-47956][SQL] Sanity check for unresolved LCA reference

2024-04-23 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 66613ba042c4 [SPARK-47956][SQL] Sanity check

(spark) branch master updated: [SPARK-47948][PYTHON] Upgrade the minimum `Pandas` version to 2.0.0

2024-04-23 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2b01755f2791 [SPARK-47948][PYTHON] Upgrade

(spark) branch master updated (cf5fc0c720ee -> 9c4f12ca04ac)

2024-04-23 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from cf5fc0c720ee [MINOR][DOCS] Fix type hint of 3 functions add 9c4f12ca04ac [SPARK-47949][SQL][DOCKER][TESTS

(spark) branch master updated: [MINOR][DOCS] Fix type hint of 3 functions

2024-04-23 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new cf5fc0c720ee [MINOR][DOCS] Fix type hint of 3

(spark) branch master updated (ca916258b991 -> 33fa77cb4868)

2024-04-23 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from ca916258b991 [SPARK-47953][DOCS] MsSQLServer: Document Mapping Spark SQL Data Types to Microsoft SQL Server

(spark) branch master updated: [SPARK-47953][DOCS] MsSQLServer: Document Mapping Spark SQL Data Types to Microsoft SQL Server

2024-04-23 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ca916258b991 [SPARK-47953][DOCS] MsSQLServer

(spark-kubernetes-operator) branch main updated: [SPARK-47943] Add `GitHub Action` CI for Java Build and Test

2024-04-22 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/spark-kubernetes-operator.git The following commit(s) were added to refs/heads/main by this push: new 4a5febd [SPARK-47943] Add

(spark-kubernetes-operator) branch main updated: [SPARK-47929] Setup Static Analysis for Operator

2024-04-22 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/spark-kubernetes-operator.git The following commit(s) were added to refs/heads/main by this push: new 798ca15 [SPARK-47929] Setup

(spark) branch master updated (9d715ba49171 -> 876c2cf34a35)

2024-04-22 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 9d715ba49171 [SPARK-47938][SQL] MsSQLServer: Cannot find data type BYTE error add 876c2cf34a35 [SPARK-44170

(spark) branch master updated: [SPARK-47938][SQL] MsSQLServer: Cannot find data type BYTE error

2024-04-22 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9d715ba49171 [SPARK-47938][SQL] MsSQLServer

(spark) branch master updated (e4fb7dd98219 -> a97e72cfa7d4)

2024-04-22 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from e4fb7dd98219 [MINOR] Remove unnecessary `imports` add a97e72cfa7d4 [SPARK-47937][PYTHON][DOCS] Fix docstring

(spark) branch master updated (b335dd366fb1 -> e4fb7dd98219)

2024-04-22 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from b335dd366fb1 [SPARK-47909][CONNECT][PYTHON][TESTS][FOLLOW-UP] Move `pyspark.classic` references add

(spark) branch branch-3.5 updated: [SPARK-47904][SQL][3.5] Preserve case in Avro schema when using enableStableIdentifiersForUnionType

2024-04-22 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new d7c3794a0c56 [SPARK-47904][SQL][3.5

(spark) branch master updated: [SPARK-47942][K8S][DOCS] Drop K8s v1.26 Support

2024-04-22 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ac9a12ef6e06 [SPARK-47942][K8S][DOCS] Drop K8s

(spark) branch master updated (f2d0cf23018f -> fc0c8553ea05)

2024-04-22 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from f2d0cf23018f [SPARK-47907][SQL] Put bang under a config add fc0c8553ea05 [SPARK-47904][SQL] Preserve case

<    1   2   3   4   5   6   7   8   9   10   >