(spark) branch master updated: [SPARK-46681][CORE] Refactor `ExecutorFailureTracker#maxNumExecutorFailures` to avoid calculating `defaultMaxNumExecutorFailures` when `MAX_EXECUTOR_FAILURES` is configu

2024-01-12 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 755c892a7b40 [SPARK-46681][CORE] Refactor

(spark) branch master updated: [SPARK-46692][BUILD] Load `inputs.envs` always in `Python` and `Upload`-related steps

2024-01-12 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9f061b0d03a3 [SPARK-46692][BUILD] Load

(spark) branch master updated: [SPARK-46665][PYTHON] Remove `assertPandasOnSparkEqual`

2024-01-12 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d0a89f8fecc7 [SPARK-46665][PYTHON] Remove

(spark) branch master updated: [SPARK-46682][BUILD] Upgrade `curator` to 5.6.0

2024-01-11 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2a27d697d291 [SPARK-46682][BUILD] Upgrade

(spark) branch master updated: Revert "[SPARK-46474][INFRA] Upgrade upload-artifact action to v4"

2024-01-11 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c18c87dc70d4 Revert "[SPARK-46474][

(spark) branch master updated: [SPARK-46368][CORE] Support `readyz` in REST Submission API

2024-01-11 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 89c71f7c195d [SPARK-46368][CORE] Support

(spark) branch master updated: [SPARK-46664][CORE][TESTS][FOLLOWUP] Add a persistent `DriverInfo`

2024-01-11 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4b0ceaddde17 [SPARK-46664][CORE][TESTS

(spark) branch master updated (bfaf9e47b35b -> c84ac6f7cf4e)

2024-01-11 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from bfaf9e47b35b [SPARK-46678][TEST] Set `datanucleus.autoStartMechanismMode=ignored` to clean the wall of noisy logs

(spark) branch master updated: [SPARK-46678][TEST] Set `datanucleus.autoStartMechanismMode=ignored` to clean the wall of noisy logs

2024-01-11 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new bfaf9e47b35b [SPARK-46678][TEST] Set

(spark) branch master updated: [SPARK-46672][BUILD] Upgrade log4j2 to 2.22.1

2024-01-11 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2a65001ab4fb [SPARK-46672][BUILD] Upgrade

(spark) branch master updated: [SPARK-46675][SQL] Remove unused inferTimestampNTZ in ParquetReadSupport

2024-01-11 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 46d52fc45473 [SPARK-46675][SQL] Remove unused

(spark) branch master updated: [SPARK-46664][CORE] Improve `Master` to recover quickly in case of zero workers and apps

2024-01-10 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ef2e730662f2 [SPARK-46664][CORE] Improve

(spark) branch master updated (4653d501c156 -> dcfd37c8fee0)

2024-01-10 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 4653d501c156 [SPARK-46382][SQL] XML: Update doc for `ignoreSurroundingSpaces` add dcfd37c8fee0 [SPARK-46662

(spark) branch master updated: [SPARK-46657][INFRA] Install `lxml` in Python 3.12

2024-01-10 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5e9e9350de8a [SPARK-46657][INFRA] Install

(spark) branch master updated: [SPARK-46648][SQL] Use `zstd` as the default ORC compression

2024-01-09 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a3991b17e379 [SPARK-46648][SQL] Use `zstd

(spark) branch master updated: [SPARK-46646][SQL][TESTS] Improve `TPCDSQueryBenchmark` to support other file formats

2024-01-09 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 24cb6117ba4a [SPARK-46646][SQL][TESTS] Improve

(spark) branch master updated: [SPARK-46643][SQL][TESTS] Fix ORC tests to be independent from default compression

2024-01-09 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 48d22e9f876 [SPARK-46643][SQL][TESTS] Fix ORC

(spark) branch master updated: [MINOR][DOCS] Add license header at docs/_plugins

2024-01-09 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d613772765f [MINOR][DOCS] Add license header

(spark) branch master updated: [SPARK-46634][SQL] literal validation should not drill down to null fields

2024-01-09 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 56dd1f7c101e [SPARK-46634][SQL] literal

(spark) branch master updated: [SPARK-46622][CORE] Override `toString` method for `o.a.s.network.shuffledb.StoreVersion`

2024-01-09 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ef7846aa236e [SPARK-46622][CORE] Override

(spark) branch master updated: [SPARK-40876][SQL][TESTS][FOLLOW-UP] Remove invalid decimal test case when ANSI mode is on

2024-01-08 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ee2a87b4642c [SPARK-40876][SQL][TESTS][FOLLOW

(spark) branch branch-3.4 updated: [SPARK-46628][INFRA] Use SPDX short identifier in `license` name

2024-01-08 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new ce22af0563a4 [SPARK-46628][INFRA] Use

(spark) branch master updated: [SPARK-46628][INFRA] Use SPDX short identifier in `license` name

2024-01-08 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d008f81a9d8d [SPARK-46628][INFRA] Use SPDX

(spark) branch branch-3.5 updated: [SPARK-46628][INFRA] Use SPDX short identifier in `license` name

2024-01-08 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 75b567daa705 [SPARK-46628][INFRA] Use

(spark) branch master updated: [SPARK-46624][BUILD] Upgrade joda-time to 2.12.6

2024-01-08 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new bb0f77d076ee [SPARK-46624][BUILD] Upgrade joda

(spark) branch master updated: [SPARK-46605][CONNECT] Make `lit/typedLit` function in connect module support `s.c.immutable.ArraySeq`

2024-01-06 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e4335206b59a [SPARK-46605][CONNECT] Make `lit

(spark) branch master updated: [SPARK-46604][SQL] Make `Literal.apply` support `s.c.immuable.ArraySeq`

2024-01-06 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b35e61f83ff9 [SPARK-46604][SQL] Make

(spark) branch branch-3.4 updated: [SPARK-46598][SQL] OrcColumnarBatchReader should respect the memory mode when creating column vectors for the missing column

2024-01-06 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 53683a82ba0e [SPARK-46598][SQL

(spark) branch branch-3.5 updated: [SPARK-46598][SQL] OrcColumnarBatchReader should respect the memory mode when creating column vectors for the missing column

2024-01-06 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new fe22ec74db78 [SPARK-46598][SQL

(spark) branch master updated: [SPARK-46598][SQL] OrcColumnarBatchReader should respect the memory mode when creating column vectors for the missing column

2024-01-06 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0c1c5e93e376 [SPARK-46598][SQL

(spark) branch master updated: [SPARK-46609][SQL] Avoid exponential explosion in PartitioningPreservingUnaryExecNode

2024-01-05 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f8115da1a2bb [SPARK-46609][SQL] Avoid

(spark) branch branch-3.5 updated: [SPARK-46609][SQL] Avoid exponential explosion in PartitioningPreservingUnaryExecNode

2024-01-05 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 9f095b71ca2f [SPARK-46609][SQL] Avoid

(spark) branch master updated: [SPARK-46568][PYTHON] Make Python data source options a case-insensitive dictionary

2024-01-04 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a98c885da09d [SPARK-46568][PYTHON] Make Python

(spark) branch master updated: [SPARK-46560][PYTHON][DOCS] Refine docstring `reverse/map_contains_key`

2024-01-04 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f03f3d01176d [SPARK-46560][PYTHON][DOCS

(spark) branch master updated: [SPARK-46586][SQL] Support `s.c.immutable.ArraySeq` as `customCollectionCls` in `MapObjects`

2024-01-04 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b71192cb08cb [SPARK-46586][SQL] Support

(spark) branch master updated: [SPARK-46569][SQL] Remove ThreadLocal due to SecureRandom is thread safe since JDK9

2024-01-04 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6a9a06d3d3a9 [SPARK-46569][SQL] Remove

(spark) branch master updated (f3e454a8323 -> 56023635ab8)

2024-01-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from f3e454a8323 [SPARK-45292][SQL][HIVE] Remove Guava from shared classes from IsolatedClientLoader add

(spark) branch master updated: [SPARK-45292][SQL][HIVE] Remove Guava from shared classes from IsolatedClientLoader

2024-01-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f3e454a8323a [SPARK-45292][SQL][HIVE] Remove

(spark) branch master updated (5c10fb3e509a -> 893e69172560)

2024-01-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 5c10fb3e509a [SPARK-44556][SQL] Reuse `OrcTail` when enable vectorizedReader add 893e69172560 [SPARK-46580

(spark) branch master updated (85b44ccef4c4 -> 5c10fb3e509a)

2024-01-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 85b44ccef4c4 [SPARK-46546][DOCS] Fix the formatting of tables in `running-on-yarn` pages add 5c10fb3e509a

(spark) branch branch-3.5 updated: [SPARK-46546][DOCS] Fix the formatting of tables in `running-on-yarn` pages

2024-01-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new fb90ade2c739 [SPARK-46546][DOCS] Fix

(spark) branch master updated: [SPARK-46546][DOCS] Fix the formatting of tables in `running-on-yarn` pages

2024-01-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 85b44ccef4c4 [SPARK-46546][DOCS] Fix

(spark) branch master updated: [SPARK-46579][SQL] Redact JDBC url in errors and logs

2024-01-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 49f94eb6e88a [SPARK-46579][SQL] Redact JDBC

(spark) branch master updated (605fecd22cc1 -> 06f9e7419966)

2024-01-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 605fecd22cc1 [SPARK-46577][SQL] HiveMetastoreLazyInitializationSuite leaks hive's SessionState add

(spark) branch branch-3.4 updated: [SPARK-46577][SQL] HiveMetastoreLazyInitializationSuite leaks hive's SessionState

2024-01-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 2eb603c09fb5 [SPARK-46577][SQL

(spark) branch branch-3.5 updated: [SPARK-46577][SQL] HiveMetastoreLazyInitializationSuite leaks hive's SessionState

2024-01-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 2891d92e9d8a [SPARK-46577][SQL

(spark) branch master updated (3b1d843da2de -> 605fecd22cc1)

2024-01-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 3b1d843da2de [SPARK-46567][CORE] Remove ThreadLocal for ReadAheadInputStream add 605fecd22cc1 [SPARK-46577

(spark) branch master updated: [SPARK-46567][CORE] Remove ThreadLocal for ReadAheadInputStream

2024-01-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3b1d843da2de [SPARK-46567][CORE] Remove

(spark) branch master updated: [SPARK-46573][K8S] Use `appId` instead of `conf.appId` in `LoggingPodStatusWatcherImpl`

2024-01-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 347c955fe723 [SPARK-46573][K8S] Use `appId

(spark) branch master updated: [SPARK-46525][DOCKER][TESTS] Fix docker-integration-tests on Apple Sillicon

2024-01-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9208c42b3a11 [SPARK-46525][DOCKER][TESTS] Fix

(spark) branch branch-3.4 updated: [SPARK-46425][INFRA] Pin the bundler version in CI

2024-01-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new b478eb4aba94 [SPARK-46425][INFRA] Pin

(spark) branch branch-3.5 updated: [SPARK-46425][INFRA] Pin the bundler version in CI

2024-01-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 6e8dbacf8a14 [SPARK-46425][INFRA] Pin

(spark) branch branch-3.5 updated: [SPARK-46562][SQL] Remove retrieval of `keytabFile` from `UserGroupInformation` in `HiveAuthFactory`

2024-01-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new f0e5fc973c1c [SPARK-46562][SQL] Remove

(spark) branch master updated: [SPARK-46562][SQL] Remove retrieval of `keytabFile` from `UserGroupInformation` in `HiveAuthFactory`

2024-01-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new bc7e949cf993 [SPARK-46562][SQL] Remove

(spark) branch master updated: [SPARK-46564][PYTHON][INFRA] Exclude unrelated files via using omit options properly in PySpark coverage report

2024-01-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4ab5197529ae [SPARK-46564][PYTHON][INFRA

(spark) branch master updated: [SPARK-46552][SQL] Replace `UnsupportedOperationException` by `SparkUnsupportedOperationException` in `catalyst`

2024-01-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 381f3691bd48 [SPARK-46552][SQL] Replace

(spark) branch master updated (04b5128745e0 -> af3a22533ca0)

2023-12-29 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 04b5128745e0 [SPARK-46545][INFRA] Pin `lxml==4.9.4` add af3a22533ca0 [SPARK-46531][BUILD] Move the dependency

(spark) branch master updated: [SPARK-46545][INFRA] Pin `lxml==4.9.4`

2023-12-29 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 04b5128745e0 [SPARK-46545][INFRA] Pin `lxml

(spark) branch master updated (9671abbc1dc9 -> 0eeb60bd24cf)

2023-12-29 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 9671abbc1dc9 [SPARK-46509][CORE][SS] Replace `.reverse.find` with `.findLast` add 0eeb60bd24cf [SPARK-46542

(spark) branch master updated: [SPARK-46509][CORE][SS] Replace `.reverse.find` with `.findLast`

2023-12-29 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9671abbc1dc9 [SPARK-46509][CORE][SS] Replace

(spark) branch branch-3.5 updated: [SPARK-46478][SQL][3.5] Revert SPARK-43049 to use oracle varchar(255) for string

2023-12-27 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 432ab15013b7 [SPARK-46478][SQL][3.5

(spark) branch master updated: [SPARK-46502][SQL] Support timestamp types in UnwrapCastInBinaryComparison

2023-12-27 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5430c700ba64 [SPARK-46502][SQL] Support

(spark) branch master updated (fb09e31fffc5 -> 5a5d3c70401f)

2023-12-26 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from fb09e31fffc5 [SPARK-46513][PS][TESTS] Move `BasicIndexingTests` to `pyspark.pandas.tests.indexes.*` add

(spark) branch master updated: [SPARK-46498][CORE] Remove `shuffleServiceEnabled` from `o.a.spark.util.Utils#getConfiguredLocalDirs`

2023-12-26 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8ea09de807f9 [SPARK-46498][CORE] Remove

(spark) branch master updated: [SPARK-46371][BUILD] Clean up outdated items in `.rat-excludes`

2023-12-26 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c0ff0f579daa [SPARK-46371][BUILD] Clean up

(spark) branch master updated: [SPARK-40876][SQL][TESTS][FOLLOWUP] Fix failed test in `ParquetTypeWideningSuite` when `SPARK_ANSI_SQL_MODE` is set to true

2023-12-25 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c1888cdf5361 [SPARK-40876][SQL][TESTS

(spark) branch master updated: [SPARK-46501][INFRA] List the python packages with the correct versions

2023-12-25 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new bb85bbcf16f7 [SPARK-46501][INFRA] List

(spark) branch master updated (768aba1d0582 -> e314d3cd82d6)

2023-12-25 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 768aba1d0582 [SPARK-46475][BUILD] Upgrade RoaringBitmap to 1.0.1 add e314d3cd82d6 [SPARK-46497][SQL][TESTS] Re

(spark) branch master updated (a546ff4bbe5e -> 768aba1d0582)

2023-12-25 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from a546ff4bbe5e [SPARK-46499][BUILD] Bump sbt-eclipse 6.2.0 add 768aba1d0582 [SPARK-46475][BUILD] Upgrade

(spark) branch master updated: [SPARK-46499][BUILD] Bump sbt-eclipse 6.2.0

2023-12-25 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a546ff4bbe5e [SPARK-46499][BUILD] Bump sbt

(spark) branch master updated: [SPARK-46496][BUILD] Upgrade Arrow to 14.0.2

2023-12-24 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new eae09299c6c9 [SPARK-46496][BUILD] Upgrade

(spark) branch master updated: [SPARK-46455][CORE][SQL][SS][CONNECT][PYTHON] Remove redundant type conversion

2023-12-24 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5db7beb59a67 [SPARK-46455][CORE][SQL][SS

(spark) branch master updated: [SPARK-46478][SQL] Revert SPARK-43049 to use oracle varchar(255) for string

2023-12-24 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 53c7d16080cf [SPARK-46478][SQL] Revert SPARK

(spark) branch master updated: [SPARK-46471][PS][TESTS][FOLLOWUPS] Move `OpsOnDiffFramesEnabledTests` to `pyspark.pandas.tests.diff_frames_ops.*``

2023-12-24 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ef7e1e685f61 [SPARK-46471][PS][TESTS

(spark) branch master updated: [SPARK-46495][INFRA] Merge pyspark-error to pyspark-core

2023-12-24 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new bd29569c5ddd [SPARK-46495][INFRA] Merge

(spark) branch master updated: [SPARK-45231][INFRA][FOLLOWUP] Remove unrecognized and meaningless command about Ammonite from the GA testing workflow

2023-12-23 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new eacf82ad227e [SPARK-45231][INFRA][FOLLOWUP

(spark) branch master updated: [SPARK-46471][PS][TESTS][FOLLOWUPS] Reorganize `OpsOnDiffFramesEnabledTests`: Factor out `test_assignment_*`

2023-12-23 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 98fef6ea5855 [SPARK-46471][PS][TESTS

(spark) branch master updated: [SPARK-46492][BUILD] Simplify the Java version check in `SparkBuild.scala`

2023-12-23 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 64d1cc96fa9c [SPARK-46492][BUILD] Simplify

(spark) branch master updated: [SPARK-46493][INFRA] Upgrade `apache-rat` in the `dev/check-license` to 0.15

2023-12-23 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5c2896abce4a [SPARK-46493][INFRA] Upgrade

(spark) branch master updated (0c29593436d5 -> 82d0fb494f3f)

2023-12-23 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 0c29593436d5 [SPARK-46479][CORE] Change `Utils.isJavaVersionAtLeast21` to use the utility method from `commons

(spark) branch master updated: [SPARK-46456][CORE] Add `spark.ui.jettyStopTimeout` to set Jetty server stop timeout to unblock SparkContext shutdown

2023-12-20 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 847b65eac370 [SPARK-46456][CORE] Add

(spark) branch master updated: [SPARK-46377][INFRA] Upgrade labeler action to v5

2023-12-18 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new eb17ddff1d77 [SPARK-46377][INFRA] Upgrade

(spark) branch master updated: [SPARK-46411][BUILD] Change to use `bcprov/bcpkix-jdk18on` for UT

2023-12-18 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9a75a1d69aae [SPARK-46411][BUILD] Change

(spark) branch master updated: [SPARK-46439][PS][TESTS] Move IO-related tests to `pyspark.pandas.tests.io.*`

2023-12-18 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c41a5ff60a71 [SPARK-46439][PS][TESTS] Move IO

(spark) branch master updated (9756bbe8026c -> 61f51113d884)

2023-12-18 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 9756bbe8026c [SPARK-46289][SQL] Support ordering UDTs in interpreted mode add 61f51113d884 [SPARK-46420][SQL

(spark) branch master updated: [SPARK-46289][SQL] Support ordering UDTs in interpreted mode

2023-12-18 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9756bbe8026c [SPARK-46289][SQL] Support

(spark) branch master updated (036af4bf2336 -> feeb9a0b6208)

2023-12-18 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 036af4bf2336 [SPARK-45725][SQL][FOLLOWUP] Fix arguments of a removed SQL config add feeb9a0b6208 [SPARK-46438

(spark) branch master updated: [SPARK-46430][CONNECT][TESTS] Add test for `ProtoUtils.abbreviate`

2023-12-17 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 96bf373e9002 [SPARK-46430][CONNECT][TESTS] Add

(spark) branch master updated (5e1b904ca54f -> 29db77653fe0)

2023-12-17 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 5e1b904ca54f [SPARK-46389][CORE] Manually close the `RocksDB/LevelDB` instance when `checkVersion` throw Exception

(spark) branch master updated: [SPARK-46389][CORE] Manually close the `RocksDB/LevelDB` instance when `checkVersion` throw Exception

2023-12-17 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5e1b904ca54f [SPARK-46389][CORE] Manually

(spark) branch master updated: [SPARK-46376][SQL][TESTS] Simplify the code to generate the Spark tarball `filename` in the `HiveExternalCatalogVersionsSuite`

2023-12-17 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0745bb507f36 [SPARK-46376][SQL][TESTS

(spark) branch master updated: [SPARK-45502][BUILD] Upgrade Kafka to 3.6.1

2023-12-16 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b702f63bed27 [SPARK-45502][BUILD] Upgrade

(spark) branch master updated: [MINOR][DOCS] Use user-facing feature names in Python metrics documentation

2023-12-16 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 20be0b0bffcb [MINOR][DOCS] Use user-facing

(spark) tag v3.3.4 created (now 18db204995b)

2023-12-16 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to tag v3.3.4 in repository https://gitbox.apache.org/repos/asf/spark.git at 18db204995b (commit) No new revisions were added by this update

svn commit: r66087 - /release/spark/spark-3.3.3/

2023-12-15 Thread dongjoon
Author: dongjoon Date: Sat Dec 16 00:33:47 2023 New Revision: 66087 Log: Remove Apache Spark 3.3.3 after releasing 3.3.4 Removed: release/spark/spark-3.3.3/ - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org

svn commit: r66086 - /dev/spark/v3.3.4-rc1-bin/ /release/spark/spark-3.3.4/

2023-12-15 Thread dongjoon
Author: dongjoon Date: Sat Dec 16 00:25:31 2023 New Revision: 66086 Log: Release Apache Spark 3.3.4 Added: release/spark/spark-3.3.4/ - copied from r66085, dev/spark/v3.3.4-rc1-bin/ Removed: dev/spark/v3.3.4-rc1-bin

(spark) branch master updated: [SPARK-46353][CORE] Refactor to improve `RegisterWorker` unit test coverage

2023-12-12 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2215cef40043 [SPARK-46353][CORE] Refactor

(spark) branch branch-3.4 updated: [SPARK-46369][CORE] Remove `kill` link from `RELAUNCHING` drivers in `MasterPage`

2023-12-11 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new b813e2e100f [SPARK-46369][CORE] Remove

(spark) branch branch-3.5 updated: [SPARK-46369][CORE] Remove `kill` link from `RELAUNCHING` drivers in `MasterPage`

2023-12-11 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new ac031d68a01 [SPARK-46369][CORE] Remove

(spark) branch master updated (3e0808c33f1 -> e434c9f0d57)

2023-12-11 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 3e0808c33f1 [SPARK-46351][SQL] Require an error class in `AnalysisException` add e434c9f0d57 [SPARK-46369

<    3   4   5   6   7   8   9   10   11   12   >