(spark) branch master updated: [SPARK-46907][CORE] Show driver log location in Spark History Server

2024-01-29 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 29355c07580e [SPARK-46907][CORE] Show driver

(spark) branch master updated (e211dbdee42c -> c468c3d5c685)

2024-01-29 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from e211dbdee42c [SPARK-46831][SQL] Collations - Extending StringType and PhysicalStringType with collationId field

(spark) branch master updated: [SPARK-46903][CORE] Support Spark History Server Log UI

2024-01-29 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8dd395b2eabd [SPARK-46903][CORE] Support Spark

(spark) branch master updated: [SPARK-46902][UI] Fix Spark History Server UI for using un-exported setAppLimit

2024-01-29 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1386b52f3eb6 [SPARK-46902][UI] Fix Spark

(spark) branch master updated: [SPARK-46900][BUILD] Upgrade slf4j to 2.0.11

2024-01-28 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a368280708dd [SPARK-46900][BUILD] Upgrade

(spark) branch master updated: [SPARK-46901][PYTHON] Upgrade `pyarrow` to 15.0.0

2024-01-28 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 487cbc086a30 [SPARK-46901][PYTHON] Upgrade

(spark) branch master updated: [SPARK-46899][CORE] Remove `POST` APIs from `MasterWebUI` when `spark.ui.killEnabled` is `false`

2024-01-28 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 95a4abd5b5bc [SPARK-46899][CORE] Remove `POST

(spark) branch master updated: [SPARK-46897][PYTHON][DOCS] Refine docstring of `bit_and/bit_or/bit_xor`

2024-01-28 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5056a17919ac [SPARK-46897][PYTHON][DOCS

(spark) branch master updated (f078998df2f3 -> bb2195554e6d)

2024-01-28 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from f078998df2f3 [MINOR][DOCS] Miscellaneous documentation improvements add bb2195554e6d [SPARK-46874][PYTHON

(spark) branch master updated: [SPARK-46892][BUILD] Upgrade dropwizard metrics 4.2.25

2024-01-28 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d74aecd11dcd [SPARK-46892][BUILD] Upgrade

(spark) branch branch-3.4 updated: [SPARK-46888][CORE] Fix `Master` to reject `/workers/kill/` requests if decommission is disabled

2024-01-27 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 51b021fdf915 [SPARK-46888][CORE] Fix

(spark) branch branch-3.5 updated: [SPARK-46888][CORE] Fix `Master` to reject `/workers/kill/` requests if decommission is disabled

2024-01-27 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new accfb39e4ddf [SPARK-46888][CORE] Fix

(spark) branch master updated: [SPARK-46888][CORE] Fix `Master` to reject `/workers/kill/` requests if decommission is disabled

2024-01-27 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 20b593811dc0 [SPARK-46888][CORE] Fix `Master

(spark) branch master updated: [SPARK-46883][CORE][FOLLOWUP] Fix `clusterutilization` API to handle 0 worker case

2024-01-27 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a96f399d5094 [SPARK-46883][CORE][FOLLOWUP] Fix

(spark) branch master updated: [SPARK-46887][DOCS] Document a few missed `spark.ui.*` configs to `Configuration` page

2024-01-27 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1787a5261e87 [SPARK-46887][DOCS] Document

(spark) branch master updated: [SPARK-46886][CORE] Enable `spark.ui.prometheus.enabled` by default

2024-01-27 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c8d116bcfde9 [SPARK-46886][CORE] Enable

(spark) branch master updated: [SPARK-46883][CORE] Support `/json/clusterutilization` API

2024-01-27 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f75c7a7b5240 [SPARK-46883][CORE] Support

(spark) branch master updated (e014248434ac -> ecdacf8e14c8)

2024-01-26 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from e014248434ac [SPARK-46880][PYTHON][CONNECT][TESTS] Improve and test warning for Arrow-optimized Python UDF add

(spark) branch master updated: [SPARK-46880][PYTHON][CONNECT][TESTS] Improve and test warning for Arrow-optimized Python UDF

2024-01-26 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e014248434ac [SPARK-46880][PYTHON][CONNECT

(spark) branch master updated: [SPARK-46849][SQL] Run optimizer on CREATE TABLE column defaults

2024-01-26 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7ab7509fa124 [SPARK-46849][SQL] Run optimizer

(spark) branch master updated: [SPARK-46871][PS][TESTS] Clean up the imports in `pyspark.pandas.tests.computation.*`

2024-01-25 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f9f413e5ff6a [SPARK-46871][PS][TESTS] Clean up

(spark) branch branch-3.4 updated: [SPARK-46855][INFRA][3.4] Add `sketch` to the dependencies of the `catalyst` in `module.py`

2024-01-25 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 441c33da0dbb [SPARK-46855][INFRA][3.4

(spark) branch branch-3.5 updated: [SPARK-46855][INFRA][3.5] Add `sketch` to the dependencies of the `catalyst` in `module.py`

2024-01-25 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new e5a654e818b4 [SPARK-46855][INFRA][3.5

(spark) branch master updated: [SPARK-46872][CORE] Recover `log-view.js` to be non-module

2024-01-25 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1eedb7507ae2 [SPARK-46872][CORE] Recover `log

(spark) branch master updated: [SPARK-46870][CORE] Support Spark Master Log UI

2024-01-25 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d6fc06bd4515 [SPARK-46870][CORE] Support Spark

(spark) branch master updated: [SPARK-46868][CORE] Support Spark Worker Log UI

2024-01-25 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 48cd8604f953 [SPARK-46868][CORE] Support Spark

(spark) branch master updated: [SPARK-46869][K8S] Add `logrotate` to Spark docker files

2024-01-25 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 25df5dad6761 [SPARK-46869][K8S] Add `logrotate

(spark) branch branch-3.4 updated: [SPARK-46861][CORE] Avoid Deadlock in DAGScheduler

2024-01-25 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 3130ac9276bd [SPARK-46861][CORE] Avoid

(spark) branch branch-3.5 updated: [SPARK-46861][CORE] Avoid Deadlock in DAGScheduler

2024-01-25 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 125b2f87d453 [SPARK-46861][CORE] Avoid

(spark) branch master updated: [SPARK-46861][CORE] Avoid Deadlock in DAGScheduler

2024-01-25 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 617014cc92d9 [SPARK-46861][CORE] Avoid

(spark) branch master updated: [SPARK-46855][INFRA] Add `sketch` to the dependencies of the `catalyst` in `module.py`

2024-01-25 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1bee07e39f1b [SPARK-46855][INFRA] Add `sketch

(spark-website) branch asf-site updated: docs: udpate third party projects (#497)

2024-01-25 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git The following commit(s) were added to refs/heads/asf-site by this push: new a6ce63fb9c docs: udpate third

(spark) branch master updated: [SPARK-46828][SQL] Remove the invalid assertion of remote mode for spark sql shell

2024-01-24 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 51cdf34226ed [SPARK-46828][SQL] Remove

(spark) branch master updated: [SPARK-46846][CORE] Make `WorkerResourceInfo` extend `Serializable` explicitly

2024-01-24 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b86053c430e5 [SPARK-46846][CORE] Make

(spark) branch master updated: [SPARK-46827][CORE] Make `RocksDBPersistenceEngine` to support a symbolic link

2024-01-24 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1f23edfa84aa [SPARK-46827][CORE] Make

(spark) branch master updated: [SPARK-46823][CONNECT][PYTHON] `LocalDataToArrowConversion` should check the nullability

2024-01-24 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1642e928478c [SPARK-46823][CONNECT][PYTHON

(spark) branch master updated: [SPARK-46822][SQL] Respect spark.sql.legacy.charVarcharAsString when casting jdbc type to catalyst type in jdbc

2024-01-23 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0a470430c81c [SPARK-46822][SQL] Respect

(spark) branch branch-3.4 updated: [SPARK-46817][CORE] Fix `spark-daemon.sh` usage by adding `decommission` command

2024-01-23 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new e56bd97c04c1 [SPARK-46817][CORE] Fix

(spark) branch branch-3.5 updated: [SPARK-46817][CORE] Fix `spark-daemon.sh` usage by adding `decommission` command

2024-01-23 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new be7f1e9979c3 [SPARK-46817][CORE] Fix

(spark) branch master updated: [SPARK-46817][CORE] Fix `spark-daemon.sh` usage by adding `decommission` command

2024-01-23 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 00a92d328576 [SPARK-46817][CORE] Fix `spark

(spark) branch master updated: [SPARK-40876][SQL] Widening type promotion from integers to decimal in Parquet vectorized reader

2024-01-23 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0356ac009472 [SPARK-40876][SQL] Widening type

(spark) branch branch-3.4 updated: [SPARK-46794][SQL] Remove subqueries from LogicalRDD constraints

2024-01-23 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 894faabbffb4 [SPARK-46794][SQL] Remove

(spark) branch branch-3.5 updated: [SPARK-46794][SQL] Remove subqueries from LogicalRDD constraints

2024-01-23 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 05f7aa596c7b [SPARK-46794][SQL] Remove

(spark) branch master updated (8ab69992584a -> d26e871136e0)

2024-01-23 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 8ab69992584a [SPARK-46772][SQL][TESTS] Benchmarking Avro with Compression Codecs add d26e871136e0 [SPARK-46794

(spark) branch master updated: [SPARK-46772][SQL][TESTS] Benchmarking Avro with Compression Codecs

2024-01-23 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8ab69992584a [SPARK-46772][SQL][TESTS

(spark) branch master updated: [SPARK-46718][BUILD] Upgrade Arrow to 15.0.0

2024-01-22 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8a7609f1cb2d [SPARK-46718][BUILD] Upgrade

(spark) branch master updated: [SPARK-46805][BUILD] Upgrade `scalafmt` to 3.7.17

2024-01-22 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 34beb02827ff [SPARK-46805][BUILD] Upgrade

(spark) branch master updated (00a9b94d1827 -> 31ffb2d99900)

2024-01-22 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 00a9b94d1827 [SPARK-46804][DOCS][TESTS] Recover the generated documents add 31ffb2d99900 [SPARK-46800][CORE

(spark) branch master updated: [SPARK-46804][DOCS][TESTS] Recover the generated documents

2024-01-22 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 00a9b94d1827 [SPARK-46804][DOCS][TESTS

(spark) branch master updated: [SPARK-46801][PYTHON][TESTS] Do not treat exit code 5 as a test failure in Python testing script

2024-01-22 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 52b62921cadb [SPARK-46801][PYTHON][TESTS] Do

(spark) branch branch-3.4 updated: [SPARK-46801][PYTHON][TESTS] Do not treat exit code 5 as a test failure in Python testing script

2024-01-22 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 2621882da3ef [SPARK-46801][PYTHON

(spark) branch branch-3.5 updated: [SPARK-46801][PYTHON][TESTS] Do not treat exit code 5 as a test failure in Python testing script

2024-01-22 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new a6869b25fb9a [SPARK-46801][PYTHON

(spark) branch master updated: [SPARK-46799][CORE][TESTS] Improve `MasterSuite` to use nanoTime-based appIDs and workerIDs

2024-01-22 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f9feddfbc9de [SPARK-46799][CORE][TESTS

(spark) branch master updated: [SPARK-46797][CORE] Rename `spark.deploy.spreadOut` to `spark.deploy.spreadOutApps`

2024-01-22 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8d1212837538 [SPARK-46797][CORE] Rename

(spark) branch branch-3.4 updated: [SPARK-46779][SQL] `InMemoryRelation` instances of the same cached plan should be semantically equivalent

2024-01-22 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 97536c6673bb [SPARK-46779][SQL

(spark) branch branch-3.5 updated: [SPARK-46779][SQL] `InMemoryRelation` instances of the same cached plan should be semantically equivalent

2024-01-22 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 68d9f353300e [SPARK-46779][SQL

(spark) branch master updated (77062021c5d0 -> b80e8cb45522)

2024-01-22 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 77062021c5d0 [SPARK-46758][INFRA] Upgrade github cache action to v4 add b80e8cb45522 [SPARK-46779][SQL

(spark) branch master updated: [SPARK-46758][INFRA] Upgrade github cache action to v4

2024-01-22 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 77062021c5d0 [SPARK-46758][INFRA] Upgrade

(spark) branch master updated: [SPARK-46791][SQL] Support Java Set in JavaTypeInference

2024-01-22 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 667c0a9dbbe0 [SPARK-46791][SQL] Support Java

(spark) branch branch-3.5 updated: [SPARK-46789][K8S][TESTS] Add `VolumeSuite` to K8s IT

2024-01-22 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 04d32493fde7 [SPARK-46789][K8S][TESTS

(spark) branch master updated: [SPARK-46788][DOCS] Add instructions for running Docker integration tests

2024-01-21 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new aa4944f99566 [SPARK-46788][DOCS] Add

(spark) branch branch-3.4 updated: [SPARK-44495][INFRA][K8S][3.4] Use the latest minikube in K8s IT

2024-01-21 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 137528aeab18 [SPARK-44495][INFRA][K8S

(spark) branch branch-3.5 updated: [SPARK-44495][INFRA][K8S][3.5] Use the latest minikube in K8s IT

2024-01-20 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 687c2979959f [SPARK-44495][INFRA][K8S

(spark) branch branch-3.4 updated: [SPARK-46786][K8S] Fix `MountVolumesFeatureStep` to use `ReadWriteOncePod` instead of `ReadWriteOnce`

2024-01-20 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new bb4a893d2061 [SPARK-46786][K8S] Fix

(spark) branch branch-3.5 updated: [SPARK-46786][K8S] Fix `MountVolumesFeatureStep` to use `ReadWriteOncePod` instead of `ReadWriteOnce`

2024-01-20 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new b98cf95896a2 [SPARK-46786][K8S] Fix

(spark) branch master updated: [SPARK-46786][K8S] Fix `MountVolumesFeatureStep` to use `ReadWriteOncePod` instead of `ReadWriteOnce`

2024-01-20 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 45ec74415a4a [SPARK-46786][K8S] Fix

(spark) branch master updated: [SPARK-46783][K8S][TESTS] Use `built-in` storage classes in PVTestsSuite

2024-01-20 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b7356b6682b0 [SPARK-46783][K8S][TESTS] Use

(spark) branch master updated: [SPARK-46784][K8S][TESTS] Create and use a K8s test tag for `PersistentVolume`

2024-01-20 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7b4fd90aa5fd [SPARK-46784][K8S][TESTS] Create

(spark) branch master updated: [SPARK-46755][K8S][INFRA][DOCS] Upgrade `Volcano` to 1.8.2

2024-01-20 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0a0a131e987c [SPARK-46755][K8S][INFRA][DOCS

(spark) branch master updated: [SPARK-46780][K8S][TESTS] Improve SBT K8s IT to skip R image build step if not needed

2024-01-19 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3d400d333050 [SPARK-46780][K8S][TESTS] Improve

(spark) branch master updated (3d395a6b874b -> 39f8e1a5953b)

2024-01-19 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 3d395a6b874b [SPARK-46774][SQL][AVRO] Use mapreduce.output.fileoutputformat.compress instead of deprecated

(spark) branch master updated: [SPARK-46774][SQL][AVRO] Use mapreduce.output.fileoutputformat.compress instead of deprecated mapred.output.compress in Avro write jobs

2024-01-19 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3d395a6b874b [SPARK-46774][SQL][AVRO] Use

(spark) branch master updated: [SPARK-46770][K8S][TESTS] Remove legacy `docker-for-desktop` logic

2024-01-19 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a569fca2e9b4 [SPARK-46770][K8S][TESTS] Remove

(spark) branch master updated: [SPARK-46759][SQL][AVRO] Codec xz and zstandard support compression level for avro files

2024-01-18 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 01bb1b1a3dbf [SPARK-46759][SQL][AVRO] Codec xz

(spark) branch branch-3.5 updated: [MINOR][DOCS] Add zstandard as a candidate to fix the desc of spark.sql.avro.compression.codec

2024-01-18 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new b27d169c85e9 [MINOR][DOCS] Add

(spark) branch branch-3.4 updated: [MINOR][DOCS] Add zstandard as a candidate to fix the desc of spark.sql.avro.compression.codec

2024-01-18 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 37a0e464a189 [MINOR][DOCS] Add

(spark) branch master updated: [MINOR][DOCS] Add zstandard as a candidate to fix the desc of spark.sql.avro.compression.codec

2024-01-18 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c040824fd75c [MINOR][DOCS] Add zstandard

(spark) branch master updated: [SPARK-46745][INFRA] Purge pip cache in dockerfile

2024-01-17 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new da0c31c629ca [SPARK-46745][INFRA] Purge pip

(spark) branch master updated: [SPARK-46751][PYTHON][TESTS] Skip test_datasource if PyArrow is not installed

2024-01-17 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 751a81b23bd3 [SPARK-46751][PYTHON][TESTS] Skip

(spark) branch master updated: [SPARK-46748][CORE] Remove `*slave*.sh` scripts

2024-01-17 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4d7b1ba986bc [SPARK-46748][CORE] Remove

(spark) branch master updated: [SPARK-46746][SQL][AVRO] Attach codec extension to avro datasource files

2024-01-17 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9a2f39318e3a [SPARK-46746][SQL][AVRO] Attach

(spark) branch master updated: [SPARK-46525][DOCKER][TESTS][FOLLOWUP] Fix docker-integration-tests on Apple Silicon for db2 and oracle with third-party docker environments

2024-01-17 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e3fd64b96765 [SPARK-46525][DOCKER][TESTS

(spark) branch master updated (f36c3f1d7892 -> 4a69ce68172d)

2024-01-16 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from f36c3f1d7892 [SPARK-46742][SQL][TESTS] Add ORC compression tests for `hive` module `OrcFileFormat` add

(spark) branch master updated: [SPARK-46742][SQL][TESTS] Add ORC compression tests for `hive` module `OrcFileFormat`

2024-01-16 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f36c3f1d7892 [SPARK-46742][SQL][TESTS] Add ORC

(spark) branch master updated: [SPARK-46737][SQL][TESTS] Use the default ORC compression in OrcReadBenchmark

2024-01-16 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 962d54fb8fab [SPARK-46737][SQL][TESTS] Use

(spark) branch master updated: [SPARK-46735][PYTHON][TESTS] `pyspark.sql.tests.test_group` should skip Pandas/PyArrow tests if not available

2024-01-16 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6c4747cdfb02 [SPARK-46735][PYTHON][TESTS

(spark) branch master updated: [SPARK-46717][CORE] Simplify `ReloadingX509TrustManager` by the exit operation only depend on interrupt thread

2024-01-15 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new de79388923ee [SPARK-46717][CORE] Simplify

(spark) branch master updated: [SPARK-46724][DOCS] Update tuning.md to use java 17 doc links

2024-01-15 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4207cbe67ead [SPARK-46724][DOCS] Update

(spark) branch master updated: [SPARK-46094] Support Executor JVM Profiling

2024-01-15 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new fb9c89a45db5 [SPARK-46094] Support Executor

(spark) branch master updated: [SPARK-46693][SQL] Inject LocalLimitExec when matching OffsetAndLimit or LimitAndOffset

2024-01-13 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 11890cc79b32 [SPARK-46693][SQL] Inject

(spark) branch master updated: [SPARK-46697][SQL][HIVE] Eliminate Hive configuration time variables conversion

2024-01-13 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4be05f55fdb9 [SPARK-46697][SQL][HIVE

(spark) branch branch-3.4 updated: [SPARK-46700][CORE] Count the last spilling for the shuffle disk spilling bytes metric

2024-01-12 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new bac0033d778d [SPARK-46700][CORE] Count

(spark) branch branch-3.5 updated: [SPARK-46700][CORE] Count the last spilling for the shuffle disk spilling bytes metric

2024-01-12 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 679e4b6593a1 [SPARK-46700][CORE] Count

(spark) branch master updated: [SPARK-46700][CORE] Count the last spilling for the shuffle disk spilling bytes metric

2024-01-12 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4ea374257c1f [SPARK-46700][CORE] Count

(spark) branch branch-3.4 updated: [SPARK-46704][CORE][UI] Fix `MasterPage` to sort `Running Drivers` table by `Duration` column correctly

2024-01-12 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 0172413aa2af [SPARK-46704][CORE][UI

(spark) branch branch-3.5 updated: [SPARK-46704][CORE][UI] Fix `MasterPage` to sort `Running Drivers` table by `Duration` column correctly

2024-01-12 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 2fe253e2f137 [SPARK-46704][CORE][UI

(spark) branch master updated: [SPARK-46704][CORE][UI] Fix `MasterPage` to sort `Running Drivers` table by `Duration` column correctly

2024-01-12 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 25c680cfd4dc [SPARK-46704][CORE][UI] Fix

(spark) branch master updated (a3266b411723 -> 6e5431501ec0)

2024-01-12 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from a3266b411723 [SPARK-46695][SQL][HIVE] Always setting hive.execution.engine to mr add 6e5431501ec0 [SPARK-46703

(spark) branch master updated: [SPARK-46695][SQL][HIVE] Always setting hive.execution.engine to mr

2024-01-12 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a3266b411723 [SPARK-46695][SQL][HIVE] Always

(spark) branch master updated: [SPARK-46698][CORE] Replace Timer with single thread scheduled executor for ConsoleProgressBar

2024-01-12 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new fc6657624be9 [SPARK-46698][CORE] Replace Timer

<    2   3   4   5   6   7   8   9   10   11   >