(spark) branch master updated: [SPARK-46358][CONNECT] Simplify the condition check in the `ResponseValidator#verifyResponse`

2023-12-11 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 051b1781827 [SPARK-46358][CONNECT] Simplify

(spark) branch master updated (bab884082c0 -> bb886abcc4a)

2023-12-11 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from bab884082c0 [MINOR][DOCS] Fix documentation for `spark.sql.legacy.doLooseUpcast` in SQL migration guide add

(spark) branch master updated: [SPARK-46215][CORE][FOLLOWUP] Handle symbolic links

2023-12-10 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new bacdb3b5fec [SPARK-46215][CORE][FOLLOWUP

(spark) branch master updated: [SPARK-45642][CORE][SQL] Fix `FileSystem.isFile & FileSystem.isDirectory is deprecated`

2023-12-10 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new fd009d652f7 [SPARK-45642][CORE][SQL] Fix

(spark) branch branch-3.5 updated: [SPARK-45969][DOCS] Document configuration change of executor failure tracker

2023-12-10 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new cbaefe9cc6a [SPARK-45969][DOCS

(spark) branch master updated: [SPARK-45969][DOCS] Document configuration change of executor failure tracker

2023-12-10 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7a43de193aa [SPARK-45969][DOCS] Document

(spark) branch master updated: [SPARK-46285][SQL] Add `foreachWithSubqueries`

2023-12-10 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a77713081a8 [SPARK-46285][SQL] Add

(spark) branch master updated: [SPARK-46342][SQL] Replace `IllegalStateException` by `SparkException.internalError` in sql

2023-12-10 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d02fbba6491 [SPARK-46342][SQL] Replace

(spark) branch master updated: [SPARK-46346][CORE] Fix Master to update a worker from `UNKNOWN` to `ALIVE` on `RegisterWorker` msg

2023-12-10 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 109b1e4a79d [SPARK-46346][CORE] Fix Master

(spark) branch master updated: [SPARK-46348][CORE] Support `spark.deploy.recoveryTimeout`

2023-12-10 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 82a02321b87 [SPARK-46348][CORE] Support

(spark) branch master updated: [SPARK-46344][CORE] Warn properly when a driver exists successfully but master is disconnected

2023-12-09 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 166df8b1df59 [SPARK-46344][CORE] Warn properly

(spark) branch branch-3.4 updated: [SPARK-46339][SS] Directory with batch number name should not be treated as metadata log

2023-12-09 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 4e80b3a09407 [SPARK-46339][SS

(spark) branch branch-3.5 updated: [SPARK-46339][SS] Directory with batch number name should not be treated as metadata log

2023-12-09 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 28a8b181e96d [SPARK-46339][SS

(spark) branch master updated: [SPARK-46339][SS] Directory with batch number name should not be treated as metadata log

2023-12-09 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 75805f07f5ca [SPARK-46339][SS] Directory

(spark) branch master updated (1af4b658064d -> cae4bdc88161)

2023-12-09 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 1af4b658064d [SPARK-46338][PS][TESTS] Re-enable the `get_item` test for `BasicIndexingTests` add cae4bdc88161

(spark) branch master updated: [SPARK-46338][PS][TESTS] Re-enable the `get_item` test for `BasicIndexingTests`

2023-12-09 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1af4b658064d [SPARK-46338][PS][TESTS] Re

(spark) branch master updated: [SPARK-46334][INFRA][PS] Upgrade `Pandas` to 2.1.4

2023-12-08 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 48e773451eeb [SPARK-46334][INFRA][PS] Upgrade

(spark) branch branch-3.4 updated: [SPARK-46275][3.4] Protobuf: Return null in permissive mode when deserialization fails

2023-12-08 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 4745138601b7 [SPARK-46275][3.4

(spark) branch master updated: [SPARK-46325][CONNECT] Remove unnecessary override functions when constructing `WrappedCloseableIterator` in `ResponseValidator#wrapIterator`

2023-12-08 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 75cb37011fa2 [SPARK-46325][CONNECT] Remove

(spark) branch master updated: [SPARK-46332][SQL] Migrate `CatalogNotFoundException` to the error class `CATALOG_NOT_FOUND`

2023-12-08 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d9f0fccd967b [SPARK-46332][SQL] Migrate

(spark) branch master updated: [SPARK-46324][SQL][PYTHON] Fix the output name of pyspark.sql.functions.user and session_user

2023-12-08 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3224cddcf9da [SPARK-46324][SQL][PYTHON] Fix

svn commit: r65952 - in /dev/spark/v3.3.4-rc1-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/R/articles/ _site/api/R/deps/ _site/api/R/deps/bootstrap-5.3.1/ _site/api/R/deps/bootstrap-5.3.1/fonts/

2023-12-08 Thread dongjoon
Author: dongjoon Date: Fri Dec 8 20:21:58 2023 New Revision: 65952 Log: Apache Spark v3.3.4-rc1 docs [This commit notification would consist of 2683 parts, which exceeds the limit of 50 ones, so it was shortened to the summary

svn commit: r65951 - /dev/spark/v3.4.2-rc1-docs/

2023-12-08 Thread dongjoon
Author: dongjoon Date: Fri Dec 8 19:49:07 2023 New Revision: 65951 Log: Remove Apache Spark 3.4.2 RC1 docs after 3.4.2 release Removed: dev/spark/v3.4.2-rc1-docs/ - To unsubscribe, e-mail: commits-unsubscr

svn commit: r65950 - /dev/spark/v3.3.4-rc1-bin/

2023-12-08 Thread dongjoon
Author: dongjoon Date: Fri Dec 8 19:47:54 2023 New Revision: 65950 Log: Apache Spark v3.3.4-rc1 Added: dev/spark/v3.3.4-rc1-bin/ dev/spark/v3.3.4-rc1-bin/SparkR_3.3.4.tar.gz (with props) dev/spark/v3.3.4-rc1-bin/SparkR_3.3.4.tar.gz.asc dev/spark/v3.3.4-rc1-bin/SparkR_3.3.4

(spark) branch master updated: [SPARK-46328][SQL] Allocate capacity of array list of TColumns by columns size in TRowSet generation

2023-12-08 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 20c9b3dc4fac [SPARK-46328][SQL] Allocate

(spark) 01/01: Preparing development version 3.3.5-SNAPSHOT

2023-12-08 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git commit 0837e78d9cee986f3f791072df2488947dcf0b9a Author: Dongjoon Hyun AuthorDate: Fri Dec 8 18:28:19 2023 +

(spark) 01/01: Preparing Spark release v3.3.4-rc1

2023-12-08 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to tag v3.3.4-rc1 in repository https://gitbox.apache.org/repos/asf/spark.git commit 18db204995b32e87a650f2f09f9bcf047ddafa90 Author: Dongjoon Hyun AuthorDate: Fri Dec 8 18:28:15 2023 +

(spark) branch branch-3.3 updated (6a4488f2f486 -> 0837e78d9cee)

2023-12-08 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git from 6a4488f2f486 [SPARK-45580][SQL][3.3] Handle case where a nested subquery becomes an existence join add

(spark) tag v3.3.4-rc1 created (now 18db204995b3)

2023-12-08 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to tag v3.3.4-rc1 in repository https://gitbox.apache.org/repos/asf/spark.git at 18db204995b3 (commit) This tag includes the following new commits: new 18db204995b3 Preparing Spark release

(spark) branch master updated (c06d41859f08 -> 9ffdcc398ed5)

2023-12-07 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from c06d41859f08 [SPARK-46320][CORE] Support `spark.master.rest.host` add 9ffdcc398ed5 [SPARK-46321][PS][TESTS] Re

(spark) branch master updated (b6b450927ec8 -> c06d41859f08)

2023-12-07 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from b6b450927ec8 [SPARK-46317][PYTHON][CONNECT] Match minor behaviour matching in SparkSession with full test coverage

(spark) branch master updated: [SPARK-46316][CORE] Enable `buf-lint-action` on `core` module

2023-12-07 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7e4a63a0588f [SPARK-46316][CORE] Enable `buf

(spark) branch master updated: Revert "[SPARK-46316][CORE] Enable `buf-lint-action` on `core` module"

2023-12-07 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 80dc64a573e1 Revert "[SPARK-46316]

(spark) branch master updated (105eee73cfa0 -> dcbae0643ce1)

2023-12-07 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 105eee73cfa0 [SPARK-46313][CORE] Log `Spark HA` recovery duration add dcbae0643ce1 [SPARK-46316][CORE] Enable

(spark) branch master updated (61a3e0587df6 -> 105eee73cfa0)

2023-12-07 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 61a3e0587df6 [SPARK-46312][CORE] Use `lower_camel_case` in `store_types.proto` add 105eee73cfa0 [SPARK-46313

(spark) branch master updated: [SPARK-46312][CORE] Use `lower_camel_case` in `store_types.proto`

2023-12-07 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 61a3e0587df6 [SPARK-46312][CORE] Use

(spark) branch master updated: [SPARK-46309][PS][TESTS] Remove unused code in `pyspark.pandas.tests.indexes.* `

2023-12-07 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9585cf6d56e3 [SPARK-46309][PS][TESTS] Remove

(spark) branch master updated (027aeb1764a8 -> 82e67461511e)

2023-12-07 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 027aeb1764a8 [SPARK-46277][PYTHON] Validate startup urls with the config being set add 82e67461511e [SPARK

(spark) branch master updated: [SPARK-46293][CONNECT][PYTHON] Use `protobuf` transitive dependency

2023-12-07 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e359318c4493 [SPARK-46293][CONNECT][PYTHON

(spark) branch master updated (0692856bb124 -> 8132e1700c81)

2023-12-07 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 0692856bb124 [SPARK-46307][PS][TESTS] Enable `fill_value` tests for `GroupByTests.test_shift` add 8132e1700c81

(spark) branch master updated: [SPARK-46301][CORE] Support `spark.worker.(initial|max)RegistrationRetries`

2023-12-07 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b92d64d6ef0c [SPARK-46301][CORE] Support

(spark) branch branch-3.3 updated: [SPARK-45580][SQL][3.3] Handle case where a nested subquery becomes an existence join

2023-12-06 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 6a4488f2f48 [SPARK-45580][SQL][3.3

(spark) branch branch-3.4 updated: [SPARK-45580][SQL][3.4] Handle case where a nested subquery becomes an existence join

2023-12-06 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 8e40ec6fa52 [SPARK-45580][SQL][3.4

(spark) branch master updated: [SPARK-46299][DOCS] Make `spark.deploy.recovery*` docs up-to-date

2023-12-06 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 43ca0b929ab [SPARK-46299][DOCS] Make

(spark) branch master updated: [SPARK-46292][CORE][UI] Show a summary of workers in MasterPage

2023-12-06 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e2441c41de4 [SPARK-46292][CORE][UI] Show

(spark) branch branch-3.5 updated: [SPARK-45580][SQL][3.5] Handle case where a nested subquery becomes an existence join

2023-12-06 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new dbb61981b80 [SPARK-45580][SQL][3.5

(spark) branch master updated: [SPARK-46230][PYTHON] Migrate `RetriesExceeded` into PySpark error

2023-12-06 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 31a48381f51 [SPARK-46230][PYTHON] Migrate

(spark) branch master updated: [SPARK-46270][SQL][CORE][SS] Use java16 instanceof expressions to replace the java8 instanceof statement

2023-12-06 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 231d89f89ed [SPARK-46270][SQL][CORE][SS] Use

(spark) branch master updated: [SPARK-46186][CONNECT][TESTS][FOLLOWUP] Remove flakiness of `ReattachableExecuteSuite`

2023-12-06 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 982c7268f4c [SPARK-46186][CONNECT][TESTS

(spark) branch master updated: [SPARK-45580][SQL] Handle case where a nested subquery becomes an existence join

2023-12-06 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c96fef2ea55 [SPARK-45580][SQL] Handle case

(spark) branch master updated: [SPARK-46232][PYTHON][FOLLOWUP] Migrate `ValueError` into `PySparkValueError`

2023-12-06 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 467df65ceba [SPARK-46232][PYTHON][FOLLOWUP

(spark) branch master updated: [SPARK-46283][INFRA] Remove `streaming-kinesis-asl` module from `MODULES_TO_TEST` for branch-3.x daily tests

2023-12-06 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 809cec01205 [SPARK-46283][INFRA] Remove

(spark) branch branch-3.3 updated: [SPARK-46286][DOCS] Document `spark.io.compression.zstd.bufferPool.enabled`

2023-12-06 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 37d10ec3644 [SPARK-46286][DOCS

(spark) branch branch-3.4 updated: [SPARK-46286][DOCS] Document `spark.io.compression.zstd.bufferPool.enabled`

2023-12-06 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 93fef098a0d [SPARK-46286][DOCS

(spark) branch branch-3.5 updated: [SPARK-46286][DOCS] Document `spark.io.compression.zstd.bufferPool.enabled`

2023-12-06 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new b5cbe1fcdb4 [SPARK-46286][DOCS

(spark) branch master updated: [SPARK-46286][DOCS] Document `spark.io.compression.zstd.bufferPool.enabled`

2023-12-06 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6b6980de451 [SPARK-46286][DOCS] Document

(spark) branch master updated: [SPARK-46287][PYTHON][CONNECT] `DataFrame.isEmpty` should work with all datatypes

2023-12-06 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f4e41e0e318 [SPARK-46287][PYTHON][CONNECT

(spark) branch master updated: [SPARK-46288][PS][TESTS] Remove unused code in `pyspark.pandas.tests.frame.*`

2023-12-06 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f6861c3918b [SPARK-46288][PS][TESTS] Remove

(spark) branch master updated: [SPARK-46268][PS][CONNECT][TESTS] Re-organize `StatsTests`

2023-12-05 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ef05fb632424 [SPARK-46268][PS][CONNECT][TESTS

(spark) branch master updated: [SPARK-46271][PS][TESTS] Remove unused properties in `pyspark.pandas.tests.groupby.*`

2023-12-05 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a56ca8a673d7 [SPARK-46271][PS][TESTS] Remove

(spark) branch master updated: [SPARK-46266][PS][CONNECT][TESTS] Re-organize `NumOpsTests`

2023-12-05 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e9ba896f8446 [SPARK-46266][PS][CONNECT][TESTS

(spark) branch master updated (7c741c8c25fc -> 9808ad3ac322)

2023-12-05 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 7c741c8c25fc [SPARK-46265][CONNECT] Assertions in AddArtifact RPC make the connect client incompatible with older

(spark) branch master updated: [SPARK-46219][SQL] Unwrap cast in join predicates

2023-12-05 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8235f1d56bf2 [SPARK-46219][SQL] Unwrap cast

(spark) branch master updated (b4bf9ec065bf -> c8451b58a3c4)

2023-12-05 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from b4bf9ec065bf [SPARK-46269][PS] Enable more NumPy compatibility function tests add c8451b58a3c4 [SPARK-46069

(spark) branch master updated: [SPARK-46269][PS] Enable more NumPy compatibility function tests

2023-12-05 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b4bf9ec065bf [SPARK-46269][PS] Enable more

(spark) branch master updated: [SPARK-46258][CORE] Add `RocksDBPersistenceEngine`

2023-12-05 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new dd11075db618 [SPARK-46258][CORE] Add

(spark) branch master updated: [SPARK-46233][PYTHON] Migrate all remaining `AttributeError` into PySpark error framework

2023-12-04 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new be49ca6dd71b [SPARK-46233][PYTHON] Migrate all

(spark) branch branch-3.3 updated: [SPARK-46239][CORE] Hide `Jetty` info

2023-12-04 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new aaec17fb244c [SPARK-46239][CORE] Hide

(spark) branch branch-3.4 updated: [SPARK-46239][CORE] Hide `Jetty` info

2023-12-04 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 757c3a9d62b7 [SPARK-46239][CORE] Hide

(spark) branch branch-3.5 updated: [SPARK-46239][CORE] Hide `Jetty` info

2023-12-04 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 1321b4e64dea [SPARK-46239][CORE] Hide

(spark) branch master updated: [SPARK-46239][CORE] Hide `Jetty` info

2023-12-04 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ff4f59341215 [SPARK-46239][CORE] Hide `Jetty

(spark) branch branch-3.3 updated: [SPARK-46092][SQL][3.3] Don't push down Parquet row group filters that overflow

2023-12-04 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new c9412307394f [SPARK-46092][SQL][3.3

(spark) branch master updated: [SPARK-46245][CORE][SQL][SS][YARN][K8S][UI] Replcace `s.c.MapOps.view.filterKeys` with `s.c.MapOps.filter`

2023-12-04 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ac0bd2eb7b40 [SPARK-46245][CORE][SQL][SS][YARN

(spark) branch master updated: [SPARK-32246][BUILD][INFRA] Enable `streaming-kinesis-asl` tests in Github Action CI

2023-12-04 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 64ec5f1017e1 [SPARK-32246][BUILD][INFRA

(spark) branch branch-3.4 updated: [SPARK-46092][SQL][3.4] Don't push down Parquet row group filters that overflow

2023-12-04 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 05b5c9e2e3df [SPARK-46092][SQL][3.4

(spark) branch branch-3.5 updated: [SPARK-46092][SQL][3.5] Don't push down Parquet row group filters that overflow

2023-12-04 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 97472c91ed56 [SPARK-46092][SQL][3.5

(spark) branch master updated: [SPARK-46231][PYTHON] Migrate all remaining `NotImplementedError` & `TypeError` into PySpark error framework

2023-12-04 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9666bf37958e [SPARK-46231][PYTHON] Migrate all

(spark) branch master updated: [SPARK-46237][SQL][TESTS] Make `HiveDDLSuite` independently testable

2023-12-04 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 37d19b9ee0e4 [SPARK-46237][SQL][TESTS] Make

(spark) branch master updated: [SPARK-46232][PYTHON] Migrate all remaining ValueError into PySpark error framework

2023-12-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b23ae15da019 [SPARK-46232][PYTHON] Migrate all

(spark) branch branch-3.4 updated: [SPARK-46182][CORE] Track `lastTaskFinishTime` using the exact task finished event

2023-12-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new b8750d5c0b41 [SPARK-46182][CORE] Track

(spark) branch branch-3.5 updated: [SPARK-46182][CORE] Track `lastTaskFinishTime` using the exact task finished event

2023-12-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 273ef5708fc3 [SPARK-46182][CORE] Track

(spark) branch master updated: [SPARK-46182][CORE] Track `lastTaskFinishTime` using the exact task finished event

2023-12-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6f112f7b1a50 [SPARK-46182][CORE] Track

(spark) branch master updated (0c029e70706c -> 712352e37ec5)

2023-12-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 0c029e70706c [SPARK-46218][BUILD] Upgrade commons-cli to 1.6.0 add 712352e37ec5 [SPARK-40559][PYTHON][DOCS

(spark) branch master updated: [SPARK-46218][BUILD] Upgrade commons-cli to 1.6.0

2023-12-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0c029e70706c [SPARK-46218][BUILD] Upgrade

(spark) branch master updated: [SPARK-46227][SQL] Move `withSQLConf` from `SQLHelper` to `SQLConfHelper`

2023-12-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new aee6b1582775 [SPARK-46227][SQL] Move

(spark) branch master updated: [SPARK-46217][CORE][TESTS] Include `Driver/App` data in `PersistenceEngineBenchmark`

2023-12-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5031e52f9e0 [SPARK-46217][CORE][TESTS] Include

(spark) branch master updated: [SPARK-46216][CORE] Improve `FileSystemPersistenceEngine` to support compressions

2023-12-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3da2e5c6324 [SPARK-46216][CORE] Improve

(spark) branch master updated: [SPARK-46206][PS] Use a narrower scope exception for SQL processor

2023-12-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 73a09ed7bd7 [SPARK-46206][PS] Use a narrower

(spark) branch master updated: [SPARK-46212][CORE][SQL][SS][CONNECT][MLLIB][GRAPHX][DSTREAM][PROTOBUF][EXAMPLES] Use other functions to simplify the code pattern of `s.c.MapOps#view.mapValues`

2023-12-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 938b7f58051 [SPARK-46212][CORE][SQL][SS

(spark) branch master updated: [SPARK-46215][CORE] Improve `FileSystemPersistenceEngine` to allow nonexistent parents

2023-12-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d1311f75dea [SPARK-46215][CORE] Improve

(spark) branch master updated: [SPARK-46213][PYTHON] Introduce `PySparkImportError` for error framework

2023-12-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 75b0eb2d6017 [SPARK-46213][PYTHON] Introduce

(spark) branch master updated: [MINOR][DOCS] Add `since` tag for `Scan.reportDriverMetrics`

2023-12-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new aa1eca8d26cc [MINOR][DOCS] Add `since` tag

(spark) branch master updated: [SPARK-41532][CONNECT][PYTHON][FOLLOWUP] Expose `SessionNotSameException` as PySpark exceptions

2023-12-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ccedc1988fa5 [SPARK-41532][CONNECT][PYTHON

(spark) branch master updated: [SPARK-46205][CORE][TESTS][FOLLOWUP] Simplify PersistenceEngineBenchmark

2023-12-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a6afd09f7f2f [SPARK-46205][CORE][TESTS

(spark) branch branch-3.5 updated: [SPARK-45975][SQL][TESTS][3.5] Reset storeAssignmentPolicy to original

2023-12-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new fde0fe676358 [SPARK-45975][SQL][TESTS

(spark) branch master updated: [SPARK-46092][SQL] Don't push down Parquet row group filters that overflow

2023-12-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8f8e41ea5203 [SPARK-46092][SQL] Don't push

(spark) branch master updated: [SPARK-46214][BUILD] Upgrade commons-io to 2.15.1

2023-12-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 341b7d7a6e3a [SPARK-46214][BUILD] Upgrade

(spark) branch master updated: [SPARK-46205][CORE] Improve `PersistenceEngine` performance with `KryoSerializer`

2023-12-01 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0d40b1aea758 [SPARK-46205][CORE] Improve

(spark) branch master updated: [SPARK-46201][PYTHON][DOCS] Correct the typing of `schema_of_{csv, json, xml}`

2023-12-01 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a4678143f6bb [SPARK-46201][PYTHON][DOCS

(spark) branch master updated: [SPARK-46199][PYTHON][DOCS] Add PyPi link icon to PySpark doc header

2023-12-01 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8060e7e73170 [SPARK-46199][PYTHON][DOCS] Add

<    4   5   6   7   8   9   10   11   12   13   >