svn commit: r67484 - /release/spark/KEYS

2024-02-21 Thread gurwls223
Author: gurwls223 Date: Thu Feb 22 04:41:14 2024 New Revision: 67484 Log: Update KEYS Modified: release/spark/KEYS Modified: release/spark/KEYS == --- release/spark/KEYS (original) +++ release/spark/KEYS Thu Feb 22

svn commit: r67483 - /dev/spark/v3.5.1-rc2-bin/ /release/spark/spark-3.5.1/

2024-02-21 Thread gurwls223
Author: gurwls223 Date: Thu Feb 22 04:39:15 2024 New Revision: 67483 Log: Release Apache Spark 3.5.1 Added: release/spark/spark-3.5.1/ - copied from r67482, dev/spark/v3.5.1-rc2-bin/ Removed: dev/spark/v3.5.1-rc2-bin

(spark) branch branch-3.5 updated: [SPARK-47125][SQL] Return null if Univocity never triggers parsing

2024-02-21 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new e81df1f39e8f [SPARK-47125][SQL

(spark) branch branch-3.4 updated: [SPARK-47125][SQL] Return null if Univocity never triggers parsing

2024-02-21 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 3192c8c68423 [SPARK-47125][SQL

(spark) branch master updated (65fe9efa40a3 -> a87015efb5cf)

2024-02-21 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 65fe9efa40a3 [SPARK-47101][SQL] Allow comma to be used in top-level column names and remove check nested type

(spark) branch master updated: [SPARK-47112][INFRA] Write logs into a file in SparkR Windows build

2024-02-20 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0d938de112df [SPARK-47112][INFRA] Write logs

(spark) branch master updated: [SPARK-47115][INFRA] Use larger memory for Maven builds

2024-02-20 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f4bb6528596b [SPARK-47115][INFRA] Use larger

(spark) branch master updated: [SPARK-47097][CONNECT][TESTS] Deflake interrupt tag at SparkSessionE2ESuite

2024-02-19 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b0aad59f1235 [SPARK-47097][CONNECT][TESTS

(spark) branch master updated: [SPARK-46820][PYTHON] Fix error message regression by restoring `new_msg`

2024-02-19 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9389c6b00f5f [SPARK-46820][PYTHON] Fix error

(spark) branch master updated (6dda3258533f -> aa53c8e18453)

2024-02-19 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 6dda3258533f [SPARK-47096][INFRA] Upgrade Python version in Maven builds add aa53c8e18453 [SPARK-47062

(spark) branch master updated: [MINOR][INFRA] Rename build_maven.yml and build_maven_java21.yml

2024-02-18 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 174a19c1c039 [MINOR][INFRA] Rename

(spark) branch master updated: [SPARK-47066][INFRA][FOLLOW-UP] Deduplicate Apple Silicon Maven build definition

2024-02-18 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8a9a1be9b02a [SPARK-47066][INFRA][FOLLOW-UP

(spark) branch master updated: [SPARK-47082][SQL] Fix out-of-bounds error condition

2024-02-17 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 63e8a1422059 [SPARK-47082][SQL] Fix out

(spark) branch master updated: Revert "[SPARK-47067][INFRA] Add Daily Apple Silicon Github Action Job (Java/Scala)"

2024-02-17 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e02ee42b1930 Revert "[SPARK-47067][INFRA

(spark) branch master updated: [SPARK-47057][PYTHON] Reeanble MyPy data test

2024-02-16 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d4235963309e [SPARK-47057][PYTHON] Reeanble

(spark) branch branch-3.4 updated: [SPARK-47068][PYTHON][TESTS] Recover -1 and 0 case for spark.sql.execution.arrow.maxRecordsPerBatch

2024-02-15 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new b4e28df675fa [SPARK-47068][PYTHON

(spark) branch branch-3.5 updated: [SPARK-47068][PYTHON][TESTS] Recover -1 and 0 case for spark.sql.execution.arrow.maxRecordsPerBatch

2024-02-15 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 1c1c5faa29dc [SPARK-47068][PYTHON

(spark) branch master updated: [SPARK-47068][PYTHON][TESTS] Recover -1 and 0 case for spark.sql.execution.arrow.maxRecordsPerBatch

2024-02-15 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3bb762dc0328 [SPARK-47068][PYTHON][TESTS

(spark) branch master updated: [SPARK-46078][PYTHON][TESTS] Upgrade `pytorch` for Python 3.12

2024-02-15 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3a146ce46c55 [SPARK-46078][PYTHON][TESTS

(spark) branch master updated: [SPARK-47055][PYTHON] Upgrade MyPy 1.8.0

2024-02-15 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7668eb5daf22 [SPARK-47055][PYTHON] Upgrade

(spark) branch master updated: [SPARK-46687][TESTS][PYTHON][FOLLOW-UP] Skip MemoryProfilerParityTests when codecov enabled

2024-02-14 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d72efc038124 [SPARK-46687][TESTS][PYTHON

(spark) branch branch-3.5 updated: Revert "[SPARK-45396][PYTHON] Add doc entry for `pyspark.ml.connect` module, and adds `Evaluator` to `__all__` at `ml.connect`"

2024-02-14 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new ea6b25767fb8 Revert "[SPARK-

(spark) branch master updated (5da73d32e36a -> 7acc1563696a)

2024-02-12 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 5da73d32e36a [SPARK-47026][SQL][TESTS] Enable JSON sources in default value nested type tests add

(spark) branch master updated: [SPARK-47026][SQL][TESTS] Enable JSON sources in default value nested type tests

2024-02-12 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5da73d32e36a [SPARK-47026][SQL][TESTS] Enable

(spark) branch master updated: [MINOR][SQL] Show only number of test blocks when there is a mismatch

2024-02-12 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 615c423d363e [MINOR][SQL] Show only number

(spark) branch master updated: [SPARK-46944] Follow up to SPARK-46792 (ChannelBuilder refactoring): Fix minor typing oversight

2024-02-12 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new fb7760621c33 [SPARK-46944] Follow up to SPARK

(spark) branch master updated: [SPARK-46984][PYTHON] Remove pyspark.copy_func

2024-02-06 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0bed57325de5 [SPARK-46984][PYTHON] Remove

(spark) branch master updated: [SPARK-46954][SQL] XML: Wrap InputStreamReader with BufferedReader

2024-02-05 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 10439902b6dd [SPARK-46954][SQL] XML: Wrap

(spark) branch master updated: Revert "[MINOR][DOCS] The default fractional numeric literal in SQL is a decimal"

2024-02-04 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4797e52f6766 Revert "[MINOR]

(spark) branch master updated: [MINOR][DOCS] The default fractional numeric literal in SQL is a decimal

2024-02-04 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b95f6d691cb5 [MINOR][DOCS] The default

(spark) branch master updated: [SPARK-46974][SQL][TEST] Recover a test case for day-of-year 2-letter 'DD' pattern parsing 3-digit values

2024-02-04 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1e13d8d8accb [SPARK-46974][SQL][TEST] Recover

(spark) branch master updated: [SPARK-46954][SQL] XML: Optimize schema index lookup

2024-02-04 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 69239729f35e [SPARK-46954][SQL] XML: Optimize

(spark) branch master updated: [SPARK-46952][SQL] XML: Limit size of corrupt record

2024-02-01 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2e07662e24e2 [SPARK-46952][SQL] XML: Limit

(spark) branch master updated: [SPARK-46683][SQL][TESTS][FOLLOW-UP] Fix typo, use queries in partition set

2024-02-01 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 58c9b5ac8ff4 [SPARK-46683][SQL][TESTS][FOLLOW

(spark) branch master updated: [SPARK-46941][SQL] Can't insert window group limit node for top-k computation if contains SizeBasedWindowFunction

2024-02-01 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c426b7285b58 [SPARK-46941][SQL] Can't insert

(spark) branch master updated: [MINOR][DOCS] Fix outgoing links from SELECT SQL reference page

2024-02-01 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 47fb5041b014 [MINOR][DOCS] Fix outgoing links

(spark) branch master updated (5d87ac6214bb -> 0871a6f15623)

2024-01-31 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 5d87ac6214bb [SPARK-46926][PS] Add `convert_dtypes`, `infer_objects` and `set_axis` in fallback list add

(spark) branch master updated (4f0a9df534a4 -> 2f917c32feeb)

2024-01-31 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 4f0a9df534a4 [SPARK-46925][PYTHON][CONNECT] Add a warning that instructs to install memory_profiler for memory

(spark) branch master updated (ecdb38e2d059 -> 4f0a9df534a4)

2024-01-31 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from ecdb38e2d059 [SPARK-46923][DOCS] Limit width of configuration tables add 4f0a9df534a4 [SPARK-46925][PYTHON

(spark) branch master updated (8e29c0d8c5cd -> ecdb38e2d059)

2024-01-31 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 8e29c0d8c5cd [SPARK-46921][BUILD] Move `ProblemFilters` that do not belong to `defaultExcludes` to `v40excludes

(spark) branch master updated: [SPARK-46910][PYTHON] Eliminate JDK Requirement in PySpark Installation

2024-01-29 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 83fad32f1c68 [SPARK-46910][PYTHON] Eliminate

(spark) branch master updated: [MINOR][DOCS] Remove Canonicalize in docs

2024-01-28 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 112f4acb6283 [MINOR][DOCS] Remove

(spark) branch master updated: [MINOR][DOCS] Miscellaneous documentation improvements

2024-01-28 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f078998df2f3 [MINOR][DOCS] Miscellaneous

(spark) branch master updated: [MINOR][DOCS] Remove unneeded comments from global.html

2024-01-28 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 901850cab748 [MINOR][DOCS] Remove unneeded

(spark) branch master updated (89d86e617da2 -> 02c945d6ab61)

2024-01-28 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 89d86e617da2 [SPARK-46873][SS] Do not recreate new StreamingQueryManager for the same Spark Session add

(spark) branch master updated: [SPARK-46873][SS] Do not recreate new StreamingQueryManager for the same Spark Session

2024-01-28 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 89d86e617da2 [SPARK-46873][SS] Do

(spark) branch master updated: [MINOR][INFRA] Update the location for error class README.md

2024-01-25 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new de71884273a3 [MINOR][INFRA] Update

(spark) branch master updated (1f23edfa84aa -> 3928b549dbe6)

2024-01-24 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 1f23edfa84aa [SPARK-46827][CORE] Make `RocksDBPersistenceEngine` to support a symbolic link add 3928b549dbe6

(spark) branch master updated (ee6ed43aa046 -> 7004dd9edcad)

2024-01-23 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from ee6ed43aa046 [SPARK-46733][CORE] Simplify the BlockManager by the exit operation only depend on interrupt thread

(spark) branch master updated: [SPARK-46811][FOLLOWUP] Increase check_run response result from 30 to 100

2024-01-23 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6ea2094da252 [SPARK-46811][FOLLOWUP] Increase

(spark) branch master updated: [SPARK-46530][PYTHON][SQL][FOLLOW-UP] Avoid checking Py4J and PySpark library when initial lookup of Python Data Sources

2024-01-23 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2ae7575b9ed1 [SPARK-46530][PYTHON][SQL

(spark) branch master updated: [SPARK-46811][INFRA] Fix Github Action: TypeError: Cannot read properties of undefined (reading 'head_sha')

2024-01-23 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new bfcc5e0135a0 [SPARK-46811][INFRA] Fix Github

(spark) branch master updated: Revert "[SPARK-46530][PYTHON][SQL][FOLLOW-UP] Uses path separator instead of file separator to correctly check PySpark library existence"

2024-01-23 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 20bb7c0b8584 Revert "[SPARK-46530][P

(spark) branch master updated: [SPARK-46728][PYTHON] Check Pandas installation properly

2024-01-23 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a43f93d76c9d [SPARK-46728][PYTHON] Check

(spark) branch master updated (0356ac009472 -> d1fbc4c7191a)

2024-01-23 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 0356ac009472 [SPARK-40876][SQL] Widening type promotion from integers to decimal in Parquet vectorized reader

(spark) branch master updated: [SPARK-46808][PYTHON] Refine error classes in Python with automatic sorting function

2024-01-22 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new eeed19158ea5 [SPARK-46808][PYTHON] Refine

(spark) branch master updated: [SPARK-46807][DOCS] Add automation notice to generated SQL error class docs

2024-01-22 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e7fb0ad68f73 [SPARK-46807][DOCS] Add

(spark) branch master updated: [SPARK-46806][PYTHON] Improve error message for spark.table when argument type is wrong

2024-01-22 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ae2d43f279d5 [SPARK-46806][PYTHON] Improve

(spark) branch master updated: [SPARK-46802][PYTHON][TESTS] Clean up obsolete code in PySpark coverage script

2024-01-22 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 227611d70d52 [SPARK-46802][PYTHON][TESTS

(spark) branch master updated: [SPARK-46781][PYTHON][TESTS] Test custom data source and input partition (pyspark.sql.datasource)

2024-01-22 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b1b29d9eeb76 [SPARK-46781][PYTHON][TESTS

(spark) branch master updated: [MINOR][DOCS] Miscellaneous link and anchor fixes

2024-01-22 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0a68e6ef1c54 [MINOR][DOCS] Miscellaneous link

(spark) branch master updated: [MINOR][DOCS] Fix SQL Error links and link anchors

2024-01-22 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3f3cbae8680e [MINOR][DOCS] Fix SQL Error

(spark) branch master updated: [SPARK-46775][DOCS] Fix formatting of Kinesis docs

2024-01-21 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1f68dc73f69f [SPARK-46775][DOCS] Fix

(spark) branch master updated: [MINOR][DOCS] Fix broken ML paper links

2024-01-21 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0721c108588e [MINOR][DOCS] Fix broken ML

(spark) branch master updated (c0939fa1f5c6 -> b5f592bdb1a1)

2024-01-18 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from c0939fa1f5c6 [SPARK-46576][SQL][FOLLOWUP] Improve error messages for unsupported data source save mode add

(spark) branch master updated (01bb1b1a3dbf -> c0939fa1f5c6)

2024-01-18 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 01bb1b1a3dbf [SPARK-46759][SQL][AVRO] Codec xz and zstandard support compression level for avro files add

(spark) branch master updated: [SPARK-46749][DOCS] Document `SPARK_LOG_*` and `SPARK_PID_DIR`

2024-01-17 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new be1e8d8792ed [SPARK-46749][DOCS] Document

(spark) branch branch-3.5 updated: [SPARK-46663][PYTHON][3.5] Disable memory profiler for pandas UDFs with iterators

2024-01-17 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new d083da76b4d6 [SPARK-46663][PYTHON

(spark) branch master updated: [SPARK-46686][PYTHON][CONNECT] Basic support of SparkSession based Python UDF profiler

2024-01-17 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d8703dd1c7bb [SPARK-46686][PYTHON][CONNECT

(spark) branch branch-3.5 updated: [SPARK-46732][CONNECT][3.5] Make Subquery/Broadcast thread work with Connect's artifact management

2024-01-16 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 5a0bc96d5f5e [SPARK-46732][CONNECT

(spark) branch master updated: [SPARK-46474][INFRA] Upgrade upload-artifact action to v4

2024-01-16 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4ea8ae0105e5 [SPARK-46474][INFRA] Upgrade

(spark) branch master updated: [SPARK-46732][CONNECT] Make Subquery/Broadcast thread work with Connect's artifact management

2024-01-16 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d968986704ad [SPARK-46732][CONNECT] Make

(spark) branch master updated: [SPARK-46730][PYTHON][DOCS] Refine docstring of `str_to_map/map_filter/map_zip_with`

2024-01-16 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3960c57b4c1b [SPARK-46730][PYTHON][DOCS

(spark) branch master updated: [SPARK-46670][PYTHON][SQL][FOLLOW-UP] Do not pass static Python Data Sources around when cloning DataSourceManager

2024-01-15 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 293b2a3d51da [SPARK-46670][PYTHON][SQL

(spark) branch master updated: [SPARK-46677][SQL][CONNECT] Fix `dataframe["*"]` resolution

2024-01-15 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new cd3fa2f6b937 [SPARK-46677][SQL][CONNECT] Fix

(spark) branch master updated: [SPARK-46723][CONNECT][SCALA] Make addArtifact retryable

2024-01-15 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f5d7aef1b184 [SPARK-46723][CONNECT][SCALA

(spark) branch master updated: [SPARK-46720][SQL][PYTHON] Refactor Python Data Source to align with other DSv2 built-in Data Sources

2024-01-15 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f3ffd3ca68d2 [SPARK-46720][SQL][PYTHON

(spark) branch master updated: [SPARK-46660][CONNECT] ReattachExecute requests updates aliveness of SessionHolder

2024-01-15 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2c8ea75d92ee [SPARK-46660][CONNECT

(spark) branch master updated: [SPARK-46716][SS][TESTS] Add a test regarding to backward compatibility check for Scala StreamingQueryListener

2024-01-14 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b18b6cca28ef [SPARK-46716][SS][TESTS] Add

(spark) branch master updated (86bac8911a31 -> 4f72ef843c4e)

2024-01-14 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 86bac8911a31 [SPARK-46711][SS] Fix RocksDB state provider race condition during rollback add 4f72ef843c4e

(spark) branch master updated: [SPARK-46709][SS] Expose partition_id column for state data source

2024-01-14 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1c3b94150b44 [SPARK-46709][SS] Expose

(spark) branch master updated: [SPARK-42960][PYTHON][SS][TESTS] Factor Connect/non-Connect specific logics out

2024-01-12 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 57121c7d815a [SPARK-42960][PYTHON][SS][TESTS

(spark) branch master updated (4ea374257c1f -> 1c9b022f5264)

2024-01-12 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 4ea374257c1f [SPARK-46700][CORE] Count the last spilling for the shuffle disk spilling bytes metric add

(spark) branch branch-3.5 updated: [SPARK-46684][PYTHON][CONNECT][3.5] Fix CoGroup.applyInPandas/Arrow to pass arguments properly

2024-01-11 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new d422aed4a2e8 [SPARK-46684][PYTHON

(spark) branch master updated (28da1d853477 -> b7e976696f51)

2024-01-11 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 28da1d853477 [SPARK-46383] Reduce Driver Heap Usage by Reducing the Lifespan of `TaskInfo.accumulables()` add

(spark) branch master updated: [SPARK-46670][PYTHON][SQL] Make DataSourceManager self clone-able by separating static and runtime Python Data Sources

2024-01-11 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4828f49ce15a [SPARK-46670][PYTHON][SQL] Make

(spark) branch master updated: [SPARK-46667][SQL] XML: Throw error on multiple XML data source

2024-01-11 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 462b3dd2bf39 [SPARK-46667][SQL] XML: Throw

(spark) branch master updated: [SPARK-46668][DOCS] Parallelize Sphinx build of Python API docs

2024-01-10 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5eec99df01f8 [SPARK-46668][DOCS] Parallelize

(spark) branch master updated: [SPARK-46614][PYTHON][DOCS] Refine docstring `make_timestamp/make_timestamp_ltz/make_timestamp_ntz/make_ym_interval`

2024-01-10 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 48d429dd8014 [SPARK-46614][PYTHON][DOCS

(spark) branch master updated: [SPARK-46666][PYTHON][TESTS] Make lxml as an optional testing dependency in test_session

2024-01-10 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 442bf77426b0 [SPARK-4][PYTHON][TESTS

(spark) branch master updated: [SPARK-46382][SQL] XML: Update doc for `ignoreSurroundingSpaces`

2024-01-10 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4653d501c156 [SPARK-46382][SQL] XML: Update

(spark) branch master updated: [SPARK-46658][DOCS] Loosen Ruby dependency specification

2024-01-10 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1e3892f939f8 [SPARK-46658][DOCS] Loosen Ruby

(spark) branch master updated: [SPARK-46474][INFRA] Upgrade upload-artifact action to v4

2024-01-10 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 186e1b3f4a43 [SPARK-46474][INFRA] Upgrade

(spark) branch master updated: [SPARK-46437][FOLLOWUP] Update configuration.md to use include_api_gen

2024-01-09 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new fcdfc8cbb24e [SPARK-46437][FOLLOWUP] Update

(spark) branch master updated (a3991b17e379 -> 63758177e9c6)

2024-01-09 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from a3991b17e379 [SPARK-46648][SQL] Use `zstd` as the default ORC compression add 63758177e9c6 [SPARK-46651][PS

(spark) branch master updated: [MINOR][DOCS] Correct the usage example of Dataset in Java

2024-01-09 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d2f572428be5 [MINOR][DOCS] Correct the usage

(spark) branch master updated: [SPARK-46649][PYTHON][INFRA] Run PyPy 3 and Python 3.10 tests independently

2024-01-09 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f526bea1dc0c [SPARK-46649][PYTHON][INFRA] Run

(spark) branch master updated (0791e9f302fb -> 4957c1a5fd42)

2024-01-09 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 0791e9f302fb [SPARK-46536][SQL] Support GROUP BY calendar_interval_type add 4957c1a5fd42 [SPARK-46645][INFRA

(spark) branch master updated: [SPARK-46536][SQL] Support GROUP BY calendar_interval_type

2024-01-09 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0791e9f302fb [SPARK-46536][SQL] Support GROUP

(spark) branch master updated: [SPARK-37039][PS] Fix `Series.astype` to work properly with missing value

2024-01-09 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0a66be8ded3 [SPARK-37039][PS] Fix

<    1   2   3   4   5   6   7   8   9   10   >