(spark) branch master updated (c71d02ab7c80 -> 991763c2cdf8)

2024-04-30 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from c71d02ab7c80 [SPARK-48028][TESTS] Regenerate benchmark results after turning ANSI on add 991763c2cdf8 [SPARK

(spark) branch master updated (12a507464f10 -> 332570f42203)

2024-04-30 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 12a507464f10 [SPARK-47566][SQL] Support SubstringIndex function to work with collated strings add

(spark) branch master updated (87b20b166c41 -> e0af82497607)

2024-04-29 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 87b20b166c41 [SPARK-47585][SQL] SQL core: Migrate logInfo with variables to structured logging framework add

(spark) branch master updated: [SPARK-48039][PYTHON][CONNECT] Update the error class for `group.apply`

2024-04-29 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c74f584481d9 [SPARK-48039][PYTHON][CONNECT

(spark) branch master updated: [SPARK-48002][PYTHON][SS][TESTS] Adds sleep before event testing after query termination

2024-04-29 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new eaed585c55e5 [SPARK-48002][PYTHON][SS][TESTS

(spark) branch master updated (506b2d5eb8d9 -> 8c446f35dc03)

2024-04-28 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 506b2d5eb8d9 [SPARK-48014][SQL] Change the makeFromJava error in EvaluatePython to a user-facing error add

(spark) branch master updated (023f07d845c3 -> 506b2d5eb8d9)

2024-04-28 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 023f07d845c3 [SPARK-47933][CONNECT][PYTHON][FOLLOW-UP] Remove `pyspark.sql.classic` reference in `pyspark.ml.stat

(spark) branch master updated: [SPARK-47933][CONNECT][PYTHON][FOLLOW-UP] Remove `pyspark.sql.classic` reference in `pyspark.ml.stat`

2024-04-28 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 023f07d845c3 [SPARK-47933][CONNECT][PYTHON

(spark) branch master updated: [SPARK-48024][PYTHON][CONNECT][TESTS] Enable `UDFParityTests.test_udf_timestamp_ntz`

2024-04-28 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 657d9d0df5d6 [SPARK-48024][PYTHON][CONNECT

(spark) branch master updated: [SPARK-48002][PYTHON][SS] Add test for observed metrics in PySpark StreamingQueryListener

2024-04-28 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a80579bbcf74 [SPARK-48002][PYTHON][SS] Add

(spark) branch master updated (e04ac56e645f -> 95d6c615c081)

2024-04-26 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from e04ac56e645f [SPARK-45225][SQL][FOLLOW-UP] XML: Fix nested XSD file path resolution add 95d6c615c081 [SPARK

(spark) branch master updated: [SPARK-45225][SQL][FOLLOW-UP] XML: Fix nested XSD file path resolution

2024-04-26 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e04ac56e645f [SPARK-45225][SQL][FOLLOW-UP

(spark) branch master updated (2e5825fb32c0 -> 3451e66fe71d)

2024-04-26 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 2e5825fb32c0 [SPARK-47858][PYTHON][FOLLOWUP] Excluding Python magic methods from error context target add

(spark) branch master updated: [SPARK-47858][PYTHON][FOLLOWUP] Excluding Python magic methods from error context target

2024-04-26 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2e5825fb32c0 [SPARK-47858][PYTHON][FOLLOWUP

(spark) branch master updated (b4624bf4be28 -> dab4a044b647)

2024-04-25 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from b4624bf4be28 [SPARK-47414][SQL] Lowercase collation support for regexp expressions add dab4a044b647 [SPARK

(spark) branch master updated: Revert "[SPARK-45302][PYTHON] Remove PID communication between Pythonworkers when no demon is used"

2024-04-24 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c6aaa18e6cfd Revert "[SPARK-45302][P

(spark) branch master updated (d23389252a7d -> ea37c860a1a8)

2024-04-24 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from d23389252a7d [SPARK-47967][SQL] Make `JdbcUtils.makeGetter` handle reading time type as NTZ correctly add

(spark) branch master updated: [SPARK-47965][CORE] Avoid orNull in TypedConfigBuilder and OptionalConfigEntry

2024-04-24 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0042b676c232 [SPARK-47965][CORE] Avoid orNull

(spark) branch master updated (fd695be19d3f -> 6f01982094f6)

2024-04-24 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from fd695be19d3f [SPARK-47903][PYTHON][FOLLOW-UP] Removed changes relating to try_parse_json add 6f01982094f6

(spark) branch master updated: [SPARK-47903][PYTHON][FOLLOW-UP] Removed changes relating to try_parse_json

2024-04-24 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new fd695be19d3f [SPARK-47903][PYTHON][FOLLOW-UP

(spark) branch master updated: [SPARK-47933][PYTHON][CONNECT][FOLLOW-UP] Add a check of `__name__` at `_with_origin`

2024-04-23 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new aa4a84bd8474 [SPARK-47933][PYTHON][CONNECT

(spark) branch master updated: Revert "Revert "[SPARK-45302][PYTHON] Remove PID communication between Python workers when no demon is used""

2024-04-23 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b3c11ef8e090 Revert "Revert "[S

(spark) branch master updated (390fb7429029 -> e8f529bb89a6)

2024-04-23 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 390fb7429029 [SPARK-47941][SS][CONNECT] Propagate ForeachBatch worker initialization errors to users for PySpark

(spark) branch master updated (c88fabfee41d -> 390fb7429029)

2024-04-23 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from c88fabfee41d [SPARK-47604][CORE] Resource managers: Migrate logInfo with variables to structured logging framework

(spark) branch master updated (9e7ee7601d38 -> b335dd366fb1)

2024-04-22 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 9e7ee7601d38 [SPARK-47903][PYTHON] Add support for remaining scalar types in the PySpark Variant library add

(spark) branch master updated: [SPARK-47903][PYTHON] Add support for remaining scalar types in the PySpark Variant library

2024-04-22 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9e7ee7601d38 [SPARK-47903][PYTHON] Add

(spark) branch master updated (e1432ef6405a -> 79a1fa4b84dd)

2024-04-22 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from e1432ef6405a [SPARK-47413][SQL] - add support to substr/left/right for collations add 79a1fa4b84dd [SPARK

(spark) branch master updated (393a84fb074a -> 2d9d444b122d)

2024-04-21 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 393a84fb074a [SPARK-47909][PYTHON][CONNECT] Parent DataFrame class for Spark Connect and Spark Classic add

(spark) branch master updated (adf02d38061b -> 393a84fb074a)

2024-04-21 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from adf02d38061b [SPARK-47925][SQL][TESTS] Mark `BloomFilterAggregateQuerySuite` as `ExtendedSQLTest` add

(spark) branch master updated (e2e17fe6e038 -> bb5ded8f1bb0)

2024-04-18 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from e2e17fe6e038 [SPARK-47816][CONNECT][DOCS][FOLLOWUP] refine the description add bb5ded8f1bb0 [SPARK-47371][SQL

(spark) branch master updated: [SPARK-47816][CONNECT][DOCS][FOLLOWUP] refine the description

2024-04-18 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e2e17fe6e038 [SPARK-47816][CONNECT][DOCS

(spark) branch master updated: [SPARK-44461][FOLLOWUP][SS][CONNECT] Remove unneeded TODOs

2024-04-18 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d09230b6601c [SPARK-44461][FOLLOWUP][SS

(spark) branch master updated (216379df3543 -> bcafb43825ac)

2024-04-18 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 216379df3543 [SPARK-47858][SPARK-47852][PYTHON][SQL] Refactoring the structure for DataFrame error context

(spark) branch master updated: [SPARK-47858][SPARK-47852][PYTHON][SQL] Refactoring the structure for DataFrame error context

2024-04-18 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 216379df3543 [SPARK-47858][SPARK-47852

(spark) branch master updated (eb8688c2b6ce -> 564b2384c40d)

2024-04-18 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from eb8688c2b6ce [SPARK-47896][BUILD] Upgrade netty to `4.1.109.Final` add 564b2384c40d [SPARK-47864][PYTHON][DOCS

(spark) branch master updated: [SPARK-46810][DOCS][FOLLOWUP] Make some reference file links clickable

2024-04-17 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2e81f9a3b561 [SPARK-46810][DOCS][FOLLOWUP

(spark) branch master updated: [SPARK-47891][PYTHON][DOCS] Improve docstring of mapInPandas

2024-04-17 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a7f8ccef122a [SPARK-47891][PYTHON][DOCS

(spark) branch master updated (5da7b6878c20 -> 7dc88db0c8b6)

2024-04-17 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 5da7b6878c20 [SPARK-47763][CONNECT][TESTS] Enable local-cluster tests with pyspark-connect package add

(spark) branch master updated: [SPARK-47763][CONNECT][TESTS] Enable local-cluster tests with pyspark-connect package

2024-04-17 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5da7b6878c20 [SPARK-47763][CONNECT][TESTS

(spark) branch master updated: [SPARK-47884][INFRA] Switch ANSI SQL CI job to NON-ANSI SQL CI job

2024-04-17 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e327c1220abf [SPARK-47884][INFRA] Switch ANSI

(spark) branch master updated: [SPARK-46812][CONNECT][PYTHON][FOLLOW-UP] Add pyspark.pyspark.sql.connect.resource into PyPi packaging

2024-04-17 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8c2c0fb43a9d [SPARK-46812][CONNECT][PYTHON

(spark) branch master updated: [SPARK-46375][DOCS] Add user guide for Python data source API

2024-04-16 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f9ebe1b3d24b [SPARK-46375][DOCS] Add user

(spark) branch master updated (5321353b24db -> 86837d3155b1)

2024-04-16 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 5321353b24db [SPARK-47875][CORE] Remove `spark.deploy.recoverySerializer` add 86837d3155b1 [SPARK-47877][SS

(spark) branch master updated: [SPARK-47760][SPARK-47763][CONNECT][TESTS] Reeanble Avro and Protobuf function doctests

2024-04-16 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 57c7db2c4c1d [SPARK-47760][SPARK-47763

(spark) branch master updated: [SPARK-47818][CONNECT] Introduce plan cache in SparkConnectPlanner to improve performance of Analyze requests

2024-04-16 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a1fc6d57b27d [SPARK-47818][CONNECT] Introduce

(spark) branch master updated (3ff339362b75 -> 21cc89b68ba5)

2024-04-15 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 3ff339362b75 [SPARK-47861][BUILD] Upgrade `slf4j` to 2.0.13 add 21cc89b68ba5 [SPARK-47862][PYTHON][CONNECT

(spark) branch master updated: [SPARK-47233][CONNECT][SS][2/2] Client & Server logic for Client side streaming query listener

2024-04-15 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 51d3efcead5b [SPARK-47233][CONNECT][SS][2/2

(spark) branch master updated (61f8ec6c5175 -> e815012f26ab)

2024-04-15 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 61f8ec6c5175 [SPARK-47866][SQL][TESTS] Use explicit GC in `PythonForeachWriterSuite` add e815012f26ab [SPARK

(spark) branch master updated (c5b8e60e0d59 -> 61f8ec6c5175)

2024-04-15 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from c5b8e60e0d59 [SPARK-46810][DOCS] Align error class terminology with SQL standard add 61f8ec6c5175 [SPARK

(spark) branch master updated (e6b7950f553c -> b8354bbe53c0)

2024-04-15 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from e6b7950f553c [SPARK-47788][SS] Ensure the same hash partitioning for streaming stateful ops add b8354bbe53c0

(spark) branch master updated (a7cff5c7a383 -> 73aa4059cd5c)

2024-04-14 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from a7cff5c7a383 [SPARK-47757][SPARK-47756][CONNECT][PYTHON][TESTS] Make testing Spark Connect server having

(spark) branch master updated (1096801ead29 -> a7cff5c7a383)

2024-04-14 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 1096801ead29 [SPARK-47828][CONNECT][PYTHON] DataFrameWriterV2.overwrite` fails with invalid plan add

(spark) branch master updated (85c4f053f25a -> e7d0ba783f43)

2024-04-14 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 85c4f053f25a [SPARK-47841][BUILD] Upgrade `postgresql` to 42.7.3 add e7d0ba783f43 [SPARK-47826][SQL][PYTHON

(spark) branch master updated: [SPARK-47812][CONNECT] Support Serialization of SparkSession for ForEachBatch worker

2024-04-12 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e7fc4003b246 [SPARK-47812][CONNECT] Support

(spark) branch master updated (de00ac8a05ae -> f0ea0968d946)

2024-04-12 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from de00ac8a05ae [SPARK-47765][SQL] Add SET COLLATION to parser rules add f0ea0968d946 [MINOR][PYTHON] Enable

(spark) branch master updated: [SPARK-47831][PS][CONNECT][TESTS] Run Pandas API on Spark for pyspark-connect package

2024-04-12 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new daf260f74e12 [SPARK-47831][PS][CONNECT][TESTS

(spark) branch master updated (1ee3496f4836 -> 4e46852d0880)

2024-04-12 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 1ee3496f4836 [SPARK-47792][CORE] Make the value of MDC can support `null` & cannot be `MessageWithCon

(spark) branch master updated: [SPARK-47174][CONNECT][SS][1/2] Server side SparkConnectListenerBusListener for Client side streaming query listener

2024-04-11 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f086c2327c36 [SPARK-47174][CONNECT][SS][1/2

(spark) branch branch-3.5 updated: [SPARK-47824][PS] Fix nondeterminism in pyspark.pandas.series.asof

2024-04-11 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new d18659de626c [SPARK-47824][PS] Fix

(spark) branch branch-3.4 updated: [SPARK-47824][PS] Fix nondeterminism in pyspark.pandas.series.asof

2024-04-11 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new d0fd730839d8 [SPARK-47824][PS] Fix

(spark) branch master updated: [SPARK-47824][PS] Fix nondeterminism in pyspark.pandas.series.asof

2024-04-11 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a0ccdf27e5ff [SPARK-47824][PS] Fix

(spark) branch master updated: [SPARK-47811][PYTHON][CONNECT][TESTS] Run ML tests for pyspark-connect package

2024-04-11 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new aa568354725c [SPARK-47811][PYTHON][CONNECT

(spark) branch master updated (c303b042966b -> 6fdf9c9df545)

2024-04-11 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from c303b042966b [SPARK-47808][PYTHON][ML][TESTS] Make pyspark.ml.connect tests running without optional dependencies

(spark) branch master updated: [SPARK-47808][PYTHON][ML][TESTS] Make pyspark.ml.connect tests running without optional dependencies

2024-04-11 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c303b042966b [SPARK-47808][PYTHON][ML][TESTS

(spark) branch branch-3.4 updated: [MINOR][DOCS] Clarify relation between grouping API and `spark.sql.execution.arrow.maxRecordsPerBatch`

2024-04-10 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new e94bb505b897 [MINOR][DOCS] Clarify

(spark) branch branch-3.5 updated: [MINOR][DOCS] Clarify relation between grouping API and `spark.sql.execution.arrow.maxRecordsPerBatch`

2024-04-10 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 0818ce7eac97 [MINOR][DOCS] Clarify

(spark) branch master updated: [MINOR][DOCS] Clarify relation between grouping API and `spark.sql.execution.arrow.maxRecordsPerBatch`

2024-04-10 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6c8e4cfd6f3f [MINOR][DOCS] Clarify relation

(spark) branch branch-3.5 updated: [SPARK-47704][SQL] JSON parsing fails with "java.lang.ClassCastException" when spark.sql.json.enablePartialResults is enabled

2024-04-10 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 8a77a012cd6d [SPARK-47704][SQL] JSON

(spark) branch master updated: [SPARK-47704][SQL] JSON parsing fails with "java.lang.ClassCastException" when spark.sql.json.enablePartialResults is enabled

2024-04-10 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a2b7050e0fc5 [SPARK-47704][SQL] JSON parsing

(spark) branch master updated: [SPARK-47725][INFRA][FOLLOW-UP] Do not run scheduled job in forked repository

2024-04-10 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8da9a70f701a [SPARK-47725][INFRA][FOLLOW-UP

(spark) branch master updated: [SPARK-47366][SQL][PYTHON] Add VariantVal for PySpark

2024-04-10 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f6d5ad3ec75b [SPARK-47366][SQL][PYTHON] Add

(spark) branch master updated: [SPARK-41811][PYTHON][CONNECT] Implement `SQLStringFormatter` with `WithRelations`

2024-04-10 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a100e11936bc [SPARK-41811][PYTHON][CONNECT

(spark-connect-go) branch master updated: [MINOR] Make readme easier to follow

2024-04-10 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark-connect-go.git The following commit(s) were added to refs/heads/master by this push: new f7ad518 [MINOR] Make readme

(spark) branch master updated: [SPARK-47081][CONNECT][FOLLOW] Improving the usability of the Progress Handler

2024-04-09 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4a3fd8f7e69e [SPARK-47081][CONNECT][FOLLOW

(spark) branch master updated: [MINOR][TESTS] Make `check_invalid_args` reusable in parity test

2024-04-08 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new fea1994fe756 [MINOR][TESTS] Make

(spark) branch branch-3.5 updated: [SPARK-47762][PYTHON][CONNECT] Add pyspark.sql.connect.protobuf into setup.py

2024-04-08 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 932f9c7df38d [SPARK-47762][PYTHON

(spark) branch master updated: [SPARK-47762][PYTHON][CONNECT] Add pyspark.sql.connect.protobuf into setup.py

2024-04-08 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f94d95d75886 [SPARK-47762][PYTHON][CONNECT

(spark) branch master updated: [MINOR][PYTHON][SS][TESTS] Drop the tables after being used at `test_streaming_foreach_batch`

2024-04-07 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ad2367c55aeb [MINOR][PYTHON][SS][TESTS] Drop

(spark) branch master updated (b299b2bc06a9 -> cc6c0eb1bee6)

2024-04-07 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from b299b2bc06a9 [SPARK-47299][PYTHON][DOCS] Use the same `versions.json` in the dropdown of different versions

(spark) branch master updated (e92e8f5441a7 -> 0c992b205946)

2024-04-07 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from e92e8f5441a7 [SPARK-47744] Add support for negative-valued bytes in range encoder add 0c992b205946 [SPARK

(spark) branch master updated (d7430124191a -> f7dff4aa0c8f)

2024-04-07 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from d7430124191a [SPARK-47753][PYTHON][CONNECT][TESTS] Make pyspark.testing compatible with pyspark-connect add

(spark) branch master updated: [SPARK-47753][PYTHON][CONNECT][TESTS] Make pyspark.testing compatible with pyspark-connect

2024-04-07 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d7430124191a [SPARK-47753][PYTHON][CONNECT

(spark) branch master updated: [SPARK-47751][PYTHON][CONNECT] Make pyspark.worker_utils compatible with pyspark-connect

2024-04-07 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c11585ac296e [SPARK-47751][PYTHON][CONNECT

(spark) branch master updated (644687b66e1a -> 4d9dbb35aacb)

2024-04-07 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 644687b66e1a [SPARK-47709][BUILD] Upgrade tink to 1.13.0 add 4d9dbb35aacb [SPARK-46722][CONNECT][SS][TESTS

(spark) branch master updated (d5620cbe9a2e -> aeb082e06091)

2024-04-04 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from d5620cbe9a2e [SPARK-47289][SQL] Allow extensions to log extended information in explain plan add aeb082e06091

(spark) branch branch-3.5 updated: [SPARK-47734][PYTHON][TESTS] Fix flaky DataFrame.writeStream doctest by stopping streaming query

2024-04-04 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 3cb6a44a8d91 [SPARK-47734][PYTHON

(spark) branch master updated (b9ca91dde94c -> 0107435cb39d)

2024-04-04 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from b9ca91dde94c [SPARK-47712][CONNECT] Allow connect plugins to create and process Datasets add 0107435cb39d

(spark) branch branch-3.5 updated: [SPARK-47568][SS][3.5] Fix race condition between maintenance thread and load/commit for snapshot files

2024-04-04 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 465a85375b1e [SPARK-47568][SS][3.5

(spark) branch master updated: [SPARK-47712][CONNECT] Allow connect plugins to create and process Datasets

2024-04-04 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b9ca91dde94c [SPARK-47712][CONNECT] Allow

(spark) branch master updated: [SPARK-47081][CONNECT][FOLLOW-UP] Add the `shell` module into PyPI package

2024-04-04 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 404d58c74e16 [SPARK-47081][CONNECT][FOLLOW-UP

(spark) branch master updated (f6999df0c7f0 -> bffb02d14fa4)

2024-04-04 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from f6999df0c7f0 [SPARK-47081][CONNECT] Support Query Execution Progress add bffb02d14fa4 [SPARK-47565][PYTHON

(spark) branch master updated: [SPARK-47724][PYTHON][TESTS] Add an environment variable for testing remote pure Python library

2024-04-03 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d272a1b4367e [SPARK-47724][PYTHON][TESTS] Add

(spark) branch master updated (447f8aff6c26 -> 678aeb7ef708)

2024-04-03 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 447f8aff6c26 [SPARK-47720][CORE] Update `spark.speculation.multiplier` to 3 and `spark.speculation.quantile

(spark) branch master updated: [SPARK-47708][CONNECT] Do not log gRPC exception to stderr in PySpark

2024-04-03 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d87ac8ef49db [SPARK-47708][CONNECT] Do

(spark) branch master updated: [SPARK-47722][SS] Wait until RocksDB background work finish before closing

2024-04-03 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 49eefc5d1d92 [SPARK-47722][SS] Wait until

(spark) branch master updated: [SPARK-47721][DOC] Guidelines for the Structured Logging Framework

2024-04-03 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new fbe6b1dba2ab [SPARK-47721][DOC] Guidelines

(spark) branch master updated (7dec5eb14644 -> 6a0555c39b2d)

2024-04-03 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 7dec5eb14644 [SPARK-47705][INFRA] Sort LogKey alphabetically and build a test to ensure it add 6a0555c39b2d

(spark) branch master updated (62f90ec6d32f -> 6e3a42515067)

2024-04-03 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 62f90ec6d32f [SPARK-47452][INFRA][FOLLOWUP] Enforce to install `six` to `Python 3.10` add 6e3a42515067 [MINOR

(spark) branch master updated: [SPARK-46812][CONNECT][PYTHON] Make mapInPandas / mapInArrow support ResourceProfile

2024-04-01 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 43cedc0b3dea [SPARK-46812][CONNECT][PYTHON

(spark) branch master updated (128f74b055d3 -> 58f44e8a00f3)

2024-04-01 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 128f74b055d3 [SPARK-47676][BUILD] Clean up the removed `VersionsSuite` references add 58f44e8a00f3 [SPARK

<    1   2   3   4   5   6   7   8   9   10   >