(spark) branch master updated: [SPARK-48412][PYTHON] Refactor data type json parse

2024-05-24 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new bd95040c3170 [SPARK-48412][PYTHON] Refactor

(spark) branch master updated: [MINOR][TESTS] Add a helper function for `spark.table` in dsl

2024-05-23 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4a471cceebed [MINOR][TESTS] Add a helper

(spark) branch master updated: [SPARK-48395][PYTHON] Fix `StructType.treeString` for parameterized types

2024-05-23 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 14d3f447360b [SPARK-48395][PYTHON] Fix

(spark) branch master updated: [SPARK-48372][SPARK-45716][PYTHON] Implement `StructType.treeString`

2024-05-22 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e55875b0bbe0 [SPARK-48372][SPARK-45716][PYTHON

(spark) branch master updated (e702b32656bc -> a886121aee45)

2024-05-21 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from e702b32656bc [SPARK-48314][SS] Don't double cache files for FileStreamSource using Trigger.AvailableNow add

(spark) branch master updated (6e6e7a00f662 -> df50d4b309b5)

2024-05-21 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 6e6e7a00f662 [SPARK-48369][SQL][PYTHON][CONNECT] Add function `timestamp_add` add df50d4b309b5 [SPARK-48336

(spark) branch master updated: [SPARK-48369][SQL][PYTHON][CONNECT] Add function `timestamp_add`

2024-05-21 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6e6e7a00f662 [SPARK-48369][SQL][PYTHON

(spark) branch master updated: [MINOR][PYTHON][TESTS] Test `test_mixed_udf_and_sql` with parent `Colum` class

2024-05-20 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d2edefac59a7 [MINOR][PYTHON][TESTS] Test

(spark) branch master updated (52ca921113b4 -> fa8aa571ad18)

2024-05-20 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 52ca921113b4 [MINOR][PYTHON][TESTS] Remove unnecessary hack imports add fa8aa571ad18 [SPARK-48335][PYTHON

(spark) branch master updated: [MINOR][PYTHON][TESTS] Remove unnecessary hack imports

2024-05-20 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 52ca921113b4 [MINOR][PYTHON][TESTS] Remove

(spark) branch master updated: [SPARK-48321][CONNECT][TESTS] Avoid using deprecated methods in dsl

2024-05-17 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 15fb4787354a [SPARK-48321][CONNECT][TESTS

(spark) branch master updated: [SPARK-41625][PYTHON][CONNECT][TESTS][FOLLOW-UP] Enable `DataFrameObservationParityTests.test_observe_str`

2024-05-16 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 889820c1ff39 [SPARK-41625][PYTHON][CONNECT

(spark) branch master updated: [SPARK-48301][SQL][FOLLOWUP] Update the error message

2024-05-16 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b0e535217bf8 [SPARK-48301][SQL][FOLLOWUP

(spark) branch master updated: [SPARK-48301][SQL] Rename `CREATE_FUNC_WITH_IF_NOT_EXISTS_AND_REPLACE` to `CREATE_ROUTINE_WITH_IF_NOT_EXISTS_AND_REPLACE`

2024-05-16 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3d3d18f14ba2 [SPARK-48301][SQL] Rename

(spark) branch master updated: [SPARK-48287][PS][CONNECT] Apply the builtin `timestamp_diff` method

2024-05-15 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d0f4533f4e79 [SPARK-48287][PS][CONNECT] Apply

(spark) branch master updated: [SPARK-48278][PYTHON][CONNECT] Refine the string representation of `Cast`

2024-05-15 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e97ad0a44419 [SPARK-48278][PYTHON][CONNECT

(spark) branch master updated: [SPARK-48272][SQL][PYTHON][CONNECT] Add function `timestamp_diff`

2024-05-15 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c03ebb467ec2 [SPARK-48272][SQL][PYTHON

(spark) branch master updated: [SPARK-48276][PYTHON][CONNECT] Add the missing `__repr__` method for `SQLExpression`

2024-05-14 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d31161b27404 [SPARK-48276][PYTHON][CONNECT

(spark) branch master updated: [SPARK-41794][FOLLOWUP] Add `try_remainder` to python API references

2024-05-13 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4cc589afe5b5 [SPARK-41794][FOLLOWUP] Add

(spark) branch master updated: [SPARK-48259][CONNECT][TESTS] Add 3 missing methods in dsl

2024-05-13 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 28cf3db77932 [SPARK-48259][CONNECT][TESTS] Add

(spark) branch master updated: [MINOR][PYTHON][TESTS] Move test `test_named_arguments_negative` to `test_arrow_python_udf`

2024-05-12 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new cae2248bc13d [MINOR][PYTHON][TESTS] Move test

(spark) branch master updated: [SPARK-48228][PYTHON][CONNECT][FOLLOWUP] Also apply `_validate_pandas_udf` in MapInXXX

2024-05-10 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 259760a5c5e2 [SPARK-48228][PYTHON][CONNECT

(spark) branch master updated: [SPARK-48190][PYTHON][PS][TESTS] Introduce a helper function to drop metadata

2024-05-08 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d7f69e7003a3 [SPARK-48190][PYTHON][PS][TESTS

(spark) branch master updated: [SPARK-48058][SPARK-43727][PYTHON][CONNECT][TESTS][FOLLOWUP] Code clean up

2024-05-07 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 98d4ab734de0 [SPARK-48058][SPARK-43727

(spark) branch master updated (05b22ebb3060 -> 3b9f52f7768a)

2024-05-06 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 05b22ebb3060 [SPARK-48141][TEST] Update the Oracle docker image version used for test and integration to use Oracle

(spark) branch master updated: [SPARK-48142][PYTHON][CONNECT][TESTS] Enable `CogroupedApplyInPandasTests.test_wrong_args`

2024-05-06 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2ef7246b9c5b [SPARK-48142][PYTHON][CONNECT

(spark) branch master updated: [SPARK-48055][PYTHON][CONNECT][TESTS] Enable `PandasUDFScalarParityTests.{test_vectorized_udf_empty_partition, test_vectorized_udf_struct_with_empty_partition}`

2024-04-30 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ed5aa56f1200 [SPARK-48055][PYTHON][CONNECT

(spark) branch branch-3.4 updated: [SPARK-47129][CONNECT][SQL][3.4] Make ResolveRelations cache connect plan properly

2024-04-30 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 5f58fa7738eb [SPARK-47129][CONNECT

(spark) branch branch-3.5 updated: [SPARK-47129][CONNECT][SQL][3.5] Make ResolveRelations cache connect plan properly

2024-04-29 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 9bc2ab01dde1 [SPARK-47129][CONNECT

(spark) branch master updated: [SPARK-47986][CONNECT][PYTHON] Unable to create a new session when the default session is closed by the server

2024-04-26 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7d04d0f043d2 [SPARK-47986][CONNECT][PYTHON

(spark) branch master updated: [SPARK-47985][PYTHON] Simplify functions with `lit`

2024-04-25 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 24b0c7560718 [SPARK-47985][PYTHON] Simplify

(spark) branch master updated: [SPARK-47971][PYTHON][CONNECT][TESTS] Reenable `PandasUDFGroupedAggParityTests.test_grouped_with_empty_partition`

2024-04-24 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0f1b6446a25a [SPARK-47971][PYTHON][CONNECT

(spark) branch master updated: [SPARK-47771][PYTHON][DOCS][TESTS][FOLLOWUP] Make `max_by, min_by` doctests deterministic

2024-04-23 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3cf0c83d29aa [SPARK-47771][PYTHON][DOCS][TESTS

(spark) branch master updated (2d9d444b122d -> 9f34b8eca2f3)

2024-04-21 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 2d9d444b122d [MINOR][DOCS] Change `SPARK_ANSI_SQL_MODE`in PlanStabilitySuite documentation add 9f34b8eca2f3

(spark) branch master updated (2bf43460b923 -> 0d553d06fe2f)

2024-04-19 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 2bf43460b923 [SPARK-47833][SQL][CORE] Supply caller stackstrace for checkAndGlobPathIfNecessary AnalysisException

(spark) branch master updated: [SPARK-47883][SQL] Make `CollectTailExec.doExecute` lazy with RowQueue

2024-04-18 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new fe47edece059 [SPARK-47883][SQL] Make

(spark) branch master updated: [SPARK-47858][SPARK-47852][PYTHON][SQL][FOLLOWUP] Fix Python Liner

2024-04-18 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new fd3f70c74ba6 [SPARK-47858][SPARK-47852][PYTHON

(spark) branch master updated: [SPARK-47868][CONNECT] Fix recursion limit error in SparkConnectPlanner and SparkSession

2024-04-16 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 119271d49356 [SPARK-47868][CONNECT] Fix

(spark) branch master updated: [SPARK-47828][CONNECT][PYTHON] DataFrameWriterV2.overwrite` fails with invalid plan

2024-04-14 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1096801ead29 [SPARK-47828][CONNECT][PYTHON

(spark) branch master updated: [SPARK-47816][CONNECT][DOCS] Document the lazy evaluation of views in `spark.{sql, table}`

2024-04-12 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 49d2214a7660 [SPARK-47816][CONNECT][DOCS

(spark) branch master updated: [MINOR][PYTHON][TESTS] Enable `test_udf_cache` parity test

2024-04-10 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 697596bf9357 [MINOR][PYTHON][TESTS] Enable

(spark) branch master updated: [SPARK-47779][PS][TESTS] Add a helper function to sort PS Frame/Series

2024-04-09 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 070461cc673c [SPARK-47779][PS][TESTS] Add

(spark) branch master updated (149ac0f8893b -> 83f3a34df7a0)

2024-04-09 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 149ac0f8893b [SPARK-47581][CORE] SQL catalyst: Migrate logWarning with variables to structured logging framework

(spark) branch master updated (319edfdc5cd6 -> edba7b9f9119)

2024-04-08 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 319edfdc5cd6 [SPARK-47682][SQL] Support cast from variant add edba7b9f9119 [SPARK-47771][PYTHON][TESTS] Make

(spark) branch master updated (f0d8f82f8c45 -> 211afd4ab526)

2024-04-08 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from f0d8f82f8c45 [SPARK-47750][DOCS][SQL] Postgres: Document Mapping Spark SQL Data Types to PostgreSQL add

(spark) branch master updated: [SPARK-47669][SQL][CONNECT][PYTHON] Add `Column.try_cast`

2024-04-02 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 55b5ff6f45fd [SPARK-47669][SQL][CONNECT

(spark) branch master updated: [SPARK-47664][PYTHON][CONNECT][TESTS][FOLLOW-UP] Add more tests

2024-04-02 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a598f654066d [SPARK-47664][PYTHON][CONNECT

(spark) branch master updated: [SPARK-47638][PS][CONNECT] Skip column name validation in PS

2024-03-28 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a57f94b03e30 [SPARK-47638][PS][CONNECT] Skip

(spark) branch master updated: [SPARK-47621][PYTHON][DOCS] Refine docstring of `try_sum`, `try_avg`, `avg`, `sum`, `mean`

2024-03-28 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b594c4edb383 [SPARK-47621][PYTHON][DOCS

(spark) branch master updated: [MINOR][PYTHON][TESTS] Remove redundant parity tests

2024-03-28 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8a6e5bb7a292 [MINOR][PYTHON][TESTS] Remove

(spark) branch master updated: [SPARK-47620][PYTHON][CONNECT] Add a helper function to sort columns

2024-03-27 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0eb96ae6eb86 [SPARK-47620][PYTHON][CONNECT

(spark) branch master updated (88b29c5076d4 -> 9db527ec5adc)

2024-03-26 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 88b29c5076d4 [SPARK-47570][SS] Integrate range scan encoder changes with timer implementation add 9db527ec5adc

(spark) branch master updated: [SPARK-47560][PYTHON][CONNECT] Avoid RPC to validate column name with cached schema

2024-03-26 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new becbf8b94213 [SPARK-47560][PYTHON][CONNECT

(spark-website) branch asf-site updated: Update the organization for beliefer (#510)

2024-03-25 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git The following commit(s) were added to refs/heads/asf-site by this push: new e344ef4d14 Update the organization

(spark) branch master updated (310dd5294267 -> 3f171ce3f43b)

2024-03-18 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 310dd5294267 [SPARK-45891][DOCS] Update README with more details add 3f171ce3f43b [SPARK-47436][PYTHON][DOCS

(spark) branch master updated (9986462811f1 -> 49af659c9aec)

2024-03-14 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 9986462811f1 [SPARK-47385] Fix tuple encoders with Option inputs add 49af659c9aec [SPARK-46988][CONNECT

(spark) branch master updated: [SPARK-41762][PYTHON][CONNECT][TESTS] Enable column name comparsion in `test_column_arithmetic_ops`

2024-03-13 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new bc0ba7dccdd5 [SPARK-41762][PYTHON][CONNECT

(spark) branch master updated (37d0c556fdd9 -> 5d32e62436dc)

2024-03-12 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 37d0c556fdd9 [SPARK-47348][INFRA] Align the version of the ubuntu host machine where the GitHub workflow runs

(spark) branch master updated: [MINOR] Minor English fixes

2024-03-12 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e1865811cac9 [MINOR] Minor English fixes

(spark) branch master updated (50131054b818 -> 00de3ed5e0aa)

2024-03-08 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 50131054b818 [SPARK-47265][SQL][TESTS][COLUMN] Replace `createTable(..., schema: StructType

(spark) branch master updated (c6538301c0a8 -> 0c28df40e049)

2024-03-06 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from c6538301c0a8 [SPARK-47070][SQL][FOLLOW-UP] Add a flag guarding a subquery in aggregate rewrite add

(spark) branch master updated (999abb5671ce -> 5d69388c8283)

2024-02-27 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 999abb5671ce [SPARK-47186][DOCKER][TESTS] Add some timeouts options and logs to improve the debuggability

(spark) branch master updated (a778e6c79cc4 -> cdae4c6bb194)

2024-02-27 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from a778e6c79cc4 [SPARK-41873][PYTHON][CONNECT][TESTS] Enable `DataFrameParityTests.test_pandas_api` add

(spark) branch master updated (1ca92181af8d -> a778e6c79cc4)

2024-02-27 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 1ca92181af8d [SPARK-47184][PYTHON][CONNECT][TESTS] Make `test_repartitionByRange_dataframe` reusable add

(spark) branch master updated: [SPARK-43117][CONNECT] Make `ProtoUtils.abbreviate` support repeated fields

2024-02-07 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 71b76dc3e66a [SPARK-43117][CONNECT] Make

(spark) branch master updated: [SPARK-46976][PS] Implement `DataFrameGroupBy.corr`

2024-02-06 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new cfbf3c704f0f [SPARK-46976][PS] Implement

(spark) branch master updated: [SPARK-46955][PS] Implement `Frame.to_stata`

2024-02-04 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 30190edb2df7 [SPARK-46955][PS] Implement

(spark) branch master updated: [SPARK-46936][PS] Implement `Frame.to_feather`

2024-02-01 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 53cbaeb20293 [SPARK-46936][PS] Implement

(spark) branch master updated (0871a6f15623 -> e95e820ac137)

2024-01-31 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 0871a6f15623 [SPARK-46753][PYTHON][TESTS] Fix pypy3 python test add e95e820ac137 [SPARK-46932] Clean up

(spark) branch master updated (8f406212aa09 -> 5d87ac6214bb)

2024-01-31 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 8f406212aa09 [SPARK-46924][CORE] Fix `Load New` button in `Master/HistoryServer` Log UI add 5d87ac6214bb

(spark) branch master updated: [SPARK-46896][PS][TESTS] Clean up the imports in `pyspark.pandas.tests.{frame, series, groupby}.*`

2024-01-28 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8cd0d1854da0 [SPARK-46896][PS][TESTS] Clean up

(spark) branch master updated: [SPARK-46620][PS][CONNECT] Introduce a basic fallback mechanism for frame methods

2024-01-25 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8e1fa5616068 [SPARK-46620][PS][CONNECT

(spark) branch master updated: [SPARK-46851][DOCS] Remove `buf` version information from the doc `contributing.rst`

2024-01-25 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 95ea2a6dd403 [SPARK-46851][DOCS] Remove `buf

(spark) branch master updated: [SPARK-46856][PS][TESTS] Apply approximate equality in ewm tests

2024-01-25 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 38a517de8e22 [SPARK-46856][PS][TESTS] Apply

(spark) branch master updated: [SPARK-46808][PYTHON][FOLLOW-UP] Add a guide for automatic sorting in `test_error_classes_sorted`

2024-01-24 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new df4370c0759b [SPARK-46808][PYTHON][FOLLOW-UP

(spark) branch master updated: [SPARK-46765][PYTHON][CONNECT] Make `shuffle` specify the datatype of `seed`

2024-01-18 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 36da27fae56a [SPARK-46765][PYTHON][CONNECT

(spark) branch master updated: [SPARK-40546][DOCS] Remove unused TODO

2024-01-18 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e2aca4f792e2 [SPARK-40546][DOCS] Remove unused

(spark) branch master updated: [SPARK-46750][CONNECT][PYTHON] DataFrame APIs code clean up

2024-01-17 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 764cb3e07364 [SPARK-46750][CONNECT][PYTHON

(spark) branch branch-3.4 updated: [SPARK-46715][INFRA][3.4] Pin `sphinxcontrib-*`

2024-01-16 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 8f89f40be5cd [SPARK-46715][INFRA][3.4

(spark) branch master updated (bfb0f016817d -> 872fbc33dc27)

2024-01-16 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from bfb0f016817d [SPARK-46677][CONNECT][FOLLOWUP] Convert `count(df["*"])` to `count(1)` on client sid

(spark) branch master updated: [SPARK-46677][CONNECT][FOLLOWUP] Convert `count(df["*"])` to `count(1)` on client side

2024-01-16 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new bfb0f016817d [SPARK-46677][CONNECT][FOLLOWUP

(spark) branch branch-3.5 updated: [SPARK-46715][INFRA][3.5] Pin `sphinxcontrib-*`

2024-01-15 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 10d5d8956b4c [SPARK-46715][INFRA][3.5

(spark) branch master updated: [SPARK-46726][PS][TESTS] Rebalance `pyspark_pandas_connect_part?`

2024-01-15 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b095960c7290 [SPARK-46726][PS][TESTS

(spark) branch master updated (2c8ea75d92ee -> 1bdb81b2b547)

2024-01-15 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 2c8ea75d92ee [SPARK-46660][CONNECT] ReattachExecute requests updates aliveness of SessionHolder add

(spark) branch master updated: [SPARK-46719][PS][TESTS] Rebalance `pyspark_pandas` and `pyspark_pandas_slow`

2024-01-14 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ee0d243f0141 [SPARK-46719][PS][TESTS

(spark) branch master updated: [SPARK-46715][INFRA] Pin `sphinxcontrib-*`

2024-01-14 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 416b7b1cd5a6 [SPARK-46715][INFRA] Pin

(spark) branch master updated: [SPARK-46656][PS][TESTS] Split `GroupbyParitySplitApplyTests`

2024-01-10 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 514ecc6fc183 [SPARK-46656][PS][TESTS] Split

(spark) branch master updated: [SPARK-46541][SQL][CONNECT] Fix the ambiguous column reference in self join

2024-01-09 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 686f428dc104 [SPARK-46541][SQL][CONNECT] Fix

(spark) branch master updated: Revert "[SPARK-46593][PS][TESTS] Refactor `data_type_ops` tests"

2024-01-04 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 20b6a32f4980 Revert "[SPARK-46593][PS][

(spark) branch master updated: [SPARK-46593][PS][TESTS] Refactor `data_type_ops` tests

2024-01-04 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3793c2f44099 [SPARK-46593][PS][TESTS] Refactor

(spark) branch master updated: [SPARK-46504][PS][TESTS][FOLLOWUP] Break the remaining part of `IndexesTests` into small test files

2024-01-03 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 59d147a4f48f [SPARK-46504][PS][TESTS][FOLLOWUP

(spark-website) branch asf-site updated: docs: update examples page (#494)

2024-01-03 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git The following commit(s) were added to refs/heads/asf-site by this push: new 67c90a03a7 docs: update examples

(spark) branch master updated: [SPARK-46543][PYTHON][CONNECT] Make `json_tuple` throw PySparkValueError for empty fields

2024-01-01 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f3e162336f65 [SPARK-46543][PYTHON][CONNECT

(spark) branch master updated: [SPARK-46504][PS][TESTS][FOLLOWUPS] Moving move slow tests out of `IndexesTests`

2023-12-31 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ae9106370a9f [SPARK-46504][PS][TESTS

(spark) branch master updated: [SPARK-46504][PS][TESTS][FOLLOWUPS] Moving slow tests out of `IndexesTests`: conversion and drop methods

2023-12-29 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e7145ae51bfe [SPARK-46504][PS][TESTS

(spark) branch master updated (2e918e8b5c11 -> d6334a3ba87c)

2023-12-29 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 2e918e8b5c11 [SPARK-46532][CONNECT][PYTHON][FOLLOW-UP] Pass message parameters in Python Spark Connect client

(spark) branch master updated (c7c43cf5b1e1 -> e9c4e7ebd595)

2023-12-28 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from c7c43cf5b1e1 [SPARK-46533][PYTHON][DOCS] Refine docstring of `array_min/array_max/array_size/array_repeat` add

(spark) branch master updated: [SPARK-46538][ML] Fix the ambiguous column reference issue in `ALSModel.transform`

2023-12-28 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b249cb8af35 [SPARK-46538][ML] Fix

(spark) branch master updated: [SPARK-46484][SQL][CONNECT] Make `resolveOperators*` helper functions keep the plan id

2023-12-28 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 826f8d9eb04 [SPARK-46484][SQL][CONNECT] Make

(spark) branch master updated: [SPARK-46517][PS][TESTS][FOLLOWUPS] Reorganize `IndexingTest`: Move to `pyspark.pandas.tests.indexes.*` and add the parity test

2023-12-28 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0de70c4cb0b [SPARK-46517][PS][TESTS][FOLLOWUPS

  1   2   3   4   5   6   7   8   9   10   >