(spark) branch master updated: [SPARK-49995][SQL] Add named argument support to more TVFs

2024-11-05 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b81da764b9c5 [SPARK-49995][SQL] Add named

(spark) branch master updated: [SPARK-49009][SQL][PYTHON] Make Column APIs and functions accept Enums

2024-07-26 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7e678a07ecd1 [SPARK-49009][SQL][PYTHON] Make

(spark) branch master updated: [SPARK-48996][SQL][PYTHON] Allow bare literals for __and__ and __or__ of Column

2024-07-25 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 78b83fa542a5 [SPARK-48996][SQL][PYTHON] Allow

(spark) branch master updated (c4085f1f6f58 -> b062d4436f2b)

2024-07-08 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from c4085f1f6f58 [SPARK-48776] Fix timestamp formatting for json, xml and csv add b062d4436f2b [SPARK-48798][PYTHON

(spark) branch master updated (66d8a29dd7b4 -> 0864bbeac399)

2024-06-17 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 66d8a29dd7b4 [SPARK-47577][SPARK-47579] Correct misleading usage of log key TASK_ID add 0864bbeac399 [SPARK

(spark) branch branch-3.5 updated: [SPARK-47921][CONNECT] Fix ExecuteJobTag creation in ExecuteHolder

2024-04-24 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new fdc0cee17908 [SPARK-47921][CONNECT] Fix

(spark) branch master updated (62dd64a5d13d -> 5a1559a7ef03)

2024-04-24 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 62dd64a5d13d [SPARK-47583][CORE] SQL core: Migrate logError with variables to structured logging framework add

(spark) branch master updated (7c81bdf1ed17 -> add49b3c115f)

2024-03-15 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 7c81bdf1ed17 [SPARK-47345][SQL][TESTS] Xml functions suite add add49b3c115f [SPARK-47346][PYTHON] Make daemon

(spark) branch master updated (36df0a63a139 -> f028d3eba314)

2024-02-28 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 36df0a63a139 [SPARK-47135][SS] Implement error classes for Kafka data loss exceptions add f028d3eba314 [SPARK

(spark) branch master updated (e2dcb0274f13 -> f5d38001808a)

2024-02-26 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from e2dcb0274f13 [SPARK-47173][SS][UI] Fix a typo in streaming UI explanation add f5d38001808a [SPARK-47079][PYTHON

(spark) branch master updated (28951ed6681f -> 772a445e412b)

2024-02-23 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 28951ed6681f [SPARK-47118][BUILD][CORE][SQL][UI] Migrate from Jetty 10 to Jetty 11 add 772a445e412b [SPARK-47035

(spark) branch master updated (6185e5cad7be -> 9debaeaa5a07)

2024-02-22 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 6185e5cad7be [SPARK-47132][DOCS][PYTHON] Correct docstring for pyspark's dataframe.head add 9debaeaa5a07 [

(spark) branch master updated: [SPARK-47002][PYTHON] Return better error message if UDTF 'analyze' method 'orderBy' field accidentally returns a list of strings

2024-02-08 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6569f15490ec [SPARK-47002][PYTHON] Return better

(spark) branch master updated: [SPARK-46688][SPARK-46691][PYTHON][CONNECT] Support v2 profiling in aggregate Pandas UDFs

2024-02-07 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9bd0d7c3ee13 [SPARK-46688][SPARK-46691][PYTHON

(spark) branch master updated: [SPARK-46966][PYTHON] Add UDTF API for 'analyze' method to indicate subset of input table columns to select

2024-02-07 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 31f85e5ff77c [SPARK-46966][PYTHON] Add UDTF API

(spark) branch master updated: [SPARK-46687][PYTHON][CONNECT] Basic support of SparkSession-based memory profiler

2024-01-29 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 528ac8b3e854 [SPARK-46687][PYTHON][CONNECT

(spark) branch master updated: [SPARK-46040][SQL][PYTHON] Update UDTF API for 'analyze' partitioning/ordering columns to support general expressions

2023-12-04 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 91a02e5d9701 [SPARK-46040][SQL][PYTHON] Update

(spark) branch master updated: [SPARK-45746][PYTHON] Return specific error messages if UDTF 'analyze' or 'eval' method accepts or returns wrong values

2023-11-29 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f5e4e84ce3a [SPARK-45746][PYTHON] Return

(spark) branch master updated: [SPARK-45810][PYTHON] Create Python UDTF API to stop consuming rows from the input table

2023-11-15 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 36983443112 [SPARK-45810][PYTHON] Create Python

[spark] branch master updated: [SPARK-45523][PYTHON] Refactor the null-checking to have shortcuts

2023-10-24 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 68c0f64dddc9 [SPARK-45523][PYTHON] Refactor the

[spark] branch master updated (840306d867e2 -> 7ef96ee5b888)

2023-10-24 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 840306d867e2 [SPARK-45643][CORE][SQL] Replace `s.c.mutable.MapOps#transform` with `s.c.mutable.MapOps

[spark] branch master updated: [SPARK-45523][PYTHON] Return useful error message if UDTF returns None for any non-nullable column

2023-10-20 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 227cd8bb8f5 [SPARK-45523][PYTHON] Return useful

[spark] branch master updated (b10fea96b5b -> 4a0ed9cd725)

2023-10-17 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from b10fea96b5b [SPARK-45566][PS] Support Pandas-like testing utils for Pandas API on Spark add 4a0ed9cd725 [SPARK

[spark] branch master updated (f72b87b90be -> 12880c846b5)

2023-10-12 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from f72b87b90be [SPARK-45515][CORE][SQL] Use enhanced `switch` expressions to replace the regular `switch` statement

[spark] branch master updated: [SPARK-45505][PYTHON] Refactor analyzeInPython to make it reusable

2023-10-12 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 280f6b33110d [SPARK-45505][PYTHON] Refactor

[spark] branch master updated: [SPARK-45402][SQL][PYTHON] Add UDTF API for 'eval' and 'terminate' methods to consume previous 'analyze' result

2023-10-11 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 69cf80d25f0e [SPARK-45402][SQL][PYTHON] Add UDTF

[spark] branch master updated: [SPARK-45362][PYTHON] Project out PARTITION BY expressions before Python UDTF 'eval' method consumes them

2023-09-28 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b3d5bc0c109 [SPARK-45362][PYTHON] Project out

[spark] branch master updated: [SPARK-45266][PYTHON] Refactor ResolveFunctions analyzer rule to delay making lateral join when table arguments are used

2023-09-28 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2cf937f9bac [SPARK-45266][PYTHON] Refactor

[spark] branch master updated: [SPARK-45118][PYTHON] Refactor converters for complex types to short cut when the element types don't need converters

2023-09-14 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 090fd18f362 [SPARK-45118][PYTHON] Refactor

[spark] branch master updated: [SPARK-44640][PYTHON][FOLLOW-UP] Update UDTF error messages to include method name

2023-09-02 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3e22c8653d7 [SPARK-44640][PYTHON][FOLLOW-UP

[spark] branch master updated (df534c355d9 -> e4ebb372fa1)

2023-09-01 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from df534c355d9 [SPARK-44952][SQL][PYTHON] Support named arguments in aggregate Pandas UDFs add e4ebb372fa1 [SPARK

[spark] branch master updated: [SPARK-44952][SQL][PYTHON] Support named arguments in aggregate Pandas UDFs

2023-09-01 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new df534c355d9 [SPARK-44952][SQL][PYTHON] Support

[spark] branch master updated: [SPARK-44918][SQL][PYTHON] Support named arguments in scalar Python/Pandas UDFs

2023-08-24 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ce6b5f3751e [SPARK-44918][SQL][PYTHON] Support

[spark] branch master updated: [SPARK-44748][SQL] Query execution for the PARTITION BY clause in UDTF TABLE arguments

2023-08-21 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7f3a439fe31 [SPARK-44748][SQL] Query execution

[spark] branch branch-3.5 updated: [SPARK-44834][PYTHON][SQL][TESTS] Add SQL query tests for Python UDTFs

2023-08-17 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new e473d892bf3 [SPARK-44834][PYTHON][SQL

[spark] branch master updated (047b2247879 -> be04ac1ace9)

2023-08-17 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 047b2247879 [SPARK-44849] Expose SparkConnectExecutionManager.listActiveExecutions add be04ac1ace9 [SPARK-44834

[spark] branch master updated: [SPARK-44836][PYTHON] Refactor Arrow Python UDTF

2023-08-16 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 06959e2b812 [SPARK-44836][PYTHON] Refactor Arrow

[spark] branch branch-3.5 updated: [SPARK-44836][PYTHON][3.5] Refactor Arrow Python UDTF

2023-08-16 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 08bf227a4e5 [SPARK-44836][PYTHON][3.5

[spark] branch master updated (b9f11143d05 -> ac567b36db9)

2023-08-15 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from b9f11143d05 [SPARK-42664][CONNECT] Support `bloomFilter` function for `DataFrameStatFunctions` add ac567b36db9

[spark] branch master updated (1d562904e4e -> f7002fb25ca)

2023-08-14 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 1d562904e4e [SPARK-44795][CONNECT] CodeGenerator Cache should be classloader specific add f7002fb25ca [SPARK

[spark] branch master updated: [SPARK-44749][SQL][PYTHON] Support named arguments in Python UDTF

2023-08-14 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d4629563492 [SPARK-44749][SQL][PYTHON] Support

[spark] branch master updated: [SPARK-44503][SQL] Project any PARTITION BY expressions not already returned from Python UDTF TABLE arguments

2023-08-09 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 87298db43d9 [SPARK-44503][SQL] Project any

[spark] branch branch-3.5 updated: [SPARK-44561][PYTHON] Fix AssertionError when converting UDTF output to a complex type

2023-08-07 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new ea6b41cb398 [SPARK-44561][PYTHON] Fix

[spark] branch master updated: [SPARK-44561][PYTHON] Fix AssertionError when converting UDTF output to a complex type

2023-08-07 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f1a161cb395 [SPARK-44561][PYTHON] Fix

[spark] branch branch-3.5 updated: [SPARK-44433][3.5][PYTHON][CONNECT][SS][FOLLOWUP] Terminate listener process with removeListener and improvements

2023-08-04 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new f22b618174b [SPARK-44433][3.5][PYTHON

[spark] branch master updated: [SPARK-44433][PYTHON][CONNECT][SS][FOLLOWUP] Set back USE_DAEMON after creating streaming python processes

2023-08-04 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new cf64008fce7 [SPARK-44433][PYTHON][CONNECT][SS

[spark] branch branch-3.5 updated: [SPARK-44663][PYTHON] Disable arrow optimization by default for Python UDTFs

2023-08-04 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 4cba54d8c0e [SPARK-44663][PYTHON

[spark] branch master updated: [SPARK-44663][PYTHON] Disable arrow optimization by default for Python UDTFs

2023-08-04 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8b53fed7ef0 [SPARK-44663][PYTHON] Disable arrow

[spark] branch master updated (780bae92839 -> 62415dc5962)

2023-08-04 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 780bae92839 [SPARK-44671][PYTHON][CONNECT] Retry ExecutePlan in case initial request didn't reach server in P

[spark] branch branch-3.5 updated: [SPARK-44559][PYTHON][3.5] Improve error messages for Python UDTF arrow cast

2023-08-02 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new fe3754afcfe [SPARK-44559][PYTHON][3.5

[spark] branch master updated (e326b9b6565 -> cfc75ec12ae)

2023-08-02 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from e326b9b6565 [SPARK-41532][DOCS][FOLLOWUP] Regenerate `sql-error-conditions-connect-error-class.md` add

[spark] branch branch-3.5 updated: [SPARK-44614][PYTHON][CONNECT][3.5] Add missing packages in setup.py

2023-08-01 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 84f17e7dcd5 [SPARK-44614][PYTHON

[spark] branch master updated: [SPARK-44614][PYTHON][CONNECT] Add missing packages in setup.py

2023-08-01 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a011d16a24d [SPARK-44614][PYTHON][CONNECT] Add

[spark] branch master updated: [SPARK-42941][SS][CONNECT] Python StreamingQueryListener

2023-07-31 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 799ab87ebd2 [SPARK-42941][SS][CONNECT] Python

[spark] branch master updated: [SPARK-44559][PYTHON] Improve error messages for Python UDTF arrow cast

2023-07-31 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5384f4601a4 [SPARK-44559][PYTHON] Improve error

[spark] branch branch-3.5 updated: [SPARK-44603] Add pyspark.testing to setup.py

2023-07-31 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 242ac2377ea [SPARK-44603] Add

[spark] branch master updated: [SPARK-44603] Add pyspark.testing to setup.py

2023-07-31 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1380a3df08e [SPARK-44603] Add pyspark.testing to

[spark] branch master updated: [SPARK-43968][PYTHON] Improve error messages for Python UDTFs with wrong number of outputs

2023-07-27 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7194ce9263f [SPARK-43968][PYTHON] Improve error

[spark] branch master updated: [SPARK-44533][PYTHON] Add support for accumulator, broadcast, and Spark files in Python UDTF's analyze

2023-07-26 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8647b243dee [SPARK-44533][PYTHON] Add support

[spark] branch branch-3.5 updated: [SPARK-44479][PYTHON][3.5] Fix ArrowStreamPandasUDFSerializer to accept no-column pandas DataFrame

2023-07-26 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 803b2854a9e [SPARK-44479][PYTHON][3.5

[spark] branch master updated: [SPARK-44479][PYTHON] Fix ArrowStreamPandasUDFSerializer to accept no-column pandas DataFrame

2023-07-26 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 02e36dd0f07 [SPARK-44479][PYTHON] Fix

[spark] branch master updated: [SPARK-44503][SQL][FOLLOWUP] Simplify the test case for PARTITION BY and ORDER BY clause after TABLE arguments for TVF calls

2023-07-25 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a8b25f8b5ba [SPARK-44503][SQL][FOLLOWUP

[spark] branch master updated: [SPARK-44503][SQL] Add SQL grammar for PARTITION BY and ORDER BY clause after TABLE arguments for TVF calls

2023-07-24 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 58e5d86cc07 [SPARK-44503][SQL] Add SQL grammar

[spark] branch branch-3.5 updated: Revert "[SPARK-44380][PYTHON][FOLLOWUP] Set __doc__ for analyze static method when Arrow is enabled"

2023-07-24 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new d0ad48334dc Revert "[SPARK-44380][P

[spark] branch master updated: [SPARK-44395][SQL] Update TVF arguments to require parentheses around identifier after TABLE keyword

2023-07-13 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 63cef16ef77 [SPARK-44395][SQL] Update TVF

[spark] branch master updated (a8893422752 -> 47ddac13144)

2023-05-31 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from a8893422752 [SPARK-43867][SQL] Improve suggested candidates for unresolved attribute add 47ddac13144 [SPARK

[spark] branch master updated: [SPARK-42437][CONNECT][PYTHON][FOLLOW-UP] Storage level proto converters

2023-04-19 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c291564c7d4 [SPARK-42437][CONNECT][PYTHON

[spark] branch master updated (dabd771c37b -> 2931993e059)

2023-04-12 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from dabd771c37b [SPARK-43038][SQL] Support the CBC mode by `aes_encrypt()`/`aes_decrypt()` add 2931993e059 [SPARK

[spark] branch master updated: [SPARK-39048][PYTHON] Refactor GroupBy._reduce_for_stat_function on accepted data types

2022-04-29 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 30f49981ef0 [SPARK-39048][PYTHON] Refactor

[spark] branch master updated (c00942d -> 21db916)

2022-03-15 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from c00942d [SPARK-38524][SPARK-38553][K8S] Bump `Volcano` to v1.5.1 and fix Volcano `weight` to be positive integer

[spark] branch master updated (c16a66a -> f6c4634)

2022-03-14 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from c16a66a [SPARK-36194][SQL] Add a logical plan visitor to propagate the distinct attributes add f6c4634 [SPARK

[spark] branch master updated (01014aa -> 0f4c26a)

2022-03-09 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 01014aa [SPARK-38486][K8S][TESTS] Upgrade the minimum Minikube version to 1.18.0 add 0f4c26a [SPARK-38387

[spark] branch master updated: [SPARK-37011][PYTHON] Remove unnecessary 'noqa: F401' comments

2021-12-28 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2b2d722 [SPARK-37011][PYTHON] Remove

[spark] branch branch-3.2 updated: [SPARK-37678][PYTHON] Fix _cleanup_and_return signature

2021-12-20 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new ebf7e61 [SPARK-37678][PYTHON] Fix

[spark] branch master updated (eeee3f5 -> 0129390)

2021-12-20 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 3f5 [SPARK-37698][BUILD] Update ORC to 1.7.2 add 0129390 [SPARK-37678][PYTHON] Fix _cleanup_and_return

[spark] branch master updated (aaf0e5e -> 8e05c78)

2021-11-12 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from aaf0e5e [SPARK-37292][SQL][FOLLOWUP] Simplify the condition when removing outer join if it only has DISTINCT on

[spark] branch master updated: [SPARK-37048][PYTHON] Clean up inlining type hints under SQL module

2021-10-20 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 64eabb6 [SPARK-37048][PYTHON] Clean up inlining

[spark] branch master updated (1ef6c13 -> c2ba498)

2021-10-18 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 1ef6c13 [SPARK-36933][CORE] Clean up TaskMemoryManager.acquireExecutionMemory() add c2ba498 [SPARK-36945

[spark] branch master updated (21fa3ce -> 25fc495)

2021-10-18 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 21fa3ce [SPARK-35925][SQL] Support DayTimeIntervalType in width-bucket function add 25fc495 [SPARK-36886

[spark] branch master updated: [SPARK-36910][PYTHON] Inline type hints for python/pyspark/sql/types.py

2021-10-15 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 722ac1b [SPARK-36910][PYTHON] Inline type hints

[spark] branch master updated: [SPARK-36991][PYTHON] Inline type hints for spark/python/pyspark/sql/streaming.py

2021-10-15 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e3b4d1e [SPARK-36991][PYTHON] Inline type hints

[spark] branch master updated (c4e975e -> e7faa85)

2021-10-14 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from c4e975e [SPARK-23626][CORE] Eagerly compute RDD.partitions on entire DAG when submitting job to DAGScheduler

[spark] branch master updated (bb83f27 -> 2267d7f)

2021-10-14 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from bb83f27 [SPARK-36938][PYTHON] Inline type hints for group.py in python/pyspark/sql add 2267d7f [SPARK-37000

[spark] branch master updated: [SPARK-36938][PYTHON] Inline type hints for group.py in python/pyspark/sql

2021-10-14 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new bb83f27 [SPARK-36938][PYTHON] Inline type hints

[spark] branch master updated: [SPARK-36951][PYTHON] Inline type hints for python/pyspark/sql/column.py

2021-10-12 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3ba57f5 [SPARK-36951][PYTHON] Inline type hints

[spark] branch master updated: [SPARK-36940][PYTHON] Inline type hints for python/pyspark/sql/avro/functions.py

2021-10-07 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 255d86f [SPARK-36940][PYTHON] Inline type hints

[spark] branch master updated: [SPARK-36906][PYTHON] Inline type hints for conf.py and observation.py in python/pyspark/sql

2021-10-04 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8181260 [SPARK-36906][PYTHON] Inline type hints

[spark] branch branch-3.2 updated: [SPARK-36818][PYTHON] Fix filtering a Series by a boolean Series

2021-09-22 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 423cff4 [SPARK-36818][PYTHON] Fix

[spark] branch master updated (a7cbe69 -> 6a5ee02)

2021-09-22 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from a7cbe69 [SPARK-36753][SQL] ArrayExcept handle duplicated Double.NaN and Float.NaN add 6a5ee02 [SPARK-36818

[spark] branch branch-3.2 updated (affd7a4 -> 4543ac6)

2021-09-21 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git. from affd7a4 [SPARK-36670][FOLLOWUP][TEST] Remove brotli-codec dependency add 4543ac6 [SPARK-36771][PYTHON][3.2

[spark] branch master updated: [SPARK-36771][PYTHON] Fix `pop` of Categorical Series

2021-09-21 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 079a9c5 [SPARK-36771][PYTHON] Fix `pop` of

[spark] branch master updated: [SPARK-36769][PYTHON] Improve `filter` of single-indexed DataFrame

2021-09-21 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 33e463c [SPARK-36769][PYTHON] Improve `filter

[spark] branch branch-3.2 updated: [SPARK-36785][PYTHON] Fix DataFrame.isin when DataFrame has NaN value

2021-09-20 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 3d47c69 [SPARK-36785][PYTHON] Fix

[spark] branch master updated (4b61c62 -> cc182fe)

2021-09-20 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 4b61c62 [SPARK-36746][PYTHON] Refactor `_select_rows_by_iterable` in `iLocIndexer` to use `Column.isin` add

[spark] branch master updated: [SPARK-36746][PYTHON] Refactor `_select_rows_by_iterable` in `iLocIndexer` to use `Column.isin`

2021-09-20 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4b61c62 [SPARK-36746][PYTHON] Refactor

[spark] branch master updated: [SPARK-36618][PYTHON] Support dropping rows of a single-indexed DataFrame

2021-09-20 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4cf86d3 [SPARK-36618][PYTHON] Support dropping

[spark] branch branch-3.2 updated: [SPARK-36762][PYTHON] Fix Series.isin when Series has NaN values

2021-09-17 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 36ce9cc [SPARK-36762][PYTHON] Fix

[spark] branch master updated: [SPARK-36762][PYTHON] Fix Series.isin when Series has NaN values

2021-09-17 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 32b8512 [SPARK-36762][PYTHON] Fix Series.isin

[spark] branch branch-3.2 updated: [SPARK-36722][PYTHON] Fix Series.update with another in same frame

2021-09-15 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 017bce7 [SPARK-36722][PYTHON] Fix

[spark] branch master updated: [SPARK-36722][PYTHON] Fix Series.update with another in same frame

2021-09-15 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c15072c [SPARK-36722][PYTHON] Fix Series.update

  1   2   3   >