(spark) branch master updated: [SPARK-47420][SQL] Fix test output

2024-04-15 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6762d1f8beaf [SPARK-47420][SQL] Fix test output

Re: [PR] add pandas on spark page [spark-website]

2024-04-15 Thread via GitHub
zhengruifeng commented on PR #513: URL: https://github.com/apache/spark-website/pull/513#issuecomment-2058277144 LGTM, thanks for working on this -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

(spark) branch master updated: [SPARK-47769][SQL] Add schema_of_variant_agg expression

2024-04-15 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 348b1bcff75c [SPARK-47769][SQL] Add

(spark) branch master updated: [SPARK-47463][SQL] Use V2Predicate to wrap expression with return type of boolean

2024-04-15 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new fa3ef03a0734 [SPARK-47463][SQL] Use V2Predicate

(spark) branch master updated (3ff339362b75 -> 21cc89b68ba5)

2024-04-15 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 3ff339362b75 [SPARK-47861][BUILD] Upgrade `slf4j` to 2.0.13 add 21cc89b68ba5 [SPARK-47862][PYTHON][CONNECT]

(spark) branch branch-3.5 updated: [SPARK-46335][BUILD][3.5] Upgrade Maven to 3.9.6

2024-04-15 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new d54f24cf3c3d [SPARK-46335][BUILD][3.5]

(spark) branch master updated: [SPARK-47861][BUILD] Upgrade `slf4j` to 2.0.13

2024-04-15 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3ff339362b75 [SPARK-47861][BUILD] Upgrade

(spark) branch branch-3.5 updated: [SPARK-47840][SS] Disable foldable propagation across Streaming Aggregate/Join nodes

2024-04-15 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 6c67c61bfd21 [SPARK-47840][SS] Disable

(spark) branch master updated (51d3efcead5b -> f21719346eb0)

2024-04-15 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 51d3efcead5b [SPARK-47233][CONNECT][SS][2/2] Client & Server logic for Client side streaming query listener add

(spark) branch master updated: [SPARK-47233][CONNECT][SS][2/2] Client & Server logic for Client side streaming query listener

2024-04-15 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 51d3efcead5b [SPARK-47233][CONNECT][SS][2/2]

(spark) branch master updated (61f8ec6c5175 -> e815012f26ab)

2024-04-15 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 61f8ec6c5175 [SPARK-47866][SQL][TESTS] Use explicit GC in `PythonForeachWriterSuite` add e815012f26ab

(spark) branch master updated (c5b8e60e0d59 -> 61f8ec6c5175)

2024-04-15 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from c5b8e60e0d59 [SPARK-46810][DOCS] Align error class terminology with SQL standard add 61f8ec6c5175

(spark) branch master updated (be080703688f -> c5b8e60e0d59)

2024-04-15 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from be080703688f [SPARK-47673][SS] Implementing TTL for ListState add c5b8e60e0d59 [SPARK-46810][DOCS] Align error

(spark) branch master updated: [SPARK-47673][SS] Implementing TTL for ListState

2024-04-15 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new be080703688f [SPARK-47673][SS] Implementing TTL

(spark) branch master updated: [SPARK-47804] Add Dataframe cache debug log

2024-04-15 Thread gengliang
This is an automated email from the ASF dual-hosted git repository. gengliang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f10ad3d56896 [SPARK-47804] Add Dataframe

(spark) branch branch-3.4 updated: [SPARK-43394][BUILD] Upgrade maven to 3.8.8

2024-04-15 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 1ee3f4e6bd79 [SPARK-43394][BUILD]

(spark) branch branch-3.5 updated (b8e2498007a0 -> 3b3903dda363)

2024-04-15 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git from b8e2498007a0 [SPARK-47318][CORE][3.5] Adds HKDF round to AuthEngine key derivation to follow standard KEX

(spark) branch master updated (becbca6752a5 -> 6d1b3668db42)

2024-04-15 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from becbca6752a5 [SPARK-47860][BUILD][K8S] Upgrade `kubernetes-client` to 6.12.0 add 6d1b3668db42

(spark) branch master updated (61264f77fd68 -> becbca6752a5)

2024-04-15 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 61264f77fd68 [SPARK-47603][KUBERNETES][YARN] Resource managers: Migrate logWarn with variables to structured

(spark) branch master updated (83fe9b16ab5a -> 61264f77fd68)

2024-04-15 Thread gengliang
This is an automated email from the ASF dual-hosted git repository. gengliang pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 83fe9b16ab5a [SPARK-47694][CONNECT] Make max message size configurable on the client side add 61264f77fd68

Re: [PR] add pandas on spark page [spark-website]

2024-04-15 Thread via GitHub
dongjoon-hyun commented on PR #513: URL: https://github.com/apache/spark-website/pull/513#issuecomment-2057743710 cc @HyukjinKwon -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

(spark) branch master updated: [SPARK-47694][CONNECT] Make max message size configurable on the client side

2024-04-15 Thread hvanhovell
This is an automated email from the ASF dual-hosted git repository. hvanhovell pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 83fe9b16ab5a [SPARK-47694][CONNECT] Make max

Re: [PR] add pandas on spark page [spark-website]

2024-04-15 Thread via GitHub
xinrong-meng commented on PR #513: URL: https://github.com/apache/spark-website/pull/513#issuecomment-2057571560 I wanted to add that https://github.com/apache/spark-website/blob/6b0863728b12ee2518af563f6437482642f8b2b4/pandas-on-spark/index.md has the major content to review -- This is

(spark) branch master updated (f3a6ca9e2c47 -> ba673d74973a)

2024-04-15 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from f3a6ca9e2c47 [SPARK-47357][SQL] Add support for Upper, Lower, InitCap (all collations) add ba673d74973a

(spark) branch master updated (b8354bbe53c0 -> f3a6ca9e2c47)

2024-04-15 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from b8354bbe53c0 [SPARK-47851][CONNECT][DOCS] Document pyspark-connect package add f3a6ca9e2c47 [SPARK-47357][SQL]

[PR] add pandas on spark page [spark-website]

2024-04-15 Thread via GitHub
MrPowers opened a new pull request, #513: URL: https://github.com/apache/spark-website/pull/513 Sorry for the huge PR! This PR adds a pandas on Spark page to explain the benefits of pandas on Spark. The [pandas API on Spark

(spark) branch master updated (e6b7950f553c -> b8354bbe53c0)

2024-04-15 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from e6b7950f553c [SPARK-47788][SS] Ensure the same hash partitioning for streaming stateful ops add b8354bbe53c0

(spark) branch master updated (f86dc2b7e5c3 -> e6b7950f553c)

2024-04-15 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from f86dc2b7e5c3 [SPARK-47848][SS] Fix thread safety issue around access to loadedMaps in close function for hdfs store

(spark) branch master updated: [SPARK-47848][SS] Fix thread safety issue around access to loadedMaps in close function for hdfs store provider

2024-04-15 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f86dc2b7e5c3 [SPARK-47848][SS] Fix thread