(spark) branch master updated: [SPARK-47701][SQL][TESTS] Postgres: Add test for Composite and Range types

2024-04-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9a20794b252d [SPARK-47701][SQL][TESTS]

(spark) branch master updated: [SPARK-45733][PYTHON][TESTS][FOLLOWUP] Skip `pyspark.sql.tests.connect.client.test_client` if not should_test_connect

2024-04-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 360a3f9023d0

Re: [PR] Add Spark Connect page [spark-website]

2024-04-02 Thread via GitHub
dongjoon-hyun commented on code in PR #511: URL: https://github.com/apache/spark-website/pull/511#discussion_r1548892591 ## spark-connect/index.md: ## @@ -0,0 +1,151 @@ +--- +layout: global +type: "page singular" +title: Spark Connect +description: Spark Connect makes remote

Re: [PR] Add Spark Connect page [spark-website]

2024-04-02 Thread via GitHub
dongjoon-hyun commented on code in PR #511: URL: https://github.com/apache/spark-website/pull/511#discussion_r1548892050 ## spark-connect/index.md: ## @@ -0,0 +1,151 @@ +--- +layout: global +type: "page singular" +title: Spark Connect +description: Spark Connect makes remote

(spark) branch master updated (2c2a2adc3275 -> 344f640b2f35)

2024-04-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 2c2a2adc3275 [SPARK-47655][SS] Integrate timer with Initial State handling for state-v2 add 344f640b2f35

(spark) branch master updated (49b7b6b9fe6b -> 2c2a2adc3275)

2024-04-02 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 49b7b6b9fe6b [SPARK-47691][SQL] Postgres: Support multi dimensional array on the write side add 2c2a2adc3275

(spark) branch master updated (55b5ff6f45fd -> 49b7b6b9fe6b)

2024-04-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 55b5ff6f45fd [SPARK-47669][SQL][CONNECT][PYTHON] Add `Column.try_cast` add 49b7b6b9fe6b [SPARK-47691][SQL]

Re: [PR] Add Spark Connect page [spark-website]

2024-04-02 Thread via GitHub
MrPowers commented on PR #511: URL: https://github.com/apache/spark-website/pull/511#issuecomment-2033318574 Thank you for the review @dongjoon-hyun. This pull request was merged, so I will address your comments in another PR. I really appreciate your feedback. -- This is an automated

(spark) branch master updated: [SPARK-47669][SQL][CONNECT][PYTHON] Add `Column.try_cast`

2024-04-02 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 55b5ff6f45fd

Re: [PR] Add Spark Connect page [spark-website]

2024-04-02 Thread via GitHub
MrPowers commented on code in PR #511: URL: https://github.com/apache/spark-website/pull/511#discussion_r1548753924 ## spark-connect/index.md: ## @@ -0,0 +1,151 @@ +--- +layout: global +type: "page singular" +title: Spark Connect +description: Spark Connect makes remote Spark

Re: [PR] Add Spark Connect page [spark-website]

2024-04-02 Thread via GitHub
dongjoon-hyun commented on code in PR #511: URL: https://github.com/apache/spark-website/pull/511#discussion_r1548741671 ## spark-connect/index.md: ## @@ -0,0 +1,151 @@ +--- +layout: global +type: "page singular" +title: Spark Connect +description: Spark Connect makes remote

Re: [PR] Add Spark Connect page [spark-website]

2024-04-02 Thread via GitHub
srowen commented on PR #511: URL: https://github.com/apache/spark-website/pull/511#issuecomment-2033256929 Merged to asf-site -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] Add Spark Connect page [spark-website]

2024-04-02 Thread via GitHub
srowen closed pull request #511: Add Spark Connect page URL: https://github.com/apache/spark-website/pull/511 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

(spark) branch master updated: [SPARK-47697][INFRA] Add Scala style check for invalid MDC usage

2024-04-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 27fdf96842ea [SPARK-47697][INFRA] Add Scala

Re: [PR] Add Spark Connect page [spark-website]

2024-04-02 Thread via GitHub
MrPowers commented on PR #511: URL: https://github.com/apache/spark-website/pull/511#issuecomment-2033168687 @srowen - I rebased, good call. I could also break this up into two separate commits if that would help. Sorry for sending the massive PR. -- This is an automated message

Re: [PR] Add Spark Connect page [spark-website]

2024-04-02 Thread via GitHub
srowen commented on PR #511: URL: https://github.com/apache/spark-website/pull/511#issuecomment-2033120138 For good measure, rebase this? I think this also include your change that was merged months ago at

Re: [PR] Add Spark Connect page [spark-website]

2024-04-02 Thread via GitHub
MrPowers commented on PR #511: URL: https://github.com/apache/spark-website/pull/511#issuecomment-2033080398 Here's the main file that should be reviewed: https://github.com/apache/spark-website/pull/511/files#diff-65090e623c6aabb88b162b7e17e2a81dc359e84234e9fac9561340f7acd05431 -- This

[PR] Add Spark Connect page [spark-website]

2024-04-02 Thread via GitHub
MrPowers opened a new pull request, #511: URL: https://github.com/apache/spark-website/pull/511 This PR adds a Spark Connect page. Sorry for the huge PR. This PR adds Spark Connect to the dropdown which apparently modifies a bunch of HTML files. Let me know if this is OK!

(spark) branch master updated: [SPARK-47699][BUILD] Upgrade `gcs-connector` to 2.2.21 and add a note for 3.0.0

2024-04-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d11d9cf729ab [SPARK-47699][BUILD] Upgrade

(spark) branch master updated (db0975cb2a1c -> e6144e4d75b7)

2024-04-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from db0975cb2a1c [SPARK-47602][CORE] Resource managers: Migrate logError with variables to structured logging framework

(spark) branch master updated (8d4e9647c971 -> db0975cb2a1c)

2024-04-02 Thread gengliang
This is an automated email from the ASF dual-hosted git repository. gengliang pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 8d4e9647c971 [SPARK-47684][SQL] Postgres: Map length unspecified bpchar to StringType add db0975cb2a1c

(spark) branch master updated (ba98b7ae53f8 -> 8d4e9647c971)

2024-04-02 Thread yao
This is an automated email from the ASF dual-hosted git repository. yao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from ba98b7ae53f8 [SPARK-47689][SQL] Do not wrap query execution error during data writing add 8d4e9647c971

(spark) branch branch-3.4 updated: [SPARK-47666][SQL][3.4] Fix NPE when reading mysql bit array as LongType

2024-04-02 Thread yao
This is an automated email from the ASF dual-hosted git repository. yao pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 9f8eb54c7566 [SPARK-47666][SQL][3.4] Fix

(spark) branch master updated: [SPARK-47689][SQL] Do not wrap query execution error during data writing

2024-04-02 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ba98b7ae53f8 [SPARK-47689][SQL] Do not wrap

(spark) branch master updated (03f4e45cd7e9 -> b1b1fde42bd8)

2024-04-02 Thread yao
This is an automated email from the ASF dual-hosted git repository. yao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 03f4e45cd7e9 [SPARK-47685][SQL] Restore the support for `Stream` type in `Dataset#groupBy` add b1b1fde42bd8 Revert

(spark) branch branch-3.5 updated: [SPARK-47666][SQL][3.5] Fix NPE when reading mysql bit array as LongType

2024-04-02 Thread yao
This is an automated email from the ASF dual-hosted git repository. yao pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 2dda441bec01 [SPARK-47666][SQL][3.5] Fix

(spark) branch master updated (a598f654066d -> 03f4e45cd7e9)

2024-04-02 Thread yangjie01
This is an automated email from the ASF dual-hosted git repository. yangjie01 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from a598f654066d [SPARK-47664][PYTHON][CONNECT][TESTS][FOLLOW-UP] Add more tests add 03f4e45cd7e9

(spark) branch master updated: [SPARK-47664][PYTHON][CONNECT][TESTS][FOLLOW-UP] Add more tests

2024-04-02 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a598f654066d

(spark) branch master updated (e2e6e09a24db -> 22771a6a87e7)

2024-04-02 Thread yao
This is an automated email from the ASF dual-hosted git repository. yao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from e2e6e09a24db [SPARK-47634][SQL] Add legacy support for disabling map key normalization add 22771a6a87e7

(spark) branch master updated: [SPARK-47634][SQL] Add legacy support for disabling map key normalization

2024-04-02 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e2e6e09a24db [SPARK-47634][SQL] Add legacy

(spark) branch master updated: [SPARK-47663][CORE][TESTS] add end to end test for task limiting according to different cpu and gpu configurations

2024-04-02 Thread weichenxu123
This is an automated email from the ASF dual-hosted git repository. weichenxu123 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new eb9b12692601 [SPARK-47663][CORE][TESTS]

(spark) branch master updated: [SPARK-47686][SQL][TESTS] Use `=!=` instead of `!==` in `JoinHintSuite`

2024-04-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 00162b82fe3c [SPARK-47686][SQL][TESTS] Use