[GitHub] [spark-website] zhengruifeng commented on pull request #478: [SPARK-45195][FOLLOWUP] Update python example

2023-09-18 Thread via GitHub
zhengruifeng commented on PR #478: URL: https://github.com/apache/spark-website/pull/478#issuecomment-1724871330 thank you guys -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[spark-website] branch asf-site updated: [SPARK-45195][FOLLOWUP] Update python example (#478)

2023-09-18 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git The following commit(s) were added to refs/heads/asf-site by this push: new c578724e88 [SPARK-45195][FOLLOWUP]

[GitHub] [spark-website] zhengruifeng merged pull request #478: [SPARK-45195][FOLLOWUP] Update python example

2023-09-18 Thread via GitHub
zhengruifeng merged PR #478: URL: https://github.com/apache/spark-website/pull/478 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[spark] branch branch-3.1 updated: [SPARK-45210][DOCS][3.4] Switch languages consistently across docs for all code snippets (Spark 3.4 and below)

2023-09-18 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.1 by this push: new 4a418a448ea [SPARK-45210][DOCS][3.4]

[spark] branch branch-3.2 updated: [SPARK-45210][DOCS][3.4] Switch languages consistently across docs for all code snippets (Spark 3.4 and below)

2023-09-18 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new e428fe902bb [SPARK-45210][DOCS][3.4]

[spark] branch branch-3.3 updated: [SPARK-45210][DOCS][3.4] Switch languages consistently across docs for all code snippets (Spark 3.4 and below)

2023-09-18 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 578233e8e0a [SPARK-45210][DOCS][3.4]

[spark] branch branch-3.4 updated: [SPARK-45210][DOCS][3.4] Switch languages consistently across docs for all code snippets (Spark 3.4 and below)

2023-09-18 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 796d8785c61 [SPARK-45210][DOCS][3.4]

[spark] branch branch-3.4 updated: [SPARK-44910][SQL][3.4] Encoders.bean does not support superclasses with generic type arguments

2023-09-18 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new e5d82875463 [SPARK-44910][SQL][3.4]

[spark] branch branch-3.5 updated: [SPARK-44910][SQL] Encoders.bean does not support superclasses with generic type arguments

2023-09-18 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 6a498087361 [SPARK-44910][SQL]

[spark] branch master updated: [SPARK-44910][SQL] Encoders.bean does not support superclasses with generic type arguments

2023-09-18 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7e14c8cc33f [SPARK-44910][SQL] Encoders.bean

[spark] branch master updated: [SPARK-43654][CONNECT][PS][TESTS] Enable `InternalFrameParityTests.test_from_pandas`

2023-09-18 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2697a9426e1 [SPARK-43654][CONNECT][PS][TESTS]

[GitHub] [spark-website] gatorsmile commented on a diff in pull request #478: [SPARK-45195] Update python example

2023-09-18 Thread via GitHub
gatorsmile commented on code in PR #478: URL: https://github.com/apache/spark-website/pull/478#discussion_r1329548341 ## index.md: ## @@ -88,13 +88,17 @@ navigation: Run now -Install with 'pip' or try offical image +

[GitHub] [spark-website] gatorsmile commented on a diff in pull request #478: [SPARK-45195] Update python example

2023-09-18 Thread via GitHub
gatorsmile commented on code in PR #478: URL: https://github.com/apache/spark-website/pull/478#discussion_r1329547154 ## index.md: ## @@ -88,13 +88,17 @@ navigation: Run now -Install with 'pip' or try offical image +

[GitHub] [spark-website] zhengruifeng opened a new pull request, #478: [SPARK-45195] Update python example

2023-09-18 Thread via GitHub
zhengruifeng opened a new pull request, #478: URL: https://github.com/apache/spark-website/pull/478 To address https://github.com/apache/spark-website/pull/477#discussion_r1329098596

[spark] branch master updated: [SPARK-45202][BUILD] Fix lint-js tool and js format

2023-09-18 Thread yao
This is an automated email from the ASF dual-hosted git repository. yao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e818e9cefa0 [SPARK-45202][BUILD] Fix lint-js tool

[spark] branch branch-3.5 updated: Revert "Revert "[SPARK-44742][PYTHON][DOCS] Add Spark version drop down to the PySpark doc site""

2023-09-18 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 555c8def51e Revert "Revert

[GitHub] [spark-website] zhengruifeng commented on a diff in pull request #477: [SPARK-45195] Update examples with docker official image

2023-09-18 Thread via GitHub
zhengruifeng commented on code in PR #477: URL: https://github.com/apache/spark-website/pull/477#discussion_r1329402279 ## index.md: ## @@ -88,11 +88,13 @@ navigation: Run now -Installing with 'pip' +

[spark] branch master updated: [SPARK-45113][PYTHON][DOCS][FOLLOWUP] Add sorting to the example of `collect_set/collect_list` to ensure stable results

2023-09-18 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 464a3c19f51

[spark] branch branch-3.5 updated: [SPARK-45167][CONNECT][PYTHON][FOLLOW-UP] Use lighter threading Rlock, and use the existing eventually util function

2023-09-18 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 2a9dd2b3968

[spark] branch branch-3.5 updated: [SPARK-45167][CONNECT][PYTHON][3.5] Python client must call `release_all`

2023-09-18 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 60073f31831

[spark] branch master updated: [SPARK-45133][CONNECT][TESTS][FOLLOWUP] Add test that queries transition to FINISHED

2023-09-18 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8323c0c48de

[spark] branch master updated: [SPARK-45065][PYTHON][PS] Support Pandas 2.1.0

2023-09-18 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f83e5ec202b [SPARK-45065][PYTHON][PS] Support

[spark] branch master updated: [SPARK-45188][SQL][DOCS] Update error messages related to parameterized `sql()`

2023-09-18 Thread maxgekk
This is an automated email from the ASF dual-hosted git repository. maxgekk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 981312284f0 [SPARK-45188][SQL][DOCS] Update

[spark] branch branch-3.4 updated: [SPARK-45081][SQL][3.4] Encoders.bean does no longer work with read-only properties

2023-09-18 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 66f5f964f82 [SPARK-45081][SQL][3.4]

[spark] branch master updated: [SPARK-45153][BUILD][PS] Rebalance testing time for `pyspark-pandas-connect-part1`

2023-09-18 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 29acdf755cd [SPARK-45153][BUILD][PS] Rebalance

[spark] branch branch-3.4 updated: [SPARK-45078][SQL][3.4] Fix `array_insert` ImplicitCastInputTypes not work

2023-09-18 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 464811a243c [SPARK-45078][SQL][3.4]

[spark] branch master updated: [SPARK-45203][SQL][TEST] Join tests in KeyGroupedPartitioningSuite should use merge join hint

2023-09-18 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new eadb591f37a [SPARK-45203][SQL][TEST] Join

[GitHub] [spark-website] allisonwang-db commented on a diff in pull request #477: [SPARK-45195] Update examples with docker official image

2023-09-18 Thread via GitHub
allisonwang-db commented on code in PR #477: URL: https://github.com/apache/spark-website/pull/477#discussion_r1329098596 ## index.md: ## @@ -88,11 +88,13 @@ navigation: Run now -Installing with 'pip' +

[spark] branch master updated (8d363c6e2c8 -> 0dda75f824d)

2023-09-18 Thread maxgekk
This is an automated email from the ASF dual-hosted git repository. maxgekk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 8d363c6e2c8 [SPARK-45196][PYTHON][DOCS] Refine docstring of `array/array_contains/arrays_overlap` add

[spark] branch master updated: [SPARK-45196][PYTHON][DOCS] Refine docstring of `array/array_contains/arrays_overlap`

2023-09-18 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8d363c6e2c8 [SPARK-45196][PYTHON][DOCS] Refine

[spark] branch master updated: [SPARK-43628][SPARK-43629][CONNECT][PS][TESTS] Clear message for JVM dependent tests

2023-09-18 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 02bbd2867be

[spark] branch master updated (82d0823c2f9 -> 1ae8e018164)

2023-09-18 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 82d0823c2f9 [SPARK-44788][PYTHON][DOCS][FOLLOW-UP] Move `from_xml`/`schema_of_xml` to `Xml Functions` add

[spark] branch master updated: [SPARK-44788][PYTHON][DOCS][FOLLOW-UP] Move `from_xml`/`schema_of_xml` to `Xml Functions`

2023-09-18 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 82d0823c2f9

[spark] branch master updated: [SPARK-45148][BUILD] Upgrade scalatest related dependencies to the 3.2.17 series

2023-09-18 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c1c58698d3d [SPARK-45148][BUILD] Upgrade

[spark-website] branch asf-site updated: [SPARK-45195] Update examples with docker official image

2023-09-18 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git The following commit(s) were added to refs/heads/asf-site by this push: new 6b10f7fd85 [SPARK-45195] Update

[GitHub] [spark-website] srowen closed pull request #477: [SPARK-45195] Update examples with docker official image

2023-09-18 Thread via GitHub
srowen closed pull request #477: [SPARK-45195] Update examples with docker official image URL: https://github.com/apache/spark-website/pull/477 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[spark] branch master updated: [SPARK-45197][CORE] Make `StandaloneRestServer` add `JavaModuleOptions` to drivers

2023-09-18 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 360adc2250b [SPARK-45197][CORE] Make

[spark] branch master updated: [SPARK-44788][PYTHON][DOCS][FOLLOW-UP] Add from_xml and schema_of_xml into PySpark documentation

2023-09-18 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5b89bc156cb

[spark] branch master updated: [SPARK-45193][PS][CONNECT][TESTS] Refactor `test_mode` to be compatible with Spark Connect

2023-09-18 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5db824aa6f9 [SPARK-45193][PS][CONNECT][TESTS]

[spark] branch master updated: [SPARK-44788][CONNECT][PYTHON][SQL] Add from_xml and schema_of_xml to pyspark, spark connect and sql function

2023-09-18 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 89041a4a8c7

[spark] branch master updated: [SPARK-44823][PYTHON] Update black to 23.9.1 and fix erroneous check

2023-09-18 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5299e5423f4 [SPARK-44823][PYTHON] Update

[GitHub] [spark-website] zhengruifeng commented on pull request #477: [SPARK-45195] Update example with docker official image

2023-09-18 Thread via GitHub
zhengruifeng commented on PR #477: URL: https://github.com/apache/spark-website/pull/477#issuecomment-1722809681 also cc @gatorsmile @HyukjinKwon @allisonwang-db @Yikun -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [spark-website] zhengruifeng opened a new pull request, #477: Update Example with docker official image

2023-09-18 Thread via GitHub
zhengruifeng opened a new pull request, #477: URL: https://github.com/apache/spark-website/pull/477 1, add `docker` commands for PySpark and SparkR; 2, switch to docker official image for SQL, Scala and Java; refer to https://hub.docker.com/_/spark also manually checked