[spark] branch master updated: [SPARK-42992][PYTHON] Introduce PySparkRuntimeError

2023-04-25 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ad454f46d85 [SPARK-42992][PYTHON] Introduce

[spark] branch master updated (b461cdea92e -> eae91ee3c96)

2023-04-25 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from b461cdea92e [SPARK-43156][SPARK-43098][SQL] Extend scalar subquery count bug test with decorrelateInnerQuery

[spark] branch master updated: [SPARK-43156][SPARK-43098][SQL] Extend scalar subquery count bug test with decorrelateInnerQuery disabled

2023-04-25 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b461cdea92e [SPARK-43156][SPARK-43098][SQL]

[spark] branch master updated (014685c41e4 -> 55865bd1756)

2023-04-25 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 014685c41e4 [SPARK-43277][YARN] Clean up deprecation hadoop api usage in `yarn` module add 55865bd1756

[GitHub] [spark-website] Yikun commented on pull request #458: Update Spark Docker Images publish workflow

2023-04-25 Thread via GitHub
Yikun commented on PR #458: URL: https://github.com/apache/spark-website/pull/458#issuecomment-1522735459 > As you know, Apache Spark dev mailing list is the only official way to build a community consensus. All the other channels (GitHub or even user mailing list). Please shoot the email.

[spark] branch master updated: [SPARK-43277][YARN] Clean up deprecation hadoop api usage in `yarn` module

2023-04-25 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 014685c41e4 [SPARK-43277][YARN] Clean up

[GitHub] [spark-website] dongjoon-hyun commented on pull request #458: Update Spark Docker Images publish workflow

2023-04-25 Thread via GitHub
dongjoon-hyun commented on PR #458: URL: https://github.com/apache/spark-website/pull/458#issuecomment-1522655970 @Yikun . We cannot simply remove anything like this PR. The official way to adopt new standard is to send the email on dev mailing list and build a community consensus.

[GitHub] [spark-website] Yikun commented on pull request #458: Update Spark Docker Images publish workflow

2023-04-25 Thread via GitHub
Yikun commented on PR #458: URL: https://github.com/apache/spark-website/pull/458#issuecomment-1522651856 > I believe 3.4.0 and v3.4.0 only causes many confusions to the users. In Apache Spark community, that's the reason why I propose to keep v3.4.0 tag format only (whatever we used;

[spark] branch master updated (b26844ce879 -> a2a5299cb2d)

2023-04-25 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from b26844ce879 [SPARK-43136][CONNECT] Adding groupByKey + mapGroup + coGroup functions add a2a5299cb2d

[GitHub] [spark-website] dongjoon-hyun commented on pull request #458: Update Spark Docker Images publish workflow

2023-04-25 Thread via GitHub
dongjoon-hyun commented on PR #458: URL: https://github.com/apache/spark-website/pull/458#issuecomment-1522621830 1. If we are going to maintain the manual process, why do you remove old description in this PR? > For tag, it's intentional. In 3.4.0, v3.4.0 tag and 3.4.0 serious tags

[GitHub] [spark-website] Yikun commented on pull request #458: Update Spark Docker Images publish workflow

2023-04-25 Thread via GitHub
Yikun commented on PR #458: URL: https://github.com/apache/spark-website/pull/458#issuecomment-1522546716 Yes, but I meant we still need to update in apache/spark-docker. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark-website] dongjoon-hyun commented on pull request #458: Update Spark Docker Images publish workflow

2023-04-25 Thread via GitHub
dongjoon-hyun commented on PR #458: URL: https://github.com/apache/spark-website/pull/458#issuecomment-1522543950 It's already Java 17 by default. > For java17, I think we can switch to java17 in docker image. -- This is an automated message from the Apache Git Service. To respond

[GitHub] [spark-website] Yikun commented on pull request #458: Update Spark Docker Images publish workflow

2023-04-25 Thread via GitHub
Yikun commented on PR #458: URL: https://github.com/apache/spark-website/pull/458#issuecomment-1522543145 Thanks for catch and reminder it! @dongjoon-hyun For java17, I think we can switch to java17 in docker image. For tag, it's intentional. In 3.4.0, `v3.4.0` tag and `3.4.0`

[GitHub] [spark-website] dongjoon-hyun commented on pull request #458: Update Spark Docker Images publish workflow

2023-04-25 Thread via GitHub
dongjoon-hyun commented on PR #458: URL: https://github.com/apache/spark-website/pull/458#issuecomment-1522426433 cc @sunchao , too -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark-website] dongjoon-hyun commented on pull request #458: Update Spark Docker Images publish workflow

2023-04-25 Thread via GitHub
dongjoon-hyun commented on PR #458: URL: https://github.com/apache/spark-website/pull/458#issuecomment-1522426236 Hi, @Yikun , @HyukjinKwon , @yaooqinn , @zhengruifeng . it seems that this PR introduced two user-facing breaking changes - Downgrade Java from 17 to 11 ``` $

[spark] branch master updated (0e6446ac62d -> b26844ce879)

2023-04-25 Thread hvanhovell
This is an automated email from the ASF dual-hosted git repository. hvanhovell pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 0e6446ac62d [SPARK-43285] Fix ReplE2ESuite consistently failing with JDK 17 add b26844ce879

[spark] branch master updated: [SPARK-43285] Fix ReplE2ESuite consistently failing with JDK 17

2023-04-25 Thread hvanhovell
This is an automated email from the ASF dual-hosted git repository. hvanhovell pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0e6446ac62d [SPARK-43285] Fix ReplE2ESuite

[spark] branch master updated (516d7b3d483 -> 9c237d7bc7b)

2023-04-25 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 516d7b3d483 [SPARK-42798][BUILD] Upgrade protobuf-java to 3.22.3 add 9c237d7bc7b [SPARK-43225][BUILD][SQL] Remove

[spark] branch master updated: [SPARK-42798][BUILD] Upgrade protobuf-java to 3.22.3

2023-04-25 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 516d7b3d483 [SPARK-42798][BUILD] Upgrade

[spark] branch master updated: [SPARK-42419][FOLLOWUP][CONNECT][PYTHON] Remove unused exception

2023-04-25 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b59d3af4ca2

[spark] branch master updated: [SPARK-43142] Fix DSL expressions on attributes with special characters

2023-04-25 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 98ae33b7acb [SPARK-43142] Fix DSL expressions

[spark] branch master updated (50b652e241f -> 331e5bb25f8)

2023-04-25 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 50b652e241f [SPARK-43226] Define extractors for file-constant metadata add 331e5bb25f8 [SPARK-43204][SQL] Align

[spark] branch master updated: [SPARK-43226] Define extractors for file-constant metadata

2023-04-25 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 50b652e241f [SPARK-43226] Define extractors for

[spark] branch master updated (71969fb9958 -> 4b60de63770)

2023-04-25 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 71969fb9958 [SPARK-43231][ML][PYTHON][CONNECT][TESTS] Reduce the memory requirement in torch-related tests add

[spark] branch master updated: [SPARK-43231][ML][PYTHON][CONNECT][TESTS] Reduce the memory requirement in torch-related tests

2023-04-25 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 71969fb9958

[spark] branch master updated: [SPARK-43260][PYTHON] Migrate the Spark SQL pandas arrow type errors into error class

2023-04-25 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 15111a05e92 [SPARK-43260][PYTHON] Migrate the

[spark] branch master updated: [SPARK-43144] Scala Client DataStreamReader table() API

2023-04-25 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new adc4a3dd600 [SPARK-43144] Scala Client