[spark] branch master updated (499f620 -> 56edb81)

2021-03-02 Thread yamamuro
This is an automated email from the ASF dual-hosted git repository. yamamuro pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 499f620 [MINOR][SQL][DOCS] Fix some wrong default values in SQL tuning guide's AQE section add 56edb81 [SPAR

[spark] branch branch-3.0 updated: [MINOR][SQL][DOCS] Fix some wrong default values in SQL tuning guide's AQE section

2021-03-02 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.0 by this push: new e2455c5 [MINOR][SQL][DOCS] Fix some w

[spark] branch branch-3.1 updated: [MINOR][SQL][DOCS] Fix some wrong default values in SQL tuning guide's AQE section

2021-03-02 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.1 by this push: new 1401faf [MINOR][SQL][DOCS] Fix some w

[spark] branch master updated (229d2e0 -> 499f620)

2021-03-02 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 229d2e0 [SPARK-34222][SQL] Enhance boolean simplification rule add 499f620 [MINOR][SQL][DOCS] Fix some wrong

[spark] branch master updated (17f0e70 -> 229d2e0)

2021-03-02 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 17f0e70 [SPARK-34576][SQL] Fix drop/add columns to a dataset of `DESCRIBE COLUMN` add 229d2e0 [SPARK-34222][S

[spark] branch master updated (cd649e7 -> 17f0e70)

2021-03-02 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from cd649e7 [SPARK-27793][SQL] Add ANSI SQL day-time and year-month interval types add 17f0e70 [SPARK-34576][SQL]

[spark] branch master updated (5362f08 -> cd649e7)

2021-03-02 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 5362f08 [SPARK-34593][SQL] Preserve broadcast nested loop join partitioning and ordering add cd649e7 [SPARK-2

[spark] branch master updated (4e43819 -> 5362f08)

2021-03-02 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 4e43819 [SPARK-34534] Fix blockIds order when use FetchShuffleBlocks to fetch blocks add 5362f08 [SPARK-34593

[spark] branch branch-3.0 updated: [SPARK-34534] Fix blockIds order when use FetchShuffleBlocks to fetch blocks

2021-03-02 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.0 by this push: new 5f06f2e [SPARK-34534] Fix blockIds orde

[spark] branch branch-3.1 updated: [SPARK-34534] Fix blockIds order when use FetchShuffleBlocks to fetch blocks

2021-03-02 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.1 by this push: new a18883a [SPARK-34534] Fix blockIds orde

[spark] branch master updated (ecf4811 -> 4e43819)

2021-03-02 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from ecf4811 [SPARK-34596][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in NewInstance.doGenCode

[spark] branch branch-3.0 updated: [SPARK-34596][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in NewInstance.doGenCode

2021-03-02 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.0 by this push: new 24ba689 [SPARK-34596][SQL] Use Utils.

[spark] branch branch-3.1 updated: [SPARK-34596][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in NewInstance.doGenCode

2021-03-02 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.1 by this push: new 4c8403e [SPARK-34596][SQL] Use Utils.

[spark] branch master updated (1077666 -> ecf4811)

2021-03-02 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 1077666 [SPARK-34548][SQL][FOLLOW-UP] Call toSeq to recover Scala 2.13 build in RemoveNoopUnion add ecf4811

[spark] branch branch-3.0 updated (6e338c3 -> d7b66e9)

2021-03-02 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git. from 6e338c3 [SPARK-34543][SQL][3.0] Respect the `spark.sql.caseSensitive` config while resolving partition spec i

[spark] branch master updated (bab9531 -> 1077666)

2021-03-02 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from bab9531 [SPARK-34548][SQL] Remove unnecessary children from Union under Distince and Deduplicate add 1077666

[spark] branch master updated (6c5322d -> bab9531)

2021-03-02 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 6c5322d [SPARK-34361][K8S] In case of downscaling avoid killing of executors already known by the scheduler backend

[spark] branch branch-3.1 updated: [SPARK-34361][K8S] In case of downscaling avoid killing of executors already known by the scheduler backend in the pod allocator

2021-03-02 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.1 by this push: new 28f2d51 [SPARK-34361][K8S] In case of do

[spark] branch master updated: [SPARK-34361][K8S] In case of downscaling avoid killing of executors already known by the scheduler backend in the pod allocator

2021-03-02 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6c5322d [SPARK-34361][K8S] In case of downscalin

[GitHub] [spark-website] gengliangwang commented on pull request #319: Add docs for Apache Spark 3.1.1

2021-03-02 Thread GitBox
gengliangwang commented on pull request #319: URL: https://github.com/apache/spark-website/pull/319#issuecomment-789094278 > Both issues are gone after I cleaned the cache. Yes, there is cache in browsers. If you don't see https://spark.apache.org/docs/latest/ updated, try hard refre

[GitHub] [spark-website] gatorsmile edited a comment on pull request #319: Add docs for Apache Spark 3.1.1

2021-03-02 Thread GitBox
gatorsmile edited a comment on pull request #319: URL: https://github.com/apache/spark-website/pull/319#issuecomment-789089008 Both issues are gone after I cleaned the cache. The search box is not working. @gengliangwang is asking the algolia team to trigger the crawl. https://gith

[GitHub] [spark-website] gatorsmile commented on pull request #319: Add docs for Apache Spark 3.1.1

2021-03-02 Thread GitBox
gatorsmile commented on pull request #319: URL: https://github.com/apache/spark-website/pull/319#issuecomment-789089008 Both issues are gone after I cleaned the cache. The search box is not working. @gengliangwang is asking them to trigger the crawl. https://github.com/algolia/docs

[GitHub] [spark-website] gatorsmile commented on pull request #319: Add docs for Apache Spark 3.1.1

2021-03-02 Thread GitBox
gatorsmile commented on pull request #319: URL: https://github.com/apache/spark-website/pull/319#issuecomment-789078222 https://spark.apache.org/docs/latest/api/python/index.html points to an old python page. https://spark.apache.org/docs/3.1.1/api/python/index.html is the right one. -

[GitHub] [spark-website] gatorsmile commented on pull request #319: Add docs for Apache Spark 3.1.1

2021-03-02 Thread GitBox
gatorsmile commented on pull request #319: URL: https://github.com/apache/spark-website/pull/319#issuecomment-789066541 https://spark.apache.org/docs/3.1.1/ works, but https://spark.apache.org/docs/latest/ misses the menu T

[GitHub] [spark-website] gatorsmile merged pull request #320: Add Spark 3.1.1 release notes, news and etc.

2021-03-02 Thread GitBox
gatorsmile merged pull request #320: URL: https://github.com/apache/spark-website/pull/320 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark-website] gatorsmile merged pull request #319: Add docs for Apache Spark 3.1.1

2021-03-02 Thread GitBox
gatorsmile merged pull request #319: URL: https://github.com/apache/spark-website/pull/319 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[spark] branch master updated: [SPARK-34558][SQL] warehouse path should be qualified ahead of populating and use

2021-03-02 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6093a78 [SPARK-34558][SQL] warehouse path shoul

[spark] branch master updated (2e54d68 -> 9e8547c)

2021-03-02 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 2e54d68 [SPARK-34547][SQL] Only use metadata columns for resolution as last resort add 9e8547c [SPARK-34498][

[GitHub] [spark-website] HyukjinKwon opened a new pull request #320: Add Spark 3.1.1 release notes, news and etc.

2021-03-02 Thread GitBox
HyukjinKwon opened a new pull request #320: URL: https://github.com/apache/spark-website/pull/320 This PR fixes to update our website. I checked the followings are available as of now. - https://dist.apache.org/repos/dist/release/spark/spark-3.1.1/ - https://repo1.maven.org/maven2

[GitHub] [spark-website] HyukjinKwon opened a new pull request #319: Add docs for Apache Spark 3.1.1

2021-03-02 Thread GitBox
HyukjinKwon opened a new pull request #319: URL: https://github.com/apache/spark-website/pull/319 This PR aims to add Apache Spark 3.1.1 documentation - Add `v3.1.1-rc3-docs/_site` into `site/docs/3.1.1`. - Change `latest` to `3.1.1` --

svn commit: r46416 - /dev/spark/v3.1.1-rc3-docs/

2021-03-02 Thread gurwls223
Author: gurwls223 Date: Tue Mar 2 11:06:13 2021 New Revision: 46416 Log: Removing RC artifacts. Removed: dev/spark/v3.1.1-rc3-docs/ - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-

svn commit: r46415 - /release/spark/KEYS

2021-03-02 Thread gurwls223
Author: gurwls223 Date: Tue Mar 2 11:03:57 2021 New Revision: 46415 Log: Update KEYS Modified: release/spark/KEYS Modified: release/spark/KEYS == --- release/spark/KEYS (original) +++ release/spark/KEYS Tue Mar 2 1

svn commit: r46414 - /dev/spark/v3.1.1-rc3-bin/ /release/spark/spark-3.1.1/

2021-03-02 Thread rxin
Author: rxin Date: Tue Mar 2 11:00:12 2021 New Revision: 46414 Log: Moving Apache Spark 3.1.1 RC3 to Apache Spark 3.1.1 Added: release/spark/spark-3.1.1/ - copied from r46413, dev/spark/v3.1.1-rc3-bin/ Removed: dev/spark/v3.1.1-rc3-bin/ ---

svn commit: r46413 - in /dev/spark: v3.1.1-rc3-bin/ v3.1.1-rc3-docs/

2021-03-02 Thread rxin
Author: rxin Date: Tue Mar 2 10:55:39 2021 New Revision: 46413 Log: Recover 3.1.1 RC3 Added: dev/spark/v3.1.1-rc3-bin/ - copied from r46410, dev/spark/v3.1.1-rc3-bin/ dev/spark/v3.1.1-rc3-docs/ - copied from r46410, dev/spark/v3.1.1-rc3-docs/ ---

svn commit: r46411 - in /dev/spark: v3.1.1-rc3-bin/ v3.1.1-rc3-docs/

2021-03-02 Thread rxin
Author: rxin Date: Tue Mar 2 10:39:38 2021 New Revision: 46411 Log: Removing RC artifacts. Removed: dev/spark/v3.1.1-rc3-bin/ dev/spark/v3.1.1-rc3-docs/ - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org Fo

svn commit: r46412 - in /dev/spark: v3.1.0-rc1-bin/ v3.1.0-rc1-docs/

2021-03-02 Thread rxin
Author: rxin Date: Tue Mar 2 10:39:58 2021 New Revision: 46412 Log: Removing RC artifacts. Removed: dev/spark/v3.1.0-rc1-bin/ dev/spark/v3.1.0-rc1-docs/ - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org Fo

svn commit: r46410 - in /dev/spark: v3.1.1-rc2-bin/ v3.1.1-rc2-docs/

2021-03-02 Thread rxin
Author: rxin Date: Tue Mar 2 10:39:32 2021 New Revision: 46410 Log: Removing RC artifacts. Removed: dev/spark/v3.1.1-rc2-bin/ dev/spark/v3.1.1-rc2-docs/ - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org Fo

svn commit: r46409 - in /dev/spark: v3.1.1-rc1-bin/ v3.1.1-rc1-docs/

2021-03-02 Thread rxin
Author: rxin Date: Tue Mar 2 10:39:25 2021 New Revision: 46409 Log: Removing RC artifacts. Removed: dev/spark/v3.1.1-rc1-bin/ dev/spark/v3.1.1-rc1-docs/ - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org Fo

[spark-website] branch v3.1.1 created (now 27ab39a)

2021-03-02 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch v3.1.1 in repository https://gitbox.apache.org/repos/asf/spark-website.git. at 27ab39a Add docs for Apache Spark 3.1.1 This branch includes the following new commits: new 27ab39a

[spark] branch master updated: [SPARK-34547][SQL] Only use metadata columns for resolution as last resort

2021-03-02 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2e54d68 [SPARK-34547][SQL] Only use metadata co

[spark] branch branch-3.1 updated: [SPARK-34547][SQL] Only use metadata columns for resolution as last resort

2021-03-02 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.1 by this push: new 29364f8 [SPARK-34547][SQL] Only use met

[spark] branch master updated (08a1257 -> 4bda3c0)

2021-03-02 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 08a1257 [SPARK-34585][SQL] Remove no longer needed BatchWriteHelper add 4bda3c0 [SPARK-34417][SQL] org.apache

[spark] branch branch-3.1 updated: [SPARK-34417][SQL] org.apache.spark.sql.DataFrameNaFunctions.fillMap fails for column name having a dot

2021-03-02 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.1 by this push: new 66ec64e [SPARK-34417][SQL] org.apache.

[spark] tag v3.1.1 created (now 1d550c4)

2021-03-02 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to tag v3.1.1 in repository https://gitbox.apache.org/repos/asf/spark.git. at 1d550c4 (commit) No new revisions were added by this update. --