[spark] branch master updated: [SPARK-37017][SQL] Reduce the scope of synchronized to prevent potential deadlock

2021-10-18 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 875963a [SPARK-37017][SQL] Reduce the scope of

[spark] branch branch-3.2 updated: [SPARK-37052][CORE] Spark should only pass --verbose argument to main class when is sql shell

2021-10-18 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 34086b0 [SPARK-37052][CORE] Spark shoul

[spark] branch master updated (ebca5232 -> a6d3a2c)

2021-10-18 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from ebca5232 [SPARK-36871][SQL][FOLLOWUP] Move error checking from create cmd to parser add a6d3a2c [SPARK-37052][

[spark] branch master updated: [SPARK-36871][SQL][FOLLOWUP] Move error checking from create cmd to parser

2021-10-18 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ebca5232 [SPARK-36871][SQL][FOLLOWUP] Move error

[GitHub] [spark-website] gengliangwang commented on pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
gengliangwang commented on pull request #361: URL: https://github.com/apache/spark-website/pull/361#issuecomment-946400783 Thanks all for the reviews. I will keep this open for a few more hours. -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark-website] gengliangwang merged pull request #362: Update DocSearch facet filter of 3.2.0 documentation

2021-10-18 Thread GitBox
gengliangwang merged pull request #362: URL: https://github.com/apache/spark-website/pull/362 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: comm

[spark-website] branch asf-site updated: update facetFilters (#362)

2021-10-18 Thread gengliang
This is an automated email from the ASF dual-hosted git repository. gengliang pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git The following commit(s) were added to refs/heads/asf-site by this push: new c734972 update facetFilters (#362

[GitHub] [spark-website] gengliangwang opened a new pull request #362: Update DocSearch facet filter of 3.2.0 documentation

2021-10-18 Thread GitBox
gengliangwang opened a new pull request #362: URL: https://github.com/apache/spark-website/pull/362 There is a bug in updating the DocSearch facet filter on https://github.com/apache/spark/blob/master/dev/create-release/release-tag.sh. The version is not updated as the release vers

[spark] branch master updated: [SPARK-36834][SHUFFLE] Add support for namespacing log lines emitted by external shuffle service

2021-10-18 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4072a22 [SPARK-36834][SHUFFLE] Add support fo

[spark] branch master updated (1ef6c13 -> c2ba498)

2021-10-18 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 1ef6c13 [SPARK-36933][CORE] Clean up TaskMemoryManager.acquireExecutionMemory() add c2ba498 [SPARK-36945][PYTH

[spark] branch master updated: [SPARK-36933][CORE] Clean up TaskMemoryManager.acquireExecutionMemory()

2021-10-18 Thread joshrosen
This is an automated email from the ASF dual-hosted git repository. joshrosen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1ef6c13 [SPARK-36933][CORE] Clean up TaskMem

[spark] branch master updated (21fa3ce -> 25fc495)

2021-10-18 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 21fa3ce [SPARK-35925][SQL] Support DayTimeIntervalType in width-bucket function add 25fc495 [SPARK-36886][PYTH

[GitHub] [spark-website] gengliangwang commented on a change in pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
gengliangwang commented on a change in pull request #361: URL: https://github.com/apache/spark-website/pull/361#discussion_r731104138 ## File path: releases/_posts/2021-10-13-spark-release-3-2-0.md ## @@ -0,0 +1,319 @@ +--- +layout: post +title: Spark Release 3.2.0 +categories:

[GitHub] [spark-website] sunchao commented on a change in pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
sunchao commented on a change in pull request #361: URL: https://github.com/apache/spark-website/pull/361#discussion_r731092808 ## File path: releases/_posts/2021-10-13-spark-release-3-2-0.md ## @@ -0,0 +1,319 @@ +--- +layout: post +title: Spark Release 3.2.0 +categories: [] +t

[GitHub] [spark-website] gengliangwang commented on a change in pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
gengliangwang commented on a change in pull request #361: URL: https://github.com/apache/spark-website/pull/361#discussion_r731092815 ## File path: releases/_posts/2021-10-13-spark-release-3-2-0.md ## @@ -0,0 +1,319 @@ +--- +layout: post +title: Spark Release 3.2.0 +categories:

[GitHub] [spark-website] sunchao commented on a change in pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
sunchao commented on a change in pull request #361: URL: https://github.com/apache/spark-website/pull/361#discussion_r731085852 ## File path: releases/_posts/2021-10-13-spark-release-3-2-0.md ## @@ -0,0 +1,318 @@ +--- +layout: post +title: Spark Release 3.2.0 +categories: [] +t

[GitHub] [spark-website] sunchao commented on a change in pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
sunchao commented on a change in pull request #361: URL: https://github.com/apache/spark-website/pull/361#discussion_r731084843 ## File path: releases/_posts/2021-10-13-spark-release-3-2-0.md ## @@ -0,0 +1,318 @@ +--- +layout: post +title: Spark Release 3.2.0 +categories: [] +t

[GitHub] [spark-website] gatorsmile commented on a change in pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
gatorsmile commented on a change in pull request #361: URL: https://github.com/apache/spark-website/pull/361#discussion_r731078539 ## File path: releases/_posts/2021-10-13-spark-release-3-2-0.md ## @@ -0,0 +1,319 @@ +--- +layout: post +title: Spark Release 3.2.0 +categories: []

[GitHub] [spark-website] gatorsmile commented on a change in pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
gatorsmile commented on a change in pull request #361: URL: https://github.com/apache/spark-website/pull/361#discussion_r731070322 ## File path: releases/_posts/2021-10-13-spark-release-3-2-0.md ## @@ -0,0 +1,319 @@ +--- +layout: post +title: Spark Release 3.2.0 +categories: []

[GitHub] [spark-website] gengliangwang commented on a change in pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
gengliangwang commented on a change in pull request #361: URL: https://github.com/apache/spark-website/pull/361#discussion_r730932576 ## File path: releases/_posts/2021-10-13-spark-release-3-2-0.md ## @@ -0,0 +1,317 @@ +--- +layout: post +title: Spark Release 3.2.0 +categories:

[spark] branch master updated (c29bb02 -> 21fa3ce)

2021-10-18 Thread maxgekk
This is an automated email from the ASF dual-hosted git repository. maxgekk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from c29bb02 [SPARK-36965][PYTHON] Extend python test runner by logging out the temp output files add 21fa3ce [SPA

[GitHub] [spark-website] h-vetinari commented on pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
h-vetinari commented on pull request #361: URL: https://github.com/apache/spark-website/pull/361#issuecomment-945711644 Update 2: pyspark 3.2.0 has been uploaded to https://anaconda.org/conda-forge/pyspark/files, will make its way through the CDN in about an hour. > @h-vetinari yes

[GitHub] [spark-website] Ngone51 commented on a change in pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
Ngone51 commented on a change in pull request #361: URL: https://github.com/apache/spark-website/pull/361#discussion_r730861107 ## File path: releases/_posts/2021-10-13-spark-release-3-2-0.md ## @@ -0,0 +1,317 @@ +--- +layout: post +title: Spark Release 3.2.0 +categories: [] +t

[GitHub] [spark-website] Ngone51 commented on a change in pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
Ngone51 commented on a change in pull request #361: URL: https://github.com/apache/spark-website/pull/361#discussion_r730858991 ## File path: releases/_posts/2021-10-13-spark-release-3-2-0.md ## @@ -0,0 +1,317 @@ +--- +layout: post +title: Spark Release 3.2.0 +categories: [] +t

[GitHub] [spark-website] Ngone51 commented on a change in pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
Ngone51 commented on a change in pull request #361: URL: https://github.com/apache/spark-website/pull/361#discussion_r730858991 ## File path: releases/_posts/2021-10-13-spark-release-3-2-0.md ## @@ -0,0 +1,317 @@ +--- +layout: post +title: Spark Release 3.2.0 +categories: [] +t

[GitHub] [spark-website] gengliangwang commented on pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
gengliangwang commented on pull request #361: URL: https://github.com/apache/spark-website/pull/361#issuecomment-945660978 @h-vetinari yes please raise a PR to update https://github.com/apache/spark/blob/master/python/docs/source/getting_started/install.rst, thanks! -- This is an automa

[GitHub] [spark-website] h-vetinari commented on pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
h-vetinari commented on pull request #361: URL: https://github.com/apache/spark-website/pull/361#issuecomment-945636499 Little update, the conda-forge build of pyspark is now waiting to be merged by the feedstock team resp. conda-forge/core. However, I noticed that the [install](htt

[spark] branch master updated (0bba90b -> c29bb02)

2021-10-18 Thread attilapiros
This is an automated email from the ASF dual-hosted git repository. attilapiros pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 0bba90b [SPARK-36978][SQL] InferConstraints rule should create IsNotNull constraints on the accessed nested fie

[spark] branch master updated (e7815b1 -> 0bba90b)

2021-10-18 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from e7815b1 [SPARK-37032][SQL] Fix broken SQL syntax link in SQL Reference page add 0bba90b [SPARK-36978][SQL] In

[GitHub] [spark-website] gengliangwang commented on a change in pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
gengliangwang commented on a change in pull request #361: URL: https://github.com/apache/spark-website/pull/361#discussion_r730748515 ## File path: js/downloads.js ## @@ -22,7 +22,7 @@ var packagesV10 = [hadoop2p7, hadoop3p2, hadoopFree, sources]; // 3.1.0+ var packagesV11 =

[GitHub] [spark-website] gengliangwang commented on a change in pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
gengliangwang commented on a change in pull request #361: URL: https://github.com/apache/spark-website/pull/361#discussion_r730744351 ## File path: releases/_posts/2021-10-13-spark-release-3-2-0.md ## @@ -0,0 +1,318 @@ +--- +layout: post +title: Spark Release 3.2.0 +categories:

[GitHub] [spark-website] yaooqinn commented on a change in pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
yaooqinn commented on a change in pull request #361: URL: https://github.com/apache/spark-website/pull/361#discussion_r730726311 ## File path: js/downloads.js ## @@ -22,7 +22,7 @@ var packagesV10 = [hadoop2p7, hadoop3p2, hadoopFree, sources]; // 3.1.0+ var packagesV11 = [hado

[GitHub] [spark-website] yaooqinn commented on a change in pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
yaooqinn commented on a change in pull request #361: URL: https://github.com/apache/spark-website/pull/361#discussion_r730725129 ## File path: releases/_posts/2021-10-13-spark-release-3-2-0.md ## @@ -0,0 +1,318 @@ +--- +layout: post +title: Spark Release 3.2.0 +categories: [] +

[GitHub] [spark-website] yaooqinn commented on a change in pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
yaooqinn commented on a change in pull request #361: URL: https://github.com/apache/spark-website/pull/361#discussion_r730725129 ## File path: releases/_posts/2021-10-13-spark-release-3-2-0.md ## @@ -0,0 +1,318 @@ +--- +layout: post +title: Spark Release 3.2.0 +categories: [] +

[GitHub] [spark-website] gengliangwang commented on a change in pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
gengliangwang commented on a change in pull request #361: URL: https://github.com/apache/spark-website/pull/361#discussion_r730722931 ## File path: releases/_posts/2021-10-13-spark-release-3-2-0.md ## @@ -0,0 +1,318 @@ +--- +layout: post +title: Spark Release 3.2.0 +categories:

[GitHub] [spark-website] gengliangwang commented on a change in pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
gengliangwang commented on a change in pull request #361: URL: https://github.com/apache/spark-website/pull/361#discussion_r730722931 ## File path: releases/_posts/2021-10-13-spark-release-3-2-0.md ## @@ -0,0 +1,318 @@ +--- +layout: post +title: Spark Release 3.2.0 +categories:

[GitHub] [spark-website] gengliangwang commented on a change in pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
gengliangwang commented on a change in pull request #361: URL: https://github.com/apache/spark-website/pull/361#discussion_r730721947 ## File path: releases/_posts/2021-10-13-spark-release-3-2-0.md ## @@ -0,0 +1,318 @@ +--- +layout: post +title: Spark Release 3.2.0 +categories:

[GitHub] [spark-website] gengliangwang commented on a change in pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
gengliangwang commented on a change in pull request #361: URL: https://github.com/apache/spark-website/pull/361#discussion_r730721796 ## File path: releases/_posts/2021-10-13-spark-release-3-2-0.md ## @@ -0,0 +1,318 @@ +--- +layout: post +title: Spark Release 3.2.0 +categories:

[GitHub] [spark-website] cloud-fan commented on a change in pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
cloud-fan commented on a change in pull request #361: URL: https://github.com/apache/spark-website/pull/361#discussion_r730721766 ## File path: releases/_posts/2021-10-13-spark-release-3-2-0.md ## @@ -0,0 +1,318 @@ +--- +layout: post +title: Spark Release 3.2.0 +categories: []

[GitHub] [spark-website] yaooqinn commented on a change in pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
yaooqinn commented on a change in pull request #361: URL: https://github.com/apache/spark-website/pull/361#discussion_r730716668 ## File path: releases/_posts/2021-10-13-spark-release-3-2-0.md ## @@ -0,0 +1,318 @@ +--- +layout: post +title: Spark Release 3.2.0 +categories: [] +

[GitHub] [spark-website] gengliangwang commented on pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
gengliangwang commented on pull request #361: URL: https://github.com/apache/spark-website/pull/361#issuecomment-945532927 FYI the PySpark 3.2 is available on PyPI now: https://pypi.org/project/pyspark/3.2.0/ -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark-website] cloud-fan commented on a change in pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
cloud-fan commented on a change in pull request #361: URL: https://github.com/apache/spark-website/pull/361#discussion_r730688457 ## File path: releases/_posts/2021-10-13-spark-release-3-2-0.md ## @@ -0,0 +1,318 @@ +--- +layout: post +title: Spark Release 3.2.0 +categories: []

[GitHub] [spark-website] cloud-fan commented on a change in pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
cloud-fan commented on a change in pull request #361: URL: https://github.com/apache/spark-website/pull/361#discussion_r730685882 ## File path: releases/_posts/2021-10-13-spark-release-3-2-0.md ## @@ -0,0 +1,318 @@ +--- +layout: post +title: Spark Release 3.2.0 +categories: []

[GitHub] [spark-website] cloud-fan commented on a change in pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
cloud-fan commented on a change in pull request #361: URL: https://github.com/apache/spark-website/pull/361#discussion_r730684820 ## File path: releases/_posts/2021-10-13-spark-release-3-2-0.md ## @@ -0,0 +1,318 @@ +--- +layout: post +title: Spark Release 3.2.0 +categories: []

[GitHub] [spark-website] h-vetinari commented on pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
h-vetinari commented on pull request #361: URL: https://github.com/apache/spark-website/pull/361#issuecomment-945483919 > @gengliangwang Have we pushed it to Conda? Hey all, I started a pull-request to package pyspark 3.2 for conda-forge (normally this would have been done sooner alr

[GitHub] [spark-website] gengliangwang commented on a change in pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
gengliangwang commented on a change in pull request #361: URL: https://github.com/apache/spark-website/pull/361#discussion_r730621527 ## File path: releases/_posts/2021-10-13-spark-release-3-2-0.md ## @@ -0,0 +1,318 @@ +--- +layout: post +title: Spark Release 3.2.0 +categories:

[GitHub] [spark-website] gengliangwang commented on a change in pull request #361: Add 3.2.0 release note and news and update links

2021-10-18 Thread GitBox
gengliangwang commented on a change in pull request #361: URL: https://github.com/apache/spark-website/pull/361#discussion_r730621346 ## File path: releases/_posts/2021-10-13-spark-release-3-2-0.md ## @@ -0,0 +1,318 @@ +--- +layout: post +title: Spark Release 3.2.0 +categories: