This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git
commit cce59bf813570795e1d25d42a98e7c06de413ec5 Author: Holden Karau <hol...@pigscanfly.ca> AuthorDate: Fri Feb 18 17:24:39 2022 -0800 Initial 3.1.3 addition --- documentation.md | 1 + downloads.md | 5 +++ js/downloads.js | 2 +- news/_posts/2022-02-18-3-1-3-released.md | 14 ++++++++ releases/_posts/2022-02-18-spark-release-3-1-3.md | 41 +++++++++++++++++++++++ 5 files changed, 62 insertions(+), 1 deletion(-) diff --git a/documentation.md b/documentation.md index eeab8c4..3a443cd 100644 --- a/documentation.md +++ b/documentation.md @@ -14,6 +14,7 @@ navigation: <ul> <li><a href="{{site.baseurl}}/docs/3.2.1/">Spark 3.2.1</a></li> <li><a href="{{site.baseurl}}/docs/3.2.0/">Spark 3.2.0</a></li> + <li><a href="{{site.baseurl}}/docs/3.1.2/">Spark 3.1.3</a></li> <li><a href="{{site.baseurl}}/docs/3.1.2/">Spark 3.1.2</a></li> <li><a href="{{site.baseurl}}/docs/3.1.1/">Spark 3.1.1</a></li> <li><a href="{{site.baseurl}}/docs/3.0.3/">Spark 3.0.3</a></li> diff --git a/downloads.md b/downloads.md index e5d1db3..8a6aca7 100644 --- a/downloads.md +++ b/downloads.md @@ -40,6 +40,11 @@ Spark artifacts are [hosted in Maven Central](https://search.maven.org/search?q= ### Installing with PyPi <a href="https://pypi.org/project/pyspark/">PySpark</a> is now available in pypi. To install just run `pip install pyspark`. + +### Convenience Docker Container Images + +[Spark Docker Container images are available from DockerHub](https://hub.docker.com/repository/docker/apache/spark), these images contain non-ASF software and may be subject to different license terms. + ### Release notes for stable releases <ul id="sparkReleaseNotes"></ul> diff --git a/js/downloads.js b/js/downloads.js index 2d40312..babc72a 100644 --- a/js/downloads.js +++ b/js/downloads.js @@ -27,7 +27,7 @@ var packagesV11 = [hadoop3p2, hadoop2p7, hadoopFree, sources]; var packagesV12 = [hadoop3p3, hadoop3p3scala213, hadoop2p7, hadoopFree, sources]; addRelease("3.2.1", new Date("01/26/2022"), packagesV12, true); -addRelease("3.1.2", new Date("06/01/2021"), packagesV11, true); +addRelease("3.1.3", new Date("02/18/2022"), packagesV11, true); addRelease("3.0.3", new Date("06/23/2021"), packagesV10, true); function append(el, contents) { diff --git a/news/_posts/2022-02-18-3-1-3-released.md b/news/_posts/2022-02-18-3-1-3-released.md new file mode 100644 index 0000000..d9a826f --- /dev/null +++ b/news/_posts/2022-02-18-3-1-3-released.md @@ -0,0 +1,14 @@ +--- +layout: post +title: Spark 3.1.3 released +categories: +- News +tags: [] +status: publish +type: post +published: true +meta: + _edit_last: '4' + _wpas_done_all: '1' +--- +We are happy to announce the availability of <a href="{{site.baseurl}}/releases/spark-release-3-1-3.html" title="Spark Release 3.1.3">Spark 3.1.3</a>! Visit the <a href="{{site.baseurl}}/releases/spark-release-3-1-3.html" title="Spark Release 3.1.3">release notes</a> to read about the new features, or <a href="{{site.baseurl}}/downloads.html">download</a> the release today. diff --git a/releases/_posts/2022-02-18-spark-release-3-1-3.md b/releases/_posts/2022-02-18-spark-release-3-1-3.md new file mode 100644 index 0000000..b48b19b --- /dev/null +++ b/releases/_posts/2022-02-18-spark-release-3-1-3.md @@ -0,0 +1,41 @@ +--- +layout: post +title: Spark Release 3.1.3 +categories: [] +tags: [] +status: publish +type: post +published: true +meta: +_edit_last: '4' +_wpas_done_all: '1' +--- + +Spark 3.1.3 is a maintenance release containing stability fixes. This release is based on the branch-3.1 maintenance branch of Spark. We strongly recommend all 3.1.3 users to upgrade to this stable release. + +### Notable changes + + - [[SPARK-38075]](https://issues.apache.org/jira/browse/SPARK-38075): Hive script transform with order by and limit will return fake rows + - [[SPARK-37784]](https://issues.apache.org/jira/browse/SPARK-37784): CodeGenerator.addBufferedState() does not properly handle UDTs + - [[SPARK-37079]](https://issues.apache.org/jira/browse/SPARK-37079): Fix DataFrameWriterV2.partitionedBy to send the arguments to JVM properly + - [[SPARK-37049]](https://issues.apache.org/jira/browse/SPARK-37049): executorIdleTimeout is not working for pending pods on K8s + - [[SPARK-36783]](https://issues.apache.org/jira/browse/SPARK-36783): ScanOperation should not push Filter through nondeterministic Project + - [[SPARK-36782]](https://issues.apache.org/jira/browse/SPARK-36782): Deadlock between map-output-dispatcher and dispatcher-BlockManagerMaster upon migrating shuffle blocks + - [[SPARK-36704]](https://issues.apache.org/jira/browse/SPARK-36704): InaccessibleObjectException in Java 9+ on startup + - [[SPARK-36740]](https://issues.apache.org/jira/browse/SPARK-36740): Various NaN issues with array operations. + - [[SPARK-36532]](https://issues.apache.org/jira/browse/SPARK-36532): Deadlock in CoarseGrainedExecutorBackend.onDisconnected + - [[SPARK-36489]](https://issues.apache.org/jira/browse/SPARK-36489): Aggregate functions over no grouping keys, on tables with a single bucket, return multiple rows + - [[SPARK-36339]](https://issues.apache.org/jira/browse/SPARK-36339): aggsBuffer should collect AggregateExpression in the map range + - [[SPARK-35391]](https://issues.apache.org/jira/browse/SPARK-36339): Memory leak in ExecutorAllocationListener breaks dynamic allocation under high load + +### Dependency Changes + +While being a maintence release we did still upgrade some dependencies in this release they are: + + - [[SPARK-36734]](https://issues.apache.org/jira/browse/SPARK-36734): Upgrade ORC to 1.5.13 + - [[SPARK-36129]](https://issues.apache.org/jira/browse/SPARK-36129): Upgrade commons-compress to 1.21 + + +You can consult JIRA for the [detailed changes](https://s.apache.org/spark-3.2.1). + +We would like to acknowledge all community members for contributing patches to this release. --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org